Aug 01 21:15:11 user nova-compute[72586]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 01 21:15:14 user nova-compute[72586]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=72586) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Aug 01 21:15:14 user nova-compute[72586]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=72586) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Aug 01 21:15:14 user nova-compute[72586]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=72586) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Aug 01 21:15:14 user nova-compute[72586]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 01 21:15:14 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:15:14 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.033s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:15:15 user nova-compute[72586]: INFO nova.virt.driver [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 01 21:15:15 user nova-compute[72586]: INFO nova.compute.provider_config [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] Acquiring lock "singleton_lock" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] Acquired lock "singleton_lock" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] Releasing lock "singleton_lock" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] Full set of CONF: {{(pid=72586) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] ******************************************************************************** {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] Configuration options gathered from: {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] ================================================================================ {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] allow_resize_to_same_host      = True {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] arq_binding_timeout            = 300 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] backdoor_port                  = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] backdoor_socket                = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] block_device_allocate_retries  = 300 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] block_device_allocate_retries_interval = 5 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cert                           = self.pem {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] compute_monitors               = [] {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] config_dir                     = [] {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] config_drive_format            = iso9660 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] config_source                  = [] {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] console_host                   = user {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] control_exchange               = nova {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cpu_allocation_ratio           = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] daemon                         = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] debug                          = True {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] default_access_ip_network_name = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] default_availability_zone      = nova {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] default_ephemeral_format       = ext4 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] default_schedule_zone          = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] disk_allocation_ratio          = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] enable_new_services            = True {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] enabled_apis                   = ['osapi_compute'] {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] enabled_ssl_apis               = [] {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] flat_injected                  = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] force_config_drive             = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] force_raw_images               = True {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] graceful_shutdown_timeout      = 5 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] heal_instance_info_cache_interval = 60 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] host                           = user {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] initial_disk_allocation_ratio  = 1.0 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] initial_ram_allocation_ratio   = 1.0 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] instance_build_timeout         = 0 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] instance_delete_interval       = 300 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] instance_format                = [instance: %(uuid)s]  {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] instance_name_template         = instance-%08x {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] instance_usage_audit           = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] instance_usage_audit_period    = month {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] internal_service_availability_zone = internal {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] key                            = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] live_migration_retry_count     = 30 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] log_config_append              = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] log_dir                        = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] log_file                       = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] log_options                    = True {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] log_rotate_interval            = 1 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] log_rotate_interval_type       = days {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] log_rotation_type              = none {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] long_rpc_timeout               = 1800 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] max_concurrent_builds          = 10 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] max_concurrent_live_migrations = 1 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] max_concurrent_snapshots       = 5 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] max_local_block_devices        = 3 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] max_logfile_count              = 30 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] max_logfile_size_mb            = 200 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] maximum_instance_delete_attempts = 5 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] metadata_listen                = 0.0.0.0 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] metadata_listen_port           = 8775 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] metadata_workers               = 3 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] migrate_max_retries            = -1 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] mkisofs_cmd                    = genisoimage {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] my_block_storage_ip            = 10.0.0.210 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] my_ip                          = 10.0.0.210 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] network_allocate_retries       = 0 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] osapi_compute_listen           = 0.0.0.0 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] osapi_compute_listen_port      = 8774 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] osapi_compute_unique_server_name_scope =  {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] osapi_compute_workers          = 3 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] password_length                = 12 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] periodic_enable                = True {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] periodic_fuzzy_delay           = 60 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] pointer_model                  = ps2mouse {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] preallocate_images             = none {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] publish_errors                 = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] pybasedir                      = /opt/stack/nova {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] ram_allocation_ratio           = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] rate_limit_burst               = 0 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] rate_limit_except_level        = CRITICAL {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] rate_limit_interval            = 0 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] reboot_timeout                 = 0 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] reclaim_instance_interval      = 0 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] record                         = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] reimage_timeout_per_gb         = 60 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] report_interval                = 10 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] rescue_timeout                 = 0 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] reserved_host_cpus             = 0 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] reserved_host_disk_mb          = 0 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] reserved_host_memory_mb        = 512 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] reserved_huge_pages            = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] resize_confirm_window          = 0 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] resize_fs_using_block_device   = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] resume_guests_state_on_host_boot = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] rpc_response_timeout           = 60 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] run_external_periodic_tasks    = True {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] running_deleted_instance_action = reap {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] running_deleted_instance_poll_interval = 1800 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] running_deleted_instance_timeout = 0 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] scheduler_instance_sync_interval = 120 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] service_down_time              = 60 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] servicegroup_driver            = db {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] shelved_offload_time           = 0 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] shelved_poll_interval          = 3600 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] shutdown_timeout               = 0 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] source_is_ipv6                 = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] ssl_only                       = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] state_path                     = /opt/stack/data/nova {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] sync_power_state_interval      = 600 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] sync_power_state_pool_size     = 1000 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] syslog_log_facility            = LOG_USER {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] tempdir                        = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] timeout_nbd                    = 10 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] transport_url                  = **** {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] update_resources_interval      = 0 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] use_cow_images                 = True {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] use_eventlog                   = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] use_journal                    = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] use_json                       = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] use_rootwrap_daemon            = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] use_stderr                     = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] use_syslog                     = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vcpu_pin_set                   = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vif_plugging_is_fatal          = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vif_plugging_timeout           = 0 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] virt_mkfs                      = [] {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] volume_usage_poll_interval     = 0 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] watch_log_file                 = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] web                            = /usr/share/spice-html5 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_concurrency.disable_process_locking = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] api.auth_strategy              = keystone {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] api.compute_link_prefix        = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] api.dhcp_domain                = novalocal {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] api.enable_instance_password   = True {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] api.glance_link_prefix         = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] api.instance_list_cells_batch_strategy = distributed {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] api.instance_list_per_project_cells = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] api.list_records_by_skipping_down_cells = True {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] api.local_metadata_per_cell    = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] api.max_limit                  = 1000 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] api.metadata_cache_expiration  = 15 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] api.neutron_default_tenant_id  = default {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] api.use_forwarded_for          = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] api.use_neutron_default_nets   = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] api.vendordata_dynamic_failure_fatal = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] api.vendordata_dynamic_targets = [] {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] api.vendordata_jsonfile_path   = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cache.backend                  = dogpile.cache.memcached {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cache.backend_argument         = **** {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cache.config_prefix            = cache.oslo {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cache.dead_timeout             = 60.0 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cache.debug_cache_backend      = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cache.enable_retry_client      = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cache.enable_socket_keepalive  = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cache.enabled                  = True {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cache.expiration_time          = 600 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cache.hashclient_retry_attempts = 2 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cache.hashclient_retry_delay   = 1.0 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cache.memcache_dead_retry      = 300 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cache.memcache_password        =  {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cache.memcache_pool_maxsize    = 10 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cache.memcache_sasl_enabled    = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cache.memcache_socket_timeout  = 1.0 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cache.memcache_username        =  {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cache.proxies                  = [] {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cache.retry_attempts           = 2 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cache.retry_delay              = 0.0 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cache.socket_keepalive_count   = 1 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cache.socket_keepalive_idle    = 1 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cache.socket_keepalive_interval = 1 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cache.tls_allowed_ciphers      = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cache.tls_cafile               = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cache.tls_certfile             = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cache.tls_enabled              = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cache.tls_keyfile              = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cinder.auth_section            = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cinder.auth_type               = password {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cinder.cafile                  = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cinder.catalog_info            = volumev3::publicURL {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cinder.certfile                = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cinder.collect_timing          = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cinder.cross_az_attach         = True {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cinder.debug                   = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cinder.endpoint_template       = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cinder.http_retries            = 3 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cinder.insecure                = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cinder.keyfile                 = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cinder.os_region_name          = RegionOne {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cinder.split_loggers           = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cinder.timeout                 = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] compute.cpu_dedicated_set      = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] compute.cpu_shared_set         = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] compute.image_type_exclude_list = [] {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] compute.live_migration_wait_for_vif_plug = True {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] compute.max_concurrent_disk_ops = 0 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] compute.max_disk_devices_to_attach = -1 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] compute.resource_provider_association_refresh = 300 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] compute.shutdown_retry_interval = 10 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] conductor.workers              = 3 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] console.allowed_origins        = [] {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] console.ssl_ciphers            = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] console.ssl_minimum_version    = default {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] consoleauth.token_ttl          = 600 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cyborg.cafile                  = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cyborg.certfile                = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cyborg.collect_timing          = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cyborg.connect_retries         = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cyborg.connect_retry_delay     = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cyborg.endpoint_override       = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cyborg.insecure                = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cyborg.keyfile                 = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cyborg.max_version             = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cyborg.min_version             = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cyborg.region_name             = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cyborg.service_name            = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cyborg.service_type            = accelerator {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cyborg.split_loggers           = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cyborg.status_code_retries     = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cyborg.status_code_retry_delay = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cyborg.timeout                 = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] cyborg.version                 = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] database.backend               = sqlalchemy {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] database.connection            = **** {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] database.connection_debug      = 0 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] database.connection_parameters =  {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] database.connection_recycle_time = 3600 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] database.connection_trace      = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] database.db_inc_retry_interval = True {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] database.db_max_retries        = 20 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] database.db_max_retry_interval = 10 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] database.db_retry_interval     = 1 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] database.max_overflow          = 50 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] database.max_pool_size         = 5 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] database.max_retries           = 10 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] database.mysql_enable_ndb      = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] database.mysql_wsrep_sync_wait = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] database.pool_timeout          = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] database.retry_interval        = 10 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] database.slave_connection      = **** {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] database.sqlite_synchronous    = True {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] api_database.backend           = sqlalchemy {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] api_database.connection        = **** {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] api_database.connection_debug  = 0 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] api_database.connection_parameters =  {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] api_database.connection_recycle_time = 3600 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] api_database.connection_trace  = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] api_database.db_inc_retry_interval = True {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] api_database.db_max_retries    = 20 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] api_database.db_max_retry_interval = 10 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] api_database.db_retry_interval = 1 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] api_database.max_overflow      = 50 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] api_database.max_pool_size     = 5 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] api_database.max_retries       = 10 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] api_database.mysql_enable_ndb  = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] api_database.mysql_wsrep_sync_wait = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] api_database.pool_timeout      = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] api_database.retry_interval    = 10 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] api_database.slave_connection  = **** {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] api_database.sqlite_synchronous = True {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] devices.enabled_mdev_types     = [] {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] ephemeral_storage_encryption.enabled = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] ephemeral_storage_encryption.key_size = 512 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] glance.api_servers             = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] glance.cafile                  = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] glance.certfile                = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] glance.collect_timing          = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] glance.connect_retries         = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] glance.connect_retry_delay     = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] glance.debug                   = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] glance.default_trusted_certificate_ids = [] {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] glance.enable_certificate_validation = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] glance.enable_rbd_download     = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] glance.endpoint_override       = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] glance.insecure                = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] glance.keyfile                 = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] glance.max_version             = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] glance.min_version             = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] glance.num_retries             = 3 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] glance.rbd_ceph_conf           =  {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] glance.rbd_connect_timeout     = 5 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] glance.rbd_pool                =  {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] glance.rbd_user                =  {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] glance.region_name             = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] glance.service_name            = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] glance.service_type            = image {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] glance.split_loggers           = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] glance.status_code_retries     = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] glance.status_code_retry_delay = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] glance.timeout                 = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] glance.verify_glance_signatures = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] glance.version                 = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] guestfs.debug                  = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] hyperv.config_drive_cdrom      = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] hyperv.config_drive_inject_password = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] hyperv.enable_instance_metrics_collection = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] hyperv.enable_remotefx         = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] hyperv.instances_path_share    =  {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] hyperv.iscsi_initiator_list    = [] {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] hyperv.limit_cpu_features      = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] hyperv.power_state_check_timeframe = 60 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] hyperv.power_state_event_polling_interval = 2 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] hyperv.use_multipath_io        = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] hyperv.volume_attach_retry_count = 10 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] hyperv.volume_attach_retry_interval = 5 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] hyperv.vswitch_name            = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] mks.enabled                    = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] image_cache.manager_interval   = 2400 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] image_cache.precache_concurrency = 1 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] image_cache.remove_unused_base_images = True {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] image_cache.subdirectory_name  = _base {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] ironic.api_max_retries         = 60 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] ironic.api_retry_interval      = 2 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] ironic.auth_section            = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] ironic.auth_type               = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] ironic.cafile                  = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] ironic.certfile                = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] ironic.collect_timing          = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] ironic.connect_retries         = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] ironic.connect_retry_delay     = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] ironic.endpoint_override       = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] ironic.insecure                = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] ironic.keyfile                 = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] ironic.max_version             = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] ironic.min_version             = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] ironic.partition_key           = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] ironic.peer_list               = [] {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] ironic.region_name             = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] ironic.serial_console_state_timeout = 10 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] ironic.service_name            = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] ironic.service_type            = baremetal {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] ironic.split_loggers           = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] ironic.status_code_retries     = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] ironic.status_code_retry_delay = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] ironic.timeout                 = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] ironic.version                 = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] key_manager.fixed_key          = **** {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] barbican.barbican_api_version  = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] barbican.barbican_endpoint     = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] barbican.barbican_endpoint_type = public {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] barbican.barbican_region_name  = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] barbican.cafile                = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] barbican.certfile              = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] barbican.collect_timing        = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] barbican.insecure              = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] barbican.keyfile               = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] barbican.number_of_retries     = 60 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] barbican.retry_delay           = 1 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] barbican.send_service_user_token = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] barbican.split_loggers         = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] barbican.timeout               = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] barbican.verify_ssl            = True {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] barbican.verify_ssl_path       = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] barbican_service_user.auth_section = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] barbican_service_user.auth_type = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] barbican_service_user.cafile   = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] barbican_service_user.certfile = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] barbican_service_user.collect_timing = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] barbican_service_user.insecure = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] barbican_service_user.keyfile  = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] barbican_service_user.split_loggers = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] barbican_service_user.timeout  = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vault.approle_role_id          = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vault.approle_secret_id        = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vault.cafile                   = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vault.certfile                 = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vault.collect_timing           = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vault.insecure                 = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vault.keyfile                  = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vault.kv_mountpoint            = secret {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vault.kv_version               = 2 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vault.namespace                = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vault.root_token_id            = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vault.split_loggers            = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vault.ssl_ca_crt_file          = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vault.timeout                  = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vault.use_ssl                  = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] keystone.cafile                = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] keystone.certfile              = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] keystone.collect_timing        = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] keystone.connect_retries       = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] keystone.connect_retry_delay   = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] keystone.endpoint_override     = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] keystone.insecure              = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] keystone.keyfile               = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] keystone.max_version           = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] keystone.min_version           = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] keystone.region_name           = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] keystone.service_name          = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] keystone.service_type          = identity {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] keystone.split_loggers         = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] keystone.status_code_retries   = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] keystone.status_code_retry_delay = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] keystone.timeout               = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] keystone.version               = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.connection_uri         =  {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.cpu_mode               = custom {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.cpu_model_extra_flags  = [] {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: WARNING oslo_config.cfg [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.cpu_power_governor_high = performance {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.cpu_power_governor_low = powersave {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.cpu_power_management   = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.device_detach_attempts = 8 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.device_detach_timeout  = 20 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.disk_cachemodes        = [] {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.disk_prefix            = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.enabled_perf_events    = [] {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.file_backed_memory     = 0 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.gid_maps               = [] {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.hw_disk_discard        = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.hw_machine_type        = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.images_rbd_ceph_conf   =  {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.images_rbd_glance_store_name =  {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.images_rbd_pool        = rbd {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.images_type            = default {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.images_volume_group    = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.inject_key             = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.inject_partition       = -2 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.inject_password        = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.iscsi_iface            = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.iser_use_multipath     = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.live_migration_bandwidth = 0 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.live_migration_completion_timeout = 800 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.live_migration_downtime = 500 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.live_migration_downtime_delay = 75 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.live_migration_downtime_steps = 10 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.live_migration_inbound_addr = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.live_migration_permit_auto_converge = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.live_migration_permit_post_copy = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.live_migration_scheme  = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.live_migration_timeout_action = abort {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.live_migration_tunnelled = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: WARNING oslo_config.cfg [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 01 21:15:15 user nova-compute[72586]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 01 21:15:15 user nova-compute[72586]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 01 21:15:15 user nova-compute[72586]: and ``live_migration_inbound_addr`` respectively.
Aug 01 21:15:15 user nova-compute[72586]: ).  Its value may be silently ignored in the future.
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.live_migration_with_native_tls = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.max_queues             = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.mem_stats_period_seconds = 10 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.nfs_mount_options      = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.num_aoe_discover_tries = 3 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.num_iser_scan_tries    = 5 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.num_memory_encrypted_guests = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.num_nvme_discover_tries = 5 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.num_pcie_ports         = 0 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.num_volume_scan_tries  = 5 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.pmem_namespaces        = [] {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.quobyte_client_cfg     = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.rbd_connect_timeout    = 5 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.rbd_secret_uuid        = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.rbd_user               = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.realtime_scheduler_priority = 1 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.remote_filesystem_transport = ssh {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.rescue_image_id        = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.rescue_kernel_id       = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.rescue_ramdisk_id      = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.rx_queue_size          = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.smbfs_mount_options    =  {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.snapshot_compression   = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.snapshot_image_format  = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.sparse_logical_volumes = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.swtpm_enabled          = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.swtpm_group            = tss {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.swtpm_user             = tss {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.sysinfo_serial         = unique {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.tb_cache_size          = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.tx_queue_size          = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.uid_maps               = [] {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.use_virtio_for_bridges = True {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.virt_type              = kvm {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.volume_clear           = zero {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.volume_clear_size      = 0 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.volume_use_multipath   = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.vzstorage_cache_path   = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.vzstorage_mount_group  = qemu {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.vzstorage_mount_opts   = [] {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.vzstorage_mount_user   = stack {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] neutron.auth_section           = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] neutron.auth_type              = password {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] neutron.cafile                 = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] neutron.certfile               = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] neutron.collect_timing         = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] neutron.connect_retries        = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] neutron.connect_retry_delay    = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] neutron.default_floating_pool  = public {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] neutron.endpoint_override      = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] neutron.extension_sync_interval = 600 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] neutron.http_retries           = 3 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] neutron.insecure               = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] neutron.keyfile                = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] neutron.max_version            = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] neutron.metadata_proxy_shared_secret = **** {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] neutron.min_version            = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] neutron.ovs_bridge             = br-int {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] neutron.physnets               = [] {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] neutron.region_name            = RegionOne {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] neutron.service_metadata_proxy = True {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] neutron.service_name           = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] neutron.service_type           = network {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] neutron.split_loggers          = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] neutron.status_code_retries    = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] neutron.status_code_retry_delay = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] neutron.timeout                = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] neutron.version                = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] notifications.bdms_in_notifications = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] notifications.default_level    = INFO {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] notifications.notification_format = unversioned {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] notifications.notify_on_state_change = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] pci.alias                      = [] {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] pci.device_spec                = [] {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] pci.report_in_placement        = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] placement.auth_section         = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] placement.auth_type            = password {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] placement.cafile               = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] placement.certfile             = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] placement.collect_timing       = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] placement.connect_retries      = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] placement.connect_retry_delay  = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] placement.default_domain_id    = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] placement.default_domain_name  = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] placement.domain_id            = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] placement.domain_name          = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] placement.endpoint_override    = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] placement.insecure             = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] placement.keyfile              = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] placement.max_version          = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] placement.min_version          = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] placement.password             = **** {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] placement.project_domain_id    = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] placement.project_domain_name  = Default {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] placement.project_id           = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] placement.project_name         = service {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] placement.region_name          = RegionOne {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] placement.service_name         = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] placement.service_type         = placement {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] placement.split_loggers        = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] placement.status_code_retries  = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] placement.status_code_retry_delay = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] placement.system_scope         = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] placement.timeout              = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] placement.trust_id             = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] placement.user_domain_id       = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] placement.user_domain_name     = Default {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] placement.user_id              = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] placement.username             = placement {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] placement.version              = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] quota.cores                    = 20 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] quota.count_usage_from_placement = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] quota.injected_file_content_bytes = 10240 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] quota.injected_file_path_length = 255 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] quota.injected_files           = 5 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] quota.instances                = 10 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] quota.key_pairs                = 100 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] quota.metadata_items           = 128 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] quota.ram                      = 51200 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] quota.recheck_quota            = True {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] quota.server_group_members     = 10 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] quota.server_groups            = 10 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] rdp.enabled                    = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] scheduler.image_metadata_prefilter = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] scheduler.max_attempts         = 3 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] scheduler.max_placement_results = 1000 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] scheduler.query_placement_for_availability_zone = True {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] scheduler.query_placement_for_image_type_support = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] scheduler.workers              = 3 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] filter_scheduler.host_subset_size = 1 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] filter_scheduler.image_properties_default_architecture = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] filter_scheduler.isolated_hosts = [] {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] filter_scheduler.isolated_images = [] {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] filter_scheduler.max_instances_per_host = 50 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] filter_scheduler.pci_in_placement = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] filter_scheduler.track_instance_changes = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] metrics.required               = True {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] metrics.weight_multiplier      = 1.0 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] metrics.weight_setting         = [] {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] serial_console.enabled         = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] serial_console.port_range      = 10000:20000 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] serial_console.serialproxy_port = 6083 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] service_user.auth_section      = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] service_user.auth_type         = password {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] service_user.cafile            = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] service_user.certfile          = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] service_user.collect_timing    = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] service_user.insecure          = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] service_user.keyfile           = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] service_user.send_service_user_token = True {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] service_user.split_loggers     = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] service_user.timeout           = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] spice.agent_enabled            = True {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] spice.enabled                  = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] spice.html5proxy_port          = 6082 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] spice.image_compression        = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] spice.jpeg_compression         = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] spice.playback_compression     = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] spice.server_listen            = 127.0.0.1 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] spice.streaming_mode           = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] spice.zlib_compression         = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] upgrade_levels.baseapi         = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] upgrade_levels.cert            = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] upgrade_levels.compute         = auto {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] upgrade_levels.conductor       = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] upgrade_levels.scheduler       = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vendordata_dynamic_auth.auth_section = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vendordata_dynamic_auth.auth_type = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vendordata_dynamic_auth.cafile = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vendordata_dynamic_auth.certfile = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vendordata_dynamic_auth.collect_timing = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vendordata_dynamic_auth.insecure = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vendordata_dynamic_auth.keyfile = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vendordata_dynamic_auth.split_loggers = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vendordata_dynamic_auth.timeout = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vmware.api_retry_count         = 10 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vmware.ca_file                 = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vmware.cache_prefix            = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vmware.cluster_name            = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vmware.connection_pool_size    = 10 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vmware.console_delay_seconds   = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vmware.datastore_regex         = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vmware.host_ip                 = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vmware.host_password           = **** {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vmware.host_port               = 443 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vmware.host_username           = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vmware.insecure                = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vmware.integration_bridge      = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vmware.maximum_objects         = 100 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vmware.pbm_default_policy      = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vmware.pbm_enabled             = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vmware.pbm_wsdl_location       = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vmware.serial_port_proxy_uri   = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vmware.serial_port_service_uri = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vmware.task_poll_interval      = 0.5 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vmware.use_linked_clone        = True {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vmware.vnc_keymap              = en-us {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vmware.vnc_port                = 5900 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vmware.vnc_port_total          = 10000 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vnc.auth_schemes               = ['none'] {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vnc.enabled                    = True {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vnc.novncproxy_port            = 6080 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vnc.server_listen              = 0.0.0.0 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vnc.vencrypt_ca_certs          = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vnc.vencrypt_client_cert       = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vnc.vencrypt_client_key        = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] workarounds.disable_fallback_pcpu_query = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] workarounds.disable_group_policy_check_upcall = True {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] workarounds.disable_rootwrap   = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] workarounds.enable_numa_live_migration = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] workarounds.handle_virt_lifecycle_events = True {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] workarounds.libvirt_disable_apic = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] workarounds.never_download_image_if_on_rbd = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] wsgi.client_socket_timeout     = 900 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] wsgi.default_pool_size         = 1000 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] wsgi.keep_alive                = True {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] wsgi.max_header_line           = 16384 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] wsgi.secure_proxy_ssl_header   = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] wsgi.ssl_ca_file               = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] wsgi.ssl_cert_file             = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] wsgi.ssl_key_file              = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] wsgi.tcp_keepidle              = 600 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] zvm.ca_file                    = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] zvm.cloud_connector_url        = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] zvm.reachable_timeout          = 300 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_policy.enforce_new_defaults = True {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_policy.enforce_scope      = True {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_policy.policy_default_rule = default {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_policy.policy_file        = policy.yaml {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] profiler.connection_string     = messaging:// {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] profiler.enabled               = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] profiler.es_doc_type           = notification {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] profiler.es_scroll_size        = 10000 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] profiler.es_scroll_time        = 2m {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] profiler.filter_error_trace    = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] profiler.hmac_keys             = **** {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] profiler.sentinel_service_name = mymaster {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] profiler.socket_timeout        = 0.1 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] profiler.trace_requests        = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] profiler.trace_sqlalchemy      = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] profiler_jaeger.process_tags   = {} {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] profiler_jaeger.service_name_prefix = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] profiler_otlp.service_name_prefix = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] remote_debug.host              = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] remote_debug.port              = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_messaging_rabbit.ssl      = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_messaging_notifications.retry = -1 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_messaging_notifications.transport_url = **** {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_limit.auth_section        = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_limit.auth_type           = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_limit.cafile              = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_limit.certfile            = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_limit.collect_timing      = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_limit.connect_retries     = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_limit.connect_retry_delay = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_limit.endpoint_id         = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_limit.endpoint_override   = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_limit.insecure            = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_limit.keyfile             = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_limit.max_version         = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_limit.min_version         = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_limit.region_name         = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_limit.service_name        = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_limit.service_type        = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_limit.split_loggers       = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_limit.status_code_retries = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_limit.status_code_retry_delay = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_limit.timeout             = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_limit.valid_interfaces    = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_limit.version             = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_reports.file_event_handler = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] oslo_reports.log_dir           = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vif_plug_linux_bridge_privileged.group = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vif_plug_linux_bridge_privileged.user = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vif_plug_ovs_privileged.group  = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vif_plug_ovs_privileged.helper_command = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] vif_plug_ovs_privileged.user   = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] os_vif_linux_bridge.flat_interface = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] os_vif_linux_bridge.vlan_interface = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] os_vif_ovs.isolate_vif         = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] os_vif_ovs.ovsdb_interface     = native {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] os_vif_ovs.per_port_bridge     = False {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] os_brick.lock_path             = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] privsep_osbrick.capabilities   = [21] {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] privsep_osbrick.group          = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] privsep_osbrick.helper_command = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] privsep_osbrick.thread_pool_size = 12 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] privsep_osbrick.user           = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] nova_sys_admin.group           = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] nova_sys_admin.helper_command  = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] nova_sys_admin.thread_pool_size = 12 {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] nova_sys_admin.user            = None {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG oslo_service.service [None req-772a9e70-aa0c-43db-b2a8-462e58096b4f None None] ******************************************************************************** {{(pid=72586) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Aug 01 21:15:15 user nova-compute[72586]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 01 21:15:15 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Starting native event thread {{(pid=72586) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Starting green dispatch thread {{(pid=72586) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Starting connection event dispatch thread {{(pid=72586) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Connecting to libvirt: qemu:///system {{(pid=72586) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f4ef2df89d0> {{(pid=72586) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Aug 01 21:15:15 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f4ef2df89d0> {{(pid=72586) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Aug 01 21:15:15 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Connection event '1' reason 'None'
Aug 01 21:15:15 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 01 21:15:15 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.mount [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Initialising _HostMountState generation 0 {{(pid=72586) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 01 21:15:22 user nova-compute[72586]: INFO nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Libvirt host capabilities <capabilities>
Aug 01 21:15:22 user nova-compute[72586]:   <host>
Aug 01 21:15:22 user nova-compute[72586]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 01 21:15:22 user nova-compute[72586]:     <cpu>
Aug 01 21:15:22 user nova-compute[72586]:       <arch>x86_64</arch>
Aug 01 21:15:22 user nova-compute[72586]:       <model>IvyBridge-IBRS</model>
Aug 01 21:15:22 user nova-compute[72586]:       <vendor>Intel</vendor>
Aug 01 21:15:22 user nova-compute[72586]:       <microcode version='1070'/>
Aug 01 21:15:22 user nova-compute[72586]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 01 21:15:22 user nova-compute[72586]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 01 21:15:22 user nova-compute[72586]:       <feature name='ss'/>
Aug 01 21:15:22 user nova-compute[72586]:       <feature name='vmx'/>
Aug 01 21:15:22 user nova-compute[72586]:       <feature name='pcid'/>
Aug 01 21:15:22 user nova-compute[72586]:       <feature name='osxsave'/>
Aug 01 21:15:22 user nova-compute[72586]:       <feature name='hypervisor'/>
Aug 01 21:15:22 user nova-compute[72586]:       <feature name='arat'/>
Aug 01 21:15:22 user nova-compute[72586]:       <feature name='tsc_adjust'/>
Aug 01 21:15:22 user nova-compute[72586]:       <feature name='md-clear'/>
Aug 01 21:15:22 user nova-compute[72586]:       <feature name='stibp'/>
Aug 01 21:15:22 user nova-compute[72586]:       <feature name='arch-capabilities'/>
Aug 01 21:15:22 user nova-compute[72586]:       <feature name='ssbd'/>
Aug 01 21:15:22 user nova-compute[72586]:       <feature name='invtsc'/>
Aug 01 21:15:22 user nova-compute[72586]:       <feature name='rsba'/>
Aug 01 21:15:22 user nova-compute[72586]:       <feature name='skip-l1dfl-vmentry'/>
Aug 01 21:15:22 user nova-compute[72586]:       <pages unit='KiB' size='4'/>
Aug 01 21:15:22 user nova-compute[72586]:       <pages unit='KiB' size='2048'/>
Aug 01 21:15:22 user nova-compute[72586]:     </cpu>
Aug 01 21:15:22 user nova-compute[72586]:     <power_management>
Aug 01 21:15:22 user nova-compute[72586]:       <suspend_mem/>
Aug 01 21:15:22 user nova-compute[72586]:       <suspend_disk/>
Aug 01 21:15:22 user nova-compute[72586]:       <suspend_hybrid/>
Aug 01 21:15:22 user nova-compute[72586]:     </power_management>
Aug 01 21:15:22 user nova-compute[72586]:     <iommu support='no'/>
Aug 01 21:15:22 user nova-compute[72586]:     <migration_features>
Aug 01 21:15:22 user nova-compute[72586]:       <live/>
Aug 01 21:15:22 user nova-compute[72586]:       <uri_transports>
Aug 01 21:15:22 user nova-compute[72586]:         <uri_transport>tcp</uri_transport>
Aug 01 21:15:22 user nova-compute[72586]:         <uri_transport>rdma</uri_transport>
Aug 01 21:15:22 user nova-compute[72586]:       </uri_transports>
Aug 01 21:15:22 user nova-compute[72586]:     </migration_features>
Aug 01 21:15:22 user nova-compute[72586]:     <topology>
Aug 01 21:15:22 user nova-compute[72586]:       <cells num='2'>
Aug 01 21:15:22 user nova-compute[72586]:         <cell id='0'>
Aug 01 21:15:22 user nova-compute[72586]:           <memory unit='KiB'>8189224</memory>
Aug 01 21:15:22 user nova-compute[72586]:           <pages unit='KiB' size='4'>2047306</pages>
Aug 01 21:15:22 user nova-compute[72586]:           <pages unit='KiB' size='2048'>0</pages>
Aug 01 21:15:22 user nova-compute[72586]:           <distances>
Aug 01 21:15:22 user nova-compute[72586]:             <sibling id='0' value='10'/>
Aug 01 21:15:22 user nova-compute[72586]:             <sibling id='1' value='20'/>
Aug 01 21:15:22 user nova-compute[72586]:           </distances>
Aug 01 21:15:22 user nova-compute[72586]:           <cpus num='6'>
Aug 01 21:15:22 user nova-compute[72586]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 01 21:15:22 user nova-compute[72586]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 01 21:15:22 user nova-compute[72586]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 01 21:15:22 user nova-compute[72586]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 01 21:15:22 user nova-compute[72586]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 01 21:15:22 user nova-compute[72586]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 01 21:15:22 user nova-compute[72586]:           </cpus>
Aug 01 21:15:22 user nova-compute[72586]:         </cell>
Aug 01 21:15:22 user nova-compute[72586]:         <cell id='1'>
Aug 01 21:15:22 user nova-compute[72586]:           <memory unit='KiB'>8206460</memory>
Aug 01 21:15:22 user nova-compute[72586]:           <pages unit='KiB' size='4'>2051615</pages>
Aug 01 21:15:22 user nova-compute[72586]:           <pages unit='KiB' size='2048'>0</pages>
Aug 01 21:15:22 user nova-compute[72586]:           <distances>
Aug 01 21:15:22 user nova-compute[72586]:             <sibling id='0' value='20'/>
Aug 01 21:15:22 user nova-compute[72586]:             <sibling id='1' value='10'/>
Aug 01 21:15:22 user nova-compute[72586]:           </distances>
Aug 01 21:15:22 user nova-compute[72586]:           <cpus num='6'>
Aug 01 21:15:22 user nova-compute[72586]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 01 21:15:22 user nova-compute[72586]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 01 21:15:22 user nova-compute[72586]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 01 21:15:22 user nova-compute[72586]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 01 21:15:22 user nova-compute[72586]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 01 21:15:22 user nova-compute[72586]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 01 21:15:22 user nova-compute[72586]:           </cpus>
Aug 01 21:15:22 user nova-compute[72586]:         </cell>
Aug 01 21:15:22 user nova-compute[72586]:       </cells>
Aug 01 21:15:22 user nova-compute[72586]:     </topology>
Aug 01 21:15:22 user nova-compute[72586]:     <cache>
Aug 01 21:15:22 user nova-compute[72586]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 01 21:15:22 user nova-compute[72586]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 01 21:15:22 user nova-compute[72586]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 01 21:15:22 user nova-compute[72586]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 01 21:15:22 user nova-compute[72586]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 01 21:15:22 user nova-compute[72586]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 01 21:15:22 user nova-compute[72586]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 01 21:15:22 user nova-compute[72586]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 01 21:15:22 user nova-compute[72586]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 01 21:15:22 user nova-compute[72586]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 01 21:15:22 user nova-compute[72586]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 01 21:15:22 user nova-compute[72586]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 01 21:15:22 user nova-compute[72586]:     </cache>
Aug 01 21:15:22 user nova-compute[72586]:     <secmodel>
Aug 01 21:15:22 user nova-compute[72586]:       <model>apparmor</model>
Aug 01 21:15:22 user nova-compute[72586]:       <doi>0</doi>
Aug 01 21:15:22 user nova-compute[72586]:     </secmodel>
Aug 01 21:15:22 user nova-compute[72586]:     <secmodel>
Aug 01 21:15:22 user nova-compute[72586]:       <model>dac</model>
Aug 01 21:15:22 user nova-compute[72586]:       <doi>0</doi>
Aug 01 21:15:22 user nova-compute[72586]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 01 21:15:22 user nova-compute[72586]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 01 21:15:22 user nova-compute[72586]:     </secmodel>
Aug 01 21:15:22 user nova-compute[72586]:   </host>
Aug 01 21:15:22 user nova-compute[72586]:   <guest>
Aug 01 21:15:22 user nova-compute[72586]:     <os_type>hvm</os_type>
Aug 01 21:15:22 user nova-compute[72586]:     <arch name='alpha'>
Aug 01 21:15:22 user nova-compute[72586]:       <wordsize>64</wordsize>
Aug 01 21:15:22 user nova-compute[72586]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='4'>clipper</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <domain type='qemu'/>
Aug 01 21:15:22 user nova-compute[72586]:     </arch>
Aug 01 21:15:22 user nova-compute[72586]:     <features>
Aug 01 21:15:22 user nova-compute[72586]:       <cpuselection/>
Aug 01 21:15:22 user nova-compute[72586]:       <deviceboot/>
Aug 01 21:15:22 user nova-compute[72586]:       <disksnapshot default='on' toggle='no'/>
Aug 01 21:15:22 user nova-compute[72586]:     </features>
Aug 01 21:15:22 user nova-compute[72586]:   </guest>
Aug 01 21:15:22 user nova-compute[72586]:   <guest>
Aug 01 21:15:22 user nova-compute[72586]:     <os_type>hvm</os_type>
Aug 01 21:15:22 user nova-compute[72586]:     <arch name='armv6l'>
Aug 01 21:15:22 user nova-compute[72586]:       <wordsize>32</wordsize>
Aug 01 21:15:22 user nova-compute[72586]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>integratorcp</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>borzoi</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>spitz</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2'>nuri</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2'>musca-b1</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>versatileab</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>kzm</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2'>musca-a</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2'>smdkc210</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>sx1</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>z2</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>tosa</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='4'>sabrelite</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>realview-eb</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>n810</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>n800</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>versatilepb</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>terrier</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>mainstone</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='4'>midway</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>musicpal</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>microbit</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>cubieboard</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>verdex</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>netduino2</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='4'>raspi2b</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>cheetah</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='4'>highbank</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>akita</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>connex</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>collie</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>raspi0</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <domain type='qemu'/>
Aug 01 21:15:22 user nova-compute[72586]:     </arch>
Aug 01 21:15:22 user nova-compute[72586]:     <features>
Aug 01 21:15:22 user nova-compute[72586]:       <cpuselection/>
Aug 01 21:15:22 user nova-compute[72586]:       <deviceboot/>
Aug 01 21:15:22 user nova-compute[72586]:       <disksnapshot default='on' toggle='no'/>
Aug 01 21:15:22 user nova-compute[72586]:     </features>
Aug 01 21:15:22 user nova-compute[72586]:   </guest>
Aug 01 21:15:22 user nova-compute[72586]:   <guest>
Aug 01 21:15:22 user nova-compute[72586]:     <os_type>hvm</os_type>
Aug 01 21:15:22 user nova-compute[72586]:     <arch name='armv7l'>
Aug 01 21:15:22 user nova-compute[72586]:       <wordsize>32</wordsize>
Aug 01 21:15:22 user nova-compute[72586]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>integratorcp</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>borzoi</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>spitz</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2'>nuri</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2'>musca-b1</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>versatileab</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>kzm</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2'>musca-a</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2'>smdkc210</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>sx1</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>z2</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>tosa</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='4'>sabrelite</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>realview-eb</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>n810</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>n800</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>versatilepb</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>terrier</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>mainstone</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='4'>midway</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>musicpal</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>microbit</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>cubieboard</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>verdex</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>netduino2</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='4'>raspi2b</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>cheetah</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='4'>highbank</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>akita</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>connex</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>collie</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>raspi0</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <domain type='qemu'/>
Aug 01 21:15:22 user nova-compute[72586]:     </arch>
Aug 01 21:15:22 user nova-compute[72586]:     <features>
Aug 01 21:15:22 user nova-compute[72586]:       <cpuselection/>
Aug 01 21:15:22 user nova-compute[72586]:       <deviceboot/>
Aug 01 21:15:22 user nova-compute[72586]:       <disksnapshot default='on' toggle='no'/>
Aug 01 21:15:22 user nova-compute[72586]:     </features>
Aug 01 21:15:22 user nova-compute[72586]:   </guest>
Aug 01 21:15:22 user nova-compute[72586]:   <guest>
Aug 01 21:15:22 user nova-compute[72586]:     <os_type>hvm</os_type>
Aug 01 21:15:22 user nova-compute[72586]:     <arch name='aarch64'>
Aug 01 21:15:22 user nova-compute[72586]:       <wordsize>64</wordsize>
Aug 01 21:15:22 user nova-compute[72586]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>integratorcp</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>borzoi</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>spitz</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2'>nuri</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2'>musca-b1</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>versatileab</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>kzm</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2'>musca-a</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2'>smdkc210</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>sx1</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>z2</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>tosa</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='4'>sabrelite</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>realview-eb</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>n810</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>n800</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>versatilepb</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>terrier</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>mainstone</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='4'>midway</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>musicpal</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>microbit</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>cubieboard</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>verdex</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>netduino2</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='4'>raspi3b</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='4'>raspi2b</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>cheetah</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='4'>highbank</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>akita</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>connex</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>collie</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>raspi0</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <domain type='qemu'/>
Aug 01 21:15:22 user nova-compute[72586]:     </arch>
Aug 01 21:15:22 user nova-compute[72586]:     <features>
Aug 01 21:15:22 user nova-compute[72586]:       <acpi default='on' toggle='yes'/>
Aug 01 21:15:22 user nova-compute[72586]:       <cpuselection/>
Aug 01 21:15:22 user nova-compute[72586]:       <deviceboot/>
Aug 01 21:15:22 user nova-compute[72586]:       <disksnapshot default='on' toggle='no'/>
Aug 01 21:15:22 user nova-compute[72586]:     </features>
Aug 01 21:15:22 user nova-compute[72586]:   </guest>
Aug 01 21:15:22 user nova-compute[72586]:   <guest>
Aug 01 21:15:22 user nova-compute[72586]:     <os_type>hvm</os_type>
Aug 01 21:15:22 user nova-compute[72586]:     <arch name='cris'>
Aug 01 21:15:22 user nova-compute[72586]:       <wordsize>32</wordsize>
Aug 01 21:15:22 user nova-compute[72586]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <domain type='qemu'/>
Aug 01 21:15:22 user nova-compute[72586]:     </arch>
Aug 01 21:15:22 user nova-compute[72586]:     <features>
Aug 01 21:15:22 user nova-compute[72586]:       <cpuselection/>
Aug 01 21:15:22 user nova-compute[72586]:       <deviceboot/>
Aug 01 21:15:22 user nova-compute[72586]:       <disksnapshot default='on' toggle='no'/>
Aug 01 21:15:22 user nova-compute[72586]:     </features>
Aug 01 21:15:22 user nova-compute[72586]:   </guest>
Aug 01 21:15:22 user nova-compute[72586]:   <guest>
Aug 01 21:15:22 user nova-compute[72586]:     <os_type>hvm</os_type>
Aug 01 21:15:22 user nova-compute[72586]:     <arch name='i686'>
Aug 01 21:15:22 user nova-compute[72586]:       <wordsize>32</wordsize>
Aug 01 21:15:22 user nova-compute[72586]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>x-remote</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>isapc</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='288'>microvm</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <domain type='qemu'/>
Aug 01 21:15:22 user nova-compute[72586]:       <domain type='kvm'/>
Aug 01 21:15:22 user nova-compute[72586]:     </arch>
Aug 01 21:15:22 user nova-compute[72586]:     <features>
Aug 01 21:15:22 user nova-compute[72586]:       <pae/>
Aug 01 21:15:22 user nova-compute[72586]:       <nonpae/>
Aug 01 21:15:22 user nova-compute[72586]:       <acpi default='on' toggle='yes'/>
Aug 01 21:15:22 user nova-compute[72586]:       <apic default='on' toggle='no'/>
Aug 01 21:15:22 user nova-compute[72586]:       <cpuselection/>
Aug 01 21:15:22 user nova-compute[72586]:       <deviceboot/>
Aug 01 21:15:22 user nova-compute[72586]:       <disksnapshot default='on' toggle='no'/>
Aug 01 21:15:22 user nova-compute[72586]:     </features>
Aug 01 21:15:22 user nova-compute[72586]:   </guest>
Aug 01 21:15:22 user nova-compute[72586]:   <guest>
Aug 01 21:15:22 user nova-compute[72586]:     <os_type>hvm</os_type>
Aug 01 21:15:22 user nova-compute[72586]:     <arch name='m68k'>
Aug 01 21:15:22 user nova-compute[72586]:       <wordsize>32</wordsize>
Aug 01 21:15:22 user nova-compute[72586]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>an5206</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>q800</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>next-cube</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <domain type='qemu'/>
Aug 01 21:15:22 user nova-compute[72586]:     </arch>
Aug 01 21:15:22 user nova-compute[72586]:     <features>
Aug 01 21:15:22 user nova-compute[72586]:       <cpuselection/>
Aug 01 21:15:22 user nova-compute[72586]:       <deviceboot/>
Aug 01 21:15:22 user nova-compute[72586]:       <disksnapshot default='on' toggle='no'/>
Aug 01 21:15:22 user nova-compute[72586]:     </features>
Aug 01 21:15:22 user nova-compute[72586]:   </guest>
Aug 01 21:15:22 user nova-compute[72586]:   <guest>
Aug 01 21:15:22 user nova-compute[72586]:     <os_type>hvm</os_type>
Aug 01 21:15:22 user nova-compute[72586]:     <arch name='microblaze'>
Aug 01 21:15:22 user nova-compute[72586]:       <wordsize>32</wordsize>
Aug 01 21:15:22 user nova-compute[72586]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <domain type='qemu'/>
Aug 01 21:15:22 user nova-compute[72586]:     </arch>
Aug 01 21:15:22 user nova-compute[72586]:     <features>
Aug 01 21:15:22 user nova-compute[72586]:       <cpuselection/>
Aug 01 21:15:22 user nova-compute[72586]:       <deviceboot/>
Aug 01 21:15:22 user nova-compute[72586]:       <disksnapshot default='on' toggle='no'/>
Aug 01 21:15:22 user nova-compute[72586]:     </features>
Aug 01 21:15:22 user nova-compute[72586]:   </guest>
Aug 01 21:15:22 user nova-compute[72586]:   <guest>
Aug 01 21:15:22 user nova-compute[72586]:     <os_type>hvm</os_type>
Aug 01 21:15:22 user nova-compute[72586]:     <arch name='microblazeel'>
Aug 01 21:15:22 user nova-compute[72586]:       <wordsize>32</wordsize>
Aug 01 21:15:22 user nova-compute[72586]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <domain type='qemu'/>
Aug 01 21:15:22 user nova-compute[72586]:     </arch>
Aug 01 21:15:22 user nova-compute[72586]:     <features>
Aug 01 21:15:22 user nova-compute[72586]:       <cpuselection/>
Aug 01 21:15:22 user nova-compute[72586]:       <deviceboot/>
Aug 01 21:15:22 user nova-compute[72586]:       <disksnapshot default='on' toggle='no'/>
Aug 01 21:15:22 user nova-compute[72586]:     </features>
Aug 01 21:15:22 user nova-compute[72586]:   </guest>
Aug 01 21:15:22 user nova-compute[72586]:   <guest>
Aug 01 21:15:22 user nova-compute[72586]:     <os_type>hvm</os_type>
Aug 01 21:15:22 user nova-compute[72586]:     <arch name='mips'>
Aug 01 21:15:22 user nova-compute[72586]:       <wordsize>32</wordsize>
Aug 01 21:15:22 user nova-compute[72586]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='16'>malta</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>mipssim</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <domain type='qemu'/>
Aug 01 21:15:22 user nova-compute[72586]:     </arch>
Aug 01 21:15:22 user nova-compute[72586]:     <features>
Aug 01 21:15:22 user nova-compute[72586]:       <cpuselection/>
Aug 01 21:15:22 user nova-compute[72586]:       <deviceboot/>
Aug 01 21:15:22 user nova-compute[72586]:       <disksnapshot default='on' toggle='no'/>
Aug 01 21:15:22 user nova-compute[72586]:     </features>
Aug 01 21:15:22 user nova-compute[72586]:   </guest>
Aug 01 21:15:22 user nova-compute[72586]:   <guest>
Aug 01 21:15:22 user nova-compute[72586]:     <os_type>hvm</os_type>
Aug 01 21:15:22 user nova-compute[72586]:     <arch name='mipsel'>
Aug 01 21:15:22 user nova-compute[72586]:       <wordsize>32</wordsize>
Aug 01 21:15:22 user nova-compute[72586]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='16'>malta</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>mipssim</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <domain type='qemu'/>
Aug 01 21:15:22 user nova-compute[72586]:     </arch>
Aug 01 21:15:22 user nova-compute[72586]:     <features>
Aug 01 21:15:22 user nova-compute[72586]:       <cpuselection/>
Aug 01 21:15:22 user nova-compute[72586]:       <deviceboot/>
Aug 01 21:15:22 user nova-compute[72586]:       <disksnapshot default='on' toggle='no'/>
Aug 01 21:15:22 user nova-compute[72586]:     </features>
Aug 01 21:15:22 user nova-compute[72586]:   </guest>
Aug 01 21:15:22 user nova-compute[72586]:   <guest>
Aug 01 21:15:22 user nova-compute[72586]:     <os_type>hvm</os_type>
Aug 01 21:15:22 user nova-compute[72586]:     <arch name='mips64'>
Aug 01 21:15:22 user nova-compute[72586]:       <wordsize>64</wordsize>
Aug 01 21:15:22 user nova-compute[72586]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='16'>malta</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>mipssim</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>pica61</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>magnum</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <domain type='qemu'/>
Aug 01 21:15:22 user nova-compute[72586]:     </arch>
Aug 01 21:15:22 user nova-compute[72586]:     <features>
Aug 01 21:15:22 user nova-compute[72586]:       <cpuselection/>
Aug 01 21:15:22 user nova-compute[72586]:       <deviceboot/>
Aug 01 21:15:22 user nova-compute[72586]:       <disksnapshot default='on' toggle='no'/>
Aug 01 21:15:22 user nova-compute[72586]:     </features>
Aug 01 21:15:22 user nova-compute[72586]:   </guest>
Aug 01 21:15:22 user nova-compute[72586]:   <guest>
Aug 01 21:15:22 user nova-compute[72586]:     <os_type>hvm</os_type>
Aug 01 21:15:22 user nova-compute[72586]:     <arch name='mips64el'>
Aug 01 21:15:22 user nova-compute[72586]:       <wordsize>64</wordsize>
Aug 01 21:15:22 user nova-compute[72586]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='16'>malta</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>mipssim</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>pica61</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>magnum</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='16'>boston</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <domain type='qemu'/>
Aug 01 21:15:22 user nova-compute[72586]:     </arch>
Aug 01 21:15:22 user nova-compute[72586]:     <features>
Aug 01 21:15:22 user nova-compute[72586]:       <cpuselection/>
Aug 01 21:15:22 user nova-compute[72586]:       <deviceboot/>
Aug 01 21:15:22 user nova-compute[72586]:       <disksnapshot default='on' toggle='no'/>
Aug 01 21:15:22 user nova-compute[72586]:     </features>
Aug 01 21:15:22 user nova-compute[72586]:   </guest>
Aug 01 21:15:22 user nova-compute[72586]:   <guest>
Aug 01 21:15:22 user nova-compute[72586]:     <os_type>hvm</os_type>
Aug 01 21:15:22 user nova-compute[72586]:     <arch name='ppc'>
Aug 01 21:15:22 user nova-compute[72586]:       <wordsize>32</wordsize>
Aug 01 21:15:22 user nova-compute[72586]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>g3beige</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>mac99</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='32'>ppce500</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>pegasos2</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>sam460ex</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>bamboo</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>40p</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>ref405ep</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>taihu</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <domain type='qemu'/>
Aug 01 21:15:22 user nova-compute[72586]:     </arch>
Aug 01 21:15:22 user nova-compute[72586]:     <features>
Aug 01 21:15:22 user nova-compute[72586]:       <cpuselection/>
Aug 01 21:15:22 user nova-compute[72586]:       <deviceboot/>
Aug 01 21:15:22 user nova-compute[72586]:       <disksnapshot default='on' toggle='no'/>
Aug 01 21:15:22 user nova-compute[72586]:     </features>
Aug 01 21:15:22 user nova-compute[72586]:   </guest>
Aug 01 21:15:22 user nova-compute[72586]:   <guest>
Aug 01 21:15:22 user nova-compute[72586]:     <os_type>hvm</os_type>
Aug 01 21:15:22 user nova-compute[72586]:     <arch name='ppc64'>
Aug 01 21:15:22 user nova-compute[72586]:       <wordsize>64</wordsize>
Aug 01 21:15:22 user nova-compute[72586]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2048'>powernv9</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>taihu</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2048'>powernv10</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='32'>ppce500</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>40p</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>pegasos2</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>bamboo</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='1'>g3beige</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 01 21:15:22 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='1'>mac99</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='1'>sam460ex</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='1'>ref405ep</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='2048'>powernv8</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <domain type='qemu'/>
Aug 01 21:15:23 user nova-compute[72586]:     </arch>
Aug 01 21:15:23 user nova-compute[72586]:     <features>
Aug 01 21:15:23 user nova-compute[72586]:       <cpuselection/>
Aug 01 21:15:23 user nova-compute[72586]:       <deviceboot/>
Aug 01 21:15:23 user nova-compute[72586]:       <disksnapshot default='on' toggle='no'/>
Aug 01 21:15:23 user nova-compute[72586]:     </features>
Aug 01 21:15:23 user nova-compute[72586]:   </guest>
Aug 01 21:15:23 user nova-compute[72586]:   <guest>
Aug 01 21:15:23 user nova-compute[72586]:     <os_type>hvm</os_type>
Aug 01 21:15:23 user nova-compute[72586]:     <arch name='ppc64le'>
Aug 01 21:15:23 user nova-compute[72586]:       <wordsize>64</wordsize>
Aug 01 21:15:23 user nova-compute[72586]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='2048'>powernv9</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='1'>taihu</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='2048'>powernv10</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='32'>ppce500</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='1'>40p</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='1'>pegasos2</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='1'>bamboo</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='1'>g3beige</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='1'>mac99</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='1'>sam460ex</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='1'>ref405ep</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='2048'>powernv8</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <domain type='qemu'/>
Aug 01 21:15:23 user nova-compute[72586]:     </arch>
Aug 01 21:15:23 user nova-compute[72586]:     <features>
Aug 01 21:15:23 user nova-compute[72586]:       <cpuselection/>
Aug 01 21:15:23 user nova-compute[72586]:       <deviceboot/>
Aug 01 21:15:23 user nova-compute[72586]:       <disksnapshot default='on' toggle='no'/>
Aug 01 21:15:23 user nova-compute[72586]:     </features>
Aug 01 21:15:23 user nova-compute[72586]:   </guest>
Aug 01 21:15:23 user nova-compute[72586]:   <guest>
Aug 01 21:15:23 user nova-compute[72586]:     <os_type>hvm</os_type>
Aug 01 21:15:23 user nova-compute[72586]:     <arch name='riscv32'>
Aug 01 21:15:23 user nova-compute[72586]:       <wordsize>32</wordsize>
Aug 01 21:15:23 user nova-compute[72586]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='8'>spike</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='1'>opentitan</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='5'>sifive_u</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='1'>sifive_e</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='8'>virt</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <domain type='qemu'/>
Aug 01 21:15:23 user nova-compute[72586]:     </arch>
Aug 01 21:15:23 user nova-compute[72586]:     <features>
Aug 01 21:15:23 user nova-compute[72586]:       <cpuselection/>
Aug 01 21:15:23 user nova-compute[72586]:       <deviceboot/>
Aug 01 21:15:23 user nova-compute[72586]:       <disksnapshot default='on' toggle='no'/>
Aug 01 21:15:23 user nova-compute[72586]:     </features>
Aug 01 21:15:23 user nova-compute[72586]:   </guest>
Aug 01 21:15:23 user nova-compute[72586]:   <guest>
Aug 01 21:15:23 user nova-compute[72586]:     <os_type>hvm</os_type>
Aug 01 21:15:23 user nova-compute[72586]:     <arch name='riscv64'>
Aug 01 21:15:23 user nova-compute[72586]:       <wordsize>64</wordsize>
Aug 01 21:15:23 user nova-compute[72586]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='8'>spike</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='5'>sifive_u</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='1'>shakti_c</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='1'>sifive_e</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='8'>virt</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <domain type='qemu'/>
Aug 01 21:15:23 user nova-compute[72586]:     </arch>
Aug 01 21:15:23 user nova-compute[72586]:     <features>
Aug 01 21:15:23 user nova-compute[72586]:       <cpuselection/>
Aug 01 21:15:23 user nova-compute[72586]:       <deviceboot/>
Aug 01 21:15:23 user nova-compute[72586]:       <disksnapshot default='on' toggle='no'/>
Aug 01 21:15:23 user nova-compute[72586]:     </features>
Aug 01 21:15:23 user nova-compute[72586]:   </guest>
Aug 01 21:15:23 user nova-compute[72586]:   <guest>
Aug 01 21:15:23 user nova-compute[72586]:     <os_type>hvm</os_type>
Aug 01 21:15:23 user nova-compute[72586]:     <arch name='s390x'>
Aug 01 21:15:23 user nova-compute[72586]:       <wordsize>64</wordsize>
Aug 01 21:15:23 user nova-compute[72586]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <domain type='qemu'/>
Aug 01 21:15:23 user nova-compute[72586]:     </arch>
Aug 01 21:15:23 user nova-compute[72586]:     <features>
Aug 01 21:15:23 user nova-compute[72586]:       <cpuselection/>
Aug 01 21:15:23 user nova-compute[72586]:       <deviceboot/>
Aug 01 21:15:23 user nova-compute[72586]:       <disksnapshot default='on' toggle='no'/>
Aug 01 21:15:23 user nova-compute[72586]:     </features>
Aug 01 21:15:23 user nova-compute[72586]:   </guest>
Aug 01 21:15:23 user nova-compute[72586]:   <guest>
Aug 01 21:15:23 user nova-compute[72586]:     <os_type>hvm</os_type>
Aug 01 21:15:23 user nova-compute[72586]:     <arch name='sh4'>
Aug 01 21:15:23 user nova-compute[72586]:       <wordsize>32</wordsize>
Aug 01 21:15:23 user nova-compute[72586]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='1'>shix</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='1'>r2d</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <domain type='qemu'/>
Aug 01 21:15:23 user nova-compute[72586]:     </arch>
Aug 01 21:15:23 user nova-compute[72586]:     <features>
Aug 01 21:15:23 user nova-compute[72586]:       <cpuselection/>
Aug 01 21:15:23 user nova-compute[72586]:       <deviceboot/>
Aug 01 21:15:23 user nova-compute[72586]:       <disksnapshot default='on' toggle='no'/>
Aug 01 21:15:23 user nova-compute[72586]:     </features>
Aug 01 21:15:23 user nova-compute[72586]:   </guest>
Aug 01 21:15:23 user nova-compute[72586]:   <guest>
Aug 01 21:15:23 user nova-compute[72586]:     <os_type>hvm</os_type>
Aug 01 21:15:23 user nova-compute[72586]:     <arch name='sh4eb'>
Aug 01 21:15:23 user nova-compute[72586]:       <wordsize>64</wordsize>
Aug 01 21:15:23 user nova-compute[72586]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='1'>shix</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='1'>r2d</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <domain type='qemu'/>
Aug 01 21:15:23 user nova-compute[72586]:     </arch>
Aug 01 21:15:23 user nova-compute[72586]:     <features>
Aug 01 21:15:23 user nova-compute[72586]:       <cpuselection/>
Aug 01 21:15:23 user nova-compute[72586]:       <deviceboot/>
Aug 01 21:15:23 user nova-compute[72586]:       <disksnapshot default='on' toggle='no'/>
Aug 01 21:15:23 user nova-compute[72586]:     </features>
Aug 01 21:15:23 user nova-compute[72586]:   </guest>
Aug 01 21:15:23 user nova-compute[72586]:   <guest>
Aug 01 21:15:23 user nova-compute[72586]:     <os_type>hvm</os_type>
Aug 01 21:15:23 user nova-compute[72586]:     <arch name='sparc'>
Aug 01 21:15:23 user nova-compute[72586]:       <wordsize>32</wordsize>
Aug 01 21:15:23 user nova-compute[72586]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='1'>SS-5</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='4'>SS-20</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='1'>LX</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='1'>SS-4</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='4'>SS-10</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='1'>Voyager</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <domain type='qemu'/>
Aug 01 21:15:23 user nova-compute[72586]:     </arch>
Aug 01 21:15:23 user nova-compute[72586]:     <features>
Aug 01 21:15:23 user nova-compute[72586]:       <cpuselection/>
Aug 01 21:15:23 user nova-compute[72586]:       <deviceboot/>
Aug 01 21:15:23 user nova-compute[72586]:       <disksnapshot default='on' toggle='no'/>
Aug 01 21:15:23 user nova-compute[72586]:     </features>
Aug 01 21:15:23 user nova-compute[72586]:   </guest>
Aug 01 21:15:23 user nova-compute[72586]:   <guest>
Aug 01 21:15:23 user nova-compute[72586]:     <os_type>hvm</os_type>
Aug 01 21:15:23 user nova-compute[72586]:     <arch name='sparc64'>
Aug 01 21:15:23 user nova-compute[72586]:       <wordsize>64</wordsize>
Aug 01 21:15:23 user nova-compute[72586]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='1'>sun4u</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='1'>niagara</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='1'>sun4v</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <domain type='qemu'/>
Aug 01 21:15:23 user nova-compute[72586]:     </arch>
Aug 01 21:15:23 user nova-compute[72586]:     <features>
Aug 01 21:15:23 user nova-compute[72586]:       <cpuselection/>
Aug 01 21:15:23 user nova-compute[72586]:       <deviceboot/>
Aug 01 21:15:23 user nova-compute[72586]:       <disksnapshot default='on' toggle='no'/>
Aug 01 21:15:23 user nova-compute[72586]:     </features>
Aug 01 21:15:23 user nova-compute[72586]:   </guest>
Aug 01 21:15:23 user nova-compute[72586]:   <guest>
Aug 01 21:15:23 user nova-compute[72586]:     <os_type>hvm</os_type>
Aug 01 21:15:23 user nova-compute[72586]:     <arch name='x86_64'>
Aug 01 21:15:23 user nova-compute[72586]:       <wordsize>64</wordsize>
Aug 01 21:15:23 user nova-compute[72586]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='1'>x-remote</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='1'>isapc</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='288'>microvm</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <domain type='qemu'/>
Aug 01 21:15:23 user nova-compute[72586]:       <domain type='kvm'/>
Aug 01 21:15:23 user nova-compute[72586]:     </arch>
Aug 01 21:15:23 user nova-compute[72586]:     <features>
Aug 01 21:15:23 user nova-compute[72586]:       <acpi default='on' toggle='yes'/>
Aug 01 21:15:23 user nova-compute[72586]:       <apic default='on' toggle='no'/>
Aug 01 21:15:23 user nova-compute[72586]:       <cpuselection/>
Aug 01 21:15:23 user nova-compute[72586]:       <deviceboot/>
Aug 01 21:15:23 user nova-compute[72586]:       <disksnapshot default='on' toggle='no'/>
Aug 01 21:15:23 user nova-compute[72586]:     </features>
Aug 01 21:15:23 user nova-compute[72586]:   </guest>
Aug 01 21:15:23 user nova-compute[72586]:   <guest>
Aug 01 21:15:23 user nova-compute[72586]:     <os_type>hvm</os_type>
Aug 01 21:15:23 user nova-compute[72586]:     <arch name='xtensa'>
Aug 01 21:15:23 user nova-compute[72586]:       <wordsize>32</wordsize>
Aug 01 21:15:23 user nova-compute[72586]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='4'>sim</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='32'>kc705</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='32'>ml605</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='32'>virt</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='32'>lx200</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='32'>lx60</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <domain type='qemu'/>
Aug 01 21:15:23 user nova-compute[72586]:     </arch>
Aug 01 21:15:23 user nova-compute[72586]:     <features>
Aug 01 21:15:23 user nova-compute[72586]:       <cpuselection/>
Aug 01 21:15:23 user nova-compute[72586]:       <deviceboot/>
Aug 01 21:15:23 user nova-compute[72586]:       <disksnapshot default='on' toggle='no'/>
Aug 01 21:15:23 user nova-compute[72586]:     </features>
Aug 01 21:15:23 user nova-compute[72586]:   </guest>
Aug 01 21:15:23 user nova-compute[72586]:   <guest>
Aug 01 21:15:23 user nova-compute[72586]:     <os_type>hvm</os_type>
Aug 01 21:15:23 user nova-compute[72586]:     <arch name='xtensaeb'>
Aug 01 21:15:23 user nova-compute[72586]:       <wordsize>32</wordsize>
Aug 01 21:15:23 user nova-compute[72586]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='4'>sim</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='32'>kc705</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='32'>ml605</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='32'>virt</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='32'>lx200</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='32'>lx60</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 01 21:15:23 user nova-compute[72586]:       <domain type='qemu'/>
Aug 01 21:15:23 user nova-compute[72586]:     </arch>
Aug 01 21:15:23 user nova-compute[72586]:     <features>
Aug 01 21:15:23 user nova-compute[72586]:       <cpuselection/>
Aug 01 21:15:23 user nova-compute[72586]:       <deviceboot/>
Aug 01 21:15:23 user nova-compute[72586]:       <disksnapshot default='on' toggle='no'/>
Aug 01 21:15:23 user nova-compute[72586]:     </features>
Aug 01 21:15:23 user nova-compute[72586]:   </guest>
Aug 01 21:15:23 user nova-compute[72586]: </capabilities>
Aug 01 21:15:23 user nova-compute[72586]: 
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=72586) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=72586) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=72586) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72586) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72586) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=72586) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72586) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=72586) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=72586) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=72586) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=72586) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Getting domain capabilities for i686 via machine types: {'pc', 'q35', 'ubuntu-q35', 'ubuntu'} {{(pid=72586) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 01 21:15:23 user nova-compute[72586]: <domainCapabilities>
Aug 01 21:15:23 user nova-compute[72586]:   <path>/usr/bin/qemu-system-i386</path>
Aug 01 21:15:23 user nova-compute[72586]:   <domain>kvm</domain>
Aug 01 21:15:23 user nova-compute[72586]:   <machine>pc-i440fx-6.2</machine>
Aug 01 21:15:23 user nova-compute[72586]:   <arch>i686</arch>
Aug 01 21:15:23 user nova-compute[72586]:   <vcpu max='255'/>
Aug 01 21:15:23 user nova-compute[72586]:   <iothreads supported='yes'/>
Aug 01 21:15:23 user nova-compute[72586]:   <os supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:     <enum name='firmware'/>
Aug 01 21:15:23 user nova-compute[72586]:     <loader supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 01 21:15:23 user nova-compute[72586]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 01 21:15:23 user nova-compute[72586]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 01 21:15:23 user nova-compute[72586]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 01 21:15:23 user nova-compute[72586]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='type'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>rom</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>pflash</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='readonly'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>yes</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>no</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='secure'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>no</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </loader>
Aug 01 21:15:23 user nova-compute[72586]:   </os>
Aug 01 21:15:23 user nova-compute[72586]:   <cpu>
Aug 01 21:15:23 user nova-compute[72586]:     <mode name='host-passthrough' supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='hostPassthroughMigratable'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>off</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </mode>
Aug 01 21:15:23 user nova-compute[72586]:     <mode name='maximum' supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='maximumMigratable'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>on</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>off</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </mode>
Aug 01 21:15:23 user nova-compute[72586]:     <mode name='host-model' supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <vendor>Intel</vendor>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='ss'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='vmx'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='pcid'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='hypervisor'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='arat'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='tsc_adjust'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='umip'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='md-clear'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='stibp'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='arch-capabilities'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='ssbd'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='ibpb'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='ibrs'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='amd-stibp'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='amd-ssbd'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='disable' name='erms'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='disable' name='xsaveopt'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='disable' name='lm'/>
Aug 01 21:15:23 user nova-compute[72586]:     </mode>
Aug 01 21:15:23 user nova-compute[72586]:     <mode name='custom' supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>qemu64</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>qemu32</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>phenom</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>pentium3</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>pentium2</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>pentium</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>n270</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>kvm64</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>kvm32</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>coreduo</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>core2duo</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>athlon</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Westmere-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Westmere</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Snowridge</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Skylake-Server</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Skylake-Client</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>SandyBridge</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Penryn</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Opteron_G5</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Opteron_G4</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Opteron_G3</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Opteron_G2</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Opteron_G1</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Nehalem-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Nehalem</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>IvyBridge</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Icelake-Server</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Haswell-noTSX</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Haswell-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Haswell</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>EPYC-Rome</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>EPYC-Milan</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>EPYC-IBPB</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>EPYC</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Dhyana</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Cooperlake</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Conroe</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Cascadelake-Server</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Broadwell-noTSX</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Broadwell-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Broadwell</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>486</model>
Aug 01 21:15:23 user nova-compute[72586]:     </mode>
Aug 01 21:15:23 user nova-compute[72586]:   </cpu>
Aug 01 21:15:23 user nova-compute[72586]:   <memoryBacking supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:     <enum name='sourceType'>
Aug 01 21:15:23 user nova-compute[72586]:       <value>file</value>
Aug 01 21:15:23 user nova-compute[72586]:       <value>anonymous</value>
Aug 01 21:15:23 user nova-compute[72586]:       <value>memfd</value>
Aug 01 21:15:23 user nova-compute[72586]:     </enum>
Aug 01 21:15:23 user nova-compute[72586]:   </memoryBacking>
Aug 01 21:15:23 user nova-compute[72586]:   <devices>
Aug 01 21:15:23 user nova-compute[72586]:     <disk supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='diskDevice'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>disk</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>cdrom</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>floppy</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>lun</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='bus'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>ide</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>fdc</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>scsi</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtio</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>usb</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>sata</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='model'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtio</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtio-transitional</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtio-non-transitional</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </disk>
Aug 01 21:15:23 user nova-compute[72586]:     <graphics supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='type'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>sdl</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>vnc</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>spice</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>egl-headless</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </graphics>
Aug 01 21:15:23 user nova-compute[72586]:     <video supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='modelType'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>vga</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>cirrus</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>vmvga</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>qxl</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtio</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>none</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>bochs</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>ramfb</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </video>
Aug 01 21:15:23 user nova-compute[72586]:     <hostdev supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='mode'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>subsystem</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='startupPolicy'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>default</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>mandatory</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>requisite</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>optional</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='subsysType'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>usb</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>pci</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>scsi</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='capsType'/>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='pciBackend'/>
Aug 01 21:15:23 user nova-compute[72586]:     </hostdev>
Aug 01 21:15:23 user nova-compute[72586]:     <rng supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='model'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtio</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtio-transitional</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtio-non-transitional</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='backendModel'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>random</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>egd</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>builtin</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </rng>
Aug 01 21:15:23 user nova-compute[72586]:     <filesystem supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='driverType'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>path</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>handle</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtiofs</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </filesystem>
Aug 01 21:15:23 user nova-compute[72586]:     <tpm supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='model'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>tpm-tis</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>tpm-crb</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='backendModel'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>passthrough</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>emulator</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </tpm>
Aug 01 21:15:23 user nova-compute[72586]:   </devices>
Aug 01 21:15:23 user nova-compute[72586]:   <features>
Aug 01 21:15:23 user nova-compute[72586]:     <gic supported='no'/>
Aug 01 21:15:23 user nova-compute[72586]:     <vmcoreinfo supported='yes'/>
Aug 01 21:15:23 user nova-compute[72586]:     <genid supported='yes'/>
Aug 01 21:15:23 user nova-compute[72586]:     <backingStoreInput supported='yes'/>
Aug 01 21:15:23 user nova-compute[72586]:     <backup supported='yes'/>
Aug 01 21:15:23 user nova-compute[72586]:     <sev supported='no'/>
Aug 01 21:15:23 user nova-compute[72586]:   </features>
Aug 01 21:15:23 user nova-compute[72586]: </domainCapabilities>
Aug 01 21:15:23 user nova-compute[72586]:  {{(pid=72586) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 01 21:15:23 user nova-compute[72586]: <domainCapabilities>
Aug 01 21:15:23 user nova-compute[72586]:   <path>/usr/bin/qemu-system-i386</path>
Aug 01 21:15:23 user nova-compute[72586]:   <domain>kvm</domain>
Aug 01 21:15:23 user nova-compute[72586]:   <machine>pc-q35-6.2</machine>
Aug 01 21:15:23 user nova-compute[72586]:   <arch>i686</arch>
Aug 01 21:15:23 user nova-compute[72586]:   <vcpu max='288'/>
Aug 01 21:15:23 user nova-compute[72586]:   <iothreads supported='yes'/>
Aug 01 21:15:23 user nova-compute[72586]:   <os supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:     <enum name='firmware'/>
Aug 01 21:15:23 user nova-compute[72586]:     <loader supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 01 21:15:23 user nova-compute[72586]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 01 21:15:23 user nova-compute[72586]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 01 21:15:23 user nova-compute[72586]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 01 21:15:23 user nova-compute[72586]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='type'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>rom</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>pflash</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='readonly'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>yes</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>no</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='secure'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>no</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </loader>
Aug 01 21:15:23 user nova-compute[72586]:   </os>
Aug 01 21:15:23 user nova-compute[72586]:   <cpu>
Aug 01 21:15:23 user nova-compute[72586]:     <mode name='host-passthrough' supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='hostPassthroughMigratable'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>off</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </mode>
Aug 01 21:15:23 user nova-compute[72586]:     <mode name='maximum' supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='maximumMigratable'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>on</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>off</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </mode>
Aug 01 21:15:23 user nova-compute[72586]:     <mode name='host-model' supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <vendor>Intel</vendor>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='ss'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='vmx'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='pcid'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='hypervisor'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='arat'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='tsc_adjust'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='umip'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='md-clear'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='stibp'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='arch-capabilities'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='ssbd'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='ibpb'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='ibrs'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='amd-stibp'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='amd-ssbd'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='disable' name='erms'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='disable' name='xsaveopt'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='disable' name='lm'/>
Aug 01 21:15:23 user nova-compute[72586]:     </mode>
Aug 01 21:15:23 user nova-compute[72586]:     <mode name='custom' supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>qemu64</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>qemu32</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>phenom</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>pentium3</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>pentium2</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>pentium</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>n270</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>kvm64</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>kvm32</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>coreduo</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>core2duo</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>athlon</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Westmere-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Westmere</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Snowridge</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Skylake-Server</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Skylake-Client</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>SandyBridge</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Penryn</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Opteron_G5</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Opteron_G4</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Opteron_G3</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Opteron_G2</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Opteron_G1</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Nehalem-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Nehalem</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>IvyBridge</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Icelake-Server</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Haswell-noTSX</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Haswell-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Haswell</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>EPYC-Rome</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>EPYC-Milan</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>EPYC-IBPB</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>EPYC</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Dhyana</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Cooperlake</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Conroe</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Cascadelake-Server</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Broadwell-noTSX</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Broadwell-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Broadwell</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>486</model>
Aug 01 21:15:23 user nova-compute[72586]:     </mode>
Aug 01 21:15:23 user nova-compute[72586]:   </cpu>
Aug 01 21:15:23 user nova-compute[72586]:   <memoryBacking supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:     <enum name='sourceType'>
Aug 01 21:15:23 user nova-compute[72586]:       <value>file</value>
Aug 01 21:15:23 user nova-compute[72586]:       <value>anonymous</value>
Aug 01 21:15:23 user nova-compute[72586]:       <value>memfd</value>
Aug 01 21:15:23 user nova-compute[72586]:     </enum>
Aug 01 21:15:23 user nova-compute[72586]:   </memoryBacking>
Aug 01 21:15:23 user nova-compute[72586]:   <devices>
Aug 01 21:15:23 user nova-compute[72586]:     <disk supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='diskDevice'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>disk</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>cdrom</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>floppy</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>lun</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='bus'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>fdc</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>scsi</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtio</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>usb</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>sata</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='model'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtio</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtio-transitional</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtio-non-transitional</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </disk>
Aug 01 21:15:23 user nova-compute[72586]:     <graphics supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='type'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>sdl</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>vnc</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>spice</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>egl-headless</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </graphics>
Aug 01 21:15:23 user nova-compute[72586]:     <video supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='modelType'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>vga</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>cirrus</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>vmvga</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>qxl</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtio</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>none</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>bochs</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>ramfb</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </video>
Aug 01 21:15:23 user nova-compute[72586]:     <hostdev supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='mode'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>subsystem</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='startupPolicy'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>default</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>mandatory</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>requisite</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>optional</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='subsysType'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>usb</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>pci</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>scsi</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='capsType'/>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='pciBackend'/>
Aug 01 21:15:23 user nova-compute[72586]:     </hostdev>
Aug 01 21:15:23 user nova-compute[72586]:     <rng supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='model'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtio</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtio-transitional</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtio-non-transitional</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='backendModel'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>random</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>egd</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>builtin</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </rng>
Aug 01 21:15:23 user nova-compute[72586]:     <filesystem supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='driverType'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>path</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>handle</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtiofs</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </filesystem>
Aug 01 21:15:23 user nova-compute[72586]:     <tpm supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='model'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>tpm-tis</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>tpm-crb</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='backendModel'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>passthrough</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>emulator</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </tpm>
Aug 01 21:15:23 user nova-compute[72586]:   </devices>
Aug 01 21:15:23 user nova-compute[72586]:   <features>
Aug 01 21:15:23 user nova-compute[72586]:     <gic supported='no'/>
Aug 01 21:15:23 user nova-compute[72586]:     <vmcoreinfo supported='yes'/>
Aug 01 21:15:23 user nova-compute[72586]:     <genid supported='yes'/>
Aug 01 21:15:23 user nova-compute[72586]:     <backingStoreInput supported='yes'/>
Aug 01 21:15:23 user nova-compute[72586]:     <backup supported='yes'/>
Aug 01 21:15:23 user nova-compute[72586]:     <sev supported='no'/>
Aug 01 21:15:23 user nova-compute[72586]:   </features>
Aug 01 21:15:23 user nova-compute[72586]: </domainCapabilities>
Aug 01 21:15:23 user nova-compute[72586]:  {{(pid=72586) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 01 21:15:23 user nova-compute[72586]: <domainCapabilities>
Aug 01 21:15:23 user nova-compute[72586]:   <path>/usr/bin/qemu-system-i386</path>
Aug 01 21:15:23 user nova-compute[72586]:   <domain>kvm</domain>
Aug 01 21:15:23 user nova-compute[72586]:   <machine>pc-q35-jammy</machine>
Aug 01 21:15:23 user nova-compute[72586]:   <arch>i686</arch>
Aug 01 21:15:23 user nova-compute[72586]:   <vcpu max='288'/>
Aug 01 21:15:23 user nova-compute[72586]:   <iothreads supported='yes'/>
Aug 01 21:15:23 user nova-compute[72586]:   <os supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:     <enum name='firmware'/>
Aug 01 21:15:23 user nova-compute[72586]:     <loader supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 01 21:15:23 user nova-compute[72586]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 01 21:15:23 user nova-compute[72586]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 01 21:15:23 user nova-compute[72586]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 01 21:15:23 user nova-compute[72586]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='type'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>rom</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>pflash</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='readonly'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>yes</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>no</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='secure'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>no</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </loader>
Aug 01 21:15:23 user nova-compute[72586]:   </os>
Aug 01 21:15:23 user nova-compute[72586]:   <cpu>
Aug 01 21:15:23 user nova-compute[72586]:     <mode name='host-passthrough' supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='hostPassthroughMigratable'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>off</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </mode>
Aug 01 21:15:23 user nova-compute[72586]:     <mode name='maximum' supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='maximumMigratable'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>on</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>off</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </mode>
Aug 01 21:15:23 user nova-compute[72586]:     <mode name='host-model' supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <vendor>Intel</vendor>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='ss'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='vmx'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='pcid'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='hypervisor'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='arat'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='tsc_adjust'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='umip'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='md-clear'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='stibp'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='arch-capabilities'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='ssbd'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='ibpb'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='ibrs'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='amd-stibp'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='amd-ssbd'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='disable' name='erms'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='disable' name='xsaveopt'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='disable' name='lm'/>
Aug 01 21:15:23 user nova-compute[72586]:     </mode>
Aug 01 21:15:23 user nova-compute[72586]:     <mode name='custom' supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>qemu64</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>qemu32</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>phenom</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>pentium3</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>pentium2</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>pentium</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>n270</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>kvm64</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>kvm32</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>coreduo</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>core2duo</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>athlon</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Westmere-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Westmere</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Snowridge</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Skylake-Server</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Skylake-Client</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>SandyBridge</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Penryn</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Opteron_G5</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Opteron_G4</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Opteron_G3</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Opteron_G2</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Opteron_G1</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Nehalem-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Nehalem</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>IvyBridge</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Icelake-Server</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Haswell-noTSX</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Haswell-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Haswell</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>EPYC-Rome</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>EPYC-Milan</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>EPYC-IBPB</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>EPYC</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Dhyana</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Cooperlake</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Conroe</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Cascadelake-Server</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Broadwell-noTSX</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Broadwell-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Broadwell</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>486</model>
Aug 01 21:15:23 user nova-compute[72586]:     </mode>
Aug 01 21:15:23 user nova-compute[72586]:   </cpu>
Aug 01 21:15:23 user nova-compute[72586]:   <memoryBacking supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:     <enum name='sourceType'>
Aug 01 21:15:23 user nova-compute[72586]:       <value>file</value>
Aug 01 21:15:23 user nova-compute[72586]:       <value>anonymous</value>
Aug 01 21:15:23 user nova-compute[72586]:       <value>memfd</value>
Aug 01 21:15:23 user nova-compute[72586]:     </enum>
Aug 01 21:15:23 user nova-compute[72586]:   </memoryBacking>
Aug 01 21:15:23 user nova-compute[72586]:   <devices>
Aug 01 21:15:23 user nova-compute[72586]:     <disk supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='diskDevice'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>disk</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>cdrom</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>floppy</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>lun</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='bus'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>fdc</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>scsi</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtio</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>usb</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>sata</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='model'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtio</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtio-transitional</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtio-non-transitional</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </disk>
Aug 01 21:15:23 user nova-compute[72586]:     <graphics supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='type'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>sdl</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>vnc</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>spice</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>egl-headless</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </graphics>
Aug 01 21:15:23 user nova-compute[72586]:     <video supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='modelType'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>vga</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>cirrus</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>vmvga</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>qxl</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtio</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>none</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>bochs</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>ramfb</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </video>
Aug 01 21:15:23 user nova-compute[72586]:     <hostdev supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='mode'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>subsystem</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='startupPolicy'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>default</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>mandatory</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>requisite</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>optional</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='subsysType'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>usb</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>pci</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>scsi</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='capsType'/>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='pciBackend'/>
Aug 01 21:15:23 user nova-compute[72586]:     </hostdev>
Aug 01 21:15:23 user nova-compute[72586]:     <rng supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='model'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtio</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtio-transitional</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtio-non-transitional</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='backendModel'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>random</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>egd</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>builtin</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </rng>
Aug 01 21:15:23 user nova-compute[72586]:     <filesystem supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='driverType'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>path</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>handle</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtiofs</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </filesystem>
Aug 01 21:15:23 user nova-compute[72586]:     <tpm supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='model'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>tpm-tis</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>tpm-crb</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='backendModel'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>passthrough</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>emulator</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </tpm>
Aug 01 21:15:23 user nova-compute[72586]:   </devices>
Aug 01 21:15:23 user nova-compute[72586]:   <features>
Aug 01 21:15:23 user nova-compute[72586]:     <gic supported='no'/>
Aug 01 21:15:23 user nova-compute[72586]:     <vmcoreinfo supported='yes'/>
Aug 01 21:15:23 user nova-compute[72586]:     <genid supported='yes'/>
Aug 01 21:15:23 user nova-compute[72586]:     <backingStoreInput supported='yes'/>
Aug 01 21:15:23 user nova-compute[72586]:     <backup supported='yes'/>
Aug 01 21:15:23 user nova-compute[72586]:     <sev supported='no'/>
Aug 01 21:15:23 user nova-compute[72586]:   </features>
Aug 01 21:15:23 user nova-compute[72586]: </domainCapabilities>
Aug 01 21:15:23 user nova-compute[72586]:  {{(pid=72586) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 01 21:15:23 user nova-compute[72586]: <domainCapabilities>
Aug 01 21:15:23 user nova-compute[72586]:   <path>/usr/bin/qemu-system-i386</path>
Aug 01 21:15:23 user nova-compute[72586]:   <domain>kvm</domain>
Aug 01 21:15:23 user nova-compute[72586]:   <machine>pc-i440fx-jammy</machine>
Aug 01 21:15:23 user nova-compute[72586]:   <arch>i686</arch>
Aug 01 21:15:23 user nova-compute[72586]:   <vcpu max='255'/>
Aug 01 21:15:23 user nova-compute[72586]:   <iothreads supported='yes'/>
Aug 01 21:15:23 user nova-compute[72586]:   <os supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:     <enum name='firmware'/>
Aug 01 21:15:23 user nova-compute[72586]:     <loader supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 01 21:15:23 user nova-compute[72586]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 01 21:15:23 user nova-compute[72586]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 01 21:15:23 user nova-compute[72586]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 01 21:15:23 user nova-compute[72586]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='type'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>rom</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>pflash</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='readonly'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>yes</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>no</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='secure'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>no</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </loader>
Aug 01 21:15:23 user nova-compute[72586]:   </os>
Aug 01 21:15:23 user nova-compute[72586]:   <cpu>
Aug 01 21:15:23 user nova-compute[72586]:     <mode name='host-passthrough' supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='hostPassthroughMigratable'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>off</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </mode>
Aug 01 21:15:23 user nova-compute[72586]:     <mode name='maximum' supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='maximumMigratable'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>on</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>off</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </mode>
Aug 01 21:15:23 user nova-compute[72586]:     <mode name='host-model' supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <vendor>Intel</vendor>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='ss'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='vmx'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='pcid'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='hypervisor'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='arat'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='tsc_adjust'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='umip'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='md-clear'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='stibp'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='arch-capabilities'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='ssbd'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='ibpb'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='ibrs'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='amd-stibp'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='amd-ssbd'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='disable' name='erms'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='disable' name='xsaveopt'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='disable' name='lm'/>
Aug 01 21:15:23 user nova-compute[72586]:     </mode>
Aug 01 21:15:23 user nova-compute[72586]:     <mode name='custom' supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>qemu64</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>qemu32</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>phenom</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>pentium3</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>pentium2</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>pentium</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>n270</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>kvm64</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>kvm32</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>coreduo</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>core2duo</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>athlon</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Westmere-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Westmere</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Snowridge</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Skylake-Server</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Skylake-Client</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>SandyBridge</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Penryn</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Opteron_G5</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Opteron_G4</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Opteron_G3</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Opteron_G2</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Opteron_G1</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Nehalem-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Nehalem</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>IvyBridge</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Icelake-Server</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Haswell-noTSX</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Haswell-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Haswell</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>EPYC-Rome</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>EPYC-Milan</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>EPYC-IBPB</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>EPYC</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Dhyana</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Cooperlake</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Conroe</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Cascadelake-Server</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Broadwell-noTSX</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Broadwell-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Broadwell</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>486</model>
Aug 01 21:15:23 user nova-compute[72586]:     </mode>
Aug 01 21:15:23 user nova-compute[72586]:   </cpu>
Aug 01 21:15:23 user nova-compute[72586]:   <memoryBacking supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:     <enum name='sourceType'>
Aug 01 21:15:23 user nova-compute[72586]:       <value>file</value>
Aug 01 21:15:23 user nova-compute[72586]:       <value>anonymous</value>
Aug 01 21:15:23 user nova-compute[72586]:       <value>memfd</value>
Aug 01 21:15:23 user nova-compute[72586]:     </enum>
Aug 01 21:15:23 user nova-compute[72586]:   </memoryBacking>
Aug 01 21:15:23 user nova-compute[72586]:   <devices>
Aug 01 21:15:23 user nova-compute[72586]:     <disk supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='diskDevice'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>disk</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>cdrom</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>floppy</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>lun</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='bus'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>ide</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>fdc</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>scsi</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtio</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>usb</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>sata</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='model'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtio</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtio-transitional</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtio-non-transitional</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </disk>
Aug 01 21:15:23 user nova-compute[72586]:     <graphics supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='type'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>sdl</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>vnc</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>spice</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>egl-headless</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </graphics>
Aug 01 21:15:23 user nova-compute[72586]:     <video supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='modelType'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>vga</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>cirrus</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>vmvga</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>qxl</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtio</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>none</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>bochs</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>ramfb</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </video>
Aug 01 21:15:23 user nova-compute[72586]:     <hostdev supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='mode'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>subsystem</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='startupPolicy'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>default</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>mandatory</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>requisite</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>optional</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='subsysType'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>usb</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>pci</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>scsi</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='capsType'/>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='pciBackend'/>
Aug 01 21:15:23 user nova-compute[72586]:     </hostdev>
Aug 01 21:15:23 user nova-compute[72586]:     <rng supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='model'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtio</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtio-transitional</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtio-non-transitional</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='backendModel'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>random</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>egd</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>builtin</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </rng>
Aug 01 21:15:23 user nova-compute[72586]:     <filesystem supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='driverType'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>path</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>handle</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtiofs</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </filesystem>
Aug 01 21:15:23 user nova-compute[72586]:     <tpm supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='model'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>tpm-tis</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>tpm-crb</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='backendModel'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>passthrough</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>emulator</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </tpm>
Aug 01 21:15:23 user nova-compute[72586]:   </devices>
Aug 01 21:15:23 user nova-compute[72586]:   <features>
Aug 01 21:15:23 user nova-compute[72586]:     <gic supported='no'/>
Aug 01 21:15:23 user nova-compute[72586]:     <vmcoreinfo supported='yes'/>
Aug 01 21:15:23 user nova-compute[72586]:     <genid supported='yes'/>
Aug 01 21:15:23 user nova-compute[72586]:     <backingStoreInput supported='yes'/>
Aug 01 21:15:23 user nova-compute[72586]:     <backup supported='yes'/>
Aug 01 21:15:23 user nova-compute[72586]:     <sev supported='no'/>
Aug 01 21:15:23 user nova-compute[72586]:   </features>
Aug 01 21:15:23 user nova-compute[72586]: </domainCapabilities>
Aug 01 21:15:23 user nova-compute[72586]:  {{(pid=72586) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=72586) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72586) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72586) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=72586) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=72586) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=72586) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=72586) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=72586) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=72586) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=72586) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=72586) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=72586) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=72586) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=72586) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=72586) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=72586) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=72586) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=72586) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72586) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72586) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72586) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=72586) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72586) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72586) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=72586) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=72586) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=72586) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=72586) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=72586) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=72586) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=72586) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=72586) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=72586) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=72586) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=72586) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=72586) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=72586) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=72586) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'q35', 'ubuntu-q35', 'ubuntu'} {{(pid=72586) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 01 21:15:23 user nova-compute[72586]: <domainCapabilities>
Aug 01 21:15:23 user nova-compute[72586]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 01 21:15:23 user nova-compute[72586]:   <domain>kvm</domain>
Aug 01 21:15:23 user nova-compute[72586]:   <machine>pc-i440fx-6.2</machine>
Aug 01 21:15:23 user nova-compute[72586]:   <arch>x86_64</arch>
Aug 01 21:15:23 user nova-compute[72586]:   <vcpu max='255'/>
Aug 01 21:15:23 user nova-compute[72586]:   <iothreads supported='yes'/>
Aug 01 21:15:23 user nova-compute[72586]:   <os supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:     <enum name='firmware'>
Aug 01 21:15:23 user nova-compute[72586]:       <value>efi</value>
Aug 01 21:15:23 user nova-compute[72586]:     </enum>
Aug 01 21:15:23 user nova-compute[72586]:     <loader supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='type'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>rom</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>pflash</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='readonly'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>yes</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>no</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='secure'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>no</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </loader>
Aug 01 21:15:23 user nova-compute[72586]:   </os>
Aug 01 21:15:23 user nova-compute[72586]:   <cpu>
Aug 01 21:15:23 user nova-compute[72586]:     <mode name='host-passthrough' supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='hostPassthroughMigratable'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>on</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>off</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </mode>
Aug 01 21:15:23 user nova-compute[72586]:     <mode name='maximum' supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='maximumMigratable'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>on</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>off</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </mode>
Aug 01 21:15:23 user nova-compute[72586]:     <mode name='host-model' supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <vendor>Intel</vendor>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='ss'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='vmx'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='pcid'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='hypervisor'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='arat'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='tsc_adjust'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='umip'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='md-clear'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='stibp'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='arch-capabilities'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='ssbd'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='invtsc'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='ibpb'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='ibrs'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='amd-stibp'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='amd-ssbd'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='rsba'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='pschange-mc-no'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='disable' name='erms'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='disable' name='xsaveopt'/>
Aug 01 21:15:23 user nova-compute[72586]:     </mode>
Aug 01 21:15:23 user nova-compute[72586]:     <mode name='custom' supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>qemu64</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>qemu32</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>phenom</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>pentium3</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>pentium2</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>pentium</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>n270</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>kvm64</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>kvm32</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>coreduo</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>core2duo</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>athlon</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>Westmere-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>Westmere</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Snowridge</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Skylake-Server</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Skylake-Client</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>SandyBridge</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>Penryn</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Opteron_G5</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Opteron_G4</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Opteron_G3</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Opteron_G2</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>Opteron_G1</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>Nehalem</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>IvyBridge</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Icelake-Server</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Haswell-noTSX</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Haswell-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Haswell</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>EPYC-Rome</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>EPYC-Milan</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>EPYC-IBPB</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>EPYC</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Dhyana</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Cooperlake</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>Conroe</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Cascadelake-Server</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Broadwell-noTSX</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Broadwell-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Broadwell</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>486</model>
Aug 01 21:15:23 user nova-compute[72586]:     </mode>
Aug 01 21:15:23 user nova-compute[72586]:   </cpu>
Aug 01 21:15:23 user nova-compute[72586]:   <memoryBacking supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:     <enum name='sourceType'>
Aug 01 21:15:23 user nova-compute[72586]:       <value>file</value>
Aug 01 21:15:23 user nova-compute[72586]:       <value>anonymous</value>
Aug 01 21:15:23 user nova-compute[72586]:       <value>memfd</value>
Aug 01 21:15:23 user nova-compute[72586]:     </enum>
Aug 01 21:15:23 user nova-compute[72586]:   </memoryBacking>
Aug 01 21:15:23 user nova-compute[72586]:   <devices>
Aug 01 21:15:23 user nova-compute[72586]:     <disk supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='diskDevice'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>disk</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>cdrom</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>floppy</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>lun</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='bus'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>ide</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>fdc</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>scsi</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtio</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>usb</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>sata</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='model'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtio</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtio-transitional</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtio-non-transitional</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </disk>
Aug 01 21:15:23 user nova-compute[72586]:     <graphics supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='type'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>sdl</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>vnc</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>spice</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>egl-headless</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </graphics>
Aug 01 21:15:23 user nova-compute[72586]:     <video supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='modelType'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>vga</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>cirrus</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>vmvga</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>qxl</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtio</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>none</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>bochs</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>ramfb</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </video>
Aug 01 21:15:23 user nova-compute[72586]:     <hostdev supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='mode'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>subsystem</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='startupPolicy'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>default</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>mandatory</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>requisite</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>optional</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='subsysType'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>usb</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>pci</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>scsi</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='capsType'/>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='pciBackend'/>
Aug 01 21:15:23 user nova-compute[72586]:     </hostdev>
Aug 01 21:15:23 user nova-compute[72586]:     <rng supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='model'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtio</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtio-transitional</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtio-non-transitional</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='backendModel'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>random</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>egd</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>builtin</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </rng>
Aug 01 21:15:23 user nova-compute[72586]:     <filesystem supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='driverType'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>path</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>handle</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtiofs</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </filesystem>
Aug 01 21:15:23 user nova-compute[72586]:     <tpm supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='model'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>tpm-tis</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>tpm-crb</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='backendModel'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>passthrough</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>emulator</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </tpm>
Aug 01 21:15:23 user nova-compute[72586]:   </devices>
Aug 01 21:15:23 user nova-compute[72586]:   <features>
Aug 01 21:15:23 user nova-compute[72586]:     <gic supported='no'/>
Aug 01 21:15:23 user nova-compute[72586]:     <vmcoreinfo supported='yes'/>
Aug 01 21:15:23 user nova-compute[72586]:     <genid supported='yes'/>
Aug 01 21:15:23 user nova-compute[72586]:     <backingStoreInput supported='yes'/>
Aug 01 21:15:23 user nova-compute[72586]:     <backup supported='yes'/>
Aug 01 21:15:23 user nova-compute[72586]:     <sev supported='no'/>
Aug 01 21:15:23 user nova-compute[72586]:   </features>
Aug 01 21:15:23 user nova-compute[72586]: </domainCapabilities>
Aug 01 21:15:23 user nova-compute[72586]:  {{(pid=72586) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 01 21:15:23 user nova-compute[72586]: <domainCapabilities>
Aug 01 21:15:23 user nova-compute[72586]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 01 21:15:23 user nova-compute[72586]:   <domain>kvm</domain>
Aug 01 21:15:23 user nova-compute[72586]:   <machine>pc-q35-6.2</machine>
Aug 01 21:15:23 user nova-compute[72586]:   <arch>x86_64</arch>
Aug 01 21:15:23 user nova-compute[72586]:   <vcpu max='288'/>
Aug 01 21:15:23 user nova-compute[72586]:   <iothreads supported='yes'/>
Aug 01 21:15:23 user nova-compute[72586]:   <os supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:     <enum name='firmware'>
Aug 01 21:15:23 user nova-compute[72586]:       <value>efi</value>
Aug 01 21:15:23 user nova-compute[72586]:     </enum>
Aug 01 21:15:23 user nova-compute[72586]:     <loader supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 01 21:15:23 user nova-compute[72586]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 01 21:15:23 user nova-compute[72586]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='type'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>rom</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>pflash</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='readonly'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>yes</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>no</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='secure'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>yes</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>no</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </loader>
Aug 01 21:15:23 user nova-compute[72586]:   </os>
Aug 01 21:15:23 user nova-compute[72586]:   <cpu>
Aug 01 21:15:23 user nova-compute[72586]:     <mode name='host-passthrough' supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='hostPassthroughMigratable'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>on</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>off</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </mode>
Aug 01 21:15:23 user nova-compute[72586]:     <mode name='maximum' supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='maximumMigratable'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>on</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>off</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </mode>
Aug 01 21:15:23 user nova-compute[72586]:     <mode name='host-model' supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <vendor>Intel</vendor>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='ss'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='vmx'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='pcid'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='hypervisor'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='arat'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='tsc_adjust'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='umip'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='md-clear'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='stibp'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='arch-capabilities'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='ssbd'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='invtsc'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='ibpb'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='ibrs'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='amd-stibp'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='amd-ssbd'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='rsba'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='pschange-mc-no'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='disable' name='erms'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='disable' name='xsaveopt'/>
Aug 01 21:15:23 user nova-compute[72586]:     </mode>
Aug 01 21:15:23 user nova-compute[72586]:     <mode name='custom' supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>qemu64</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>qemu32</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>phenom</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>pentium3</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>pentium2</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>pentium</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>n270</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>kvm64</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>kvm32</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>coreduo</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>core2duo</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>athlon</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>Westmere-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>Westmere</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Snowridge</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Skylake-Server</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Skylake-Client</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>SandyBridge</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>Penryn</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Opteron_G5</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Opteron_G4</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Opteron_G3</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Opteron_G2</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>Opteron_G1</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>Nehalem</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>IvyBridge</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Icelake-Server</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Haswell-noTSX</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Haswell-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Haswell</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>EPYC-Rome</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>EPYC-Milan</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>EPYC-IBPB</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>EPYC</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Dhyana</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Cooperlake</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>Conroe</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Cascadelake-Server</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Broadwell-noTSX</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Broadwell-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Broadwell</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>486</model>
Aug 01 21:15:23 user nova-compute[72586]:     </mode>
Aug 01 21:15:23 user nova-compute[72586]:   </cpu>
Aug 01 21:15:23 user nova-compute[72586]:   <memoryBacking supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:     <enum name='sourceType'>
Aug 01 21:15:23 user nova-compute[72586]:       <value>file</value>
Aug 01 21:15:23 user nova-compute[72586]:       <value>anonymous</value>
Aug 01 21:15:23 user nova-compute[72586]:       <value>memfd</value>
Aug 01 21:15:23 user nova-compute[72586]:     </enum>
Aug 01 21:15:23 user nova-compute[72586]:   </memoryBacking>
Aug 01 21:15:23 user nova-compute[72586]:   <devices>
Aug 01 21:15:23 user nova-compute[72586]:     <disk supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='diskDevice'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>disk</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>cdrom</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>floppy</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>lun</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='bus'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>fdc</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>scsi</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtio</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>usb</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>sata</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='model'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtio</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtio-transitional</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtio-non-transitional</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </disk>
Aug 01 21:15:23 user nova-compute[72586]:     <graphics supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='type'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>sdl</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>vnc</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>spice</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>egl-headless</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </graphics>
Aug 01 21:15:23 user nova-compute[72586]:     <video supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='modelType'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>vga</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>cirrus</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>vmvga</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>qxl</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtio</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>none</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>bochs</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>ramfb</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </video>
Aug 01 21:15:23 user nova-compute[72586]:     <hostdev supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='mode'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>subsystem</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='startupPolicy'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>default</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>mandatory</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>requisite</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>optional</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='subsysType'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>usb</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>pci</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>scsi</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='capsType'/>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='pciBackend'/>
Aug 01 21:15:23 user nova-compute[72586]:     </hostdev>
Aug 01 21:15:23 user nova-compute[72586]:     <rng supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='model'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtio</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtio-transitional</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtio-non-transitional</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='backendModel'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>random</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>egd</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>builtin</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </rng>
Aug 01 21:15:23 user nova-compute[72586]:     <filesystem supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='driverType'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>path</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>handle</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtiofs</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </filesystem>
Aug 01 21:15:23 user nova-compute[72586]:     <tpm supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='model'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>tpm-tis</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>tpm-crb</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='backendModel'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>passthrough</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>emulator</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </tpm>
Aug 01 21:15:23 user nova-compute[72586]:   </devices>
Aug 01 21:15:23 user nova-compute[72586]:   <features>
Aug 01 21:15:23 user nova-compute[72586]:     <gic supported='no'/>
Aug 01 21:15:23 user nova-compute[72586]:     <vmcoreinfo supported='yes'/>
Aug 01 21:15:23 user nova-compute[72586]:     <genid supported='yes'/>
Aug 01 21:15:23 user nova-compute[72586]:     <backingStoreInput supported='yes'/>
Aug 01 21:15:23 user nova-compute[72586]:     <backup supported='yes'/>
Aug 01 21:15:23 user nova-compute[72586]:     <sev supported='no'/>
Aug 01 21:15:23 user nova-compute[72586]:   </features>
Aug 01 21:15:23 user nova-compute[72586]: </domainCapabilities>
Aug 01 21:15:23 user nova-compute[72586]:  {{(pid=72586) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 01 21:15:23 user nova-compute[72586]: <domainCapabilities>
Aug 01 21:15:23 user nova-compute[72586]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 01 21:15:23 user nova-compute[72586]:   <domain>kvm</domain>
Aug 01 21:15:23 user nova-compute[72586]:   <machine>pc-q35-jammy</machine>
Aug 01 21:15:23 user nova-compute[72586]:   <arch>x86_64</arch>
Aug 01 21:15:23 user nova-compute[72586]:   <vcpu max='288'/>
Aug 01 21:15:23 user nova-compute[72586]:   <iothreads supported='yes'/>
Aug 01 21:15:23 user nova-compute[72586]:   <os supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:     <enum name='firmware'>
Aug 01 21:15:23 user nova-compute[72586]:       <value>efi</value>
Aug 01 21:15:23 user nova-compute[72586]:     </enum>
Aug 01 21:15:23 user nova-compute[72586]:     <loader supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 01 21:15:23 user nova-compute[72586]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 01 21:15:23 user nova-compute[72586]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='type'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>rom</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>pflash</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='readonly'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>yes</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>no</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='secure'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>yes</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>no</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </loader>
Aug 01 21:15:23 user nova-compute[72586]:   </os>
Aug 01 21:15:23 user nova-compute[72586]:   <cpu>
Aug 01 21:15:23 user nova-compute[72586]:     <mode name='host-passthrough' supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='hostPassthroughMigratable'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>on</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>off</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </mode>
Aug 01 21:15:23 user nova-compute[72586]:     <mode name='maximum' supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='maximumMigratable'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>on</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>off</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </mode>
Aug 01 21:15:23 user nova-compute[72586]:     <mode name='host-model' supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <vendor>Intel</vendor>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='ss'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='vmx'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='pcid'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='hypervisor'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='arat'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='tsc_adjust'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='umip'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='md-clear'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='stibp'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='arch-capabilities'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='ssbd'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='invtsc'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='ibpb'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='ibrs'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='amd-stibp'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='amd-ssbd'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='rsba'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='pschange-mc-no'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='disable' name='erms'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='disable' name='xsaveopt'/>
Aug 01 21:15:23 user nova-compute[72586]:     </mode>
Aug 01 21:15:23 user nova-compute[72586]:     <mode name='custom' supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>qemu64</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>qemu32</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>phenom</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>pentium3</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>pentium2</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>pentium</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>n270</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>kvm64</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>kvm32</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>coreduo</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>core2duo</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>athlon</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>Westmere-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>Westmere</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Snowridge</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Skylake-Server</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Skylake-Client</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>SandyBridge</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>Penryn</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Opteron_G5</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Opteron_G4</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Opteron_G3</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Opteron_G2</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>Opteron_G1</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>Nehalem</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>IvyBridge</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Icelake-Server</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Haswell-noTSX</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Haswell-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Haswell</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>EPYC-Rome</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>EPYC-Milan</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>EPYC-IBPB</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>EPYC</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Dhyana</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Cooperlake</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>Conroe</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Cascadelake-Server</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Broadwell-noTSX</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Broadwell-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Broadwell</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>486</model>
Aug 01 21:15:23 user nova-compute[72586]:     </mode>
Aug 01 21:15:23 user nova-compute[72586]:   </cpu>
Aug 01 21:15:23 user nova-compute[72586]:   <memoryBacking supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:     <enum name='sourceType'>
Aug 01 21:15:23 user nova-compute[72586]:       <value>file</value>
Aug 01 21:15:23 user nova-compute[72586]:       <value>anonymous</value>
Aug 01 21:15:23 user nova-compute[72586]:       <value>memfd</value>
Aug 01 21:15:23 user nova-compute[72586]:     </enum>
Aug 01 21:15:23 user nova-compute[72586]:   </memoryBacking>
Aug 01 21:15:23 user nova-compute[72586]:   <devices>
Aug 01 21:15:23 user nova-compute[72586]:     <disk supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='diskDevice'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>disk</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>cdrom</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>floppy</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>lun</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='bus'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>fdc</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>scsi</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtio</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>usb</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>sata</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='model'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtio</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtio-transitional</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtio-non-transitional</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </disk>
Aug 01 21:15:23 user nova-compute[72586]:     <graphics supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='type'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>sdl</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>vnc</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>spice</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>egl-headless</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </graphics>
Aug 01 21:15:23 user nova-compute[72586]:     <video supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='modelType'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>vga</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>cirrus</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>vmvga</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>qxl</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtio</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>none</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>bochs</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>ramfb</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </video>
Aug 01 21:15:23 user nova-compute[72586]:     <hostdev supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='mode'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>subsystem</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='startupPolicy'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>default</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>mandatory</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>requisite</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>optional</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='subsysType'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>usb</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>pci</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>scsi</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='capsType'/>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='pciBackend'/>
Aug 01 21:15:23 user nova-compute[72586]:     </hostdev>
Aug 01 21:15:23 user nova-compute[72586]:     <rng supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='model'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtio</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtio-transitional</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtio-non-transitional</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='backendModel'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>random</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>egd</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>builtin</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </rng>
Aug 01 21:15:23 user nova-compute[72586]:     <filesystem supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='driverType'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>path</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>handle</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtiofs</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </filesystem>
Aug 01 21:15:23 user nova-compute[72586]:     <tpm supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='model'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>tpm-tis</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>tpm-crb</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='backendModel'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>passthrough</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>emulator</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </tpm>
Aug 01 21:15:23 user nova-compute[72586]:   </devices>
Aug 01 21:15:23 user nova-compute[72586]:   <features>
Aug 01 21:15:23 user nova-compute[72586]:     <gic supported='no'/>
Aug 01 21:15:23 user nova-compute[72586]:     <vmcoreinfo supported='yes'/>
Aug 01 21:15:23 user nova-compute[72586]:     <genid supported='yes'/>
Aug 01 21:15:23 user nova-compute[72586]:     <backingStoreInput supported='yes'/>
Aug 01 21:15:23 user nova-compute[72586]:     <backup supported='yes'/>
Aug 01 21:15:23 user nova-compute[72586]:     <sev supported='no'/>
Aug 01 21:15:23 user nova-compute[72586]:   </features>
Aug 01 21:15:23 user nova-compute[72586]: </domainCapabilities>
Aug 01 21:15:23 user nova-compute[72586]:  {{(pid=72586) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 01 21:15:23 user nova-compute[72586]: <domainCapabilities>
Aug 01 21:15:23 user nova-compute[72586]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 01 21:15:23 user nova-compute[72586]:   <domain>kvm</domain>
Aug 01 21:15:23 user nova-compute[72586]:   <machine>pc-i440fx-jammy</machine>
Aug 01 21:15:23 user nova-compute[72586]:   <arch>x86_64</arch>
Aug 01 21:15:23 user nova-compute[72586]:   <vcpu max='255'/>
Aug 01 21:15:23 user nova-compute[72586]:   <iothreads supported='yes'/>
Aug 01 21:15:23 user nova-compute[72586]:   <os supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:     <enum name='firmware'>
Aug 01 21:15:23 user nova-compute[72586]:       <value>efi</value>
Aug 01 21:15:23 user nova-compute[72586]:     </enum>
Aug 01 21:15:23 user nova-compute[72586]:     <loader supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='type'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>rom</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>pflash</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='readonly'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>yes</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>no</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='secure'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>no</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </loader>
Aug 01 21:15:23 user nova-compute[72586]:   </os>
Aug 01 21:15:23 user nova-compute[72586]:   <cpu>
Aug 01 21:15:23 user nova-compute[72586]:     <mode name='host-passthrough' supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='hostPassthroughMigratable'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>on</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>off</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </mode>
Aug 01 21:15:23 user nova-compute[72586]:     <mode name='maximum' supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='maximumMigratable'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>on</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>off</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </mode>
Aug 01 21:15:23 user nova-compute[72586]:     <mode name='host-model' supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <vendor>Intel</vendor>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='ss'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='vmx'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='pcid'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='hypervisor'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='arat'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='tsc_adjust'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='umip'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='md-clear'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='stibp'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='arch-capabilities'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='ssbd'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='invtsc'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='ibpb'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='ibrs'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='amd-stibp'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='amd-ssbd'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='rsba'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='require' name='pschange-mc-no'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='disable' name='erms'/>
Aug 01 21:15:23 user nova-compute[72586]:       <feature policy='disable' name='xsaveopt'/>
Aug 01 21:15:23 user nova-compute[72586]:     </mode>
Aug 01 21:15:23 user nova-compute[72586]:     <mode name='custom' supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>qemu64</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>qemu32</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>phenom</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>pentium3</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>pentium2</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>pentium</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>n270</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>kvm64</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>kvm32</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>coreduo</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>core2duo</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>athlon</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>Westmere-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>Westmere</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Snowridge</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Skylake-Server</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Skylake-Client</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>SandyBridge</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>Penryn</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Opteron_G5</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Opteron_G4</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Opteron_G3</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Opteron_G2</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>Opteron_G1</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>Nehalem</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>IvyBridge</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Icelake-Server</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Haswell-noTSX</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Haswell-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Haswell</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>EPYC-Rome</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>EPYC-Milan</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>EPYC-IBPB</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>EPYC</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Dhyana</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Cooperlake</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>Conroe</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Cascadelake-Server</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Broadwell-noTSX</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Broadwell-IBRS</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='no'>Broadwell</model>
Aug 01 21:15:23 user nova-compute[72586]:       <model usable='yes'>486</model>
Aug 01 21:15:23 user nova-compute[72586]:     </mode>
Aug 01 21:15:23 user nova-compute[72586]:   </cpu>
Aug 01 21:15:23 user nova-compute[72586]:   <memoryBacking supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:     <enum name='sourceType'>
Aug 01 21:15:23 user nova-compute[72586]:       <value>file</value>
Aug 01 21:15:23 user nova-compute[72586]:       <value>anonymous</value>
Aug 01 21:15:23 user nova-compute[72586]:       <value>memfd</value>
Aug 01 21:15:23 user nova-compute[72586]:     </enum>
Aug 01 21:15:23 user nova-compute[72586]:   </memoryBacking>
Aug 01 21:15:23 user nova-compute[72586]:   <devices>
Aug 01 21:15:23 user nova-compute[72586]:     <disk supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='diskDevice'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>disk</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>cdrom</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>floppy</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>lun</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='bus'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>ide</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>fdc</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>scsi</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtio</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>usb</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>sata</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='model'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtio</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtio-transitional</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtio-non-transitional</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </disk>
Aug 01 21:15:23 user nova-compute[72586]:     <graphics supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='type'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>sdl</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>vnc</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>spice</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>egl-headless</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </graphics>
Aug 01 21:15:23 user nova-compute[72586]:     <video supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='modelType'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>vga</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>cirrus</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>vmvga</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>qxl</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtio</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>none</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>bochs</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>ramfb</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </video>
Aug 01 21:15:23 user nova-compute[72586]:     <hostdev supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='mode'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>subsystem</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='startupPolicy'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>default</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>mandatory</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>requisite</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>optional</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='subsysType'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>usb</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>pci</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>scsi</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='capsType'/>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='pciBackend'/>
Aug 01 21:15:23 user nova-compute[72586]:     </hostdev>
Aug 01 21:15:23 user nova-compute[72586]:     <rng supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='model'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtio</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtio-transitional</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtio-non-transitional</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='backendModel'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>random</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>egd</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>builtin</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </rng>
Aug 01 21:15:23 user nova-compute[72586]:     <filesystem supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='driverType'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>path</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>handle</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>virtiofs</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </filesystem>
Aug 01 21:15:23 user nova-compute[72586]:     <tpm supported='yes'>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='model'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>tpm-tis</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>tpm-crb</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:       <enum name='backendModel'>
Aug 01 21:15:23 user nova-compute[72586]:         <value>passthrough</value>
Aug 01 21:15:23 user nova-compute[72586]:         <value>emulator</value>
Aug 01 21:15:23 user nova-compute[72586]:       </enum>
Aug 01 21:15:23 user nova-compute[72586]:     </tpm>
Aug 01 21:15:23 user nova-compute[72586]:   </devices>
Aug 01 21:15:23 user nova-compute[72586]:   <features>
Aug 01 21:15:23 user nova-compute[72586]:     <gic supported='no'/>
Aug 01 21:15:23 user nova-compute[72586]:     <vmcoreinfo supported='yes'/>
Aug 01 21:15:23 user nova-compute[72586]:     <genid supported='yes'/>
Aug 01 21:15:23 user nova-compute[72586]:     <backingStoreInput supported='yes'/>
Aug 01 21:15:23 user nova-compute[72586]:     <backup supported='yes'/>
Aug 01 21:15:23 user nova-compute[72586]:     <sev supported='no'/>
Aug 01 21:15:23 user nova-compute[72586]:   </features>
Aug 01 21:15:23 user nova-compute[72586]: </domainCapabilities>
Aug 01 21:15:23 user nova-compute[72586]:  {{(pid=72586) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=72586) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=72586) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=72586) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=72586) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Checking secure boot support for host arch (x86_64) {{(pid=72586) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Checking secure boot support for host arch (x86_64) {{(pid=72586) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Checking secure boot support for host arch (x86_64) {{(pid=72586) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 01 21:15:23 user nova-compute[72586]: INFO nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Secure Boot support detected
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] cpu compare xml: <cpu match="exact">
Aug 01 21:15:23 user nova-compute[72586]:   <model>Nehalem</model>
Aug 01 21:15:23 user nova-compute[72586]: </cpu>
Aug 01 21:15:23 user nova-compute[72586]:  {{(pid=72586) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 01 21:15:23 user nova-compute[72586]: INFO nova.virt.node [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Generated node identity ca6775c1-2a64-43f9-9467-372aa0457b1d
Aug 01 21:15:23 user nova-compute[72586]: INFO nova.virt.node [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Wrote node identity ca6775c1-2a64-43f9-9467-372aa0457b1d to /opt/stack/data/nova/compute_id
Aug 01 21:15:23 user nova-compute[72586]: WARNING nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Compute nodes ['ca6775c1-2a64-43f9-9467-372aa0457b1d'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 01 21:15:23 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 01 21:15:23 user nova-compute[72586]: WARNING nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 01 21:15:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Auditing locally available compute resources for user (node: user) {{(pid=72586) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 21:15:23 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:15:23 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Hypervisor/Node resource view: name=user free_ram=10833MB free_disk=26.313228607177734GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72586) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:15:23 user nova-compute[72586]: WARNING nova.compute.resource_tracker [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] No compute node record for user:ca6775c1-2a64-43f9-9467-372aa0457b1d: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host ca6775c1-2a64-43f9-9467-372aa0457b1d could not be found.
Aug 01 21:15:23 user nova-compute[72586]: INFO nova.compute.resource_tracker [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Compute node record created for user:user with uuid: ca6775c1-2a64-43f9-9467-372aa0457b1d
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 21:15:23 user nova-compute[72586]: INFO nova.scheduler.client.report [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [req-cb64400a-1994-4cd8-b8e9-9fb11bc2f9f6] Created resource provider record via placement API for resource provider with UUID ca6775c1-2a64-43f9-9467-372aa0457b1d and name user.
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=72586) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 01 21:15:23 user nova-compute[72586]: INFO nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] kernel doesn't support AMD SEV
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Updating inventory in ProviderTree for provider ca6775c1-2a64-43f9-9467-372aa0457b1d with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:15:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Libvirt baseline CPU <cpu>
Aug 01 21:15:23 user nova-compute[72586]:   <arch>x86_64</arch>
Aug 01 21:15:23 user nova-compute[72586]:   <model>Nehalem</model>
Aug 01 21:15:23 user nova-compute[72586]:   <vendor>Intel</vendor>
Aug 01 21:15:23 user nova-compute[72586]:   <topology sockets="6" cores="1" threads="1"/>
Aug 01 21:15:23 user nova-compute[72586]: </cpu>
Aug 01 21:15:23 user nova-compute[72586]:  {{(pid=72586) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 01 21:15:24 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Updated inventory for provider ca6775c1-2a64-43f9-9467-372aa0457b1d with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 01 21:15:24 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Updating resource provider ca6775c1-2a64-43f9-9467-372aa0457b1d generation from 0 to 1 during operation: update_inventory {{(pid=72586) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 01 21:15:24 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Updating inventory in ProviderTree for provider ca6775c1-2a64-43f9-9467-372aa0457b1d with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 21:15:24 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Updating resource provider ca6775c1-2a64-43f9-9467-372aa0457b1d generation from 1 to 2 during operation: update_traits {{(pid=72586) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 01 21:15:24 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Compute_service record updated for user:user {{(pid=72586) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 21:15:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.608s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:15:24 user nova-compute[72586]: DEBUG nova.service [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Creating RPC server for service compute {{(pid=72586) start /opt/stack/nova/nova/service.py:182}}
Aug 01 21:15:24 user nova-compute[72586]: DEBUG nova.service [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Join ServiceGroup membership for this service compute {{(pid=72586) start /opt/stack/nova/nova/service.py:199}}
Aug 01 21:15:24 user nova-compute[72586]: DEBUG nova.servicegroup.drivers.db [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=72586) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 01 21:15:29 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._sync_power_states {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:15:29 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:16:14 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:16:14 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:16:14 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Starting heal instance info cache {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 21:16:14 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Rebuilding the list of instances to heal {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 21:16:14 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Didn't find any instances for network info cache update. {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 21:16:14 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:16:14 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:16:14 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:16:14 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:16:14 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:16:14 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:16:14 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72586) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 21:16:14 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:16:14 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:16:14 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:16:14 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:16:14 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Auditing locally available compute resources for user (node: user) {{(pid=72586) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 21:16:15 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:16:15 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:16:15 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Hypervisor/Node resource view: name=user free_ram=10239MB free_disk=26.216907501220703GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72586) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 21:16:15 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:16:15 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:16:15 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 21:16:15 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 21:16:15 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:16:15 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:16:15 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Compute_service record updated for user:user {{(pid=72586) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 21:16:15 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.156s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:17:15 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:17:15 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:17:15 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:17:15 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:17:15 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:17:15 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:17:15 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:17:15 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Auditing locally available compute resources for user (node: user) {{(pid=72586) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 21:17:15 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:17:15 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:17:15 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Hypervisor/Node resource view: name=user free_ram=10193MB free_disk=26.26221466064453GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72586) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 21:17:15 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:17:15 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:17:15 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 21:17:15 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 21:17:15 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:17:15 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:17:15 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Compute_service record updated for user:user {{(pid=72586) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 21:17:15 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.141s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:17:16 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:17:16 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Starting heal instance info cache {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 21:17:16 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Rebuilding the list of instances to heal {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 21:17:16 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Didn't find any instances for network info cache update. {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 21:17:16 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:17:16 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:17:16 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:17:16 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:17:16 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:17:16 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72586) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 21:18:14 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:18:14 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:18:15 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:18:15 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Starting heal instance info cache {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 21:18:15 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Rebuilding the list of instances to heal {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 21:18:15 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Didn't find any instances for network info cache update. {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 21:18:16 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:18:16 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:18:16 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:18:16 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:18:16 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:18:16 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Auditing locally available compute resources for user (node: user) {{(pid=72586) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 21:18:17 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:18:17 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:18:17 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Hypervisor/Node resource view: name=user free_ram=10216MB free_disk=26.036033630371094GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72586) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 21:18:17 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:18:17 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:18:17 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 21:18:17 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 21:18:17 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:18:17 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:18:17 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Compute_service record updated for user:user {{(pid=72586) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 21:18:17 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.137s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:18:18 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:18:18 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:18:18 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:18:18 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72586) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 21:18:18 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:19:14 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:19:15 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:19:16 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:19:17 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:19:17 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Starting heal instance info cache {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 21:19:17 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Rebuilding the list of instances to heal {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 21:19:17 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Didn't find any instances for network info cache update. {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 21:19:17 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:19:17 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:19:17 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:19:17 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:19:17 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Auditing locally available compute resources for user (node: user) {{(pid=72586) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 21:19:18 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:19:18 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:19:18 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Hypervisor/Node resource view: name=user free_ram=9464MB free_disk=26.067020416259766GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72586) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 21:19:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:19:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:19:18 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 21:19:18 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 21:19:18 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:19:18 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:19:18 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Compute_service record updated for user:user {{(pid=72586) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 21:19:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.166s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:19:19 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:19:19 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:19:19 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72586) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 21:19:19 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:19:19 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:19:19 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:19:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Acquiring lock "042f0031-1e4d-41d0-8bfa-36001675cfe3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:19:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "042f0031-1e4d-41d0-8bfa-36001675cfe3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:19:23 user nova-compute[72586]: DEBUG nova.compute.manager [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Starting instance... {{(pid=72586) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 21:19:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:19:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:19:23 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72586) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 21:19:24 user nova-compute[72586]: INFO nova.compute.claims [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Claim successful on node user
Aug 01 21:19:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Acquiring lock "98345340-5fb3-41fe-aea9-770cf4585e86" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:19:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Lock "98345340-5fb3-41fe-aea9-770cf4585e86" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:19:24 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Starting instance... {{(pid=72586) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 21:19:24 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:19:24 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:19:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:19:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.372s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:19:24 user nova-compute[72586]: DEBUG nova.compute.manager [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Start building networks asynchronously for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 21:19:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.041s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:19:24 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72586) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 21:19:24 user nova-compute[72586]: INFO nova.compute.claims [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Claim successful on node user
Aug 01 21:19:24 user nova-compute[72586]: DEBUG nova.compute.manager [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Allocating IP information in the background. {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 21:19:24 user nova-compute[72586]: DEBUG nova.network.neutron [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] allocate_for_instance() {{(pid=72586) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 21:19:24 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 21:19:24 user nova-compute[72586]: DEBUG nova.compute.manager [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Start building block device mappings for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 21:19:24 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:19:24 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:19:24 user nova-compute[72586]: DEBUG nova.compute.manager [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Start spawning the instance on the hypervisor. {{(pid=72586) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 21:19:24 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Creating instance directory {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 21:19:24 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Creating image(s)
Aug 01 21:19:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Acquiring lock "/opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:19:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "/opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:19:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "/opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:19:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Acquiring lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:19:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:19:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.430s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:19:24 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Start building networks asynchronously for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 21:19:24 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Allocating IP information in the background. {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 21:19:24 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] allocate_for_instance() {{(pid=72586) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 21:19:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08.part --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:19:25 user nova-compute[72586]: DEBUG nova.policy [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'df2af6a3f78c433790ebe6339a27f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efcd910da4d747078f86eec98beea523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72586) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 21:19:25 user nova-compute[72586]: DEBUG nova.policy [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0f678ac8999a42c4a383ee8b2976b4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a1d82f39347119a9fb49fb8e8893f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72586) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 21:19:25 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 21:19:25 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Start building block device mappings for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 21:19:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08.part --force-share --output=json" returned: 0 in 0.157s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:19:25 user nova-compute[72586]: DEBUG nova.virt.images [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] 0243d46b-6819-42a5-926f-42b71f0c97ad was qcow2, converting to raw {{(pid=72586) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 21:19:25 user nova-compute[72586]: DEBUG nova.privsep.utils [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72586) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 21:19:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08.part /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08.converted {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:19:25 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Start spawning the instance on the hypervisor. {{(pid=72586) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 21:19:25 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Creating instance directory {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 21:19:25 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Creating image(s)
Aug 01 21:19:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Acquiring lock "/opt/stack/data/nova/instances/98345340-5fb3-41fe-aea9-770cf4585e86/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:19:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Lock "/opt/stack/data/nova/instances/98345340-5fb3-41fe-aea9-770cf4585e86/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:19:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Lock "/opt/stack/data/nova/instances/98345340-5fb3-41fe-aea9-770cf4585e86/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:19:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Acquiring lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:19:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08.part /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08.converted" returned: 0 in 0.399s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:19:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08.converted --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:19:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Acquiring lock "413c3426-18ad-4a5c-af04-e0e7fc90f050" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:19:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "413c3426-18ad-4a5c-af04-e0e7fc90f050" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:19:25 user nova-compute[72586]: DEBUG nova.compute.manager [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Starting instance... {{(pid=72586) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 21:19:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08.converted --force-share --output=json" returned: 0 in 0.138s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:19:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.176s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:19:25 user nova-compute[72586]: INFO oslo.privsep.daemon [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmprijfadz8/privsep.sock']
Aug 01 21:19:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.268s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:19:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:19:25 user sudo[81733]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmprijfadz8/privsep.sock
Aug 01 21:19:25 user sudo[81733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 01 21:19:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:19:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:19:26 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72586) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 21:19:26 user nova-compute[72586]: INFO nova.compute.claims [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Claim successful on node user
Aug 01 21:19:26 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:19:26 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:19:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.324s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:19:26 user nova-compute[72586]: DEBUG nova.compute.manager [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Start building networks asynchronously for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 21:19:26 user nova-compute[72586]: DEBUG nova.compute.manager [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Allocating IP information in the background. {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 21:19:26 user nova-compute[72586]: DEBUG nova.network.neutron [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] allocate_for_instance() {{(pid=72586) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 21:19:26 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 21:19:26 user nova-compute[72586]: DEBUG nova.compute.manager [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Start building block device mappings for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 21:19:26 user nova-compute[72586]: DEBUG nova.compute.manager [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Start spawning the instance on the hypervisor. {{(pid=72586) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 21:19:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Creating instance directory {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 21:19:26 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Creating image(s)
Aug 01 21:19:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Acquiring lock "/opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:19:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "/opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:19:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "/opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:19:26 user nova-compute[72586]: DEBUG nova.policy [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0f678ac8999a42c4a383ee8b2976b4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a1d82f39347119a9fb49fb8e8893f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72586) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 21:19:27 user sudo[81733]: pam_unix(sudo:session): session closed for user root
Aug 01 21:19:27 user nova-compute[72586]: INFO oslo.privsep.daemon [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Spawned new privsep daemon via rootwrap
Aug 01 21:19:27 user nova-compute[72586]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 01 21:19:27 user nova-compute[72586]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 01 21:19:27 user nova-compute[72586]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 01 21:19:27 user nova-compute[72586]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81737
Aug 01 21:19:27 user nova-compute[72586]: WARNING oslo_privsep.priv_context [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] privsep daemon already running
Aug 01 21:19:27 user nova-compute[72586]: WARNING oslo_privsep.priv_context [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] privsep daemon already running
Aug 01 21:19:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:19:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:19:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:19:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.138s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:19:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Acquiring lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:19:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:19:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:19:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.167s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:19:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Acquiring lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:19:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.151s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:19:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Acquiring lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:19:28 user nova-compute[72586]: DEBUG nova.network.neutron [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Successfully created port: fb56dcd2-b1ea-4992-a896-22f65127a96c {{(pid=72586) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 21:19:28 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Successfully created port: 417d1712-68ee-4850-b806-09d69ba1716f {{(pid=72586) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 21:19:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.145s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:19:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/98345340-5fb3-41fe-aea9-770cf4585e86/disk 1073741824 {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:19:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/98345340-5fb3-41fe-aea9-770cf4585e86/disk 1073741824" returned: 0 in 0.067s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:19:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.217s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:19:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:19:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.198s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:19:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:19:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.153s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:19:28 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Checking if we can resize image /opt/stack/data/nova/instances/98345340-5fb3-41fe-aea9-770cf4585e86/disk. size=1073741824 {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 21:19:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98345340-5fb3-41fe-aea9-770cf4585e86/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:19:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.149s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:19:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk 1073741824 {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:19:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk 1073741824" returned: 0 in 0.043s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:19:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.199s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:19:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:19:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.432s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:19:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:19:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98345340-5fb3-41fe-aea9-770cf4585e86/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:19:28 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Cannot resize image /opt/stack/data/nova/instances/98345340-5fb3-41fe-aea9-770cf4585e86/disk to a smaller size. {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 21:19:28 user nova-compute[72586]: DEBUG nova.objects.instance [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Lazy-loading 'migration_context' on Instance uuid 98345340-5fb3-41fe-aea9-770cf4585e86 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:19:28 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Created local disks {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 21:19:28 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Ensure instance console log exists: /opt/stack/data/nova/instances/98345340-5fb3-41fe-aea9-770cf4585e86/console.log {{(pid=72586) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 21:19:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:19:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:19:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:19:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.143s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:19:28 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Checking if we can resize image /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk. size=1073741824 {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 21:19:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:19:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.163s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:19:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk 1073741824 {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:19:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk 1073741824" returned: 0 in 0.045s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:19:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.214s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:19:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:19:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:19:28 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Cannot resize image /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk to a smaller size. {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 21:19:28 user nova-compute[72586]: DEBUG nova.objects.instance [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lazy-loading 'migration_context' on Instance uuid 042f0031-1e4d-41d0-8bfa-36001675cfe3 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:19:28 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Created local disks {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 21:19:28 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Ensure instance console log exists: /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/console.log {{(pid=72586) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 21:19:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:19:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:19:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:19:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.132s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:19:28 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Checking if we can resize image /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk. size=1073741824 {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 21:19:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:19:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:19:28 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Cannot resize image /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk to a smaller size. {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 21:19:28 user nova-compute[72586]: DEBUG nova.objects.instance [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lazy-loading 'migration_context' on Instance uuid 413c3426-18ad-4a5c-af04-e0e7fc90f050 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:19:28 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Created local disks {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 21:19:28 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Ensure instance console log exists: /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/console.log {{(pid=72586) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 21:19:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:19:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:19:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:19:29 user nova-compute[72586]: DEBUG nova.network.neutron [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Successfully created port: 38381409-a508-45f7-ad5c-53e84d2d5adb {{(pid=72586) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 21:19:32 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Successfully updated port: 417d1712-68ee-4850-b806-09d69ba1716f {{(pid=72586) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 21:19:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Acquiring lock "refresh_cache-98345340-5fb3-41fe-aea9-770cf4585e86" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:19:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Acquired lock "refresh_cache-98345340-5fb3-41fe-aea9-770cf4585e86" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:19:32 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:19:32 user nova-compute[72586]: DEBUG nova.network.neutron [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Successfully updated port: fb56dcd2-b1ea-4992-a896-22f65127a96c {{(pid=72586) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 21:19:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Acquiring lock "refresh_cache-042f0031-1e4d-41d0-8bfa-36001675cfe3" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:19:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Acquired lock "refresh_cache-042f0031-1e4d-41d0-8bfa-36001675cfe3" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:19:32 user nova-compute[72586]: DEBUG nova.network.neutron [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:19:32 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Instance cache missing network info. {{(pid=72586) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 21:19:32 user nova-compute[72586]: DEBUG nova.compute.manager [req-4f46d85b-b4bc-4375-9e03-db91827c6171 req-054120ef-2bc1-49ab-bdf1-55537531c1b2 service nova] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Received event network-changed-417d1712-68ee-4850-b806-09d69ba1716f {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:19:32 user nova-compute[72586]: DEBUG nova.compute.manager [req-4f46d85b-b4bc-4375-9e03-db91827c6171 req-054120ef-2bc1-49ab-bdf1-55537531c1b2 service nova] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Refreshing instance network info cache due to event network-changed-417d1712-68ee-4850-b806-09d69ba1716f. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:19:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-4f46d85b-b4bc-4375-9e03-db91827c6171 req-054120ef-2bc1-49ab-bdf1-55537531c1b2 service nova] Acquiring lock "refresh_cache-98345340-5fb3-41fe-aea9-770cf4585e86" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:19:32 user nova-compute[72586]: DEBUG nova.network.neutron [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Instance cache missing network info. {{(pid=72586) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 21:19:33 user nova-compute[72586]: DEBUG nova.network.neutron [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Successfully updated port: 38381409-a508-45f7-ad5c-53e84d2d5adb {{(pid=72586) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 21:19:33 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Acquiring lock "refresh_cache-413c3426-18ad-4a5c-af04-e0e7fc90f050" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:19:33 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Acquired lock "refresh_cache-413c3426-18ad-4a5c-af04-e0e7fc90f050" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:19:33 user nova-compute[72586]: DEBUG nova.network.neutron [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:19:34 user nova-compute[72586]: DEBUG nova.network.neutron [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Instance cache missing network info. {{(pid=72586) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 21:19:34 user nova-compute[72586]: DEBUG nova.compute.manager [req-b91fd267-823e-45fd-a35e-75bf4cedaa6f req-94f6dc0c-3357-47e0-a302-47a2c3aaecc5 service nova] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Received event network-changed-38381409-a508-45f7-ad5c-53e84d2d5adb {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:19:34 user nova-compute[72586]: DEBUG nova.compute.manager [req-b91fd267-823e-45fd-a35e-75bf4cedaa6f req-94f6dc0c-3357-47e0-a302-47a2c3aaecc5 service nova] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Refreshing instance network info cache due to event network-changed-38381409-a508-45f7-ad5c-53e84d2d5adb. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:19:34 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-b91fd267-823e-45fd-a35e-75bf4cedaa6f req-94f6dc0c-3357-47e0-a302-47a2c3aaecc5 service nova] Acquiring lock "refresh_cache-413c3426-18ad-4a5c-af04-e0e7fc90f050" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:19:34 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Updating instance_info_cache with network_info: [{"id": "417d1712-68ee-4850-b806-09d69ba1716f", "address": "fa:16:3e:6e:41:36", "network": {"id": "7e252667-8bb6-4657-9399-2026d81f4f07", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1441939601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efcd910da4d747078f86eec98beea523", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap417d1712-68", "ovs_interfaceid": "417d1712-68ee-4850-b806-09d69ba1716f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:19:34 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Releasing lock "refresh_cache-98345340-5fb3-41fe-aea9-770cf4585e86" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:19:34 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Instance network_info: |[{"id": "417d1712-68ee-4850-b806-09d69ba1716f", "address": "fa:16:3e:6e:41:36", "network": {"id": "7e252667-8bb6-4657-9399-2026d81f4f07", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1441939601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efcd910da4d747078f86eec98beea523", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap417d1712-68", "ovs_interfaceid": "417d1712-68ee-4850-b806-09d69ba1716f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 21:19:34 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-4f46d85b-b4bc-4375-9e03-db91827c6171 req-054120ef-2bc1-49ab-bdf1-55537531c1b2 service nova] Acquired lock "refresh_cache-98345340-5fb3-41fe-aea9-770cf4585e86" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:19:34 user nova-compute[72586]: DEBUG nova.network.neutron [req-4f46d85b-b4bc-4375-9e03-db91827c6171 req-054120ef-2bc1-49ab-bdf1-55537531c1b2 service nova] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Refreshing network info cache for port 417d1712-68ee-4850-b806-09d69ba1716f {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:19:34 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Start _get_guest_xml network_info=[{"id": "417d1712-68ee-4850-b806-09d69ba1716f", "address": "fa:16:3e:6e:41:36", "network": {"id": "7e252667-8bb6-4657-9399-2026d81f4f07", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1441939601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efcd910da4d747078f86eec98beea523", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap417d1712-68", "ovs_interfaceid": "417d1712-68ee-4850-b806-09d69ba1716f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '0243d46b-6819-42a5-926f-42b71f0c97ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:19:34 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:19:34 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:19:34 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:19:34 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:19:34 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:19:34 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:19:34 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:19:34 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:19:34 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:19:34 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:19:34 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:19:34 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:19:34 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:19:34 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:19:34 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:19:34 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:19:34 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:19:34 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:19:34 user nova-compute[72586]: DEBUG nova.privsep.utils [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72586) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 21:19:34 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:19:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1462446557',display_name='tempest-DeleteServersTestJSON-server-1462446557',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1462446557',id=2,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='efcd910da4d747078f86eec98beea523',ramdisk_id='',reservation_id='r-rsqck9tm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-2041957045',owner_user_name='tempest-DeleteServersTestJSON-2041957045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:19:25Z,user_data=None,user_id='df2af6a3f78c433790ebe6339a27f679',uuid=98345340-5fb3-41fe-aea9-770cf4585e86,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "417d1712-68ee-4850-b806-09d69ba1716f", "address": "fa:16:3e:6e:41:36", "network": {"id": "7e252667-8bb6-4657-9399-2026d81f4f07", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1441939601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efcd910da4d747078f86eec98beea523", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap417d1712-68", "ovs_interfaceid": "417d1712-68ee-4850-b806-09d69ba1716f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:19:34 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Converting VIF {"id": "417d1712-68ee-4850-b806-09d69ba1716f", "address": "fa:16:3e:6e:41:36", "network": {"id": "7e252667-8bb6-4657-9399-2026d81f4f07", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1441939601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efcd910da4d747078f86eec98beea523", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap417d1712-68", "ovs_interfaceid": "417d1712-68ee-4850-b806-09d69ba1716f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:19:34 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:41:36,bridge_name='br-int',has_traffic_filtering=True,id=417d1712-68ee-4850-b806-09d69ba1716f,network=Network(7e252667-8bb6-4657-9399-2026d81f4f07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap417d1712-68') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:19:34 user nova-compute[72586]: DEBUG nova.objects.instance [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Lazy-loading 'pci_devices' on Instance uuid 98345340-5fb3-41fe-aea9-770cf4585e86 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:19:34 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:19:34 user nova-compute[72586]:   <uuid>98345340-5fb3-41fe-aea9-770cf4585e86</uuid>
Aug 01 21:19:34 user nova-compute[72586]:   <name>instance-00000002</name>
Aug 01 21:19:34 user nova-compute[72586]:   <memory>524288</memory>
Aug 01 21:19:34 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:19:34 user nova-compute[72586]:   <metadata>
Aug 01 21:19:34 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:19:34 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:19:34 user nova-compute[72586]:       <nova:name>tempest-DeleteServersTestJSON-server-1462446557</nova:name>
Aug 01 21:19:34 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:19:34</nova:creationTime>
Aug 01 21:19:34 user nova-compute[72586]:       <nova:flavor name="m1.tiny">
Aug 01 21:19:34 user nova-compute[72586]:         <nova:memory>512</nova:memory>
Aug 01 21:19:34 user nova-compute[72586]:         <nova:disk>1</nova:disk>
Aug 01 21:19:34 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:19:34 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:19:34 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:19:34 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:19:34 user nova-compute[72586]:       <nova:owner>
Aug 01 21:19:34 user nova-compute[72586]:         <nova:user uuid="df2af6a3f78c433790ebe6339a27f679">tempest-DeleteServersTestJSON-2041957045-project-member</nova:user>
Aug 01 21:19:34 user nova-compute[72586]:         <nova:project uuid="efcd910da4d747078f86eec98beea523">tempest-DeleteServersTestJSON-2041957045</nova:project>
Aug 01 21:19:34 user nova-compute[72586]:       </nova:owner>
Aug 01 21:19:34 user nova-compute[72586]:       <nova:root type="image" uuid="0243d46b-6819-42a5-926f-42b71f0c97ad"/>
Aug 01 21:19:34 user nova-compute[72586]:       <nova:ports>
Aug 01 21:19:34 user nova-compute[72586]:         <nova:port uuid="417d1712-68ee-4850-b806-09d69ba1716f">
Aug 01 21:19:34 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 01 21:19:34 user nova-compute[72586]:         </nova:port>
Aug 01 21:19:34 user nova-compute[72586]:       </nova:ports>
Aug 01 21:19:34 user nova-compute[72586]:     </nova:instance>
Aug 01 21:19:34 user nova-compute[72586]:   </metadata>
Aug 01 21:19:34 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:19:34 user nova-compute[72586]:     <system>
Aug 01 21:19:34 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:19:34 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:19:34 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:19:34 user nova-compute[72586]:       <entry name="serial">98345340-5fb3-41fe-aea9-770cf4585e86</entry>
Aug 01 21:19:34 user nova-compute[72586]:       <entry name="uuid">98345340-5fb3-41fe-aea9-770cf4585e86</entry>
Aug 01 21:19:34 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:19:34 user nova-compute[72586]:     </system>
Aug 01 21:19:34 user nova-compute[72586]:   </sysinfo>
Aug 01 21:19:34 user nova-compute[72586]:   <os>
Aug 01 21:19:34 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:19:34 user nova-compute[72586]:     <boot dev="hd"/>
Aug 01 21:19:34 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:19:34 user nova-compute[72586]:   </os>
Aug 01 21:19:34 user nova-compute[72586]:   <features>
Aug 01 21:19:34 user nova-compute[72586]:     <acpi/>
Aug 01 21:19:34 user nova-compute[72586]:     <apic/>
Aug 01 21:19:34 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:19:34 user nova-compute[72586]:   </features>
Aug 01 21:19:34 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:19:34 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:19:34 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:19:34 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:19:34 user nova-compute[72586]:   </clock>
Aug 01 21:19:34 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:19:34 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:19:34 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:19:34 user nova-compute[72586]:   </cpu>
Aug 01 21:19:34 user nova-compute[72586]:   <devices>
Aug 01 21:19:34 user nova-compute[72586]:     <disk type="file" device="disk">
Aug 01 21:19:34 user nova-compute[72586]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 21:19:34 user nova-compute[72586]:       <source file="/opt/stack/data/nova/instances/98345340-5fb3-41fe-aea9-770cf4585e86/disk"/>
Aug 01 21:19:34 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:19:34 user nova-compute[72586]:     </disk>
Aug 01 21:19:34 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:19:34 user nova-compute[72586]:       <mac address="fa:16:3e:6e:41:36"/>
Aug 01 21:19:34 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:19:34 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:19:34 user nova-compute[72586]:       <target dev="tap417d1712-68"/>
Aug 01 21:19:34 user nova-compute[72586]:     </interface>
Aug 01 21:19:34 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:19:34 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/98345340-5fb3-41fe-aea9-770cf4585e86/console.log" append="off"/>
Aug 01 21:19:34 user nova-compute[72586]:     </serial>
Aug 01 21:19:34 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:19:34 user nova-compute[72586]:     <video>
Aug 01 21:19:34 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:19:34 user nova-compute[72586]:     </video>
Aug 01 21:19:34 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:19:34 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:19:34 user nova-compute[72586]:     </rng>
Aug 01 21:19:34 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:19:34 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:19:34 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:19:34 user nova-compute[72586]:     </memballoon>
Aug 01 21:19:34 user nova-compute[72586]:   </devices>
Aug 01 21:19:34 user nova-compute[72586]: </domain>
Aug 01 21:19:34 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:19:34 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:19:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1462446557',display_name='tempest-DeleteServersTestJSON-server-1462446557',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1462446557',id=2,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='efcd910da4d747078f86eec98beea523',ramdisk_id='',reservation_id='r-rsqck9tm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-2041957045',owner_user_name='tempest-DeleteServersTestJSON-2041957045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:19:25Z,user_data=None,user_id='df2af6a3f78c433790ebe6339a27f679',uuid=98345340-5fb3-41fe-aea9-770cf4585e86,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "417d1712-68ee-4850-b806-09d69ba1716f", "address": "fa:16:3e:6e:41:36", "network": {"id": "7e252667-8bb6-4657-9399-2026d81f4f07", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1441939601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efcd910da4d747078f86eec98beea523", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap417d1712-68", "ovs_interfaceid": "417d1712-68ee-4850-b806-09d69ba1716f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:19:34 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Converting VIF {"id": "417d1712-68ee-4850-b806-09d69ba1716f", "address": "fa:16:3e:6e:41:36", "network": {"id": "7e252667-8bb6-4657-9399-2026d81f4f07", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1441939601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efcd910da4d747078f86eec98beea523", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap417d1712-68", "ovs_interfaceid": "417d1712-68ee-4850-b806-09d69ba1716f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:19:34 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:41:36,bridge_name='br-int',has_traffic_filtering=True,id=417d1712-68ee-4850-b806-09d69ba1716f,network=Network(7e252667-8bb6-4657-9399-2026d81f4f07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap417d1712-68') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:19:34 user nova-compute[72586]: DEBUG os_vif [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:41:36,bridge_name='br-int',has_traffic_filtering=True,id=417d1712-68ee-4850-b806-09d69ba1716f,network=Network(7e252667-8bb6-4657-9399-2026d81f4f07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap417d1712-68') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:19:34 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Created schema index Interface.name {{(pid=72586) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 01 21:19:34 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Created schema index Port.name {{(pid=72586) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 01 21:19:34 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Created schema index Bridge.name {{(pid=72586) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 01 21:19:34 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=72586) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 21:19:34 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] [POLLOUT] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:34 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72586) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 21:19:34 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:34 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:34 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:34 user nova-compute[72586]: DEBUG nova.compute.manager [req-8708454b-8840-45fa-a8ec-b20de1cbabe2 req-be1896db-c9c1-449f-b562-42dc99afc0ee service nova] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Received event network-changed-fb56dcd2-b1ea-4992-a896-22f65127a96c {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:19:34 user nova-compute[72586]: DEBUG nova.compute.manager [req-8708454b-8840-45fa-a8ec-b20de1cbabe2 req-be1896db-c9c1-449f-b562-42dc99afc0ee service nova] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Refreshing instance network info cache due to event network-changed-fb56dcd2-b1ea-4992-a896-22f65127a96c. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:19:34 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-8708454b-8840-45fa-a8ec-b20de1cbabe2 req-be1896db-c9c1-449f-b562-42dc99afc0ee service nova] Acquiring lock "refresh_cache-042f0031-1e4d-41d0-8bfa-36001675cfe3" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:19:34 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:34 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:19:34 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:19:34 user nova-compute[72586]: INFO oslo.privsep.daemon [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpd9h9sh8h/privsep.sock']
Aug 01 21:19:34 user sudo[81798]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpd9h9sh8h/privsep.sock
Aug 01 21:19:34 user sudo[81798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 01 21:19:34 user nova-compute[72586]: DEBUG nova.network.neutron [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Updating instance_info_cache with network_info: [{"id": "fb56dcd2-b1ea-4992-a896-22f65127a96c", "address": "fa:16:3e:8e:7c:d3", "network": {"id": "d229a8de-7a2b-4dcd-a9ac-44a40349676e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-67691992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b1a1d82f39347119a9fb49fb8e8893f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb56dcd2-b1", "ovs_interfaceid": "fb56dcd2-b1ea-4992-a896-22f65127a96c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:19:34 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Releasing lock "refresh_cache-042f0031-1e4d-41d0-8bfa-36001675cfe3" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:19:34 user nova-compute[72586]: DEBUG nova.compute.manager [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Instance network_info: |[{"id": "fb56dcd2-b1ea-4992-a896-22f65127a96c", "address": "fa:16:3e:8e:7c:d3", "network": {"id": "d229a8de-7a2b-4dcd-a9ac-44a40349676e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-67691992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b1a1d82f39347119a9fb49fb8e8893f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb56dcd2-b1", "ovs_interfaceid": "fb56dcd2-b1ea-4992-a896-22f65127a96c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 21:19:34 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-8708454b-8840-45fa-a8ec-b20de1cbabe2 req-be1896db-c9c1-449f-b562-42dc99afc0ee service nova] Acquired lock "refresh_cache-042f0031-1e4d-41d0-8bfa-36001675cfe3" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:19:34 user nova-compute[72586]: DEBUG nova.network.neutron [req-8708454b-8840-45fa-a8ec-b20de1cbabe2 req-be1896db-c9c1-449f-b562-42dc99afc0ee service nova] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Refreshing network info cache for port fb56dcd2-b1ea-4992-a896-22f65127a96c {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:19:34 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Start _get_guest_xml network_info=[{"id": "fb56dcd2-b1ea-4992-a896-22f65127a96c", "address": "fa:16:3e:8e:7c:d3", "network": {"id": "d229a8de-7a2b-4dcd-a9ac-44a40349676e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-67691992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b1a1d82f39347119a9fb49fb8e8893f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb56dcd2-b1", "ovs_interfaceid": "fb56dcd2-b1ea-4992-a896-22f65127a96c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '0243d46b-6819-42a5-926f-42b71f0c97ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:19:35 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:19:35 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:19:35 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:19:35 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:19:35 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:19:35 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:19:35 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:19:35 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:19:35 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:19:35 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:19:35 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:19:35 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:19:35 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:19:35 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:19:35 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:19:35 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:19:35 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:19:35 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:19:35 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:19:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1034962218',display_name='tempest-ServerRescueNegativeTestJSON-server-1034962218',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1034962218',id=1,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5b1a1d82f39347119a9fb49fb8e8893f',ramdisk_id='',reservation_id='r-9jvsak0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1258600061',owner_user_name='tempest-ServerRescueNegativeTestJSON-1258600061-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:19:25Z,user_data=None,user_id='0f678ac8999a42c4a383ee8b2976b4cc',uuid=042f0031-1e4d-41d0-8bfa-36001675cfe3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb56dcd2-b1ea-4992-a896-22f65127a96c", "address": "fa:16:3e:8e:7c:d3", "network": {"id": "d229a8de-7a2b-4dcd-a9ac-44a40349676e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-67691992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b1a1d82f39347119a9fb49fb8e8893f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb56dcd2-b1", "ovs_interfaceid": "fb56dcd2-b1ea-4992-a896-22f65127a96c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:19:35 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Converting VIF {"id": "fb56dcd2-b1ea-4992-a896-22f65127a96c", "address": "fa:16:3e:8e:7c:d3", "network": {"id": "d229a8de-7a2b-4dcd-a9ac-44a40349676e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-67691992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b1a1d82f39347119a9fb49fb8e8893f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb56dcd2-b1", "ovs_interfaceid": "fb56dcd2-b1ea-4992-a896-22f65127a96c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:19:35 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:7c:d3,bridge_name='br-int',has_traffic_filtering=True,id=fb56dcd2-b1ea-4992-a896-22f65127a96c,network=Network(d229a8de-7a2b-4dcd-a9ac-44a40349676e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb56dcd2-b1') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:19:35 user nova-compute[72586]: DEBUG nova.objects.instance [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lazy-loading 'pci_devices' on Instance uuid 042f0031-1e4d-41d0-8bfa-36001675cfe3 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:19:35 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:19:35 user nova-compute[72586]:   <uuid>042f0031-1e4d-41d0-8bfa-36001675cfe3</uuid>
Aug 01 21:19:35 user nova-compute[72586]:   <name>instance-00000001</name>
Aug 01 21:19:35 user nova-compute[72586]:   <memory>524288</memory>
Aug 01 21:19:35 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:19:35 user nova-compute[72586]:   <metadata>
Aug 01 21:19:35 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:19:35 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:19:35 user nova-compute[72586]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1034962218</nova:name>
Aug 01 21:19:35 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:19:35</nova:creationTime>
Aug 01 21:19:35 user nova-compute[72586]:       <nova:flavor name="m1.tiny">
Aug 01 21:19:35 user nova-compute[72586]:         <nova:memory>512</nova:memory>
Aug 01 21:19:35 user nova-compute[72586]:         <nova:disk>1</nova:disk>
Aug 01 21:19:35 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:19:35 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:19:35 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:19:35 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:19:35 user nova-compute[72586]:       <nova:owner>
Aug 01 21:19:35 user nova-compute[72586]:         <nova:user uuid="0f678ac8999a42c4a383ee8b2976b4cc">tempest-ServerRescueNegativeTestJSON-1258600061-project-member</nova:user>
Aug 01 21:19:35 user nova-compute[72586]:         <nova:project uuid="5b1a1d82f39347119a9fb49fb8e8893f">tempest-ServerRescueNegativeTestJSON-1258600061</nova:project>
Aug 01 21:19:35 user nova-compute[72586]:       </nova:owner>
Aug 01 21:19:35 user nova-compute[72586]:       <nova:root type="image" uuid="0243d46b-6819-42a5-926f-42b71f0c97ad"/>
Aug 01 21:19:35 user nova-compute[72586]:       <nova:ports>
Aug 01 21:19:35 user nova-compute[72586]:         <nova:port uuid="fb56dcd2-b1ea-4992-a896-22f65127a96c">
Aug 01 21:19:35 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 01 21:19:35 user nova-compute[72586]:         </nova:port>
Aug 01 21:19:35 user nova-compute[72586]:       </nova:ports>
Aug 01 21:19:35 user nova-compute[72586]:     </nova:instance>
Aug 01 21:19:35 user nova-compute[72586]:   </metadata>
Aug 01 21:19:35 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:19:35 user nova-compute[72586]:     <system>
Aug 01 21:19:35 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:19:35 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:19:35 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:19:35 user nova-compute[72586]:       <entry name="serial">042f0031-1e4d-41d0-8bfa-36001675cfe3</entry>
Aug 01 21:19:35 user nova-compute[72586]:       <entry name="uuid">042f0031-1e4d-41d0-8bfa-36001675cfe3</entry>
Aug 01 21:19:35 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:19:35 user nova-compute[72586]:     </system>
Aug 01 21:19:35 user nova-compute[72586]:   </sysinfo>
Aug 01 21:19:35 user nova-compute[72586]:   <os>
Aug 01 21:19:35 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:19:35 user nova-compute[72586]:     <boot dev="hd"/>
Aug 01 21:19:35 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:19:35 user nova-compute[72586]:   </os>
Aug 01 21:19:35 user nova-compute[72586]:   <features>
Aug 01 21:19:35 user nova-compute[72586]:     <acpi/>
Aug 01 21:19:35 user nova-compute[72586]:     <apic/>
Aug 01 21:19:35 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:19:35 user nova-compute[72586]:   </features>
Aug 01 21:19:35 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:19:35 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:19:35 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:19:35 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:19:35 user nova-compute[72586]:   </clock>
Aug 01 21:19:35 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:19:35 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:19:35 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:19:35 user nova-compute[72586]:   </cpu>
Aug 01 21:19:35 user nova-compute[72586]:   <devices>
Aug 01 21:19:35 user nova-compute[72586]:     <disk type="file" device="disk">
Aug 01 21:19:35 user nova-compute[72586]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 21:19:35 user nova-compute[72586]:       <source file="/opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk"/>
Aug 01 21:19:35 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:19:35 user nova-compute[72586]:     </disk>
Aug 01 21:19:35 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:19:35 user nova-compute[72586]:       <mac address="fa:16:3e:8e:7c:d3"/>
Aug 01 21:19:35 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:19:35 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:19:35 user nova-compute[72586]:       <target dev="tapfb56dcd2-b1"/>
Aug 01 21:19:35 user nova-compute[72586]:     </interface>
Aug 01 21:19:35 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:19:35 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/console.log" append="off"/>
Aug 01 21:19:35 user nova-compute[72586]:     </serial>
Aug 01 21:19:35 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:19:35 user nova-compute[72586]:     <video>
Aug 01 21:19:35 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:19:35 user nova-compute[72586]:     </video>
Aug 01 21:19:35 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:19:35 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:19:35 user nova-compute[72586]:     </rng>
Aug 01 21:19:35 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:19:35 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:19:35 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:19:35 user nova-compute[72586]:     </memballoon>
Aug 01 21:19:35 user nova-compute[72586]:   </devices>
Aug 01 21:19:35 user nova-compute[72586]: </domain>
Aug 01 21:19:35 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:19:35 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:19:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1034962218',display_name='tempest-ServerRescueNegativeTestJSON-server-1034962218',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1034962218',id=1,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5b1a1d82f39347119a9fb49fb8e8893f',ramdisk_id='',reservation_id='r-9jvsak0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1258600061',owner_user_name='tempest-ServerRescueNegativeTestJSON-1258600061-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:19:25Z,user_data=None,user_id='0f678ac8999a42c4a383ee8b2976b4cc',uuid=042f0031-1e4d-41d0-8bfa-36001675cfe3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb56dcd2-b1ea-4992-a896-22f65127a96c", "address": "fa:16:3e:8e:7c:d3", "network": {"id": "d229a8de-7a2b-4dcd-a9ac-44a40349676e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-67691992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b1a1d82f39347119a9fb49fb8e8893f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb56dcd2-b1", "ovs_interfaceid": "fb56dcd2-b1ea-4992-a896-22f65127a96c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:19:35 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Converting VIF {"id": "fb56dcd2-b1ea-4992-a896-22f65127a96c", "address": "fa:16:3e:8e:7c:d3", "network": {"id": "d229a8de-7a2b-4dcd-a9ac-44a40349676e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-67691992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b1a1d82f39347119a9fb49fb8e8893f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb56dcd2-b1", "ovs_interfaceid": "fb56dcd2-b1ea-4992-a896-22f65127a96c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:19:35 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:7c:d3,bridge_name='br-int',has_traffic_filtering=True,id=fb56dcd2-b1ea-4992-a896-22f65127a96c,network=Network(d229a8de-7a2b-4dcd-a9ac-44a40349676e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb56dcd2-b1') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:19:35 user nova-compute[72586]: DEBUG os_vif [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:7c:d3,bridge_name='br-int',has_traffic_filtering=True,id=fb56dcd2-b1ea-4992-a896-22f65127a96c,network=Network(d229a8de-7a2b-4dcd-a9ac-44a40349676e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb56dcd2-b1') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:19:35 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:35 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:19:35 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:19:35 user nova-compute[72586]: DEBUG nova.network.neutron [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Updating instance_info_cache with network_info: [{"id": "38381409-a508-45f7-ad5c-53e84d2d5adb", "address": "fa:16:3e:73:a7:41", "network": {"id": "d229a8de-7a2b-4dcd-a9ac-44a40349676e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-67691992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b1a1d82f39347119a9fb49fb8e8893f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38381409-a5", "ovs_interfaceid": "38381409-a508-45f7-ad5c-53e84d2d5adb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:19:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Releasing lock "refresh_cache-413c3426-18ad-4a5c-af04-e0e7fc90f050" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:19:35 user nova-compute[72586]: DEBUG nova.compute.manager [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Instance network_info: |[{"id": "38381409-a508-45f7-ad5c-53e84d2d5adb", "address": "fa:16:3e:73:a7:41", "network": {"id": "d229a8de-7a2b-4dcd-a9ac-44a40349676e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-67691992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b1a1d82f39347119a9fb49fb8e8893f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38381409-a5", "ovs_interfaceid": "38381409-a508-45f7-ad5c-53e84d2d5adb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 21:19:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-b91fd267-823e-45fd-a35e-75bf4cedaa6f req-94f6dc0c-3357-47e0-a302-47a2c3aaecc5 service nova] Acquired lock "refresh_cache-413c3426-18ad-4a5c-af04-e0e7fc90f050" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:19:35 user nova-compute[72586]: DEBUG nova.network.neutron [req-b91fd267-823e-45fd-a35e-75bf4cedaa6f req-94f6dc0c-3357-47e0-a302-47a2c3aaecc5 service nova] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Refreshing network info cache for port 38381409-a508-45f7-ad5c-53e84d2d5adb {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:19:35 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Start _get_guest_xml network_info=[{"id": "38381409-a508-45f7-ad5c-53e84d2d5adb", "address": "fa:16:3e:73:a7:41", "network": {"id": "d229a8de-7a2b-4dcd-a9ac-44a40349676e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-67691992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b1a1d82f39347119a9fb49fb8e8893f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38381409-a5", "ovs_interfaceid": "38381409-a508-45f7-ad5c-53e84d2d5adb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '0243d46b-6819-42a5-926f-42b71f0c97ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:19:35 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:19:35 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:19:35 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:19:35 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:19:35 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:19:35 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:19:35 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:19:35 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:19:35 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:19:35 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:19:35 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:19:35 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:19:35 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:19:35 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:19:35 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:19:35 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:19:35 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:19:35 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:19:35 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:19:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-472860044',display_name='tempest-ServerRescueNegativeTestJSON-server-472860044',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-472860044',id=3,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5b1a1d82f39347119a9fb49fb8e8893f',ramdisk_id='',reservation_id='r-vbt2qqk4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1258600061',owner_user_name='tempest-ServerRescueNegativeTestJSON-1258600061-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:19:27Z,user_data=None,user_id='0f678ac8999a42c4a383ee8b2976b4cc',uuid=413c3426-18ad-4a5c-af04-e0e7fc90f050,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38381409-a508-45f7-ad5c-53e84d2d5adb", "address": "fa:16:3e:73:a7:41", "network": {"id": "d229a8de-7a2b-4dcd-a9ac-44a40349676e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-67691992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b1a1d82f39347119a9fb49fb8e8893f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38381409-a5", "ovs_interfaceid": "38381409-a508-45f7-ad5c-53e84d2d5adb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:19:35 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Converting VIF {"id": "38381409-a508-45f7-ad5c-53e84d2d5adb", "address": "fa:16:3e:73:a7:41", "network": {"id": "d229a8de-7a2b-4dcd-a9ac-44a40349676e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-67691992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b1a1d82f39347119a9fb49fb8e8893f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38381409-a5", "ovs_interfaceid": "38381409-a508-45f7-ad5c-53e84d2d5adb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:19:35 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:a7:41,bridge_name='br-int',has_traffic_filtering=True,id=38381409-a508-45f7-ad5c-53e84d2d5adb,network=Network(d229a8de-7a2b-4dcd-a9ac-44a40349676e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38381409-a5') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:19:35 user nova-compute[72586]: DEBUG nova.objects.instance [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lazy-loading 'pci_devices' on Instance uuid 413c3426-18ad-4a5c-af04-e0e7fc90f050 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:19:35 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:19:35 user nova-compute[72586]:   <uuid>413c3426-18ad-4a5c-af04-e0e7fc90f050</uuid>
Aug 01 21:19:35 user nova-compute[72586]:   <name>instance-00000003</name>
Aug 01 21:19:35 user nova-compute[72586]:   <memory>524288</memory>
Aug 01 21:19:35 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:19:35 user nova-compute[72586]:   <metadata>
Aug 01 21:19:35 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:19:35 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:19:35 user nova-compute[72586]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-472860044</nova:name>
Aug 01 21:19:35 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:19:35</nova:creationTime>
Aug 01 21:19:35 user nova-compute[72586]:       <nova:flavor name="m1.tiny">
Aug 01 21:19:35 user nova-compute[72586]:         <nova:memory>512</nova:memory>
Aug 01 21:19:35 user nova-compute[72586]:         <nova:disk>1</nova:disk>
Aug 01 21:19:35 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:19:35 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:19:35 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:19:35 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:19:35 user nova-compute[72586]:       <nova:owner>
Aug 01 21:19:35 user nova-compute[72586]:         <nova:user uuid="0f678ac8999a42c4a383ee8b2976b4cc">tempest-ServerRescueNegativeTestJSON-1258600061-project-member</nova:user>
Aug 01 21:19:35 user nova-compute[72586]:         <nova:project uuid="5b1a1d82f39347119a9fb49fb8e8893f">tempest-ServerRescueNegativeTestJSON-1258600061</nova:project>
Aug 01 21:19:35 user nova-compute[72586]:       </nova:owner>
Aug 01 21:19:35 user nova-compute[72586]:       <nova:root type="image" uuid="0243d46b-6819-42a5-926f-42b71f0c97ad"/>
Aug 01 21:19:35 user nova-compute[72586]:       <nova:ports>
Aug 01 21:19:35 user nova-compute[72586]:         <nova:port uuid="38381409-a508-45f7-ad5c-53e84d2d5adb">
Aug 01 21:19:35 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 01 21:19:35 user nova-compute[72586]:         </nova:port>
Aug 01 21:19:35 user nova-compute[72586]:       </nova:ports>
Aug 01 21:19:35 user nova-compute[72586]:     </nova:instance>
Aug 01 21:19:35 user nova-compute[72586]:   </metadata>
Aug 01 21:19:35 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:19:35 user nova-compute[72586]:     <system>
Aug 01 21:19:35 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:19:35 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:19:35 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:19:35 user nova-compute[72586]:       <entry name="serial">413c3426-18ad-4a5c-af04-e0e7fc90f050</entry>
Aug 01 21:19:35 user nova-compute[72586]:       <entry name="uuid">413c3426-18ad-4a5c-af04-e0e7fc90f050</entry>
Aug 01 21:19:35 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:19:35 user nova-compute[72586]:     </system>
Aug 01 21:19:35 user nova-compute[72586]:   </sysinfo>
Aug 01 21:19:35 user nova-compute[72586]:   <os>
Aug 01 21:19:35 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:19:35 user nova-compute[72586]:     <boot dev="hd"/>
Aug 01 21:19:35 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:19:35 user nova-compute[72586]:   </os>
Aug 01 21:19:35 user nova-compute[72586]:   <features>
Aug 01 21:19:35 user nova-compute[72586]:     <acpi/>
Aug 01 21:19:35 user nova-compute[72586]:     <apic/>
Aug 01 21:19:35 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:19:35 user nova-compute[72586]:   </features>
Aug 01 21:19:35 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:19:35 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:19:35 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:19:35 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:19:35 user nova-compute[72586]:   </clock>
Aug 01 21:19:35 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:19:35 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:19:35 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:19:35 user nova-compute[72586]:   </cpu>
Aug 01 21:19:35 user nova-compute[72586]:   <devices>
Aug 01 21:19:35 user nova-compute[72586]:     <disk type="file" device="disk">
Aug 01 21:19:35 user nova-compute[72586]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 21:19:35 user nova-compute[72586]:       <source file="/opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk"/>
Aug 01 21:19:35 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:19:35 user nova-compute[72586]:     </disk>
Aug 01 21:19:35 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:19:35 user nova-compute[72586]:       <mac address="fa:16:3e:73:a7:41"/>
Aug 01 21:19:35 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:19:35 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:19:35 user nova-compute[72586]:       <target dev="tap38381409-a5"/>
Aug 01 21:19:35 user nova-compute[72586]:     </interface>
Aug 01 21:19:35 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:19:35 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/console.log" append="off"/>
Aug 01 21:19:35 user nova-compute[72586]:     </serial>
Aug 01 21:19:35 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:19:35 user nova-compute[72586]:     <video>
Aug 01 21:19:35 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:19:35 user nova-compute[72586]:     </video>
Aug 01 21:19:35 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:19:35 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:19:35 user nova-compute[72586]:     </rng>
Aug 01 21:19:35 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:19:35 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:19:35 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:19:35 user nova-compute[72586]:     </memballoon>
Aug 01 21:19:35 user nova-compute[72586]:   </devices>
Aug 01 21:19:35 user nova-compute[72586]: </domain>
Aug 01 21:19:35 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:19:35 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:19:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-472860044',display_name='tempest-ServerRescueNegativeTestJSON-server-472860044',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-472860044',id=3,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5b1a1d82f39347119a9fb49fb8e8893f',ramdisk_id='',reservation_id='r-vbt2qqk4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1258600061',owner_user_name='tempest-ServerRescueNegativeTestJSON-1258600061-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:19:27Z,user_data=None,user_id='0f678ac8999a42c4a383ee8b2976b4cc',uuid=413c3426-18ad-4a5c-af04-e0e7fc90f050,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38381409-a508-45f7-ad5c-53e84d2d5adb", "address": "fa:16:3e:73:a7:41", "network": {"id": "d229a8de-7a2b-4dcd-a9ac-44a40349676e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-67691992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b1a1d82f39347119a9fb49fb8e8893f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38381409-a5", "ovs_interfaceid": "38381409-a508-45f7-ad5c-53e84d2d5adb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:19:35 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Converting VIF {"id": "38381409-a508-45f7-ad5c-53e84d2d5adb", "address": "fa:16:3e:73:a7:41", "network": {"id": "d229a8de-7a2b-4dcd-a9ac-44a40349676e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-67691992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b1a1d82f39347119a9fb49fb8e8893f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38381409-a5", "ovs_interfaceid": "38381409-a508-45f7-ad5c-53e84d2d5adb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:19:35 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:a7:41,bridge_name='br-int',has_traffic_filtering=True,id=38381409-a508-45f7-ad5c-53e84d2d5adb,network=Network(d229a8de-7a2b-4dcd-a9ac-44a40349676e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38381409-a5') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:19:35 user nova-compute[72586]: DEBUG os_vif [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:a7:41,bridge_name='br-int',has_traffic_filtering=True,id=38381409-a508-45f7-ad5c-53e84d2d5adb,network=Network(d229a8de-7a2b-4dcd-a9ac-44a40349676e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38381409-a5') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:19:35 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:35 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:19:35 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:19:36 user sudo[81798]: pam_unix(sudo:session): session closed for user root
Aug 01 21:19:36 user nova-compute[72586]: INFO oslo.privsep.daemon [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Spawned new privsep daemon via rootwrap
Aug 01 21:19:36 user nova-compute[72586]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 01 21:19:36 user nova-compute[72586]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 01 21:19:36 user nova-compute[72586]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 01 21:19:36 user nova-compute[72586]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81805
Aug 01 21:19:36 user nova-compute[72586]: WARNING oslo_privsep.priv_context [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] privsep daemon already running
Aug 01 21:19:36 user nova-compute[72586]: WARNING oslo_privsep.priv_context [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] privsep daemon already running
Aug 01 21:19:36 user nova-compute[72586]: DEBUG nova.network.neutron [req-b91fd267-823e-45fd-a35e-75bf4cedaa6f req-94f6dc0c-3357-47e0-a302-47a2c3aaecc5 service nova] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Updated VIF entry in instance network info cache for port 38381409-a508-45f7-ad5c-53e84d2d5adb. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:19:36 user nova-compute[72586]: DEBUG nova.network.neutron [req-b91fd267-823e-45fd-a35e-75bf4cedaa6f req-94f6dc0c-3357-47e0-a302-47a2c3aaecc5 service nova] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Updating instance_info_cache with network_info: [{"id": "38381409-a508-45f7-ad5c-53e84d2d5adb", "address": "fa:16:3e:73:a7:41", "network": {"id": "d229a8de-7a2b-4dcd-a9ac-44a40349676e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-67691992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b1a1d82f39347119a9fb49fb8e8893f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38381409-a5", "ovs_interfaceid": "38381409-a508-45f7-ad5c-53e84d2d5adb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:19:36 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-b91fd267-823e-45fd-a35e-75bf4cedaa6f req-94f6dc0c-3357-47e0-a302-47a2c3aaecc5 service nova] Releasing lock "refresh_cache-413c3426-18ad-4a5c-af04-e0e7fc90f050" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:19:36 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Acquiring lock "eccf50b0-9acc-49b6-8044-601e47d18c38" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:19:36 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "eccf50b0-9acc-49b6-8044-601e47d18c38" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:19:36 user nova-compute[72586]: DEBUG nova.compute.manager [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Starting instance... {{(pid=72586) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 21:19:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:19:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:19:37 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72586) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 21:19:37 user nova-compute[72586]: INFO nova.compute.claims [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Claim successful on node user
Aug 01 21:19:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap417d1712-68, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:19:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap417d1712-68, col_values=(('external_ids', {'iface-id': '417d1712-68ee-4850-b806-09d69ba1716f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:41:36', 'vm-uuid': '98345340-5fb3-41fe-aea9-770cf4585e86'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:19:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:19:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:37 user nova-compute[72586]: INFO os_vif [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:41:36,bridge_name='br-int',has_traffic_filtering=True,id=417d1712-68ee-4850-b806-09d69ba1716f,network=Network(7e252667-8bb6-4657-9399-2026d81f4f07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap417d1712-68')
Aug 01 21:19:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfb56dcd2-b1, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:19:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfb56dcd2-b1, col_values=(('external_ids', {'iface-id': 'fb56dcd2-b1ea-4992-a896-22f65127a96c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:7c:d3', 'vm-uuid': '042f0031-1e4d-41d0-8bfa-36001675cfe3'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:19:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:19:37 user nova-compute[72586]: DEBUG nova.network.neutron [req-4f46d85b-b4bc-4375-9e03-db91827c6171 req-054120ef-2bc1-49ab-bdf1-55537531c1b2 service nova] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Updated VIF entry in instance network info cache for port 417d1712-68ee-4850-b806-09d69ba1716f. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:19:37 user nova-compute[72586]: DEBUG nova.network.neutron [req-4f46d85b-b4bc-4375-9e03-db91827c6171 req-054120ef-2bc1-49ab-bdf1-55537531c1b2 service nova] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Updating instance_info_cache with network_info: [{"id": "417d1712-68ee-4850-b806-09d69ba1716f", "address": "fa:16:3e:6e:41:36", "network": {"id": "7e252667-8bb6-4657-9399-2026d81f4f07", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1441939601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efcd910da4d747078f86eec98beea523", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap417d1712-68", "ovs_interfaceid": "417d1712-68ee-4850-b806-09d69ba1716f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:19:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:37 user nova-compute[72586]: INFO os_vif [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:7c:d3,bridge_name='br-int',has_traffic_filtering=True,id=fb56dcd2-b1ea-4992-a896-22f65127a96c,network=Network(d229a8de-7a2b-4dcd-a9ac-44a40349676e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb56dcd2-b1')
Aug 01 21:19:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-4f46d85b-b4bc-4375-9e03-db91827c6171 req-054120ef-2bc1-49ab-bdf1-55537531c1b2 service nova] Releasing lock "refresh_cache-98345340-5fb3-41fe-aea9-770cf4585e86" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:19:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap38381409-a5, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:19:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap38381409-a5, col_values=(('external_ids', {'iface-id': '38381409-a508-45f7-ad5c-53e84d2d5adb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:a7:41', 'vm-uuid': '413c3426-18ad-4a5c-af04-e0e7fc90f050'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:19:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:19:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:37 user nova-compute[72586]: INFO os_vif [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:a7:41,bridge_name='br-int',has_traffic_filtering=True,id=38381409-a508-45f7-ad5c-53e84d2d5adb,network=Network(d229a8de-7a2b-4dcd-a9ac-44a40349676e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38381409-a5')
Aug 01 21:19:37 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:19:37 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] No VIF found with MAC fa:16:3e:6e:41:36, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:19:37 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:19:37 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] No VIF found with MAC fa:16:3e:8e:7c:d3, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:19:37 user nova-compute[72586]: DEBUG nova.network.neutron [req-8708454b-8840-45fa-a8ec-b20de1cbabe2 req-be1896db-c9c1-449f-b562-42dc99afc0ee service nova] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Updated VIF entry in instance network info cache for port fb56dcd2-b1ea-4992-a896-22f65127a96c. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:19:37 user nova-compute[72586]: DEBUG nova.network.neutron [req-8708454b-8840-45fa-a8ec-b20de1cbabe2 req-be1896db-c9c1-449f-b562-42dc99afc0ee service nova] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Updating instance_info_cache with network_info: [{"id": "fb56dcd2-b1ea-4992-a896-22f65127a96c", "address": "fa:16:3e:8e:7c:d3", "network": {"id": "d229a8de-7a2b-4dcd-a9ac-44a40349676e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-67691992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b1a1d82f39347119a9fb49fb8e8893f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb56dcd2-b1", "ovs_interfaceid": "fb56dcd2-b1ea-4992-a896-22f65127a96c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:19:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-8708454b-8840-45fa-a8ec-b20de1cbabe2 req-be1896db-c9c1-449f-b562-42dc99afc0ee service nova] Releasing lock "refresh_cache-042f0031-1e4d-41d0-8bfa-36001675cfe3" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:19:37 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:19:37 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] No VIF found with MAC fa:16:3e:73:a7:41, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:19:37 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:19:37 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:19:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.385s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:19:37 user nova-compute[72586]: DEBUG nova.compute.manager [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Start building networks asynchronously for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 21:19:37 user nova-compute[72586]: DEBUG nova.compute.manager [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Allocating IP information in the background. {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 21:19:37 user nova-compute[72586]: DEBUG nova.network.neutron [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] allocate_for_instance() {{(pid=72586) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 21:19:37 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 21:19:37 user nova-compute[72586]: DEBUG nova.compute.manager [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Start building block device mappings for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 21:19:37 user nova-compute[72586]: DEBUG nova.compute.manager [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Start spawning the instance on the hypervisor. {{(pid=72586) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 21:19:37 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Creating instance directory {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 21:19:37 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Creating image(s)
Aug 01 21:19:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Acquiring lock "/opt/stack/data/nova/instances/eccf50b0-9acc-49b6-8044-601e47d18c38/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:19:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "/opt/stack/data/nova/instances/eccf50b0-9acc-49b6-8044-601e47d18c38/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:19:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "/opt/stack/data/nova/instances/eccf50b0-9acc-49b6-8044-601e47d18c38/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:19:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:19:37 user nova-compute[72586]: DEBUG nova.policy [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e1a0d71c79c04216b9bf278f650aeb77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae659e4ad43c44e2a8f6d48818bb796a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72586) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 21:19:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.130s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:19:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Acquiring lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:19:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:19:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:19:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.122s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:19:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/eccf50b0-9acc-49b6-8044-601e47d18c38/disk 1073741824 {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:19:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/eccf50b0-9acc-49b6-8044-601e47d18c38/disk 1073741824" returned: 0 in 0.048s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:19:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.175s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:19:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:19:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.138s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:19:38 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eccf50b0-9acc-49b6-8044-601e47d18c38/disk. size=1073741824 {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 21:19:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eccf50b0-9acc-49b6-8044-601e47d18c38/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:19:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eccf50b0-9acc-49b6-8044-601e47d18c38/disk --force-share --output=json" returned: 0 in 0.125s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:19:38 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Cannot resize image /opt/stack/data/nova/instances/eccf50b0-9acc-49b6-8044-601e47d18c38/disk to a smaller size. {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 21:19:38 user nova-compute[72586]: DEBUG nova.objects.instance [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lazy-loading 'migration_context' on Instance uuid eccf50b0-9acc-49b6-8044-601e47d18c38 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:19:38 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Created local disks {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 21:19:38 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Ensure instance console log exists: /opt/stack/data/nova/instances/eccf50b0-9acc-49b6-8044-601e47d18c38/console.log {{(pid=72586) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 21:19:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:19:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:19:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:19:38 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:38 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Acquiring lock "0fde640d-b731-405d-af91-fb4ef85fe90a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:19:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Lock "0fde640d-b731-405d-af91-fb4ef85fe90a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:19:40 user nova-compute[72586]: DEBUG nova.compute.manager [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Starting instance... {{(pid=72586) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 21:19:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:19:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:19:40 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72586) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 21:19:40 user nova-compute[72586]: INFO nova.compute.claims [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Claim successful on node user
Aug 01 21:19:40 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:40 user nova-compute[72586]: DEBUG nova.network.neutron [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Successfully created port: a766e2fb-84bd-40c0-a6d7-cdd68b728cd9 {{(pid=72586) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 21:19:40 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:40 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:40 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:40 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:40 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:40 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:19:40 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:40 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:19:40 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:40 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.459s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:19:40 user nova-compute[72586]: DEBUG nova.compute.manager [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Start building networks asynchronously for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 21:19:40 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:40 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:40 user nova-compute[72586]: DEBUG nova.compute.manager [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Allocating IP information in the background. {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 21:19:40 user nova-compute[72586]: DEBUG nova.network.neutron [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] allocate_for_instance() {{(pid=72586) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 21:19:40 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 21:19:40 user nova-compute[72586]: DEBUG nova.compute.manager [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Start building block device mappings for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 21:19:40 user nova-compute[72586]: DEBUG nova.compute.manager [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Start spawning the instance on the hypervisor. {{(pid=72586) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 21:19:40 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Creating instance directory {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 21:19:40 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Creating image(s)
Aug 01 21:19:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Acquiring lock "/opt/stack/data/nova/instances/0fde640d-b731-405d-af91-fb4ef85fe90a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:19:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Lock "/opt/stack/data/nova/instances/0fde640d-b731-405d-af91-fb4ef85fe90a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:19:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Lock "/opt/stack/data/nova/instances/0fde640d-b731-405d-af91-fb4ef85fe90a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:19:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:19:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.140s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:19:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Acquiring lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:19:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:19:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:19:41 user nova-compute[72586]: DEBUG nova.policy [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '89385b6c1686413db06c1c08a7c2e442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc531307652485c99598d21cacc2f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72586) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 21:19:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.161s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:19:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/0fde640d-b731-405d-af91-fb4ef85fe90a/disk 1073741824 {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:19:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/0fde640d-b731-405d-af91-fb4ef85fe90a/disk 1073741824" returned: 0 in 0.043s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:19:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.209s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:19:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:19:41 user nova-compute[72586]: DEBUG nova.compute.manager [req-34df3d5b-69f6-436d-9688-69a4123541a7 req-0e08e95b-0f19-4761-a240-0418dd112ef9 service nova] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Received event network-vif-plugged-38381409-a508-45f7-ad5c-53e84d2d5adb {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:19:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-34df3d5b-69f6-436d-9688-69a4123541a7 req-0e08e95b-0f19-4761-a240-0418dd112ef9 service nova] Acquiring lock "413c3426-18ad-4a5c-af04-e0e7fc90f050-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:19:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-34df3d5b-69f6-436d-9688-69a4123541a7 req-0e08e95b-0f19-4761-a240-0418dd112ef9 service nova] Lock "413c3426-18ad-4a5c-af04-e0e7fc90f050-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:19:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-34df3d5b-69f6-436d-9688-69a4123541a7 req-0e08e95b-0f19-4761-a240-0418dd112ef9 service nova] Lock "413c3426-18ad-4a5c-af04-e0e7fc90f050-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:19:41 user nova-compute[72586]: DEBUG nova.compute.manager [req-34df3d5b-69f6-436d-9688-69a4123541a7 req-0e08e95b-0f19-4761-a240-0418dd112ef9 service nova] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] No waiting events found dispatching network-vif-plugged-38381409-a508-45f7-ad5c-53e84d2d5adb {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:19:41 user nova-compute[72586]: WARNING nova.compute.manager [req-34df3d5b-69f6-436d-9688-69a4123541a7 req-0e08e95b-0f19-4761-a240-0418dd112ef9 service nova] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Received unexpected event network-vif-plugged-38381409-a508-45f7-ad5c-53e84d2d5adb for instance with vm_state building and task_state spawning.
Aug 01 21:19:41 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:41 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:41 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.171s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:19:41 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0fde640d-b731-405d-af91-fb4ef85fe90a/disk. size=1073741824 {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 21:19:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fde640d-b731-405d-af91-fb4ef85fe90a/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:19:41 user nova-compute[72586]: DEBUG nova.compute.manager [req-57472c16-396b-4c0a-b199-70ab7ba44152 req-5a36f141-d3d0-43aa-9f16-d20e52373dbd service nova] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Received event network-vif-plugged-417d1712-68ee-4850-b806-09d69ba1716f {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:19:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-57472c16-396b-4c0a-b199-70ab7ba44152 req-5a36f141-d3d0-43aa-9f16-d20e52373dbd service nova] Acquiring lock "98345340-5fb3-41fe-aea9-770cf4585e86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:19:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-57472c16-396b-4c0a-b199-70ab7ba44152 req-5a36f141-d3d0-43aa-9f16-d20e52373dbd service nova] Lock "98345340-5fb3-41fe-aea9-770cf4585e86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:19:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-57472c16-396b-4c0a-b199-70ab7ba44152 req-5a36f141-d3d0-43aa-9f16-d20e52373dbd service nova] Lock "98345340-5fb3-41fe-aea9-770cf4585e86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:19:41 user nova-compute[72586]: DEBUG nova.compute.manager [req-57472c16-396b-4c0a-b199-70ab7ba44152 req-5a36f141-d3d0-43aa-9f16-d20e52373dbd service nova] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] No waiting events found dispatching network-vif-plugged-417d1712-68ee-4850-b806-09d69ba1716f {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:19:41 user nova-compute[72586]: WARNING nova.compute.manager [req-57472c16-396b-4c0a-b199-70ab7ba44152 req-5a36f141-d3d0-43aa-9f16-d20e52373dbd service nova] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Received unexpected event network-vif-plugged-417d1712-68ee-4850-b806-09d69ba1716f for instance with vm_state building and task_state spawning.
Aug 01 21:19:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fde640d-b731-405d-af91-fb4ef85fe90a/disk --force-share --output=json" returned: 0 in 0.123s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:19:41 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Cannot resize image /opt/stack/data/nova/instances/0fde640d-b731-405d-af91-fb4ef85fe90a/disk to a smaller size. {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 21:19:41 user nova-compute[72586]: DEBUG nova.objects.instance [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Lazy-loading 'migration_context' on Instance uuid 0fde640d-b731-405d-af91-fb4ef85fe90a {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:19:41 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Created local disks {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 21:19:41 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Ensure instance console log exists: /opt/stack/data/nova/instances/0fde640d-b731-405d-af91-fb4ef85fe90a/console.log {{(pid=72586) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 21:19:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:19:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:19:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:19:42 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:42 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:42 user nova-compute[72586]: DEBUG nova.compute.manager [req-54ca9460-7e96-476d-a5ce-39185cec46b1 req-581b05b3-c1c1-4a32-9dc7-615635951e7a service nova] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Received event network-vif-plugged-fb56dcd2-b1ea-4992-a896-22f65127a96c {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:19:42 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-54ca9460-7e96-476d-a5ce-39185cec46b1 req-581b05b3-c1c1-4a32-9dc7-615635951e7a service nova] Acquiring lock "042f0031-1e4d-41d0-8bfa-36001675cfe3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:19:42 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-54ca9460-7e96-476d-a5ce-39185cec46b1 req-581b05b3-c1c1-4a32-9dc7-615635951e7a service nova] Lock "042f0031-1e4d-41d0-8bfa-36001675cfe3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:19:42 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-54ca9460-7e96-476d-a5ce-39185cec46b1 req-581b05b3-c1c1-4a32-9dc7-615635951e7a service nova] Lock "042f0031-1e4d-41d0-8bfa-36001675cfe3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:19:42 user nova-compute[72586]: DEBUG nova.compute.manager [req-54ca9460-7e96-476d-a5ce-39185cec46b1 req-581b05b3-c1c1-4a32-9dc7-615635951e7a service nova] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] No waiting events found dispatching network-vif-plugged-fb56dcd2-b1ea-4992-a896-22f65127a96c {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:19:42 user nova-compute[72586]: WARNING nova.compute.manager [req-54ca9460-7e96-476d-a5ce-39185cec46b1 req-581b05b3-c1c1-4a32-9dc7-615635951e7a service nova] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Received unexpected event network-vif-plugged-fb56dcd2-b1ea-4992-a896-22f65127a96c for instance with vm_state building and task_state spawning.
Aug 01 21:19:43 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690924783.172519, 98345340-5fb3-41fe-aea9-770cf4585e86 => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:19:43 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] VM Resumed (Lifecycle Event)
Aug 01 21:19:43 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Instance event wait completed in 0 seconds for  {{(pid=72586) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 21:19:43 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Guest created on hypervisor {{(pid=72586) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 21:19:43 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Instance spawned successfully.
Aug 01 21:19:43 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 21:19:43 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:19:43 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Found default for hw_cdrom_bus of ide {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:19:43 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Found default for hw_disk_bus of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:19:43 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Found default for hw_input_bus of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:19:43 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Found default for hw_pointer_model of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:19:43 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Found default for hw_video_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:19:43 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Found default for hw_vif_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:19:43 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:19:43 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:19:43 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690924783.172822, 98345340-5fb3-41fe-aea9-770cf4585e86 => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:19:43 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] VM Started (Lifecycle Event)
Aug 01 21:19:43 user nova-compute[72586]: DEBUG nova.compute.manager [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Instance event wait completed in 0 seconds for  {{(pid=72586) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 21:19:43 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Guest created on hypervisor {{(pid=72586) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 21:19:43 user nova-compute[72586]: DEBUG nova.compute.manager [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Instance event wait completed in 0 seconds for  {{(pid=72586) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 21:19:43 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Guest created on hypervisor {{(pid=72586) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 21:19:43 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:19:43 user nova-compute[72586]: INFO nova.compute.manager [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Took 17.70 seconds to spawn the instance on the hypervisor.
Aug 01 21:19:43 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:19:43 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Instance spawned successfully.
Aug 01 21:19:43 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 21:19:43 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Instance spawned successfully.
Aug 01 21:19:43 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 21:19:43 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:19:43 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Found default for hw_cdrom_bus of ide {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:19:43 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Found default for hw_disk_bus of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:19:43 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Found default for hw_input_bus of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:19:43 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Found default for hw_pointer_model of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:19:43 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Found default for hw_video_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:19:43 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Found default for hw_vif_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:19:43 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:19:43 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690924783.331748, 413c3426-18ad-4a5c-af04-e0e7fc90f050 => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:19:43 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] VM Resumed (Lifecycle Event)
Aug 01 21:19:43 user nova-compute[72586]: DEBUG nova.compute.manager [req-c7f8abed-e816-41df-8605-0ce2190ab5e0 req-21d92f3e-02ce-472b-bb4e-b1cf53775cc1 service nova] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Received event network-vif-plugged-38381409-a508-45f7-ad5c-53e84d2d5adb {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:19:43 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-c7f8abed-e816-41df-8605-0ce2190ab5e0 req-21d92f3e-02ce-472b-bb4e-b1cf53775cc1 service nova] Acquiring lock "413c3426-18ad-4a5c-af04-e0e7fc90f050-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:19:43 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-c7f8abed-e816-41df-8605-0ce2190ab5e0 req-21d92f3e-02ce-472b-bb4e-b1cf53775cc1 service nova] Lock "413c3426-18ad-4a5c-af04-e0e7fc90f050-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:19:43 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-c7f8abed-e816-41df-8605-0ce2190ab5e0 req-21d92f3e-02ce-472b-bb4e-b1cf53775cc1 service nova] Lock "413c3426-18ad-4a5c-af04-e0e7fc90f050-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:19:43 user nova-compute[72586]: DEBUG nova.compute.manager [req-c7f8abed-e816-41df-8605-0ce2190ab5e0 req-21d92f3e-02ce-472b-bb4e-b1cf53775cc1 service nova] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] No waiting events found dispatching network-vif-plugged-38381409-a508-45f7-ad5c-53e84d2d5adb {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:19:43 user nova-compute[72586]: WARNING nova.compute.manager [req-c7f8abed-e816-41df-8605-0ce2190ab5e0 req-21d92f3e-02ce-472b-bb4e-b1cf53775cc1 service nova] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Received unexpected event network-vif-plugged-38381409-a508-45f7-ad5c-53e84d2d5adb for instance with vm_state building and task_state spawning.
Aug 01 21:19:43 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:43 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:19:43 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:19:43 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Found default for hw_cdrom_bus of ide {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:19:43 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Found default for hw_disk_bus of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:19:43 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Found default for hw_input_bus of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:19:43 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Found default for hw_pointer_model of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:19:43 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Found default for hw_video_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:19:43 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Found default for hw_vif_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:19:43 user nova-compute[72586]: INFO nova.compute.manager [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Took 19.26 seconds to build instance.
Aug 01 21:19:43 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5c670b64-aedf-48d5-bbfa-98ffdfa54bb5 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Lock "98345340-5fb3-41fe-aea9-770cf4585e86" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.409s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:19:43 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:19:43 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690924783.3329701, 413c3426-18ad-4a5c-af04-e0e7fc90f050 => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:19:43 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] VM Started (Lifecycle Event)
Aug 01 21:19:43 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:19:43 user nova-compute[72586]: DEBUG nova.compute.manager [req-0b95c942-5834-4e5b-a37d-12e1a174273c req-dd44dec4-b974-43cf-9c3d-adf5eee7522d service nova] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Received event network-vif-plugged-417d1712-68ee-4850-b806-09d69ba1716f {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:19:43 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-0b95c942-5834-4e5b-a37d-12e1a174273c req-dd44dec4-b974-43cf-9c3d-adf5eee7522d service nova] Acquiring lock "98345340-5fb3-41fe-aea9-770cf4585e86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:19:43 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-0b95c942-5834-4e5b-a37d-12e1a174273c req-dd44dec4-b974-43cf-9c3d-adf5eee7522d service nova] Lock "98345340-5fb3-41fe-aea9-770cf4585e86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:19:43 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-0b95c942-5834-4e5b-a37d-12e1a174273c req-dd44dec4-b974-43cf-9c3d-adf5eee7522d service nova] Lock "98345340-5fb3-41fe-aea9-770cf4585e86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:19:43 user nova-compute[72586]: DEBUG nova.compute.manager [req-0b95c942-5834-4e5b-a37d-12e1a174273c req-dd44dec4-b974-43cf-9c3d-adf5eee7522d service nova] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] No waiting events found dispatching network-vif-plugged-417d1712-68ee-4850-b806-09d69ba1716f {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:19:43 user nova-compute[72586]: WARNING nova.compute.manager [req-0b95c942-5834-4e5b-a37d-12e1a174273c req-dd44dec4-b974-43cf-9c3d-adf5eee7522d service nova] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Received unexpected event network-vif-plugged-417d1712-68ee-4850-b806-09d69ba1716f for instance with vm_state active and task_state None.
Aug 01 21:19:43 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:19:43 user nova-compute[72586]: INFO nova.compute.manager [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Took 18.91 seconds to spawn the instance on the hypervisor.
Aug 01 21:19:43 user nova-compute[72586]: DEBUG nova.compute.manager [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:19:43 user nova-compute[72586]: INFO nova.compute.manager [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Took 17.12 seconds to spawn the instance on the hypervisor.
Aug 01 21:19:43 user nova-compute[72586]: DEBUG nova.compute.manager [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:19:43 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:19:43 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690924783.3465838, 042f0031-1e4d-41d0-8bfa-36001675cfe3 => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:19:43 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] VM Resumed (Lifecycle Event)
Aug 01 21:19:43 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:19:43 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:19:43 user nova-compute[72586]: INFO nova.compute.manager [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Took 19.87 seconds to build instance.
Aug 01 21:19:43 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690924783.3485308, 042f0031-1e4d-41d0-8bfa-36001675cfe3 => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:19:43 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] VM Started (Lifecycle Event)
Aug 01 21:19:43 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:19:43 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:19:43 user nova-compute[72586]: INFO nova.compute.manager [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Took 17.92 seconds to build instance.
Aug 01 21:19:43 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1184ce91-e259-4f8d-9cbc-77c5409b073c tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "042f0031-1e4d-41d0-8bfa-36001675cfe3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.142s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:19:43 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-d9a72df5-26c1-45c0-b314-a8f740491bb5 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "413c3426-18ad-4a5c-af04-e0e7fc90f050" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.039s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:19:44 user nova-compute[72586]: DEBUG nova.compute.manager [req-cac9d380-ef6d-4fc4-b6f7-4115cea8ceec req-03068d2b-2b57-4788-81a8-525e9f75d81b service nova] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Received event network-vif-plugged-fb56dcd2-b1ea-4992-a896-22f65127a96c {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:19:44 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-cac9d380-ef6d-4fc4-b6f7-4115cea8ceec req-03068d2b-2b57-4788-81a8-525e9f75d81b service nova] Acquiring lock "042f0031-1e4d-41d0-8bfa-36001675cfe3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:19:44 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-cac9d380-ef6d-4fc4-b6f7-4115cea8ceec req-03068d2b-2b57-4788-81a8-525e9f75d81b service nova] Lock "042f0031-1e4d-41d0-8bfa-36001675cfe3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:19:44 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-cac9d380-ef6d-4fc4-b6f7-4115cea8ceec req-03068d2b-2b57-4788-81a8-525e9f75d81b service nova] Lock "042f0031-1e4d-41d0-8bfa-36001675cfe3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:19:44 user nova-compute[72586]: DEBUG nova.compute.manager [req-cac9d380-ef6d-4fc4-b6f7-4115cea8ceec req-03068d2b-2b57-4788-81a8-525e9f75d81b service nova] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] No waiting events found dispatching network-vif-plugged-fb56dcd2-b1ea-4992-a896-22f65127a96c {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:19:44 user nova-compute[72586]: WARNING nova.compute.manager [req-cac9d380-ef6d-4fc4-b6f7-4115cea8ceec req-03068d2b-2b57-4788-81a8-525e9f75d81b service nova] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Received unexpected event network-vif-plugged-fb56dcd2-b1ea-4992-a896-22f65127a96c for instance with vm_state active and task_state None.
Aug 01 21:19:44 user nova-compute[72586]: DEBUG nova.network.neutron [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Successfully updated port: a766e2fb-84bd-40c0-a6d7-cdd68b728cd9 {{(pid=72586) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 21:19:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Acquiring lock "refresh_cache-eccf50b0-9acc-49b6-8044-601e47d18c38" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:19:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Acquired lock "refresh_cache-eccf50b0-9acc-49b6-8044-601e47d18c38" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:19:45 user nova-compute[72586]: DEBUG nova.network.neutron [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:19:45 user nova-compute[72586]: DEBUG nova.network.neutron [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Successfully created port: 4a722ba3-a6e6-4e2f-963d-f4938bc14926 {{(pid=72586) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 21:19:45 user nova-compute[72586]: DEBUG nova.network.neutron [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Instance cache missing network info. {{(pid=72586) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 21:19:46 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:46 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:46 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:46 user nova-compute[72586]: DEBUG nova.compute.manager [req-69b46562-a473-4728-b74f-2675797d3341 req-54f5eb45-aada-47a8-92e6-f4bbe63b50bc service nova] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Received event network-changed-a766e2fb-84bd-40c0-a6d7-cdd68b728cd9 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:19:46 user nova-compute[72586]: DEBUG nova.compute.manager [req-69b46562-a473-4728-b74f-2675797d3341 req-54f5eb45-aada-47a8-92e6-f4bbe63b50bc service nova] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Refreshing instance network info cache due to event network-changed-a766e2fb-84bd-40c0-a6d7-cdd68b728cd9. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:19:46 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-69b46562-a473-4728-b74f-2675797d3341 req-54f5eb45-aada-47a8-92e6-f4bbe63b50bc service nova] Acquiring lock "refresh_cache-eccf50b0-9acc-49b6-8044-601e47d18c38" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:19:46 user nova-compute[72586]: DEBUG nova.network.neutron [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Updating instance_info_cache with network_info: [{"id": "a766e2fb-84bd-40c0-a6d7-cdd68b728cd9", "address": "fa:16:3e:fe:82:a2", "network": {"id": "a5da07bc-2f5d-461e-b31f-df624d9c6557", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948878141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae659e4ad43c44e2a8f6d48818bb796a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa766e2fb-84", "ovs_interfaceid": "a766e2fb-84bd-40c0-a6d7-cdd68b728cd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:19:47 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Releasing lock "refresh_cache-eccf50b0-9acc-49b6-8044-601e47d18c38" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:19:47 user nova-compute[72586]: DEBUG nova.compute.manager [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Instance network_info: |[{"id": "a766e2fb-84bd-40c0-a6d7-cdd68b728cd9", "address": "fa:16:3e:fe:82:a2", "network": {"id": "a5da07bc-2f5d-461e-b31f-df624d9c6557", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948878141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae659e4ad43c44e2a8f6d48818bb796a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa766e2fb-84", "ovs_interfaceid": "a766e2fb-84bd-40c0-a6d7-cdd68b728cd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 21:19:47 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-69b46562-a473-4728-b74f-2675797d3341 req-54f5eb45-aada-47a8-92e6-f4bbe63b50bc service nova] Acquired lock "refresh_cache-eccf50b0-9acc-49b6-8044-601e47d18c38" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:19:47 user nova-compute[72586]: DEBUG nova.network.neutron [req-69b46562-a473-4728-b74f-2675797d3341 req-54f5eb45-aada-47a8-92e6-f4bbe63b50bc service nova] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Refreshing network info cache for port a766e2fb-84bd-40c0-a6d7-cdd68b728cd9 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:19:47 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Start _get_guest_xml network_info=[{"id": "a766e2fb-84bd-40c0-a6d7-cdd68b728cd9", "address": "fa:16:3e:fe:82:a2", "network": {"id": "a5da07bc-2f5d-461e-b31f-df624d9c6557", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948878141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae659e4ad43c44e2a8f6d48818bb796a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa766e2fb-84", "ovs_interfaceid": "a766e2fb-84bd-40c0-a6d7-cdd68b728cd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '0243d46b-6819-42a5-926f-42b71f0c97ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:19:47 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:19:47 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:19:47 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:19:47 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:19:47 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:19:47 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:19:47 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:19:47 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:19:47 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:19:47 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:19:47 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:19:47 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:19:47 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:19:47 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:19:47 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:19:47 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:19:47 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:19:47 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:19:47 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:19:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1431613257',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1431613257',id=4,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAzEKXFXyPEjmIAPh8qhlm5PDtJ745fuzeyPBR5mURReQVRsVkj1Kaj9A+C0pWvsCvlNKTWjeyuZ2oyzNMfwG0yhQo8/3Rvrhu8rmxObx77lv5HbcJYhByjJ1JwrLFHn7w==',key_name='tempest-keypair-2087820494',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae659e4ad43c44e2a8f6d48818bb796a',ramdisk_id='',reservation_id='r-kpiui11s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1935542868',owner_user_name='tempest-AttachVolumeShelveTestJSON-1935542868-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:19:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1a0d71c79c04216b9bf278f650aeb77',uuid=eccf50b0-9acc-49b6-8044-601e47d18c38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a766e2fb-84bd-40c0-a6d7-cdd68b728cd9", "address": "fa:16:3e:fe:82:a2", "network": {"id": "a5da07bc-2f5d-461e-b31f-df624d9c6557", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948878141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae659e4ad43c44e2a8f6d48818bb796a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa766e2fb-84", "ovs_interfaceid": "a766e2fb-84bd-40c0-a6d7-cdd68b728cd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:19:47 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Converting VIF {"id": "a766e2fb-84bd-40c0-a6d7-cdd68b728cd9", "address": "fa:16:3e:fe:82:a2", "network": {"id": "a5da07bc-2f5d-461e-b31f-df624d9c6557", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948878141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae659e4ad43c44e2a8f6d48818bb796a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa766e2fb-84", "ovs_interfaceid": "a766e2fb-84bd-40c0-a6d7-cdd68b728cd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:19:47 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:82:a2,bridge_name='br-int',has_traffic_filtering=True,id=a766e2fb-84bd-40c0-a6d7-cdd68b728cd9,network=Network(a5da07bc-2f5d-461e-b31f-df624d9c6557),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa766e2fb-84') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:19:47 user nova-compute[72586]: DEBUG nova.objects.instance [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lazy-loading 'pci_devices' on Instance uuid eccf50b0-9acc-49b6-8044-601e47d18c38 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:19:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:47 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:19:47 user nova-compute[72586]:   <uuid>eccf50b0-9acc-49b6-8044-601e47d18c38</uuid>
Aug 01 21:19:47 user nova-compute[72586]:   <name>instance-00000004</name>
Aug 01 21:19:47 user nova-compute[72586]:   <memory>524288</memory>
Aug 01 21:19:47 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:19:47 user nova-compute[72586]:   <metadata>
Aug 01 21:19:47 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:19:47 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:19:47 user nova-compute[72586]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1431613257</nova:name>
Aug 01 21:19:47 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:19:47</nova:creationTime>
Aug 01 21:19:47 user nova-compute[72586]:       <nova:flavor name="m1.tiny">
Aug 01 21:19:47 user nova-compute[72586]:         <nova:memory>512</nova:memory>
Aug 01 21:19:47 user nova-compute[72586]:         <nova:disk>1</nova:disk>
Aug 01 21:19:47 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:19:47 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:19:47 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:19:47 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:19:47 user nova-compute[72586]:       <nova:owner>
Aug 01 21:19:47 user nova-compute[72586]:         <nova:user uuid="e1a0d71c79c04216b9bf278f650aeb77">tempest-AttachVolumeShelveTestJSON-1935542868-project-member</nova:user>
Aug 01 21:19:47 user nova-compute[72586]:         <nova:project uuid="ae659e4ad43c44e2a8f6d48818bb796a">tempest-AttachVolumeShelveTestJSON-1935542868</nova:project>
Aug 01 21:19:47 user nova-compute[72586]:       </nova:owner>
Aug 01 21:19:47 user nova-compute[72586]:       <nova:root type="image" uuid="0243d46b-6819-42a5-926f-42b71f0c97ad"/>
Aug 01 21:19:47 user nova-compute[72586]:       <nova:ports>
Aug 01 21:19:47 user nova-compute[72586]:         <nova:port uuid="a766e2fb-84bd-40c0-a6d7-cdd68b728cd9">
Aug 01 21:19:47 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 01 21:19:47 user nova-compute[72586]:         </nova:port>
Aug 01 21:19:47 user nova-compute[72586]:       </nova:ports>
Aug 01 21:19:47 user nova-compute[72586]:     </nova:instance>
Aug 01 21:19:47 user nova-compute[72586]:   </metadata>
Aug 01 21:19:47 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:19:47 user nova-compute[72586]:     <system>
Aug 01 21:19:47 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:19:47 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:19:47 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:19:47 user nova-compute[72586]:       <entry name="serial">eccf50b0-9acc-49b6-8044-601e47d18c38</entry>
Aug 01 21:19:47 user nova-compute[72586]:       <entry name="uuid">eccf50b0-9acc-49b6-8044-601e47d18c38</entry>
Aug 01 21:19:47 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:19:47 user nova-compute[72586]:     </system>
Aug 01 21:19:47 user nova-compute[72586]:   </sysinfo>
Aug 01 21:19:47 user nova-compute[72586]:   <os>
Aug 01 21:19:47 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:19:47 user nova-compute[72586]:     <boot dev="hd"/>
Aug 01 21:19:47 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:19:47 user nova-compute[72586]:   </os>
Aug 01 21:19:47 user nova-compute[72586]:   <features>
Aug 01 21:19:47 user nova-compute[72586]:     <acpi/>
Aug 01 21:19:47 user nova-compute[72586]:     <apic/>
Aug 01 21:19:47 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:19:47 user nova-compute[72586]:   </features>
Aug 01 21:19:47 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:19:47 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:19:47 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:19:47 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:19:47 user nova-compute[72586]:   </clock>
Aug 01 21:19:47 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:19:47 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:19:47 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:19:47 user nova-compute[72586]:   </cpu>
Aug 01 21:19:47 user nova-compute[72586]:   <devices>
Aug 01 21:19:47 user nova-compute[72586]:     <disk type="file" device="disk">
Aug 01 21:19:47 user nova-compute[72586]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 21:19:47 user nova-compute[72586]:       <source file="/opt/stack/data/nova/instances/eccf50b0-9acc-49b6-8044-601e47d18c38/disk"/>
Aug 01 21:19:47 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:19:47 user nova-compute[72586]:     </disk>
Aug 01 21:19:47 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:19:47 user nova-compute[72586]:       <mac address="fa:16:3e:fe:82:a2"/>
Aug 01 21:19:47 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:19:47 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:19:47 user nova-compute[72586]:       <target dev="tapa766e2fb-84"/>
Aug 01 21:19:47 user nova-compute[72586]:     </interface>
Aug 01 21:19:47 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:19:47 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/eccf50b0-9acc-49b6-8044-601e47d18c38/console.log" append="off"/>
Aug 01 21:19:47 user nova-compute[72586]:     </serial>
Aug 01 21:19:47 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:19:47 user nova-compute[72586]:     <video>
Aug 01 21:19:47 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:19:47 user nova-compute[72586]:     </video>
Aug 01 21:19:47 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:19:47 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:19:47 user nova-compute[72586]:     </rng>
Aug 01 21:19:47 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:19:47 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:19:47 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:19:47 user nova-compute[72586]:     </memballoon>
Aug 01 21:19:47 user nova-compute[72586]:   </devices>
Aug 01 21:19:47 user nova-compute[72586]: </domain>
Aug 01 21:19:47 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:19:47 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:19:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1431613257',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1431613257',id=4,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAzEKXFXyPEjmIAPh8qhlm5PDtJ745fuzeyPBR5mURReQVRsVkj1Kaj9A+C0pWvsCvlNKTWjeyuZ2oyzNMfwG0yhQo8/3Rvrhu8rmxObx77lv5HbcJYhByjJ1JwrLFHn7w==',key_name='tempest-keypair-2087820494',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae659e4ad43c44e2a8f6d48818bb796a',ramdisk_id='',reservation_id='r-kpiui11s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1935542868',owner_user_name='tempest-AttachVolumeShelveTestJSON-1935542868-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:19:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1a0d71c79c04216b9bf278f650aeb77',uuid=eccf50b0-9acc-49b6-8044-601e47d18c38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a766e2fb-84bd-40c0-a6d7-cdd68b728cd9", "address": "fa:16:3e:fe:82:a2", "network": {"id": "a5da07bc-2f5d-461e-b31f-df624d9c6557", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948878141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae659e4ad43c44e2a8f6d48818bb796a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa766e2fb-84", "ovs_interfaceid": "a766e2fb-84bd-40c0-a6d7-cdd68b728cd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:19:47 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Converting VIF {"id": "a766e2fb-84bd-40c0-a6d7-cdd68b728cd9", "address": "fa:16:3e:fe:82:a2", "network": {"id": "a5da07bc-2f5d-461e-b31f-df624d9c6557", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948878141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae659e4ad43c44e2a8f6d48818bb796a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa766e2fb-84", "ovs_interfaceid": "a766e2fb-84bd-40c0-a6d7-cdd68b728cd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:19:47 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:82:a2,bridge_name='br-int',has_traffic_filtering=True,id=a766e2fb-84bd-40c0-a6d7-cdd68b728cd9,network=Network(a5da07bc-2f5d-461e-b31f-df624d9c6557),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa766e2fb-84') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:19:47 user nova-compute[72586]: DEBUG os_vif [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:82:a2,bridge_name='br-int',has_traffic_filtering=True,id=a766e2fb-84bd-40c0-a6d7-cdd68b728cd9,network=Network(a5da07bc-2f5d-461e-b31f-df624d9c6557),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa766e2fb-84') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:19:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:19:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:19:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa766e2fb-84, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:19:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa766e2fb-84, col_values=(('external_ids', {'iface-id': 'a766e2fb-84bd-40c0-a6d7-cdd68b728cd9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:82:a2', 'vm-uuid': 'eccf50b0-9acc-49b6-8044-601e47d18c38'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:19:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:19:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:47 user nova-compute[72586]: INFO os_vif [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:82:a2,bridge_name='br-int',has_traffic_filtering=True,id=a766e2fb-84bd-40c0-a6d7-cdd68b728cd9,network=Network(a5da07bc-2f5d-461e-b31f-df624d9c6557),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa766e2fb-84')
Aug 01 21:19:47 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:19:47 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] No VIF found with MAC fa:16:3e:fe:82:a2, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:19:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:48 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:48 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:49 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:49 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:49 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:49 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:49 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:49 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:49 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:50 user nova-compute[72586]: DEBUG nova.network.neutron [req-69b46562-a473-4728-b74f-2675797d3341 req-54f5eb45-aada-47a8-92e6-f4bbe63b50bc service nova] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Updated VIF entry in instance network info cache for port a766e2fb-84bd-40c0-a6d7-cdd68b728cd9. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:19:50 user nova-compute[72586]: DEBUG nova.network.neutron [req-69b46562-a473-4728-b74f-2675797d3341 req-54f5eb45-aada-47a8-92e6-f4bbe63b50bc service nova] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Updating instance_info_cache with network_info: [{"id": "a766e2fb-84bd-40c0-a6d7-cdd68b728cd9", "address": "fa:16:3e:fe:82:a2", "network": {"id": "a5da07bc-2f5d-461e-b31f-df624d9c6557", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948878141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae659e4ad43c44e2a8f6d48818bb796a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa766e2fb-84", "ovs_interfaceid": "a766e2fb-84bd-40c0-a6d7-cdd68b728cd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:19:50 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-69b46562-a473-4728-b74f-2675797d3341 req-54f5eb45-aada-47a8-92e6-f4bbe63b50bc service nova] Releasing lock "refresh_cache-eccf50b0-9acc-49b6-8044-601e47d18c38" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:19:50 user nova-compute[72586]: DEBUG nova.network.neutron [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Successfully updated port: 4a722ba3-a6e6-4e2f-963d-f4938bc14926 {{(pid=72586) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 21:19:50 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Acquiring lock "refresh_cache-0fde640d-b731-405d-af91-fb4ef85fe90a" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:19:50 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Acquired lock "refresh_cache-0fde640d-b731-405d-af91-fb4ef85fe90a" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:19:50 user nova-compute[72586]: DEBUG nova.network.neutron [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:19:50 user nova-compute[72586]: DEBUG nova.compute.manager [req-8ecdb1e2-8f18-40de-8804-7dc586b5726e req-733996d2-3bdd-4693-ad04-7b569602a7de service nova] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Received event network-changed-4a722ba3-a6e6-4e2f-963d-f4938bc14926 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:19:50 user nova-compute[72586]: DEBUG nova.compute.manager [req-8ecdb1e2-8f18-40de-8804-7dc586b5726e req-733996d2-3bdd-4693-ad04-7b569602a7de service nova] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Refreshing instance network info cache due to event network-changed-4a722ba3-a6e6-4e2f-963d-f4938bc14926. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:19:50 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-8ecdb1e2-8f18-40de-8804-7dc586b5726e req-733996d2-3bdd-4693-ad04-7b569602a7de service nova] Acquiring lock "refresh_cache-0fde640d-b731-405d-af91-fb4ef85fe90a" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:19:50 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:50 user nova-compute[72586]: DEBUG nova.network.neutron [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Instance cache missing network info. {{(pid=72586) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 21:19:51 user nova-compute[72586]: DEBUG nova.compute.manager [req-f5b81467-0f1d-482c-9d3e-0726f9386a39 req-554d4728-7e10-40a7-b2bc-db272f67839c service nova] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Received event network-vif-plugged-a766e2fb-84bd-40c0-a6d7-cdd68b728cd9 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:19:51 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-f5b81467-0f1d-482c-9d3e-0726f9386a39 req-554d4728-7e10-40a7-b2bc-db272f67839c service nova] Acquiring lock "eccf50b0-9acc-49b6-8044-601e47d18c38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:19:51 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-f5b81467-0f1d-482c-9d3e-0726f9386a39 req-554d4728-7e10-40a7-b2bc-db272f67839c service nova] Lock "eccf50b0-9acc-49b6-8044-601e47d18c38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:19:51 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-f5b81467-0f1d-482c-9d3e-0726f9386a39 req-554d4728-7e10-40a7-b2bc-db272f67839c service nova] Lock "eccf50b0-9acc-49b6-8044-601e47d18c38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:19:51 user nova-compute[72586]: DEBUG nova.compute.manager [req-f5b81467-0f1d-482c-9d3e-0726f9386a39 req-554d4728-7e10-40a7-b2bc-db272f67839c service nova] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] No waiting events found dispatching network-vif-plugged-a766e2fb-84bd-40c0-a6d7-cdd68b728cd9 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:19:51 user nova-compute[72586]: WARNING nova.compute.manager [req-f5b81467-0f1d-482c-9d3e-0726f9386a39 req-554d4728-7e10-40a7-b2bc-db272f67839c service nova] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Received unexpected event network-vif-plugged-a766e2fb-84bd-40c0-a6d7-cdd68b728cd9 for instance with vm_state building and task_state spawning.
Aug 01 21:19:51 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:51 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:51 user nova-compute[72586]: DEBUG nova.network.neutron [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Updating instance_info_cache with network_info: [{"id": "4a722ba3-a6e6-4e2f-963d-f4938bc14926", "address": "fa:16:3e:f7:58:6a", "network": {"id": "d8cf5f10-6a59-4aa2-b8e8-b53932d3734e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1728024316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc531307652485c99598d21cacc2f93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a722ba3-a6", "ovs_interfaceid": "4a722ba3-a6e6-4e2f-963d-f4938bc14926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:19:51 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:51 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Releasing lock "refresh_cache-0fde640d-b731-405d-af91-fb4ef85fe90a" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:19:51 user nova-compute[72586]: DEBUG nova.compute.manager [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Instance network_info: |[{"id": "4a722ba3-a6e6-4e2f-963d-f4938bc14926", "address": "fa:16:3e:f7:58:6a", "network": {"id": "d8cf5f10-6a59-4aa2-b8e8-b53932d3734e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1728024316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc531307652485c99598d21cacc2f93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a722ba3-a6", "ovs_interfaceid": "4a722ba3-a6e6-4e2f-963d-f4938bc14926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 21:19:51 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-8ecdb1e2-8f18-40de-8804-7dc586b5726e req-733996d2-3bdd-4693-ad04-7b569602a7de service nova] Acquired lock "refresh_cache-0fde640d-b731-405d-af91-fb4ef85fe90a" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:19:51 user nova-compute[72586]: DEBUG nova.network.neutron [req-8ecdb1e2-8f18-40de-8804-7dc586b5726e req-733996d2-3bdd-4693-ad04-7b569602a7de service nova] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Refreshing network info cache for port 4a722ba3-a6e6-4e2f-963d-f4938bc14926 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:19:51 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Start _get_guest_xml network_info=[{"id": "4a722ba3-a6e6-4e2f-963d-f4938bc14926", "address": "fa:16:3e:f7:58:6a", "network": {"id": "d8cf5f10-6a59-4aa2-b8e8-b53932d3734e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1728024316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc531307652485c99598d21cacc2f93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a722ba3-a6", "ovs_interfaceid": "4a722ba3-a6e6-4e2f-963d-f4938bc14926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '0243d46b-6819-42a5-926f-42b71f0c97ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:19:51 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:19:51 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:19:51 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:19:51 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:19:51 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:19:51 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:19:51 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:19:51 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:19:51 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:19:51 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:19:51 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:19:51 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:19:51 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:19:51 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:19:51 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:19:51 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:19:51 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:19:51 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:19:51 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:19:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-88921891',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-88921891',id=5,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGHrswvETVG0LRQ/0omeZrlpFNxA8jORgA8WjXRVoWgF1tDq9Gtuy3iR/X+aKJhzLAAdPZD6DgVxCF6brJznds0mWHOXjexn2sym7WZFHC1Zen4+emSAH5/JnC5a5wZPw==',key_name='tempest-keypair-1238992116',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2fc531307652485c99598d21cacc2f93',ramdisk_id='',reservation_id='r-y0g01qqi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-390719395',owner_user_name='tempest-ServerActionsV293TestJSON-390719395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:19:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89385b6c1686413db06c1c08a7c2e442',uuid=0fde640d-b731-405d-af91-fb4ef85fe90a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a722ba3-a6e6-4e2f-963d-f4938bc14926", "address": "fa:16:3e:f7:58:6a", "network": {"id": "d8cf5f10-6a59-4aa2-b8e8-b53932d3734e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1728024316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc531307652485c99598d21cacc2f93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a722ba3-a6", "ovs_interfaceid": "4a722ba3-a6e6-4e2f-963d-f4938bc14926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:19:51 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Converting VIF {"id": "4a722ba3-a6e6-4e2f-963d-f4938bc14926", "address": "fa:16:3e:f7:58:6a", "network": {"id": "d8cf5f10-6a59-4aa2-b8e8-b53932d3734e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1728024316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc531307652485c99598d21cacc2f93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a722ba3-a6", "ovs_interfaceid": "4a722ba3-a6e6-4e2f-963d-f4938bc14926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:19:51 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:58:6a,bridge_name='br-int',has_traffic_filtering=True,id=4a722ba3-a6e6-4e2f-963d-f4938bc14926,network=Network(d8cf5f10-6a59-4aa2-b8e8-b53932d3734e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a722ba3-a6') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:19:51 user nova-compute[72586]: DEBUG nova.objects.instance [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Lazy-loading 'pci_devices' on Instance uuid 0fde640d-b731-405d-af91-fb4ef85fe90a {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:19:51 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:19:51 user nova-compute[72586]:   <uuid>0fde640d-b731-405d-af91-fb4ef85fe90a</uuid>
Aug 01 21:19:51 user nova-compute[72586]:   <name>instance-00000005</name>
Aug 01 21:19:51 user nova-compute[72586]:   <memory>524288</memory>
Aug 01 21:19:51 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:19:51 user nova-compute[72586]:   <metadata>
Aug 01 21:19:51 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:19:51 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:19:51 user nova-compute[72586]:       <nova:name>tempest-ServerActionsV293TestJSON-server-88921891</nova:name>
Aug 01 21:19:51 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:19:51</nova:creationTime>
Aug 01 21:19:51 user nova-compute[72586]:       <nova:flavor name="m1.tiny">
Aug 01 21:19:51 user nova-compute[72586]:         <nova:memory>512</nova:memory>
Aug 01 21:19:51 user nova-compute[72586]:         <nova:disk>1</nova:disk>
Aug 01 21:19:51 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:19:51 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:19:51 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:19:51 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:19:51 user nova-compute[72586]:       <nova:owner>
Aug 01 21:19:51 user nova-compute[72586]:         <nova:user uuid="89385b6c1686413db06c1c08a7c2e442">tempest-ServerActionsV293TestJSON-390719395-project-member</nova:user>
Aug 01 21:19:51 user nova-compute[72586]:         <nova:project uuid="2fc531307652485c99598d21cacc2f93">tempest-ServerActionsV293TestJSON-390719395</nova:project>
Aug 01 21:19:51 user nova-compute[72586]:       </nova:owner>
Aug 01 21:19:51 user nova-compute[72586]:       <nova:root type="image" uuid="0243d46b-6819-42a5-926f-42b71f0c97ad"/>
Aug 01 21:19:51 user nova-compute[72586]:       <nova:ports>
Aug 01 21:19:51 user nova-compute[72586]:         <nova:port uuid="4a722ba3-a6e6-4e2f-963d-f4938bc14926">
Aug 01 21:19:51 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 01 21:19:51 user nova-compute[72586]:         </nova:port>
Aug 01 21:19:51 user nova-compute[72586]:       </nova:ports>
Aug 01 21:19:51 user nova-compute[72586]:     </nova:instance>
Aug 01 21:19:51 user nova-compute[72586]:   </metadata>
Aug 01 21:19:51 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:19:51 user nova-compute[72586]:     <system>
Aug 01 21:19:51 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:19:51 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:19:51 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:19:51 user nova-compute[72586]:       <entry name="serial">0fde640d-b731-405d-af91-fb4ef85fe90a</entry>
Aug 01 21:19:51 user nova-compute[72586]:       <entry name="uuid">0fde640d-b731-405d-af91-fb4ef85fe90a</entry>
Aug 01 21:19:51 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:19:51 user nova-compute[72586]:     </system>
Aug 01 21:19:51 user nova-compute[72586]:   </sysinfo>
Aug 01 21:19:51 user nova-compute[72586]:   <os>
Aug 01 21:19:51 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:19:51 user nova-compute[72586]:     <boot dev="hd"/>
Aug 01 21:19:51 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:19:51 user nova-compute[72586]:   </os>
Aug 01 21:19:51 user nova-compute[72586]:   <features>
Aug 01 21:19:51 user nova-compute[72586]:     <acpi/>
Aug 01 21:19:51 user nova-compute[72586]:     <apic/>
Aug 01 21:19:51 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:19:51 user nova-compute[72586]:   </features>
Aug 01 21:19:51 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:19:51 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:19:51 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:19:51 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:19:51 user nova-compute[72586]:   </clock>
Aug 01 21:19:51 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:19:51 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:19:51 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:19:51 user nova-compute[72586]:   </cpu>
Aug 01 21:19:51 user nova-compute[72586]:   <devices>
Aug 01 21:19:51 user nova-compute[72586]:     <disk type="file" device="disk">
Aug 01 21:19:51 user nova-compute[72586]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 21:19:51 user nova-compute[72586]:       <source file="/opt/stack/data/nova/instances/0fde640d-b731-405d-af91-fb4ef85fe90a/disk"/>
Aug 01 21:19:51 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:19:51 user nova-compute[72586]:     </disk>
Aug 01 21:19:51 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:19:51 user nova-compute[72586]:       <mac address="fa:16:3e:f7:58:6a"/>
Aug 01 21:19:51 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:19:51 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:19:51 user nova-compute[72586]:       <target dev="tap4a722ba3-a6"/>
Aug 01 21:19:51 user nova-compute[72586]:     </interface>
Aug 01 21:19:51 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:19:51 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/0fde640d-b731-405d-af91-fb4ef85fe90a/console.log" append="off"/>
Aug 01 21:19:51 user nova-compute[72586]:     </serial>
Aug 01 21:19:51 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:19:51 user nova-compute[72586]:     <video>
Aug 01 21:19:51 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:19:51 user nova-compute[72586]:     </video>
Aug 01 21:19:51 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:19:51 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:19:51 user nova-compute[72586]:     </rng>
Aug 01 21:19:51 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:19:51 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:19:51 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:19:51 user nova-compute[72586]:     </memballoon>
Aug 01 21:19:51 user nova-compute[72586]:   </devices>
Aug 01 21:19:51 user nova-compute[72586]: </domain>
Aug 01 21:19:51 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:19:51 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:19:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-88921891',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-88921891',id=5,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGHrswvETVG0LRQ/0omeZrlpFNxA8jORgA8WjXRVoWgF1tDq9Gtuy3iR/X+aKJhzLAAdPZD6DgVxCF6brJznds0mWHOXjexn2sym7WZFHC1Zen4+emSAH5/JnC5a5wZPw==',key_name='tempest-keypair-1238992116',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2fc531307652485c99598d21cacc2f93',ramdisk_id='',reservation_id='r-y0g01qqi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-390719395',owner_user_name='tempest-ServerActionsV293TestJSON-390719395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:19:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89385b6c1686413db06c1c08a7c2e442',uuid=0fde640d-b731-405d-af91-fb4ef85fe90a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a722ba3-a6e6-4e2f-963d-f4938bc14926", "address": "fa:16:3e:f7:58:6a", "network": {"id": "d8cf5f10-6a59-4aa2-b8e8-b53932d3734e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1728024316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc531307652485c99598d21cacc2f93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a722ba3-a6", "ovs_interfaceid": "4a722ba3-a6e6-4e2f-963d-f4938bc14926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:19:51 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Converting VIF {"id": "4a722ba3-a6e6-4e2f-963d-f4938bc14926", "address": "fa:16:3e:f7:58:6a", "network": {"id": "d8cf5f10-6a59-4aa2-b8e8-b53932d3734e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1728024316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc531307652485c99598d21cacc2f93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a722ba3-a6", "ovs_interfaceid": "4a722ba3-a6e6-4e2f-963d-f4938bc14926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:19:51 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:58:6a,bridge_name='br-int',has_traffic_filtering=True,id=4a722ba3-a6e6-4e2f-963d-f4938bc14926,network=Network(d8cf5f10-6a59-4aa2-b8e8-b53932d3734e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a722ba3-a6') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:19:51 user nova-compute[72586]: DEBUG os_vif [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:58:6a,bridge_name='br-int',has_traffic_filtering=True,id=4a722ba3-a6e6-4e2f-963d-f4938bc14926,network=Network(d8cf5f10-6a59-4aa2-b8e8-b53932d3734e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a722ba3-a6') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:19:51 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:51 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:19:51 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:19:51 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:51 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4a722ba3-a6, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:19:51 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4a722ba3-a6, col_values=(('external_ids', {'iface-id': '4a722ba3-a6e6-4e2f-963d-f4938bc14926', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:58:6a', 'vm-uuid': '0fde640d-b731-405d-af91-fb4ef85fe90a'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:19:51 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:51 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:19:51 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:51 user nova-compute[72586]: INFO os_vif [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:58:6a,bridge_name='br-int',has_traffic_filtering=True,id=4a722ba3-a6e6-4e2f-963d-f4938bc14926,network=Network(d8cf5f10-6a59-4aa2-b8e8-b53932d3734e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a722ba3-a6')
Aug 01 21:19:52 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:19:52 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] No VIF found with MAC fa:16:3e:f7:58:6a, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:19:52 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690924792.3920593, eccf50b0-9acc-49b6-8044-601e47d18c38 => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:19:52 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] VM Resumed (Lifecycle Event)
Aug 01 21:19:52 user nova-compute[72586]: DEBUG nova.compute.manager [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Instance event wait completed in 0 seconds for  {{(pid=72586) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 21:19:52 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Guest created on hypervisor {{(pid=72586) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 21:19:52 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Instance spawned successfully.
Aug 01 21:19:52 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 21:19:52 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:19:52 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:19:52 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Found default for hw_cdrom_bus of ide {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:19:52 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Found default for hw_disk_bus of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:19:52 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Found default for hw_input_bus of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:19:52 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Found default for hw_pointer_model of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:19:52 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Found default for hw_video_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:19:52 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Found default for hw_vif_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:19:52 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:19:52 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690924792.3957133, eccf50b0-9acc-49b6-8044-601e47d18c38 => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:19:52 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] VM Started (Lifecycle Event)
Aug 01 21:19:52 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:19:52 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:19:52 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:19:52 user nova-compute[72586]: INFO nova.compute.manager [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Took 14.91 seconds to spawn the instance on the hypervisor.
Aug 01 21:19:52 user nova-compute[72586]: DEBUG nova.compute.manager [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:19:52 user nova-compute[72586]: INFO nova.compute.manager [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Took 15.70 seconds to build instance.
Aug 01 21:19:52 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3ee3ebac-5a52-4729-ba8c-559ede25e7d8 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "eccf50b0-9acc-49b6-8044-601e47d18c38" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.976s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:19:53 user nova-compute[72586]: DEBUG nova.compute.manager [req-aba46957-14d6-4154-b57a-7d0d5bed37b0 req-79206df4-a0a7-4215-bfad-826012dffc6e service nova] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Received event network-vif-plugged-a766e2fb-84bd-40c0-a6d7-cdd68b728cd9 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:19:53 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-aba46957-14d6-4154-b57a-7d0d5bed37b0 req-79206df4-a0a7-4215-bfad-826012dffc6e service nova] Acquiring lock "eccf50b0-9acc-49b6-8044-601e47d18c38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:19:53 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-aba46957-14d6-4154-b57a-7d0d5bed37b0 req-79206df4-a0a7-4215-bfad-826012dffc6e service nova] Lock "eccf50b0-9acc-49b6-8044-601e47d18c38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:19:53 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-aba46957-14d6-4154-b57a-7d0d5bed37b0 req-79206df4-a0a7-4215-bfad-826012dffc6e service nova] Lock "eccf50b0-9acc-49b6-8044-601e47d18c38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:19:53 user nova-compute[72586]: DEBUG nova.compute.manager [req-aba46957-14d6-4154-b57a-7d0d5bed37b0 req-79206df4-a0a7-4215-bfad-826012dffc6e service nova] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] No waiting events found dispatching network-vif-plugged-a766e2fb-84bd-40c0-a6d7-cdd68b728cd9 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:19:53 user nova-compute[72586]: WARNING nova.compute.manager [req-aba46957-14d6-4154-b57a-7d0d5bed37b0 req-79206df4-a0a7-4215-bfad-826012dffc6e service nova] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Received unexpected event network-vif-plugged-a766e2fb-84bd-40c0-a6d7-cdd68b728cd9 for instance with vm_state active and task_state None.
Aug 01 21:19:53 user nova-compute[72586]: DEBUG nova.network.neutron [req-8ecdb1e2-8f18-40de-8804-7dc586b5726e req-733996d2-3bdd-4693-ad04-7b569602a7de service nova] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Updated VIF entry in instance network info cache for port 4a722ba3-a6e6-4e2f-963d-f4938bc14926. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:19:53 user nova-compute[72586]: DEBUG nova.network.neutron [req-8ecdb1e2-8f18-40de-8804-7dc586b5726e req-733996d2-3bdd-4693-ad04-7b569602a7de service nova] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Updating instance_info_cache with network_info: [{"id": "4a722ba3-a6e6-4e2f-963d-f4938bc14926", "address": "fa:16:3e:f7:58:6a", "network": {"id": "d8cf5f10-6a59-4aa2-b8e8-b53932d3734e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1728024316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc531307652485c99598d21cacc2f93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a722ba3-a6", "ovs_interfaceid": "4a722ba3-a6e6-4e2f-963d-f4938bc14926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:19:53 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-8ecdb1e2-8f18-40de-8804-7dc586b5726e req-733996d2-3bdd-4693-ad04-7b569602a7de service nova] Releasing lock "refresh_cache-0fde640d-b731-405d-af91-fb4ef85fe90a" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:19:53 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:53 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:53 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:54 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:54 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:54 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:55 user nova-compute[72586]: DEBUG nova.compute.manager [req-df6ac771-5041-40f9-ae1c-0a57319dbb10 req-4e680a03-f11d-4795-91f9-76f07ce7f099 service nova] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Received event network-vif-plugged-4a722ba3-a6e6-4e2f-963d-f4938bc14926 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:19:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-df6ac771-5041-40f9-ae1c-0a57319dbb10 req-4e680a03-f11d-4795-91f9-76f07ce7f099 service nova] Acquiring lock "0fde640d-b731-405d-af91-fb4ef85fe90a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:19:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-df6ac771-5041-40f9-ae1c-0a57319dbb10 req-4e680a03-f11d-4795-91f9-76f07ce7f099 service nova] Lock "0fde640d-b731-405d-af91-fb4ef85fe90a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:19:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-df6ac771-5041-40f9-ae1c-0a57319dbb10 req-4e680a03-f11d-4795-91f9-76f07ce7f099 service nova] Lock "0fde640d-b731-405d-af91-fb4ef85fe90a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:19:55 user nova-compute[72586]: DEBUG nova.compute.manager [req-df6ac771-5041-40f9-ae1c-0a57319dbb10 req-4e680a03-f11d-4795-91f9-76f07ce7f099 service nova] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] No waiting events found dispatching network-vif-plugged-4a722ba3-a6e6-4e2f-963d-f4938bc14926 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:19:55 user nova-compute[72586]: WARNING nova.compute.manager [req-df6ac771-5041-40f9-ae1c-0a57319dbb10 req-4e680a03-f11d-4795-91f9-76f07ce7f099 service nova] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Received unexpected event network-vif-plugged-4a722ba3-a6e6-4e2f-963d-f4938bc14926 for instance with vm_state building and task_state spawning.
Aug 01 21:19:56 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690924796.7121964, 0fde640d-b731-405d-af91-fb4ef85fe90a => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:19:56 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] VM Resumed (Lifecycle Event)
Aug 01 21:19:56 user nova-compute[72586]: DEBUG nova.compute.manager [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Instance event wait completed in 0 seconds for  {{(pid=72586) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 21:19:56 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Guest created on hypervisor {{(pid=72586) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 21:19:56 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Instance spawned successfully.
Aug 01 21:19:56 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 21:19:56 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:19:56 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:19:56 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:19:56 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690924796.727621, 0fde640d-b731-405d-af91-fb4ef85fe90a => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:19:56 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] VM Started (Lifecycle Event)
Aug 01 21:19:56 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Found default for hw_cdrom_bus of ide {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:19:56 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Found default for hw_disk_bus of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:19:56 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Found default for hw_input_bus of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:19:56 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Found default for hw_pointer_model of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:19:56 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Found default for hw_video_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:19:56 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Found default for hw_vif_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:19:56 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:19:56 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:19:56 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:19:56 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:56 user nova-compute[72586]: INFO nova.compute.manager [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Took 16.02 seconds to spawn the instance on the hypervisor.
Aug 01 21:19:56 user nova-compute[72586]: DEBUG nova.compute.manager [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:19:57 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:57 user nova-compute[72586]: INFO nova.compute.manager [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Took 16.97 seconds to build instance.
Aug 01 21:19:57 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c57fb515-774e-4777-a0d3-c4418e07ebfe tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Lock "0fde640d-b731-405d-af91-fb4ef85fe90a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.155s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:19:57 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:19:57 user nova-compute[72586]: DEBUG nova.compute.manager [req-ca30abd0-c1f5-4c5a-bf9c-5e62abcaeb72 req-2e8e631f-8ffc-453b-bfd6-337bfaf2a775 service nova] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Received event network-vif-plugged-4a722ba3-a6e6-4e2f-963d-f4938bc14926 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:19:57 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ca30abd0-c1f5-4c5a-bf9c-5e62abcaeb72 req-2e8e631f-8ffc-453b-bfd6-337bfaf2a775 service nova] Acquiring lock "0fde640d-b731-405d-af91-fb4ef85fe90a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:19:57 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ca30abd0-c1f5-4c5a-bf9c-5e62abcaeb72 req-2e8e631f-8ffc-453b-bfd6-337bfaf2a775 service nova] Lock "0fde640d-b731-405d-af91-fb4ef85fe90a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:19:57 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ca30abd0-c1f5-4c5a-bf9c-5e62abcaeb72 req-2e8e631f-8ffc-453b-bfd6-337bfaf2a775 service nova] Lock "0fde640d-b731-405d-af91-fb4ef85fe90a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:19:57 user nova-compute[72586]: DEBUG nova.compute.manager [req-ca30abd0-c1f5-4c5a-bf9c-5e62abcaeb72 req-2e8e631f-8ffc-453b-bfd6-337bfaf2a775 service nova] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] No waiting events found dispatching network-vif-plugged-4a722ba3-a6e6-4e2f-963d-f4938bc14926 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:19:57 user nova-compute[72586]: WARNING nova.compute.manager [req-ca30abd0-c1f5-4c5a-bf9c-5e62abcaeb72 req-2e8e631f-8ffc-453b-bfd6-337bfaf2a775 service nova] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Received unexpected event network-vif-plugged-4a722ba3-a6e6-4e2f-963d-f4938bc14926 for instance with vm_state active and task_state None.
Aug 01 21:19:58 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Acquiring lock "9197638d-0c03-4b4e-876a-003bd8db3c35" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:20:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Lock "9197638d-0c03-4b4e-876a-003bd8db3c35" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:20:00 user nova-compute[72586]: DEBUG nova.compute.manager [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Starting instance... {{(pid=72586) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 21:20:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:20:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:20:01 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72586) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 21:20:01 user nova-compute[72586]: INFO nova.compute.claims [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Claim successful on node user
Aug 01 21:20:01 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:20:01 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:20:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.604s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:20:01 user nova-compute[72586]: DEBUG nova.compute.manager [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Start building networks asynchronously for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 21:20:01 user nova-compute[72586]: DEBUG nova.compute.manager [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Allocating IP information in the background. {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 21:20:01 user nova-compute[72586]: DEBUG nova.network.neutron [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] allocate_for_instance() {{(pid=72586) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 21:20:01 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 01 21:20:01 user nova-compute[72586]: DEBUG nova.compute.manager [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Start building block device mappings for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 21:20:01 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:01 user nova-compute[72586]: DEBUG nova.policy [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a2736ebf83dc482281755eb266739a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1332e56dc4a158be5c285ce251f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72586) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 21:20:02 user nova-compute[72586]: DEBUG nova.compute.manager [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Start spawning the instance on the hypervisor. {{(pid=72586) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 21:20:02 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Creating instance directory {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 21:20:02 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Creating image(s)
Aug 01 21:20:02 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Acquiring lock "/opt/stack/data/nova/instances/9197638d-0c03-4b4e-876a-003bd8db3c35/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:20:02 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Lock "/opt/stack/data/nova/instances/9197638d-0c03-4b4e-876a-003bd8db3c35/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:20:02 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Lock "/opt/stack/data/nova/instances/9197638d-0c03-4b4e-876a-003bd8db3c35/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:20:02 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Acquiring lock "616316bc3aa017e5be44b4848d8064f39fb2137c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:20:02 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Lock "616316bc3aa017e5be44b4848d8064f39fb2137c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:20:02 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/616316bc3aa017e5be44b4848d8064f39fb2137c.part --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:20:03 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/616316bc3aa017e5be44b4848d8064f39fb2137c.part --force-share --output=json" returned: 0 in 0.263s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:20:03 user nova-compute[72586]: DEBUG nova.virt.images [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] 9f619018-9915-4d87-ac1d-9572432baab6 was qcow2, converting to raw {{(pid=72586) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 21:20:03 user nova-compute[72586]: DEBUG nova.privsep.utils [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72586) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 21:20:03 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/616316bc3aa017e5be44b4848d8064f39fb2137c.part /opt/stack/data/nova/instances/_base/616316bc3aa017e5be44b4848d8064f39fb2137c.converted {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:20:03 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:03 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/616316bc3aa017e5be44b4848d8064f39fb2137c.part /opt/stack/data/nova/instances/_base/616316bc3aa017e5be44b4848d8064f39fb2137c.converted" returned: 0 in 0.399s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:20:03 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/616316bc3aa017e5be44b4848d8064f39fb2137c.converted --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:20:03 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:03 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Acquiring lock "3830c8b3-27b8-45f3-bbdb-8a081dfcadc4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:20:03 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Lock "3830c8b3-27b8-45f3-bbdb-8a081dfcadc4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:20:03 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/616316bc3aa017e5be44b4848d8064f39fb2137c.converted --force-share --output=json" returned: 0 in 0.281s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:20:03 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Lock "616316bc3aa017e5be44b4848d8064f39fb2137c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.714s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:20:03 user nova-compute[72586]: DEBUG nova.compute.manager [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Starting instance... {{(pid=72586) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 21:20:03 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/616316bc3aa017e5be44b4848d8064f39fb2137c --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:20:03 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/616316bc3aa017e5be44b4848d8064f39fb2137c --force-share --output=json" returned: 0 in 0.218s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:20:03 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Acquiring lock "616316bc3aa017e5be44b4848d8064f39fb2137c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:20:03 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Lock "616316bc3aa017e5be44b4848d8064f39fb2137c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:20:03 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/616316bc3aa017e5be44b4848d8064f39fb2137c --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:20:04 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:20:04 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:20:04 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72586) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 21:20:04 user nova-compute[72586]: INFO nova.compute.claims [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Claim successful on node user
Aug 01 21:20:04 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/616316bc3aa017e5be44b4848d8064f39fb2137c --force-share --output=json" returned: 0 in 0.170s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:20:04 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/616316bc3aa017e5be44b4848d8064f39fb2137c,backing_fmt=raw /opt/stack/data/nova/instances/9197638d-0c03-4b4e-876a-003bd8db3c35/disk 1073741824 {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:20:04 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/616316bc3aa017e5be44b4848d8064f39fb2137c,backing_fmt=raw /opt/stack/data/nova/instances/9197638d-0c03-4b4e-876a-003bd8db3c35/disk 1073741824" returned: 0 in 0.075s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:20:04 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Lock "616316bc3aa017e5be44b4848d8064f39fb2137c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:20:04 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/616316bc3aa017e5be44b4848d8064f39fb2137c --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:20:04 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/616316bc3aa017e5be44b4848d8064f39fb2137c --force-share --output=json" returned: 0 in 0.228s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:20:04 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9197638d-0c03-4b4e-876a-003bd8db3c35/disk. size=1073741824 {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 21:20:04 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9197638d-0c03-4b4e-876a-003bd8db3c35/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:20:04 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9197638d-0c03-4b4e-876a-003bd8db3c35/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:20:04 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Cannot resize image /opt/stack/data/nova/instances/9197638d-0c03-4b4e-876a-003bd8db3c35/disk to a smaller size. {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 21:20:04 user nova-compute[72586]: DEBUG nova.objects.instance [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Lazy-loading 'migration_context' on Instance uuid 9197638d-0c03-4b4e-876a-003bd8db3c35 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:20:04 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Created local disks {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 21:20:04 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Ensure instance console log exists: /opt/stack/data/nova/instances/9197638d-0c03-4b4e-876a-003bd8db3c35/console.log {{(pid=72586) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 21:20:04 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:20:04 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:20:04 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:20:04 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:20:04 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:20:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.013s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:20:05 user nova-compute[72586]: DEBUG nova.compute.manager [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Start building networks asynchronously for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 21:20:05 user nova-compute[72586]: DEBUG nova.compute.manager [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Allocating IP information in the background. {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 21:20:05 user nova-compute[72586]: DEBUG nova.network.neutron [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] allocate_for_instance() {{(pid=72586) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 21:20:05 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 21:20:05 user nova-compute[72586]: DEBUG nova.compute.manager [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Start building block device mappings for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 21:20:05 user nova-compute[72586]: DEBUG nova.compute.manager [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Start spawning the instance on the hypervisor. {{(pid=72586) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 21:20:05 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Creating instance directory {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 21:20:05 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Creating image(s)
Aug 01 21:20:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Acquiring lock "/opt/stack/data/nova/instances/3830c8b3-27b8-45f3-bbdb-8a081dfcadc4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:20:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Lock "/opt/stack/data/nova/instances/3830c8b3-27b8-45f3-bbdb-8a081dfcadc4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:20:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Lock "/opt/stack/data/nova/instances/3830c8b3-27b8-45f3-bbdb-8a081dfcadc4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:20:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:20:05 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.176s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:20:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Acquiring lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:20:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:20:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:20:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.198s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:20:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/3830c8b3-27b8-45f3-bbdb-8a081dfcadc4/disk 1073741824 {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:20:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/3830c8b3-27b8-45f3-bbdb-8a081dfcadc4/disk 1073741824" returned: 0 in 0.067s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:20:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:20:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:20:05 user nova-compute[72586]: DEBUG nova.policy [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '06a57074fd8148679aec2090afa47ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e128138ba483401895a8d8257d2a2600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72586) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 21:20:06 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.184s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:20:06 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3830c8b3-27b8-45f3-bbdb-8a081dfcadc4/disk. size=1073741824 {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 21:20:06 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3830c8b3-27b8-45f3-bbdb-8a081dfcadc4/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:20:06 user nova-compute[72586]: DEBUG nova.network.neutron [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Successfully created port: 2c422520-a997-44b1-91dc-bfd781a5942d {{(pid=72586) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 21:20:06 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3830c8b3-27b8-45f3-bbdb-8a081dfcadc4/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:20:06 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Cannot resize image /opt/stack/data/nova/instances/3830c8b3-27b8-45f3-bbdb-8a081dfcadc4/disk to a smaller size. {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 21:20:06 user nova-compute[72586]: DEBUG nova.objects.instance [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Lazy-loading 'migration_context' on Instance uuid 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:20:06 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Created local disks {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 21:20:06 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Ensure instance console log exists: /opt/stack/data/nova/instances/3830c8b3-27b8-45f3-bbdb-8a081dfcadc4/console.log {{(pid=72586) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 21:20:06 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:20:06 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:20:06 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:20:06 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:08 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Acquiring lock "34b640b7-1dec-4b31-b64b-f1dbee7f62f6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:20:08 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Lock "34b640b7-1dec-4b31-b64b-f1dbee7f62f6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:20:08 user nova-compute[72586]: DEBUG nova.compute.manager [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Starting instance... {{(pid=72586) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 21:20:08 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:20:08 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:20:08 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72586) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 21:20:08 user nova-compute[72586]: INFO nova.compute.claims [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Claim successful on node user
Aug 01 21:20:08 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:08 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:20:08 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:20:08 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.532s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:20:08 user nova-compute[72586]: DEBUG nova.compute.manager [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Start building networks asynchronously for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 21:20:08 user nova-compute[72586]: DEBUG nova.compute.manager [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Allocating IP information in the background. {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 21:20:08 user nova-compute[72586]: DEBUG nova.network.neutron [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] allocate_for_instance() {{(pid=72586) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 21:20:08 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 21:20:08 user nova-compute[72586]: DEBUG nova.compute.manager [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Start building block device mappings for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 21:20:09 user nova-compute[72586]: DEBUG nova.policy [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '25edfd4907cf4d6c816799babd01e662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe1daeb21ad4628841cbf8406131a88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72586) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 21:20:09 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Acquiring lock "25fb970a-0caf-41e8-8d58-259dbd9cf291" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:20:09 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Lock "25fb970a-0caf-41e8-8d58-259dbd9cf291" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:20:09 user nova-compute[72586]: DEBUG nova.compute.manager [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Starting instance... {{(pid=72586) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 21:20:09 user nova-compute[72586]: DEBUG nova.compute.manager [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Start spawning the instance on the hypervisor. {{(pid=72586) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 21:20:09 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Creating instance directory {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 21:20:09 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Creating image(s)
Aug 01 21:20:09 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Acquiring lock "/opt/stack/data/nova/instances/34b640b7-1dec-4b31-b64b-f1dbee7f62f6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:20:09 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Lock "/opt/stack/data/nova/instances/34b640b7-1dec-4b31-b64b-f1dbee7f62f6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:20:09 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Lock "/opt/stack/data/nova/instances/34b640b7-1dec-4b31-b64b-f1dbee7f62f6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:20:09 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:20:09 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:20:09 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:20:09 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72586) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 21:20:09 user nova-compute[72586]: INFO nova.compute.claims [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Claim successful on node user
Aug 01 21:20:09 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.186s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:20:09 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Acquiring lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:20:09 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:20:09 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:20:09 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.178s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:20:09 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/34b640b7-1dec-4b31-b64b-f1dbee7f62f6/disk 1073741824 {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:20:09 user nova-compute[72586]: DEBUG nova.network.neutron [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Successfully updated port: 2c422520-a997-44b1-91dc-bfd781a5942d {{(pid=72586) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 21:20:09 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/34b640b7-1dec-4b31-b64b-f1dbee7f62f6/disk 1073741824" returned: 0 in 0.091s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:20:09 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:20:09 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:20:09 user nova-compute[72586]: DEBUG nova.compute.manager [req-9d7401aa-e4e7-464b-9577-8d8bd74b9285 req-b76b3499-63d1-42e3-93a9-7afce12080b7 service nova] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Received event network-changed-2c422520-a997-44b1-91dc-bfd781a5942d {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:20:09 user nova-compute[72586]: DEBUG nova.compute.manager [req-9d7401aa-e4e7-464b-9577-8d8bd74b9285 req-b76b3499-63d1-42e3-93a9-7afce12080b7 service nova] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Refreshing instance network info cache due to event network-changed-2c422520-a997-44b1-91dc-bfd781a5942d. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:20:09 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-9d7401aa-e4e7-464b-9577-8d8bd74b9285 req-b76b3499-63d1-42e3-93a9-7afce12080b7 service nova] Acquiring lock "refresh_cache-9197638d-0c03-4b4e-876a-003bd8db3c35" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:20:09 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-9d7401aa-e4e7-464b-9577-8d8bd74b9285 req-b76b3499-63d1-42e3-93a9-7afce12080b7 service nova] Acquired lock "refresh_cache-9197638d-0c03-4b4e-876a-003bd8db3c35" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:20:09 user nova-compute[72586]: DEBUG nova.network.neutron [req-9d7401aa-e4e7-464b-9577-8d8bd74b9285 req-b76b3499-63d1-42e3-93a9-7afce12080b7 service nova] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Refreshing network info cache for port 2c422520-a997-44b1-91dc-bfd781a5942d {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:20:09 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Acquiring lock "refresh_cache-9197638d-0c03-4b4e-876a-003bd8db3c35" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:20:09 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.213s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:20:09 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Checking if we can resize image /opt/stack/data/nova/instances/34b640b7-1dec-4b31-b64b-f1dbee7f62f6/disk. size=1073741824 {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 21:20:09 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b640b7-1dec-4b31-b64b-f1dbee7f62f6/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:20:09 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b640b7-1dec-4b31-b64b-f1dbee7f62f6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:20:10 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Cannot resize image /opt/stack/data/nova/instances/34b640b7-1dec-4b31-b64b-f1dbee7f62f6/disk to a smaller size. {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 21:20:10 user nova-compute[72586]: DEBUG nova.objects.instance [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Lazy-loading 'migration_context' on Instance uuid 34b640b7-1dec-4b31-b64b-f1dbee7f62f6 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:20:10 user nova-compute[72586]: DEBUG nova.network.neutron [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Successfully created port: 1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a {{(pid=72586) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 21:20:10 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Created local disks {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 21:20:10 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Ensure instance console log exists: /opt/stack/data/nova/instances/34b640b7-1dec-4b31-b64b-f1dbee7f62f6/console.log {{(pid=72586) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 21:20:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:20:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:20:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:20:10 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:20:10 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:20:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.945s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:20:10 user nova-compute[72586]: DEBUG nova.compute.manager [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Start building networks asynchronously for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 21:20:10 user nova-compute[72586]: DEBUG nova.compute.manager [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Allocating IP information in the background. {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 21:20:10 user nova-compute[72586]: DEBUG nova.network.neutron [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] allocate_for_instance() {{(pid=72586) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 21:20:10 user nova-compute[72586]: DEBUG nova.network.neutron [req-9d7401aa-e4e7-464b-9577-8d8bd74b9285 req-b76b3499-63d1-42e3-93a9-7afce12080b7 service nova] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Instance cache missing network info. {{(pid=72586) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 21:20:10 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 21:20:10 user nova-compute[72586]: DEBUG nova.compute.manager [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Start building block device mappings for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 21:20:10 user nova-compute[72586]: DEBUG nova.policy [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6d121f9e2de24379af2bccb61a3b81ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd67d749d04409923cd9b64691b638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72586) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 21:20:10 user nova-compute[72586]: DEBUG nova.compute.manager [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Start spawning the instance on the hypervisor. {{(pid=72586) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 21:20:10 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Creating instance directory {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 21:20:10 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Creating image(s)
Aug 01 21:20:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Acquiring lock "/opt/stack/data/nova/instances/25fb970a-0caf-41e8-8d58-259dbd9cf291/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:20:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Lock "/opt/stack/data/nova/instances/25fb970a-0caf-41e8-8d58-259dbd9cf291/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:20:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Lock "/opt/stack/data/nova/instances/25fb970a-0caf-41e8-8d58-259dbd9cf291/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:20:10 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:20:10 user nova-compute[72586]: DEBUG nova.network.neutron [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Successfully created port: 3a9c6772-38fc-4b17-9aee-089515b4a73e {{(pid=72586) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 21:20:10 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.188s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:20:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Acquiring lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:20:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:20:10 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:20:10 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.196s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:20:10 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/25fb970a-0caf-41e8-8d58-259dbd9cf291/disk 1073741824 {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:20:11 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/25fb970a-0caf-41e8-8d58-259dbd9cf291/disk 1073741824" returned: 0 in 0.054s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:20:11 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:20:11 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:20:11 user nova-compute[72586]: DEBUG nova.network.neutron [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Successfully updated port: 1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a {{(pid=72586) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 21:20:11 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Acquiring lock "refresh_cache-34b640b7-1dec-4b31-b64b-f1dbee7f62f6" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:20:11 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Acquired lock "refresh_cache-34b640b7-1dec-4b31-b64b-f1dbee7f62f6" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:20:11 user nova-compute[72586]: DEBUG nova.network.neutron [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:20:11 user nova-compute[72586]: DEBUG nova.compute.manager [req-0436ebfb-ee1e-425c-9749-4ba13f665c94 req-1b41eae8-97f5-4309-957a-6d869312bb5f service nova] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Received event network-changed-1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:20:11 user nova-compute[72586]: DEBUG nova.compute.manager [req-0436ebfb-ee1e-425c-9749-4ba13f665c94 req-1b41eae8-97f5-4309-957a-6d869312bb5f service nova] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Refreshing instance network info cache due to event network-changed-1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:20:11 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-0436ebfb-ee1e-425c-9749-4ba13f665c94 req-1b41eae8-97f5-4309-957a-6d869312bb5f service nova] Acquiring lock "refresh_cache-34b640b7-1dec-4b31-b64b-f1dbee7f62f6" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:20:11 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.150s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:20:11 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Checking if we can resize image /opt/stack/data/nova/instances/25fb970a-0caf-41e8-8d58-259dbd9cf291/disk. size=1073741824 {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 21:20:11 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25fb970a-0caf-41e8-8d58-259dbd9cf291/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:20:11 user nova-compute[72586]: DEBUG nova.network.neutron [req-9d7401aa-e4e7-464b-9577-8d8bd74b9285 req-b76b3499-63d1-42e3-93a9-7afce12080b7 service nova] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:20:11 user nova-compute[72586]: DEBUG nova.network.neutron [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Instance cache missing network info. {{(pid=72586) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 21:20:11 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-9d7401aa-e4e7-464b-9577-8d8bd74b9285 req-b76b3499-63d1-42e3-93a9-7afce12080b7 service nova] Releasing lock "refresh_cache-9197638d-0c03-4b4e-876a-003bd8db3c35" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:20:11 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Acquired lock "refresh_cache-9197638d-0c03-4b4e-876a-003bd8db3c35" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:20:11 user nova-compute[72586]: DEBUG nova.network.neutron [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:20:11 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25fb970a-0caf-41e8-8d58-259dbd9cf291/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:20:11 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Cannot resize image /opt/stack/data/nova/instances/25fb970a-0caf-41e8-8d58-259dbd9cf291/disk to a smaller size. {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 21:20:11 user nova-compute[72586]: DEBUG nova.objects.instance [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Lazy-loading 'migration_context' on Instance uuid 25fb970a-0caf-41e8-8d58-259dbd9cf291 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:20:11 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Created local disks {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 21:20:11 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Ensure instance console log exists: /opt/stack/data/nova/instances/25fb970a-0caf-41e8-8d58-259dbd9cf291/console.log {{(pid=72586) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 21:20:11 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:20:11 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:20:11 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:20:11 user nova-compute[72586]: DEBUG nova.network.neutron [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Instance cache missing network info. {{(pid=72586) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 21:20:11 user nova-compute[72586]: DEBUG nova.network.neutron [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Successfully created port: 91634168-0e3d-42db-b0f4-af85d2673762 {{(pid=72586) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 21:20:11 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.network.neutron [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Updating instance_info_cache with network_info: [{"id": "2c422520-a997-44b1-91dc-bfd781a5942d", "address": "fa:16:3e:43:29:03", "network": {"id": "8e827e51-e845-4426-a503-c9885ce46971", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-638517071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efd1332e56dc4a158be5c285ce251f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c422520-a9", "ovs_interfaceid": "2c422520-a997-44b1-91dc-bfd781a5942d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.network.neutron [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Updating instance_info_cache with network_info: [{"id": "1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a", "address": "fa:16:3e:1b:58:f6", "network": {"id": "869076ac-07a1-49eb-9912-83f396d5b66d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2019500958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbe1daeb21ad4628841cbf8406131a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c85a8b5-9e", "ovs_interfaceid": "1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Releasing lock "refresh_cache-9197638d-0c03-4b4e-876a-003bd8db3c35" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.compute.manager [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Instance network_info: |[{"id": "2c422520-a997-44b1-91dc-bfd781a5942d", "address": "fa:16:3e:43:29:03", "network": {"id": "8e827e51-e845-4426-a503-c9885ce46971", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-638517071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efd1332e56dc4a158be5c285ce251f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c422520-a9", "ovs_interfaceid": "2c422520-a997-44b1-91dc-bfd781a5942d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Start _get_guest_xml network_info=[{"id": "2c422520-a997-44b1-91dc-bfd781a5942d", "address": "fa:16:3e:43:29:03", "network": {"id": "8e827e51-e845-4426-a503-c9885ce46971", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-638517071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efd1332e56dc4a158be5c285ce251f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c422520-a9", "ovs_interfaceid": "2c422520-a997-44b1-91dc-bfd781a5942d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:19:49Z,direct_url=<?>,disk_format='qcow2',id=9f619018-9915-4d87-ac1d-9572432baab6,min_disk=0,min_ram=0,name='',owner='b2406ad4d66840e59420a6c85d3d590d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:19:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'size': 0, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'scsi', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/sda', 'image_id': '9f619018-9915-4d87-ac1d-9572432baab6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Releasing lock "refresh_cache-34b640b7-1dec-4b31-b64b-f1dbee7f62f6" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.compute.manager [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Instance network_info: |[{"id": "1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a", "address": "fa:16:3e:1b:58:f6", "network": {"id": "869076ac-07a1-49eb-9912-83f396d5b66d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2019500958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbe1daeb21ad4628841cbf8406131a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c85a8b5-9e", "ovs_interfaceid": "1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-0436ebfb-ee1e-425c-9749-4ba13f665c94 req-1b41eae8-97f5-4309-957a-6d869312bb5f service nova] Acquired lock "refresh_cache-34b640b7-1dec-4b31-b64b-f1dbee7f62f6" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.network.neutron [req-0436ebfb-ee1e-425c-9749-4ba13f665c94 req-1b41eae8-97f5-4309-957a-6d869312bb5f service nova] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Refreshing network info cache for port 1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Start _get_guest_xml network_info=[{"id": "1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a", "address": "fa:16:3e:1b:58:f6", "network": {"id": "869076ac-07a1-49eb-9912-83f396d5b66d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2019500958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbe1daeb21ad4628841cbf8406131a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c85a8b5-9e", "ovs_interfaceid": "1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '0243d46b-6819-42a5-926f-42b71f0c97ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:20:12 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:20:12 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:20:12 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:20:12 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:19:49Z,direct_url=<?>,disk_format='qcow2',id=9f619018-9915-4d87-ac1d-9572432baab6,min_disk=0,min_ram=0,name='',owner='b2406ad4d66840e59420a6c85d3d590d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:19:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T21:19:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1344020572',display_name='tempest-AttachSCSIVolumeTestJSON-server-1344020572',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1344020572',id=6,image_ref='9f619018-9915-4d87-ac1d-9572432baab6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMoTU7MKLzZum72kXrSTvDdkSp+qmLqlGiCGNlYCdHKCbKm6HlcbdKXg6mp3WXdh4KEz3LJZUlNcbMYMvqzsrQFmOc8SM6NYft086Z1eAmsH5N044ZCWezW/UkzOCWGy1Q==',key_name='tempest-keypair-906710204',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='efd1332e56dc4a158be5c285ce251f5f',ramdisk_id='',reservation_id='r-renvgnhk',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9f619018-9915-4d87-ac1d-9572432baab6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-646238755',owner_user_name='tempest-AttachSCSIVolumeTestJSON-646238755-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:20:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2736ebf83dc482281755eb266739a11',uuid=9197638d-0c03-4b4e-876a-003bd8db3c35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c422520-a997-44b1-91dc-bfd781a5942d", "address": "fa:16:3e:43:29:03", "network": {"id": "8e827e51-e845-4426-a503-c9885ce46971", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-638517071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efd1332e56dc4a158be5c285ce251f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c422520-a9", "ovs_interfaceid": "2c422520-a997-44b1-91dc-bfd781a5942d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Converting VIF {"id": "2c422520-a997-44b1-91dc-bfd781a5942d", "address": "fa:16:3e:43:29:03", "network": {"id": "8e827e51-e845-4426-a503-c9885ce46971", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-638517071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efd1332e56dc4a158be5c285ce251f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c422520-a9", "ovs_interfaceid": "2c422520-a997-44b1-91dc-bfd781a5942d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:29:03,bridge_name='br-int',has_traffic_filtering=True,id=2c422520-a997-44b1-91dc-bfd781a5942d,network=Network(8e827e51-e845-4426-a503-c9885ce46971),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c422520-a9') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.objects.instance [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Lazy-loading 'pci_devices' on Instance uuid 9197638d-0c03-4b4e-876a-003bd8db3c35 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T21:20:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1746161852',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1746161852',id=8,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPKzYl7JBQVoZJNm+4i5JYdGUIIrqn01ZBx9Dxn59EM/3bkIAv2U6qz+jMD9EtD+pH0t0lwSsBe6DmGDRqmtPx9+g58b8uj/ol6c7hfvBYUh2jxk2AjOzIXFtbR5OZW2WA==',key_name='tempest-keypair-1235433569',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fbe1daeb21ad4628841cbf8406131a88',ramdisk_id='',reservation_id='r-5lrvjzh8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-2000096306',owner_user_name='tempest-TaggedAttachmentsTest-2000096306-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:20:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25edfd4907cf4d6c816799babd01e662',uuid=34b640b7-1dec-4b31-b64b-f1dbee7f62f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a", "address": "fa:16:3e:1b:58:f6", "network": {"id": "869076ac-07a1-49eb-9912-83f396d5b66d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2019500958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbe1daeb21ad4628841cbf8406131a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c85a8b5-9e", "ovs_interfaceid": "1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Converting VIF {"id": "1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a", "address": "fa:16:3e:1b:58:f6", "network": {"id": "869076ac-07a1-49eb-9912-83f396d5b66d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2019500958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbe1daeb21ad4628841cbf8406131a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c85a8b5-9e", "ovs_interfaceid": "1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:58:f6,bridge_name='br-int',has_traffic_filtering=True,id=1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a,network=Network(869076ac-07a1-49eb-9912-83f396d5b66d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c85a8b5-9e') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.objects.instance [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Lazy-loading 'pci_devices' on Instance uuid 34b640b7-1dec-4b31-b64b-f1dbee7f62f6 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:20:12 user nova-compute[72586]:   <uuid>9197638d-0c03-4b4e-876a-003bd8db3c35</uuid>
Aug 01 21:20:12 user nova-compute[72586]:   <name>instance-00000006</name>
Aug 01 21:20:12 user nova-compute[72586]:   <memory>524288</memory>
Aug 01 21:20:12 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:20:12 user nova-compute[72586]:   <metadata>
Aug 01 21:20:12 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:20:12 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:20:12 user nova-compute[72586]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1344020572</nova:name>
Aug 01 21:20:12 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:20:12</nova:creationTime>
Aug 01 21:20:12 user nova-compute[72586]:       <nova:flavor name="m1.tiny">
Aug 01 21:20:12 user nova-compute[72586]:         <nova:memory>512</nova:memory>
Aug 01 21:20:12 user nova-compute[72586]:         <nova:disk>1</nova:disk>
Aug 01 21:20:12 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:20:12 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:20:12 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:20:12 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:20:12 user nova-compute[72586]:       <nova:owner>
Aug 01 21:20:12 user nova-compute[72586]:         <nova:user uuid="a2736ebf83dc482281755eb266739a11">tempest-AttachSCSIVolumeTestJSON-646238755-project-member</nova:user>
Aug 01 21:20:12 user nova-compute[72586]:         <nova:project uuid="efd1332e56dc4a158be5c285ce251f5f">tempest-AttachSCSIVolumeTestJSON-646238755</nova:project>
Aug 01 21:20:12 user nova-compute[72586]:       </nova:owner>
Aug 01 21:20:12 user nova-compute[72586]:       <nova:root type="image" uuid="9f619018-9915-4d87-ac1d-9572432baab6"/>
Aug 01 21:20:12 user nova-compute[72586]:       <nova:ports>
Aug 01 21:20:12 user nova-compute[72586]:         <nova:port uuid="2c422520-a997-44b1-91dc-bfd781a5942d">
Aug 01 21:20:12 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 01 21:20:12 user nova-compute[72586]:         </nova:port>
Aug 01 21:20:12 user nova-compute[72586]:       </nova:ports>
Aug 01 21:20:12 user nova-compute[72586]:     </nova:instance>
Aug 01 21:20:12 user nova-compute[72586]:   </metadata>
Aug 01 21:20:12 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:20:12 user nova-compute[72586]:     <system>
Aug 01 21:20:12 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:20:12 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:20:12 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:20:12 user nova-compute[72586]:       <entry name="serial">9197638d-0c03-4b4e-876a-003bd8db3c35</entry>
Aug 01 21:20:12 user nova-compute[72586]:       <entry name="uuid">9197638d-0c03-4b4e-876a-003bd8db3c35</entry>
Aug 01 21:20:12 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:20:12 user nova-compute[72586]:     </system>
Aug 01 21:20:12 user nova-compute[72586]:   </sysinfo>
Aug 01 21:20:12 user nova-compute[72586]:   <os>
Aug 01 21:20:12 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:20:12 user nova-compute[72586]:     <boot dev="hd"/>
Aug 01 21:20:12 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:20:12 user nova-compute[72586]:   </os>
Aug 01 21:20:12 user nova-compute[72586]:   <features>
Aug 01 21:20:12 user nova-compute[72586]:     <acpi/>
Aug 01 21:20:12 user nova-compute[72586]:     <apic/>
Aug 01 21:20:12 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:20:12 user nova-compute[72586]:   </features>
Aug 01 21:20:12 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:20:12 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:20:12 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:20:12 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:20:12 user nova-compute[72586]:   </clock>
Aug 01 21:20:12 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:20:12 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:20:12 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:20:12 user nova-compute[72586]:   </cpu>
Aug 01 21:20:12 user nova-compute[72586]:   <devices>
Aug 01 21:20:12 user nova-compute[72586]:     <disk type="file" device="disk">
Aug 01 21:20:12 user nova-compute[72586]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 21:20:12 user nova-compute[72586]:       <source file="/opt/stack/data/nova/instances/9197638d-0c03-4b4e-876a-003bd8db3c35/disk"/>
Aug 01 21:20:12 user nova-compute[72586]:       <target dev="sda" bus="scsi"/>
Aug 01 21:20:12 user nova-compute[72586]:       <address type="drive" controller="0" unit="0"/>
Aug 01 21:20:12 user nova-compute[72586]:     </disk>
Aug 01 21:20:12 user nova-compute[72586]:     <disk type="file" device="cdrom">
Aug 01 21:20:12 user nova-compute[72586]:       <driver name="qemu" type="raw" cache="none"/>
Aug 01 21:20:12 user nova-compute[72586]:       <source file="/opt/stack/data/nova/instances/9197638d-0c03-4b4e-876a-003bd8db3c35/disk.config"/>
Aug 01 21:20:12 user nova-compute[72586]:       <target dev="sdb" bus="scsi"/>
Aug 01 21:20:12 user nova-compute[72586]:       <address type="drive" controller="0" unit="1"/>
Aug 01 21:20:12 user nova-compute[72586]:     </disk>
Aug 01 21:20:12 user nova-compute[72586]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 01 21:20:12 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:20:12 user nova-compute[72586]:       <mac address="fa:16:3e:43:29:03"/>
Aug 01 21:20:12 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:20:12 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:20:12 user nova-compute[72586]:       <target dev="tap2c422520-a9"/>
Aug 01 21:20:12 user nova-compute[72586]:     </interface>
Aug 01 21:20:12 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:20:12 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/9197638d-0c03-4b4e-876a-003bd8db3c35/console.log" append="off"/>
Aug 01 21:20:12 user nova-compute[72586]:     </serial>
Aug 01 21:20:12 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:20:12 user nova-compute[72586]:     <video>
Aug 01 21:20:12 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:20:12 user nova-compute[72586]:     </video>
Aug 01 21:20:12 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:20:12 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:20:12 user nova-compute[72586]:     </rng>
Aug 01 21:20:12 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:20:12 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:20:12 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:20:12 user nova-compute[72586]:     </memballoon>
Aug 01 21:20:12 user nova-compute[72586]:   </devices>
Aug 01 21:20:12 user nova-compute[72586]: </domain>
Aug 01 21:20:12 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T21:19:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1344020572',display_name='tempest-AttachSCSIVolumeTestJSON-server-1344020572',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1344020572',id=6,image_ref='9f619018-9915-4d87-ac1d-9572432baab6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMoTU7MKLzZum72kXrSTvDdkSp+qmLqlGiCGNlYCdHKCbKm6HlcbdKXg6mp3WXdh4KEz3LJZUlNcbMYMvqzsrQFmOc8SM6NYft086Z1eAmsH5N044ZCWezW/UkzOCWGy1Q==',key_name='tempest-keypair-906710204',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='efd1332e56dc4a158be5c285ce251f5f',ramdisk_id='',reservation_id='r-renvgnhk',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9f619018-9915-4d87-ac1d-9572432baab6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-646238755',owner_user_name='tempest-AttachSCSIVolumeTestJSON-646238755-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:20:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2736ebf83dc482281755eb266739a11',uuid=9197638d-0c03-4b4e-876a-003bd8db3c35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c422520-a997-44b1-91dc-bfd781a5942d", "address": "fa:16:3e:43:29:03", "network": {"id": "8e827e51-e845-4426-a503-c9885ce46971", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-638517071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efd1332e56dc4a158be5c285ce251f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c422520-a9", "ovs_interfaceid": "2c422520-a997-44b1-91dc-bfd781a5942d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Converting VIF {"id": "2c422520-a997-44b1-91dc-bfd781a5942d", "address": "fa:16:3e:43:29:03", "network": {"id": "8e827e51-e845-4426-a503-c9885ce46971", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-638517071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efd1332e56dc4a158be5c285ce251f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c422520-a9", "ovs_interfaceid": "2c422520-a997-44b1-91dc-bfd781a5942d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:29:03,bridge_name='br-int',has_traffic_filtering=True,id=2c422520-a997-44b1-91dc-bfd781a5942d,network=Network(8e827e51-e845-4426-a503-c9885ce46971),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c422520-a9') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG os_vif [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:29:03,bridge_name='br-int',has_traffic_filtering=True,id=2c422520-a997-44b1-91dc-bfd781a5942d,network=Network(8e827e51-e845-4426-a503-c9885ce46971),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c422520-a9') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:20:12 user nova-compute[72586]:   <uuid>34b640b7-1dec-4b31-b64b-f1dbee7f62f6</uuid>
Aug 01 21:20:12 user nova-compute[72586]:   <name>instance-00000008</name>
Aug 01 21:20:12 user nova-compute[72586]:   <memory>524288</memory>
Aug 01 21:20:12 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:20:12 user nova-compute[72586]:   <metadata>
Aug 01 21:20:12 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:20:12 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:20:12 user nova-compute[72586]:       <nova:name>tempest-device-tagging-server-1746161852</nova:name>
Aug 01 21:20:12 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:20:12</nova:creationTime>
Aug 01 21:20:12 user nova-compute[72586]:       <nova:flavor name="m1.tiny">
Aug 01 21:20:12 user nova-compute[72586]:         <nova:memory>512</nova:memory>
Aug 01 21:20:12 user nova-compute[72586]:         <nova:disk>1</nova:disk>
Aug 01 21:20:12 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:20:12 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:20:12 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:20:12 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:20:12 user nova-compute[72586]:       <nova:owner>
Aug 01 21:20:12 user nova-compute[72586]:         <nova:user uuid="25edfd4907cf4d6c816799babd01e662">tempest-TaggedAttachmentsTest-2000096306-project-member</nova:user>
Aug 01 21:20:12 user nova-compute[72586]:         <nova:project uuid="fbe1daeb21ad4628841cbf8406131a88">tempest-TaggedAttachmentsTest-2000096306</nova:project>
Aug 01 21:20:12 user nova-compute[72586]:       </nova:owner>
Aug 01 21:20:12 user nova-compute[72586]:       <nova:root type="image" uuid="0243d46b-6819-42a5-926f-42b71f0c97ad"/>
Aug 01 21:20:12 user nova-compute[72586]:       <nova:ports>
Aug 01 21:20:12 user nova-compute[72586]:         <nova:port uuid="1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a">
Aug 01 21:20:12 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 01 21:20:12 user nova-compute[72586]:         </nova:port>
Aug 01 21:20:12 user nova-compute[72586]:       </nova:ports>
Aug 01 21:20:12 user nova-compute[72586]:     </nova:instance>
Aug 01 21:20:12 user nova-compute[72586]:   </metadata>
Aug 01 21:20:12 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:20:12 user nova-compute[72586]:     <system>
Aug 01 21:20:12 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:20:12 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:20:12 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:20:12 user nova-compute[72586]:       <entry name="serial">34b640b7-1dec-4b31-b64b-f1dbee7f62f6</entry>
Aug 01 21:20:12 user nova-compute[72586]:       <entry name="uuid">34b640b7-1dec-4b31-b64b-f1dbee7f62f6</entry>
Aug 01 21:20:12 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:20:12 user nova-compute[72586]:     </system>
Aug 01 21:20:12 user nova-compute[72586]:   </sysinfo>
Aug 01 21:20:12 user nova-compute[72586]:   <os>
Aug 01 21:20:12 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:20:12 user nova-compute[72586]:     <boot dev="hd"/>
Aug 01 21:20:12 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:20:12 user nova-compute[72586]:   </os>
Aug 01 21:20:12 user nova-compute[72586]:   <features>
Aug 01 21:20:12 user nova-compute[72586]:     <acpi/>
Aug 01 21:20:12 user nova-compute[72586]:     <apic/>
Aug 01 21:20:12 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:20:12 user nova-compute[72586]:   </features>
Aug 01 21:20:12 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:20:12 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:20:12 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:20:12 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:20:12 user nova-compute[72586]:   </clock>
Aug 01 21:20:12 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:20:12 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:20:12 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:20:12 user nova-compute[72586]:   </cpu>
Aug 01 21:20:12 user nova-compute[72586]:   <devices>
Aug 01 21:20:12 user nova-compute[72586]:     <disk type="file" device="disk">
Aug 01 21:20:12 user nova-compute[72586]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 21:20:12 user nova-compute[72586]:       <source file="/opt/stack/data/nova/instances/34b640b7-1dec-4b31-b64b-f1dbee7f62f6/disk"/>
Aug 01 21:20:12 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:20:12 user nova-compute[72586]:     </disk>
Aug 01 21:20:12 user nova-compute[72586]:     <disk type="file" device="cdrom">
Aug 01 21:20:12 user nova-compute[72586]:       <driver name="qemu" type="raw" cache="none"/>
Aug 01 21:20:12 user nova-compute[72586]:       <source file="/opt/stack/data/nova/instances/34b640b7-1dec-4b31-b64b-f1dbee7f62f6/disk.config"/>
Aug 01 21:20:12 user nova-compute[72586]:       <target dev="hda" bus="ide"/>
Aug 01 21:20:12 user nova-compute[72586]:     </disk>
Aug 01 21:20:12 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:20:12 user nova-compute[72586]:       <mac address="fa:16:3e:1b:58:f6"/>
Aug 01 21:20:12 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:20:12 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:20:12 user nova-compute[72586]:       <target dev="tap1c85a8b5-9e"/>
Aug 01 21:20:12 user nova-compute[72586]:     </interface>
Aug 01 21:20:12 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:20:12 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/34b640b7-1dec-4b31-b64b-f1dbee7f62f6/console.log" append="off"/>
Aug 01 21:20:12 user nova-compute[72586]:     </serial>
Aug 01 21:20:12 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:20:12 user nova-compute[72586]:     <video>
Aug 01 21:20:12 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:20:12 user nova-compute[72586]:     </video>
Aug 01 21:20:12 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:20:12 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:20:12 user nova-compute[72586]:     </rng>
Aug 01 21:20:12 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:20:12 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:20:12 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:20:12 user nova-compute[72586]:     </memballoon>
Aug 01 21:20:12 user nova-compute[72586]:   </devices>
Aug 01 21:20:12 user nova-compute[72586]: </domain>
Aug 01 21:20:12 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T21:20:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1746161852',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1746161852',id=8,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPKzYl7JBQVoZJNm+4i5JYdGUIIrqn01ZBx9Dxn59EM/3bkIAv2U6qz+jMD9EtD+pH0t0lwSsBe6DmGDRqmtPx9+g58b8uj/ol6c7hfvBYUh2jxk2AjOzIXFtbR5OZW2WA==',key_name='tempest-keypair-1235433569',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fbe1daeb21ad4628841cbf8406131a88',ramdisk_id='',reservation_id='r-5lrvjzh8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-2000096306',owner_user_name='tempest-TaggedAttachmentsTest-2000096306-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:20:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25edfd4907cf4d6c816799babd01e662',uuid=34b640b7-1dec-4b31-b64b-f1dbee7f62f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a", "address": "fa:16:3e:1b:58:f6", "network": {"id": "869076ac-07a1-49eb-9912-83f396d5b66d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2019500958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbe1daeb21ad4628841cbf8406131a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c85a8b5-9e", "ovs_interfaceid": "1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Converting VIF {"id": "1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a", "address": "fa:16:3e:1b:58:f6", "network": {"id": "869076ac-07a1-49eb-9912-83f396d5b66d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2019500958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbe1daeb21ad4628841cbf8406131a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c85a8b5-9e", "ovs_interfaceid": "1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:58:f6,bridge_name='br-int',has_traffic_filtering=True,id=1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a,network=Network(869076ac-07a1-49eb-9912-83f396d5b66d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c85a8b5-9e') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG os_vif [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:58:f6,bridge_name='br-int',has_traffic_filtering=True,id=1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a,network=Network(869076ac-07a1-49eb-9912-83f396d5b66d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c85a8b5-9e') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2c422520-a9, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2c422520-a9, col_values=(('external_ids', {'iface-id': '2c422520-a997-44b1-91dc-bfd781a5942d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:29:03', 'vm-uuid': '9197638d-0c03-4b4e-876a-003bd8db3c35'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:12 user nova-compute[72586]: INFO os_vif [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:29:03,bridge_name='br-int',has_traffic_filtering=True,id=2c422520-a997-44b1-91dc-bfd781a5942d,network=Network(8e827e51-e845-4426-a503-c9885ce46971),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c422520-a9')
Aug 01 21:20:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1c85a8b5-9e, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1c85a8b5-9e, col_values=(('external_ids', {'iface-id': '1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:58:f6', 'vm-uuid': '34b640b7-1dec-4b31-b64b-f1dbee7f62f6'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:12 user nova-compute[72586]: INFO os_vif [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:58:f6,bridge_name='br-int',has_traffic_filtering=True,id=1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a,network=Network(869076ac-07a1-49eb-9912-83f396d5b66d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c85a8b5-9e')
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] No BDM found with device name sda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] No VIF found with MAC fa:16:3e:43:29:03, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:20:12 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Using config drive
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.network.neutron [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Successfully updated port: 91634168-0e3d-42db-b0f4-af85d2673762 {{(pid=72586) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.compute.manager [req-e32a462d-2a36-411b-8da2-0ed8b720cc0c req-c4b6926b-ec51-4f28-98ae-ac2f3d909d65 service nova] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Received event network-changed-91634168-0e3d-42db-b0f4-af85d2673762 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.compute.manager [req-e32a462d-2a36-411b-8da2-0ed8b720cc0c req-c4b6926b-ec51-4f28-98ae-ac2f3d909d65 service nova] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Refreshing instance network info cache due to event network-changed-91634168-0e3d-42db-b0f4-af85d2673762. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-e32a462d-2a36-411b-8da2-0ed8b720cc0c req-c4b6926b-ec51-4f28-98ae-ac2f3d909d65 service nova] Acquiring lock "refresh_cache-25fb970a-0caf-41e8-8d58-259dbd9cf291" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-e32a462d-2a36-411b-8da2-0ed8b720cc0c req-c4b6926b-ec51-4f28-98ae-ac2f3d909d65 service nova] Acquired lock "refresh_cache-25fb970a-0caf-41e8-8d58-259dbd9cf291" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.network.neutron [req-e32a462d-2a36-411b-8da2-0ed8b720cc0c req-c4b6926b-ec51-4f28-98ae-ac2f3d909d65 service nova] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Refreshing network info cache for port 91634168-0e3d-42db-b0f4-af85d2673762 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] No BDM found with device name hda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] No VIF found with MAC fa:16:3e:1b:58:f6, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:20:12 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Using config drive
Aug 01 21:20:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Acquiring lock "refresh_cache-25fb970a-0caf-41e8-8d58-259dbd9cf291" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:20:12 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Creating config drive at /opt/stack/data/nova/instances/9197638d-0c03-4b4e-876a-003bd8db3c35/disk.config
Aug 01 21:20:12 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9197638d-0c03-4b4e-876a-003bd8db3c35/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpxja60dxi {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.network.neutron [req-e32a462d-2a36-411b-8da2-0ed8b720cc0c req-c4b6926b-ec51-4f28-98ae-ac2f3d909d65 service nova] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Instance cache missing network info. {{(pid=72586) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9197638d-0c03-4b4e-876a-003bd8db3c35/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpxja60dxi" returned: 0 in 0.056s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.network.neutron [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Successfully updated port: 3a9c6772-38fc-4b17-9aee-089515b4a73e {{(pid=72586) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Acquiring lock "refresh_cache-3830c8b3-27b8-45f3-bbdb-8a081dfcadc4" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Acquired lock "refresh_cache-3830c8b3-27b8-45f3-bbdb-8a081dfcadc4" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.network.neutron [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.compute.manager [req-ee8865a4-9db6-4654-bc47-96e90e27f0fe req-01dcf025-ea93-4bf8-8069-85d27e64a3fa service nova] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Received event network-changed-3a9c6772-38fc-4b17-9aee-089515b4a73e {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.compute.manager [req-ee8865a4-9db6-4654-bc47-96e90e27f0fe req-01dcf025-ea93-4bf8-8069-85d27e64a3fa service nova] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Refreshing instance network info cache due to event network-changed-3a9c6772-38fc-4b17-9aee-089515b4a73e. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ee8865a4-9db6-4654-bc47-96e90e27f0fe req-01dcf025-ea93-4bf8-8069-85d27e64a3fa service nova] Acquiring lock "refresh_cache-3830c8b3-27b8-45f3-bbdb-8a081dfcadc4" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:20:12 user nova-compute[72586]: DEBUG nova.network.neutron [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Instance cache missing network info. {{(pid=72586) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 21:20:13 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Creating config drive at /opt/stack/data/nova/instances/34b640b7-1dec-4b31-b64b-f1dbee7f62f6/disk.config
Aug 01 21:20:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/34b640b7-1dec-4b31-b64b-f1dbee7f62f6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmptbtcbsl5 {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:20:13 user nova-compute[72586]: DEBUG nova.network.neutron [req-0436ebfb-ee1e-425c-9749-4ba13f665c94 req-1b41eae8-97f5-4309-957a-6d869312bb5f service nova] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Updated VIF entry in instance network info cache for port 1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:20:13 user nova-compute[72586]: DEBUG nova.network.neutron [req-0436ebfb-ee1e-425c-9749-4ba13f665c94 req-1b41eae8-97f5-4309-957a-6d869312bb5f service nova] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Updating instance_info_cache with network_info: [{"id": "1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a", "address": "fa:16:3e:1b:58:f6", "network": {"id": "869076ac-07a1-49eb-9912-83f396d5b66d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2019500958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbe1daeb21ad4628841cbf8406131a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c85a8b5-9e", "ovs_interfaceid": "1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:20:13 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-0436ebfb-ee1e-425c-9749-4ba13f665c94 req-1b41eae8-97f5-4309-957a-6d869312bb5f service nova] Releasing lock "refresh_cache-34b640b7-1dec-4b31-b64b-f1dbee7f62f6" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:20:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/34b640b7-1dec-4b31-b64b-f1dbee7f62f6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmptbtcbsl5" returned: 0 in 0.061s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:20:13 user nova-compute[72586]: DEBUG nova.network.neutron [req-e32a462d-2a36-411b-8da2-0ed8b720cc0c req-c4b6926b-ec51-4f28-98ae-ac2f3d909d65 service nova] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:20:13 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-e32a462d-2a36-411b-8da2-0ed8b720cc0c req-c4b6926b-ec51-4f28-98ae-ac2f3d909d65 service nova] Releasing lock "refresh_cache-25fb970a-0caf-41e8-8d58-259dbd9cf291" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:20:13 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Acquired lock "refresh_cache-25fb970a-0caf-41e8-8d58-259dbd9cf291" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:20:13 user nova-compute[72586]: DEBUG nova.network.neutron [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:20:13 user nova-compute[72586]: DEBUG nova.network.neutron [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Instance cache missing network info. {{(pid=72586) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 21:20:13 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:13 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:13 user nova-compute[72586]: DEBUG nova.network.neutron [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Updating instance_info_cache with network_info: [{"id": "3a9c6772-38fc-4b17-9aee-089515b4a73e", "address": "fa:16:3e:a5:91:07", "network": {"id": "198d348c-3661-477f-9e09-f9592f57c588", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1890713425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e128138ba483401895a8d8257d2a2600", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a9c6772-38", "ovs_interfaceid": "3a9c6772-38fc-4b17-9aee-089515b4a73e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:20:13 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Releasing lock "refresh_cache-3830c8b3-27b8-45f3-bbdb-8a081dfcadc4" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:20:13 user nova-compute[72586]: DEBUG nova.compute.manager [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Instance network_info: |[{"id": "3a9c6772-38fc-4b17-9aee-089515b4a73e", "address": "fa:16:3e:a5:91:07", "network": {"id": "198d348c-3661-477f-9e09-f9592f57c588", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1890713425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e128138ba483401895a8d8257d2a2600", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a9c6772-38", "ovs_interfaceid": "3a9c6772-38fc-4b17-9aee-089515b4a73e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 21:20:13 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ee8865a4-9db6-4654-bc47-96e90e27f0fe req-01dcf025-ea93-4bf8-8069-85d27e64a3fa service nova] Acquired lock "refresh_cache-3830c8b3-27b8-45f3-bbdb-8a081dfcadc4" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:20:13 user nova-compute[72586]: DEBUG nova.network.neutron [req-ee8865a4-9db6-4654-bc47-96e90e27f0fe req-01dcf025-ea93-4bf8-8069-85d27e64a3fa service nova] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Refreshing network info cache for port 3a9c6772-38fc-4b17-9aee-089515b4a73e {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:20:13 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Start _get_guest_xml network_info=[{"id": "3a9c6772-38fc-4b17-9aee-089515b4a73e", "address": "fa:16:3e:a5:91:07", "network": {"id": "198d348c-3661-477f-9e09-f9592f57c588", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1890713425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e128138ba483401895a8d8257d2a2600", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a9c6772-38", "ovs_interfaceid": "3a9c6772-38fc-4b17-9aee-089515b4a73e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '0243d46b-6819-42a5-926f-42b71f0c97ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:20:14 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:20:14 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:20:14 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:20:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-872367695',display_name='tempest-VolumesAdminNegativeTest-server-872367695',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-872367695',id=7,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHB0OXfIzMTj1Mw98zTadhsEbG2vzvBVblTkf0S3n6x2F/U2DyYjRtgHoMqGIkZvODKY4ml3YHG5+btySbfN03XwQqvQ2ey9EzCRwTEe8ouqCViMafbOBtBtrUELG0BCXQ==',key_name='tempest-keypair-370931383',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e128138ba483401895a8d8257d2a2600',ramdisk_id='',reservation_id='r-v2tnjnoa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1961775269',owner_user_name='tempest-VolumesAdminNegativeTest-1961775269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:20:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='06a57074fd8148679aec2090afa47ff5',uuid=3830c8b3-27b8-45f3-bbdb-8a081dfcadc4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a9c6772-38fc-4b17-9aee-089515b4a73e", "address": "fa:16:3e:a5:91:07", "network": {"id": "198d348c-3661-477f-9e09-f9592f57c588", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1890713425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e128138ba483401895a8d8257d2a2600", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a9c6772-38", "ovs_interfaceid": "3a9c6772-38fc-4b17-9aee-089515b4a73e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Converting VIF {"id": "3a9c6772-38fc-4b17-9aee-089515b4a73e", "address": "fa:16:3e:a5:91:07", "network": {"id": "198d348c-3661-477f-9e09-f9592f57c588", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1890713425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e128138ba483401895a8d8257d2a2600", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a9c6772-38", "ovs_interfaceid": "3a9c6772-38fc-4b17-9aee-089515b4a73e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:91:07,bridge_name='br-int',has_traffic_filtering=True,id=3a9c6772-38fc-4b17-9aee-089515b4a73e,network=Network(198d348c-3661-477f-9e09-f9592f57c588),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a9c6772-38') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG nova.objects.instance [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Lazy-loading 'pci_devices' on Instance uuid 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:20:14 user nova-compute[72586]:   <uuid>3830c8b3-27b8-45f3-bbdb-8a081dfcadc4</uuid>
Aug 01 21:20:14 user nova-compute[72586]:   <name>instance-00000007</name>
Aug 01 21:20:14 user nova-compute[72586]:   <memory>524288</memory>
Aug 01 21:20:14 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:20:14 user nova-compute[72586]:   <metadata>
Aug 01 21:20:14 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:20:14 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:20:14 user nova-compute[72586]:       <nova:name>tempest-VolumesAdminNegativeTest-server-872367695</nova:name>
Aug 01 21:20:14 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:20:14</nova:creationTime>
Aug 01 21:20:14 user nova-compute[72586]:       <nova:flavor name="m1.tiny">
Aug 01 21:20:14 user nova-compute[72586]:         <nova:memory>512</nova:memory>
Aug 01 21:20:14 user nova-compute[72586]:         <nova:disk>1</nova:disk>
Aug 01 21:20:14 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:20:14 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:20:14 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:20:14 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:20:14 user nova-compute[72586]:       <nova:owner>
Aug 01 21:20:14 user nova-compute[72586]:         <nova:user uuid="06a57074fd8148679aec2090afa47ff5">tempest-VolumesAdminNegativeTest-1961775269-project-member</nova:user>
Aug 01 21:20:14 user nova-compute[72586]:         <nova:project uuid="e128138ba483401895a8d8257d2a2600">tempest-VolumesAdminNegativeTest-1961775269</nova:project>
Aug 01 21:20:14 user nova-compute[72586]:       </nova:owner>
Aug 01 21:20:14 user nova-compute[72586]:       <nova:root type="image" uuid="0243d46b-6819-42a5-926f-42b71f0c97ad"/>
Aug 01 21:20:14 user nova-compute[72586]:       <nova:ports>
Aug 01 21:20:14 user nova-compute[72586]:         <nova:port uuid="3a9c6772-38fc-4b17-9aee-089515b4a73e">
Aug 01 21:20:14 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 01 21:20:14 user nova-compute[72586]:         </nova:port>
Aug 01 21:20:14 user nova-compute[72586]:       </nova:ports>
Aug 01 21:20:14 user nova-compute[72586]:     </nova:instance>
Aug 01 21:20:14 user nova-compute[72586]:   </metadata>
Aug 01 21:20:14 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:20:14 user nova-compute[72586]:     <system>
Aug 01 21:20:14 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:20:14 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:20:14 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:20:14 user nova-compute[72586]:       <entry name="serial">3830c8b3-27b8-45f3-bbdb-8a081dfcadc4</entry>
Aug 01 21:20:14 user nova-compute[72586]:       <entry name="uuid">3830c8b3-27b8-45f3-bbdb-8a081dfcadc4</entry>
Aug 01 21:20:14 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:20:14 user nova-compute[72586]:     </system>
Aug 01 21:20:14 user nova-compute[72586]:   </sysinfo>
Aug 01 21:20:14 user nova-compute[72586]:   <os>
Aug 01 21:20:14 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:20:14 user nova-compute[72586]:     <boot dev="hd"/>
Aug 01 21:20:14 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:20:14 user nova-compute[72586]:   </os>
Aug 01 21:20:14 user nova-compute[72586]:   <features>
Aug 01 21:20:14 user nova-compute[72586]:     <acpi/>
Aug 01 21:20:14 user nova-compute[72586]:     <apic/>
Aug 01 21:20:14 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:20:14 user nova-compute[72586]:   </features>
Aug 01 21:20:14 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:20:14 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:20:14 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:20:14 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:20:14 user nova-compute[72586]:   </clock>
Aug 01 21:20:14 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:20:14 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:20:14 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:20:14 user nova-compute[72586]:   </cpu>
Aug 01 21:20:14 user nova-compute[72586]:   <devices>
Aug 01 21:20:14 user nova-compute[72586]:     <disk type="file" device="disk">
Aug 01 21:20:14 user nova-compute[72586]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 21:20:14 user nova-compute[72586]:       <source file="/opt/stack/data/nova/instances/3830c8b3-27b8-45f3-bbdb-8a081dfcadc4/disk"/>
Aug 01 21:20:14 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:20:14 user nova-compute[72586]:     </disk>
Aug 01 21:20:14 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:20:14 user nova-compute[72586]:       <mac address="fa:16:3e:a5:91:07"/>
Aug 01 21:20:14 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:20:14 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:20:14 user nova-compute[72586]:       <target dev="tap3a9c6772-38"/>
Aug 01 21:20:14 user nova-compute[72586]:     </interface>
Aug 01 21:20:14 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:20:14 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/3830c8b3-27b8-45f3-bbdb-8a081dfcadc4/console.log" append="off"/>
Aug 01 21:20:14 user nova-compute[72586]:     </serial>
Aug 01 21:20:14 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:20:14 user nova-compute[72586]:     <video>
Aug 01 21:20:14 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:20:14 user nova-compute[72586]:     </video>
Aug 01 21:20:14 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:20:14 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:20:14 user nova-compute[72586]:     </rng>
Aug 01 21:20:14 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:20:14 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:20:14 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:20:14 user nova-compute[72586]:     </memballoon>
Aug 01 21:20:14 user nova-compute[72586]:   </devices>
Aug 01 21:20:14 user nova-compute[72586]: </domain>
Aug 01 21:20:14 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:20:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-872367695',display_name='tempest-VolumesAdminNegativeTest-server-872367695',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-872367695',id=7,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHB0OXfIzMTj1Mw98zTadhsEbG2vzvBVblTkf0S3n6x2F/U2DyYjRtgHoMqGIkZvODKY4ml3YHG5+btySbfN03XwQqvQ2ey9EzCRwTEe8ouqCViMafbOBtBtrUELG0BCXQ==',key_name='tempest-keypair-370931383',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e128138ba483401895a8d8257d2a2600',ramdisk_id='',reservation_id='r-v2tnjnoa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1961775269',owner_user_name='tempest-VolumesAdminNegativeTest-1961775269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:20:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='06a57074fd8148679aec2090afa47ff5',uuid=3830c8b3-27b8-45f3-bbdb-8a081dfcadc4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a9c6772-38fc-4b17-9aee-089515b4a73e", "address": "fa:16:3e:a5:91:07", "network": {"id": "198d348c-3661-477f-9e09-f9592f57c588", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1890713425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e128138ba483401895a8d8257d2a2600", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a9c6772-38", "ovs_interfaceid": "3a9c6772-38fc-4b17-9aee-089515b4a73e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Converting VIF {"id": "3a9c6772-38fc-4b17-9aee-089515b4a73e", "address": "fa:16:3e:a5:91:07", "network": {"id": "198d348c-3661-477f-9e09-f9592f57c588", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1890713425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e128138ba483401895a8d8257d2a2600", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a9c6772-38", "ovs_interfaceid": "3a9c6772-38fc-4b17-9aee-089515b4a73e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:91:07,bridge_name='br-int',has_traffic_filtering=True,id=3a9c6772-38fc-4b17-9aee-089515b4a73e,network=Network(198d348c-3661-477f-9e09-f9592f57c588),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a9c6772-38') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG os_vif [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:91:07,bridge_name='br-int',has_traffic_filtering=True,id=3a9c6772-38fc-4b17-9aee-089515b4a73e,network=Network(198d348c-3661-477f-9e09-f9592f57c588),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a9c6772-38') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a9c6772-38, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3a9c6772-38, col_values=(('external_ids', {'iface-id': '3a9c6772-38fc-4b17-9aee-089515b4a73e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:91:07', 'vm-uuid': '3830c8b3-27b8-45f3-bbdb-8a081dfcadc4'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:14 user nova-compute[72586]: INFO os_vif [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:91:07,bridge_name='br-int',has_traffic_filtering=True,id=3a9c6772-38fc-4b17-9aee-089515b4a73e,network=Network(198d348c-3661-477f-9e09-f9592f57c588),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a9c6772-38')
Aug 01 21:20:14 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] No VIF found with MAC fa:16:3e:a5:91:07, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG nova.network.neutron [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Updating instance_info_cache with network_info: [{"id": "91634168-0e3d-42db-b0f4-af85d2673762", "address": "fa:16:3e:a0:ef:27", "network": {"id": "3df6057c-0dba-4e06-bfe5-4df929c74a85", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2011731775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80dd67d749d04409923cd9b64691b638", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91634168-0e", "ovs_interfaceid": "91634168-0e3d-42db-b0f4-af85d2673762", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Releasing lock "refresh_cache-25fb970a-0caf-41e8-8d58-259dbd9cf291" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG nova.compute.manager [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Instance network_info: |[{"id": "91634168-0e3d-42db-b0f4-af85d2673762", "address": "fa:16:3e:a0:ef:27", "network": {"id": "3df6057c-0dba-4e06-bfe5-4df929c74a85", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2011731775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80dd67d749d04409923cd9b64691b638", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91634168-0e", "ovs_interfaceid": "91634168-0e3d-42db-b0f4-af85d2673762", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Start _get_guest_xml network_info=[{"id": "91634168-0e3d-42db-b0f4-af85d2673762", "address": "fa:16:3e:a0:ef:27", "network": {"id": "3df6057c-0dba-4e06-bfe5-4df929c74a85", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2011731775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80dd67d749d04409923cd9b64691b638", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91634168-0e", "ovs_interfaceid": "91634168-0e3d-42db-b0f4-af85d2673762", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '0243d46b-6819-42a5-926f-42b71f0c97ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:20:14 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:20:14 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:20:14 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:20:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1502478417',display_name='tempest-TestVolumeSwap-server-1502478417',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1502478417',id=9,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCvk8l1Q8znUNmNO4t7uyUpIE+79wm96jJPMppGTBwsTiLJw7JILuwEIvh8PYggsnkpF8Uwk+qd9ucf1SkNhW44JfiQOrC0YWRK9Dtqqi9MhswF9CZL+dBNyIytFV7Y/Ow==',key_name='tempest-keypair-537422444',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80dd67d749d04409923cd9b64691b638',ramdisk_id='',reservation_id='r-k089wnn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-345897363',owner_user_name='tempest-TestVolumeSwap-345897363-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:20:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d121f9e2de24379af2bccb61a3b81ce',uuid=25fb970a-0caf-41e8-8d58-259dbd9cf291,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91634168-0e3d-42db-b0f4-af85d2673762", "address": "fa:16:3e:a0:ef:27", "network": {"id": "3df6057c-0dba-4e06-bfe5-4df929c74a85", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2011731775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80dd67d749d04409923cd9b64691b638", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91634168-0e", "ovs_interfaceid": "91634168-0e3d-42db-b0f4-af85d2673762", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Converting VIF {"id": "91634168-0e3d-42db-b0f4-af85d2673762", "address": "fa:16:3e:a0:ef:27", "network": {"id": "3df6057c-0dba-4e06-bfe5-4df929c74a85", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2011731775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80dd67d749d04409923cd9b64691b638", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91634168-0e", "ovs_interfaceid": "91634168-0e3d-42db-b0f4-af85d2673762", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:ef:27,bridge_name='br-int',has_traffic_filtering=True,id=91634168-0e3d-42db-b0f4-af85d2673762,network=Network(3df6057c-0dba-4e06-bfe5-4df929c74a85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91634168-0e') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG nova.objects.instance [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Lazy-loading 'pci_devices' on Instance uuid 25fb970a-0caf-41e8-8d58-259dbd9cf291 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:20:14 user nova-compute[72586]:   <uuid>25fb970a-0caf-41e8-8d58-259dbd9cf291</uuid>
Aug 01 21:20:14 user nova-compute[72586]:   <name>instance-00000009</name>
Aug 01 21:20:14 user nova-compute[72586]:   <memory>524288</memory>
Aug 01 21:20:14 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:20:14 user nova-compute[72586]:   <metadata>
Aug 01 21:20:14 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:20:14 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:20:14 user nova-compute[72586]:       <nova:name>tempest-TestVolumeSwap-server-1502478417</nova:name>
Aug 01 21:20:14 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:20:14</nova:creationTime>
Aug 01 21:20:14 user nova-compute[72586]:       <nova:flavor name="m1.tiny">
Aug 01 21:20:14 user nova-compute[72586]:         <nova:memory>512</nova:memory>
Aug 01 21:20:14 user nova-compute[72586]:         <nova:disk>1</nova:disk>
Aug 01 21:20:14 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:20:14 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:20:14 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:20:14 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:20:14 user nova-compute[72586]:       <nova:owner>
Aug 01 21:20:14 user nova-compute[72586]:         <nova:user uuid="6d121f9e2de24379af2bccb61a3b81ce">tempest-TestVolumeSwap-345897363-project-member</nova:user>
Aug 01 21:20:14 user nova-compute[72586]:         <nova:project uuid="80dd67d749d04409923cd9b64691b638">tempest-TestVolumeSwap-345897363</nova:project>
Aug 01 21:20:14 user nova-compute[72586]:       </nova:owner>
Aug 01 21:20:14 user nova-compute[72586]:       <nova:root type="image" uuid="0243d46b-6819-42a5-926f-42b71f0c97ad"/>
Aug 01 21:20:14 user nova-compute[72586]:       <nova:ports>
Aug 01 21:20:14 user nova-compute[72586]:         <nova:port uuid="91634168-0e3d-42db-b0f4-af85d2673762">
Aug 01 21:20:14 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 01 21:20:14 user nova-compute[72586]:         </nova:port>
Aug 01 21:20:14 user nova-compute[72586]:       </nova:ports>
Aug 01 21:20:14 user nova-compute[72586]:     </nova:instance>
Aug 01 21:20:14 user nova-compute[72586]:   </metadata>
Aug 01 21:20:14 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:20:14 user nova-compute[72586]:     <system>
Aug 01 21:20:14 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:20:14 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:20:14 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:20:14 user nova-compute[72586]:       <entry name="serial">25fb970a-0caf-41e8-8d58-259dbd9cf291</entry>
Aug 01 21:20:14 user nova-compute[72586]:       <entry name="uuid">25fb970a-0caf-41e8-8d58-259dbd9cf291</entry>
Aug 01 21:20:14 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:20:14 user nova-compute[72586]:     </system>
Aug 01 21:20:14 user nova-compute[72586]:   </sysinfo>
Aug 01 21:20:14 user nova-compute[72586]:   <os>
Aug 01 21:20:14 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:20:14 user nova-compute[72586]:     <boot dev="hd"/>
Aug 01 21:20:14 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:20:14 user nova-compute[72586]:   </os>
Aug 01 21:20:14 user nova-compute[72586]:   <features>
Aug 01 21:20:14 user nova-compute[72586]:     <acpi/>
Aug 01 21:20:14 user nova-compute[72586]:     <apic/>
Aug 01 21:20:14 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:20:14 user nova-compute[72586]:   </features>
Aug 01 21:20:14 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:20:14 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:20:14 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:20:14 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:20:14 user nova-compute[72586]:   </clock>
Aug 01 21:20:14 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:20:14 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:20:14 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:20:14 user nova-compute[72586]:   </cpu>
Aug 01 21:20:14 user nova-compute[72586]:   <devices>
Aug 01 21:20:14 user nova-compute[72586]:     <disk type="file" device="disk">
Aug 01 21:20:14 user nova-compute[72586]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 21:20:14 user nova-compute[72586]:       <source file="/opt/stack/data/nova/instances/25fb970a-0caf-41e8-8d58-259dbd9cf291/disk"/>
Aug 01 21:20:14 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:20:14 user nova-compute[72586]:     </disk>
Aug 01 21:20:14 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:20:14 user nova-compute[72586]:       <mac address="fa:16:3e:a0:ef:27"/>
Aug 01 21:20:14 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:20:14 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:20:14 user nova-compute[72586]:       <target dev="tap91634168-0e"/>
Aug 01 21:20:14 user nova-compute[72586]:     </interface>
Aug 01 21:20:14 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:20:14 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/25fb970a-0caf-41e8-8d58-259dbd9cf291/console.log" append="off"/>
Aug 01 21:20:14 user nova-compute[72586]:     </serial>
Aug 01 21:20:14 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:20:14 user nova-compute[72586]:     <video>
Aug 01 21:20:14 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:20:14 user nova-compute[72586]:     </video>
Aug 01 21:20:14 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:20:14 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:20:14 user nova-compute[72586]:     </rng>
Aug 01 21:20:14 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:20:14 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:20:14 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:20:14 user nova-compute[72586]:     </memballoon>
Aug 01 21:20:14 user nova-compute[72586]:   </devices>
Aug 01 21:20:14 user nova-compute[72586]: </domain>
Aug 01 21:20:14 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:20:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1502478417',display_name='tempest-TestVolumeSwap-server-1502478417',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1502478417',id=9,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCvk8l1Q8znUNmNO4t7uyUpIE+79wm96jJPMppGTBwsTiLJw7JILuwEIvh8PYggsnkpF8Uwk+qd9ucf1SkNhW44JfiQOrC0YWRK9Dtqqi9MhswF9CZL+dBNyIytFV7Y/Ow==',key_name='tempest-keypair-537422444',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80dd67d749d04409923cd9b64691b638',ramdisk_id='',reservation_id='r-k089wnn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-345897363',owner_user_name='tempest-TestVolumeSwap-345897363-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:20:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d121f9e2de24379af2bccb61a3b81ce',uuid=25fb970a-0caf-41e8-8d58-259dbd9cf291,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91634168-0e3d-42db-b0f4-af85d2673762", "address": "fa:16:3e:a0:ef:27", "network": {"id": "3df6057c-0dba-4e06-bfe5-4df929c74a85", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2011731775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80dd67d749d04409923cd9b64691b638", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91634168-0e", "ovs_interfaceid": "91634168-0e3d-42db-b0f4-af85d2673762", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Converting VIF {"id": "91634168-0e3d-42db-b0f4-af85d2673762", "address": "fa:16:3e:a0:ef:27", "network": {"id": "3df6057c-0dba-4e06-bfe5-4df929c74a85", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2011731775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80dd67d749d04409923cd9b64691b638", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91634168-0e", "ovs_interfaceid": "91634168-0e3d-42db-b0f4-af85d2673762", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:ef:27,bridge_name='br-int',has_traffic_filtering=True,id=91634168-0e3d-42db-b0f4-af85d2673762,network=Network(3df6057c-0dba-4e06-bfe5-4df929c74a85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91634168-0e') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG os_vif [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:ef:27,bridge_name='br-int',has_traffic_filtering=True,id=91634168-0e3d-42db-b0f4-af85d2673762,network=Network(3df6057c-0dba-4e06-bfe5-4df929c74a85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91634168-0e') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap91634168-0e, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap91634168-0e, col_values=(('external_ids', {'iface-id': '91634168-0e3d-42db-b0f4-af85d2673762', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:ef:27', 'vm-uuid': '25fb970a-0caf-41e8-8d58-259dbd9cf291'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:14 user nova-compute[72586]: INFO os_vif [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:ef:27,bridge_name='br-int',has_traffic_filtering=True,id=91634168-0e3d-42db-b0f4-af85d2673762,network=Network(3df6057c-0dba-4e06-bfe5-4df929c74a85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91634168-0e')
Aug 01 21:20:14 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] No VIF found with MAC fa:16:3e:a0:ef:27, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG nova.network.neutron [req-ee8865a4-9db6-4654-bc47-96e90e27f0fe req-01dcf025-ea93-4bf8-8069-85d27e64a3fa service nova] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Updated VIF entry in instance network info cache for port 3a9c6772-38fc-4b17-9aee-089515b4a73e. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG nova.network.neutron [req-ee8865a4-9db6-4654-bc47-96e90e27f0fe req-01dcf025-ea93-4bf8-8069-85d27e64a3fa service nova] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Updating instance_info_cache with network_info: [{"id": "3a9c6772-38fc-4b17-9aee-089515b4a73e", "address": "fa:16:3e:a5:91:07", "network": {"id": "198d348c-3661-477f-9e09-f9592f57c588", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1890713425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e128138ba483401895a8d8257d2a2600", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a9c6772-38", "ovs_interfaceid": "3a9c6772-38fc-4b17-9aee-089515b4a73e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ee8865a4-9db6-4654-bc47-96e90e27f0fe req-01dcf025-ea93-4bf8-8069-85d27e64a3fa service nova] Releasing lock "refresh_cache-3830c8b3-27b8-45f3-bbdb-8a081dfcadc4" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Cleaning up deleted instances {{(pid=72586) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] There are 0 instances to clean {{(pid=72586) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Cleaning up deleted instances with incomplete migration  {{(pid=72586) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 21:20:14 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:20:15 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:20:16 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:16 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:16 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:16 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:16 user nova-compute[72586]: DEBUG nova.compute.manager [req-75421b3a-a84e-497a-be59-c13f72e608c1 req-81fda90f-7fa7-44ae-8f38-576fc8b31827 service nova] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Received event network-vif-plugged-1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:20:16 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-75421b3a-a84e-497a-be59-c13f72e608c1 req-81fda90f-7fa7-44ae-8f38-576fc8b31827 service nova] Acquiring lock "34b640b7-1dec-4b31-b64b-f1dbee7f62f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:20:16 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-75421b3a-a84e-497a-be59-c13f72e608c1 req-81fda90f-7fa7-44ae-8f38-576fc8b31827 service nova] Lock "34b640b7-1dec-4b31-b64b-f1dbee7f62f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:20:16 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-75421b3a-a84e-497a-be59-c13f72e608c1 req-81fda90f-7fa7-44ae-8f38-576fc8b31827 service nova] Lock "34b640b7-1dec-4b31-b64b-f1dbee7f62f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:20:16 user nova-compute[72586]: DEBUG nova.compute.manager [req-75421b3a-a84e-497a-be59-c13f72e608c1 req-81fda90f-7fa7-44ae-8f38-576fc8b31827 service nova] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] No waiting events found dispatching network-vif-plugged-1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:20:16 user nova-compute[72586]: WARNING nova.compute.manager [req-75421b3a-a84e-497a-be59-c13f72e608c1 req-81fda90f-7fa7-44ae-8f38-576fc8b31827 service nova] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Received unexpected event network-vif-plugged-1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a for instance with vm_state building and task_state spawning.
Aug 01 21:20:16 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:20:17 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:17 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:17 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:17 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:17 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:17 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:20:17 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Starting heal instance info cache {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 21:20:17 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Rebuilding the list of instances to heal {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 21:20:17 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Skipping network cache update for instance because it is Building. {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 01 21:20:17 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Skipping network cache update for instance because it is Building. {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 01 21:20:17 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Skipping network cache update for instance because it is Building. {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 01 21:20:17 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Skipping network cache update for instance because it is Building. {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 01 21:20:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "refresh_cache-042f0031-1e4d-41d0-8bfa-36001675cfe3" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:20:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquired lock "refresh_cache-042f0031-1e4d-41d0-8bfa-36001675cfe3" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:20:18 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Forcefully refreshing network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 21:20:18 user nova-compute[72586]: DEBUG nova.objects.instance [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lazy-loading 'info_cache' on Instance uuid 042f0031-1e4d-41d0-8bfa-36001675cfe3 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:20:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:18 user nova-compute[72586]: DEBUG nova.compute.manager [req-eea13417-2cec-4f39-bc84-ff4e4e68b2a8 req-e9b73243-a088-47df-9bfe-56a959adbbfa service nova] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Received event network-vif-plugged-2c422520-a997-44b1-91dc-bfd781a5942d {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:20:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-eea13417-2cec-4f39-bc84-ff4e4e68b2a8 req-e9b73243-a088-47df-9bfe-56a959adbbfa service nova] Acquiring lock "9197638d-0c03-4b4e-876a-003bd8db3c35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:20:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-eea13417-2cec-4f39-bc84-ff4e4e68b2a8 req-e9b73243-a088-47df-9bfe-56a959adbbfa service nova] Lock "9197638d-0c03-4b4e-876a-003bd8db3c35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:20:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-eea13417-2cec-4f39-bc84-ff4e4e68b2a8 req-e9b73243-a088-47df-9bfe-56a959adbbfa service nova] Lock "9197638d-0c03-4b4e-876a-003bd8db3c35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:20:18 user nova-compute[72586]: DEBUG nova.compute.manager [req-eea13417-2cec-4f39-bc84-ff4e4e68b2a8 req-e9b73243-a088-47df-9bfe-56a959adbbfa service nova] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] No waiting events found dispatching network-vif-plugged-2c422520-a997-44b1-91dc-bfd781a5942d {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:20:18 user nova-compute[72586]: WARNING nova.compute.manager [req-eea13417-2cec-4f39-bc84-ff4e4e68b2a8 req-e9b73243-a088-47df-9bfe-56a959adbbfa service nova] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Received unexpected event network-vif-plugged-2c422520-a997-44b1-91dc-bfd781a5942d for instance with vm_state building and task_state spawning.
Aug 01 21:20:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:18 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Updating instance_info_cache with network_info: [{"id": "fb56dcd2-b1ea-4992-a896-22f65127a96c", "address": "fa:16:3e:8e:7c:d3", "network": {"id": "d229a8de-7a2b-4dcd-a9ac-44a40349676e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-67691992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b1a1d82f39347119a9fb49fb8e8893f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb56dcd2-b1", "ovs_interfaceid": "fb56dcd2-b1ea-4992-a896-22f65127a96c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:20:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Releasing lock "refresh_cache-042f0031-1e4d-41d0-8bfa-36001675cfe3" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:20:18 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Updated the network info_cache for instance {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 21:20:18 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:20:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:20:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:20:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:20:18 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Auditing locally available compute resources for user (node: user) {{(pid=72586) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 21:20:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:18 user nova-compute[72586]: DEBUG nova.compute.manager [req-0649deef-b30e-4f78-b9c3-9b9444dd1a2d req-fd00bd04-8ba2-427f-abf9-94e5270df0a6 service nova] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Received event network-vif-plugged-1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:20:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-0649deef-b30e-4f78-b9c3-9b9444dd1a2d req-fd00bd04-8ba2-427f-abf9-94e5270df0a6 service nova] Acquiring lock "34b640b7-1dec-4b31-b64b-f1dbee7f62f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:20:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-0649deef-b30e-4f78-b9c3-9b9444dd1a2d req-fd00bd04-8ba2-427f-abf9-94e5270df0a6 service nova] Lock "34b640b7-1dec-4b31-b64b-f1dbee7f62f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:20:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-0649deef-b30e-4f78-b9c3-9b9444dd1a2d req-fd00bd04-8ba2-427f-abf9-94e5270df0a6 service nova] Lock "34b640b7-1dec-4b31-b64b-f1dbee7f62f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:20:18 user nova-compute[72586]: DEBUG nova.compute.manager [req-0649deef-b30e-4f78-b9c3-9b9444dd1a2d req-fd00bd04-8ba2-427f-abf9-94e5270df0a6 service nova] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] No waiting events found dispatching network-vif-plugged-1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:20:18 user nova-compute[72586]: WARNING nova.compute.manager [req-0649deef-b30e-4f78-b9c3-9b9444dd1a2d req-fd00bd04-8ba2-427f-abf9-94e5270df0a6 service nova] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Received unexpected event network-vif-plugged-1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a for instance with vm_state building and task_state spawning.
Aug 01 21:20:18 user nova-compute[72586]: DEBUG nova.compute.manager [req-0649deef-b30e-4f78-b9c3-9b9444dd1a2d req-fd00bd04-8ba2-427f-abf9-94e5270df0a6 service nova] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Received event network-vif-plugged-91634168-0e3d-42db-b0f4-af85d2673762 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:20:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-0649deef-b30e-4f78-b9c3-9b9444dd1a2d req-fd00bd04-8ba2-427f-abf9-94e5270df0a6 service nova] Acquiring lock "25fb970a-0caf-41e8-8d58-259dbd9cf291-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:20:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-0649deef-b30e-4f78-b9c3-9b9444dd1a2d req-fd00bd04-8ba2-427f-abf9-94e5270df0a6 service nova] Lock "25fb970a-0caf-41e8-8d58-259dbd9cf291-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:20:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-0649deef-b30e-4f78-b9c3-9b9444dd1a2d req-fd00bd04-8ba2-427f-abf9-94e5270df0a6 service nova] Lock "25fb970a-0caf-41e8-8d58-259dbd9cf291-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:20:18 user nova-compute[72586]: DEBUG nova.compute.manager [req-0649deef-b30e-4f78-b9c3-9b9444dd1a2d req-fd00bd04-8ba2-427f-abf9-94e5270df0a6 service nova] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] No waiting events found dispatching network-vif-plugged-91634168-0e3d-42db-b0f4-af85d2673762 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:20:18 user nova-compute[72586]: WARNING nova.compute.manager [req-0649deef-b30e-4f78-b9c3-9b9444dd1a2d req-fd00bd04-8ba2-427f-abf9-94e5270df0a6 service nova] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Received unexpected event network-vif-plugged-91634168-0e3d-42db-b0f4-af85d2673762 for instance with vm_state building and task_state spawning.
Aug 01 21:20:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:20:20 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:20:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:20:20 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:20 user nova-compute[72586]: DEBUG nova.compute.manager [req-86bfcd31-c8c5-4e09-aa1f-fbabe2bece78 req-75093fa6-8717-4c60-affa-a807e086fbc5 service nova] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Received event network-vif-plugged-2c422520-a997-44b1-91dc-bfd781a5942d {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:20:20 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-86bfcd31-c8c5-4e09-aa1f-fbabe2bece78 req-75093fa6-8717-4c60-affa-a807e086fbc5 service nova] Acquiring lock "9197638d-0c03-4b4e-876a-003bd8db3c35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:20:20 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-86bfcd31-c8c5-4e09-aa1f-fbabe2bece78 req-75093fa6-8717-4c60-affa-a807e086fbc5 service nova] Lock "9197638d-0c03-4b4e-876a-003bd8db3c35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:20:20 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-86bfcd31-c8c5-4e09-aa1f-fbabe2bece78 req-75093fa6-8717-4c60-affa-a807e086fbc5 service nova] Lock "9197638d-0c03-4b4e-876a-003bd8db3c35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:20:20 user nova-compute[72586]: DEBUG nova.compute.manager [req-86bfcd31-c8c5-4e09-aa1f-fbabe2bece78 req-75093fa6-8717-4c60-affa-a807e086fbc5 service nova] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] No waiting events found dispatching network-vif-plugged-2c422520-a997-44b1-91dc-bfd781a5942d {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:20:20 user nova-compute[72586]: WARNING nova.compute.manager [req-86bfcd31-c8c5-4e09-aa1f-fbabe2bece78 req-75093fa6-8717-4c60-affa-a807e086fbc5 service nova] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Received unexpected event network-vif-plugged-2c422520-a997-44b1-91dc-bfd781a5942d for instance with vm_state building and task_state spawning.
Aug 01 21:20:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:20:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eccf50b0-9acc-49b6-8044-601e47d18c38/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:20:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eccf50b0-9acc-49b6-8044-601e47d18c38/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:20:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eccf50b0-9acc-49b6-8044-601e47d18c38/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:20:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eccf50b0-9acc-49b6-8044-601e47d18c38/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:20:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b640b7-1dec-4b31-b64b-f1dbee7f62f6/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:20:21 user nova-compute[72586]: DEBUG nova.compute.manager [req-abbfa162-34af-4da3-9fe5-ff3beef46c34 req-0d30b935-acf5-4ea3-9f22-a8382df77cb8 service nova] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Received event network-vif-plugged-91634168-0e3d-42db-b0f4-af85d2673762 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:20:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-abbfa162-34af-4da3-9fe5-ff3beef46c34 req-0d30b935-acf5-4ea3-9f22-a8382df77cb8 service nova] Acquiring lock "25fb970a-0caf-41e8-8d58-259dbd9cf291-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:20:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-abbfa162-34af-4da3-9fe5-ff3beef46c34 req-0d30b935-acf5-4ea3-9f22-a8382df77cb8 service nova] Lock "25fb970a-0caf-41e8-8d58-259dbd9cf291-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:20:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-abbfa162-34af-4da3-9fe5-ff3beef46c34 req-0d30b935-acf5-4ea3-9f22-a8382df77cb8 service nova] Lock "25fb970a-0caf-41e8-8d58-259dbd9cf291-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:20:21 user nova-compute[72586]: DEBUG nova.compute.manager [req-abbfa162-34af-4da3-9fe5-ff3beef46c34 req-0d30b935-acf5-4ea3-9f22-a8382df77cb8 service nova] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] No waiting events found dispatching network-vif-plugged-91634168-0e3d-42db-b0f4-af85d2673762 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:20:21 user nova-compute[72586]: WARNING nova.compute.manager [req-abbfa162-34af-4da3-9fe5-ff3beef46c34 req-0d30b935-acf5-4ea3-9f22-a8382df77cb8 service nova] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Received unexpected event network-vif-plugged-91634168-0e3d-42db-b0f4-af85d2673762 for instance with vm_state building and task_state spawning.
Aug 01 21:20:21 user nova-compute[72586]: DEBUG nova.compute.manager [req-abbfa162-34af-4da3-9fe5-ff3beef46c34 req-0d30b935-acf5-4ea3-9f22-a8382df77cb8 service nova] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Received event network-vif-plugged-3a9c6772-38fc-4b17-9aee-089515b4a73e {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:20:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-abbfa162-34af-4da3-9fe5-ff3beef46c34 req-0d30b935-acf5-4ea3-9f22-a8382df77cb8 service nova] Acquiring lock "3830c8b3-27b8-45f3-bbdb-8a081dfcadc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:20:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-abbfa162-34af-4da3-9fe5-ff3beef46c34 req-0d30b935-acf5-4ea3-9f22-a8382df77cb8 service nova] Lock "3830c8b3-27b8-45f3-bbdb-8a081dfcadc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:20:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-abbfa162-34af-4da3-9fe5-ff3beef46c34 req-0d30b935-acf5-4ea3-9f22-a8382df77cb8 service nova] Lock "3830c8b3-27b8-45f3-bbdb-8a081dfcadc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:20:21 user nova-compute[72586]: DEBUG nova.compute.manager [req-abbfa162-34af-4da3-9fe5-ff3beef46c34 req-0d30b935-acf5-4ea3-9f22-a8382df77cb8 service nova] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] No waiting events found dispatching network-vif-plugged-3a9c6772-38fc-4b17-9aee-089515b4a73e {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:20:21 user nova-compute[72586]: WARNING nova.compute.manager [req-abbfa162-34af-4da3-9fe5-ff3beef46c34 req-0d30b935-acf5-4ea3-9f22-a8382df77cb8 service nova] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Received unexpected event network-vif-plugged-3a9c6772-38fc-4b17-9aee-089515b4a73e for instance with vm_state building and task_state spawning.
Aug 01 21:20:21 user nova-compute[72586]: DEBUG nova.compute.manager [req-abbfa162-34af-4da3-9fe5-ff3beef46c34 req-0d30b935-acf5-4ea3-9f22-a8382df77cb8 service nova] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Received event network-vif-plugged-3a9c6772-38fc-4b17-9aee-089515b4a73e {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:20:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-abbfa162-34af-4da3-9fe5-ff3beef46c34 req-0d30b935-acf5-4ea3-9f22-a8382df77cb8 service nova] Acquiring lock "3830c8b3-27b8-45f3-bbdb-8a081dfcadc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:20:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-abbfa162-34af-4da3-9fe5-ff3beef46c34 req-0d30b935-acf5-4ea3-9f22-a8382df77cb8 service nova] Lock "3830c8b3-27b8-45f3-bbdb-8a081dfcadc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:20:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-abbfa162-34af-4da3-9fe5-ff3beef46c34 req-0d30b935-acf5-4ea3-9f22-a8382df77cb8 service nova] Lock "3830c8b3-27b8-45f3-bbdb-8a081dfcadc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:20:21 user nova-compute[72586]: DEBUG nova.compute.manager [req-abbfa162-34af-4da3-9fe5-ff3beef46c34 req-0d30b935-acf5-4ea3-9f22-a8382df77cb8 service nova] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] No waiting events found dispatching network-vif-plugged-3a9c6772-38fc-4b17-9aee-089515b4a73e {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:20:21 user nova-compute[72586]: WARNING nova.compute.manager [req-abbfa162-34af-4da3-9fe5-ff3beef46c34 req-0d30b935-acf5-4ea3-9f22-a8382df77cb8 service nova] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Received unexpected event network-vif-plugged-3a9c6772-38fc-4b17-9aee-089515b4a73e for instance with vm_state building and task_state spawning.
Aug 01 21:20:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b640b7-1dec-4b31-b64b-f1dbee7f62f6/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:20:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b640b7-1dec-4b31-b64b-f1dbee7f62f6/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:20:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b640b7-1dec-4b31-b64b-f1dbee7f62f6/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:20:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3830c8b3-27b8-45f3-bbdb-8a081dfcadc4/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:20:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3830c8b3-27b8-45f3-bbdb-8a081dfcadc4/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:20:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3830c8b3-27b8-45f3-bbdb-8a081dfcadc4/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:20:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3830c8b3-27b8-45f3-bbdb-8a081dfcadc4/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:20:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9197638d-0c03-4b4e-876a-003bd8db3c35/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:20:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9197638d-0c03-4b4e-876a-003bd8db3c35/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:20:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9197638d-0c03-4b4e-876a-003bd8db3c35/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:20:21 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690924821.81798, 34b640b7-1dec-4b31-b64b-f1dbee7f62f6 => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:20:21 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] VM Resumed (Lifecycle Event)
Aug 01 21:20:21 user nova-compute[72586]: DEBUG nova.compute.manager [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Instance event wait completed in 0 seconds for  {{(pid=72586) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 21:20:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Guest created on hypervisor {{(pid=72586) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 21:20:21 user nova-compute[72586]: DEBUG nova.compute.manager [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Instance event wait completed in 0 seconds for  {{(pid=72586) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 21:20:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Guest created on hypervisor {{(pid=72586) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 21:20:21 user nova-compute[72586]: DEBUG nova.compute.manager [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Instance event wait completed in 0 seconds for  {{(pid=72586) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 21:20:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Guest created on hypervisor {{(pid=72586) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 21:20:21 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Instance spawned successfully.
Aug 01 21:20:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 21:20:21 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:20:21 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Instance spawned successfully.
Aug 01 21:20:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 21:20:21 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Instance spawned successfully.
Aug 01 21:20:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 21:20:21 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:20:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Found default for hw_input_bus of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:20:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Found default for hw_pointer_model of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:20:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Found default for hw_video_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:20:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Found default for hw_vif_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:20:21 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:20:21 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690924821.8185387, 34b640b7-1dec-4b31-b64b-f1dbee7f62f6 => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:20:21 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] VM Started (Lifecycle Event)
Aug 01 21:20:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9197638d-0c03-4b4e-876a-003bd8db3c35/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:20:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Found default for hw_cdrom_bus of ide {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:20:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Found default for hw_disk_bus of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:20:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Found default for hw_input_bus of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:20:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Found default for hw_pointer_model of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:20:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Found default for hw_video_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:20:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Found default for hw_vif_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:20:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25fb970a-0caf-41e8-8d58-259dbd9cf291/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:20:21 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:20:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Found default for hw_cdrom_bus of ide {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:20:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Found default for hw_disk_bus of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:20:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Found default for hw_input_bus of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:20:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Found default for hw_pointer_model of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:20:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Found default for hw_video_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:20:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Found default for hw_vif_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:20:21 user nova-compute[72586]: DEBUG nova.compute.manager [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Instance event wait completed in 0 seconds for  {{(pid=72586) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 21:20:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Guest created on hypervisor {{(pid=72586) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 21:20:22 user nova-compute[72586]: INFO nova.compute.manager [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Took 19.97 seconds to spawn the instance on the hypervisor.
Aug 01 21:20:22 user nova-compute[72586]: DEBUG nova.compute.manager [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:20:22 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:20:22 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Instance spawned successfully.
Aug 01 21:20:22 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 21:20:22 user nova-compute[72586]: INFO nova.compute.manager [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Took 12.91 seconds to spawn the instance on the hypervisor.
Aug 01 21:20:22 user nova-compute[72586]: DEBUG nova.compute.manager [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:20:22 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:20:22 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690924821.8309834, 25fb970a-0caf-41e8-8d58-259dbd9cf291 => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:20:22 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] VM Resumed (Lifecycle Event)
Aug 01 21:20:22 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Found default for hw_cdrom_bus of ide {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:20:22 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Found default for hw_disk_bus of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:20:22 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Found default for hw_input_bus of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:20:22 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Found default for hw_pointer_model of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:20:22 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Found default for hw_video_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:20:22 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Found default for hw_vif_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:20:22 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:20:22 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:20:22 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:20:22 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690924821.831326, 25fb970a-0caf-41e8-8d58-259dbd9cf291 => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:20:22 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] VM Started (Lifecycle Event)
Aug 01 21:20:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25fb970a-0caf-41e8-8d58-259dbd9cf291/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:20:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25fb970a-0caf-41e8-8d58-259dbd9cf291/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:20:22 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:20:22 user nova-compute[72586]: INFO nova.compute.manager [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Took 11.62 seconds to spawn the instance on the hypervisor.
Aug 01 21:20:22 user nova-compute[72586]: DEBUG nova.compute.manager [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:20:22 user nova-compute[72586]: INFO nova.compute.manager [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Took 13.99 seconds to build instance.
Aug 01 21:20:22 user nova-compute[72586]: INFO nova.compute.manager [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Took 21.15 seconds to build instance.
Aug 01 21:20:22 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:20:22 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:20:22 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690924821.8331878, 9197638d-0c03-4b4e-876a-003bd8db3c35 => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:20:22 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] VM Resumed (Lifecycle Event)
Aug 01 21:20:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25fb970a-0caf-41e8-8d58-259dbd9cf291/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:20:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a26962e8-6c24-421c-93b8-fc41ad6a9977 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Lock "34b640b7-1dec-4b31-b64b-f1dbee7f62f6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.191s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:20:22 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:20:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f8ec0895-4642-498e-b271-23764b9f5ae4 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Lock "9197638d-0c03-4b4e-876a-003bd8db3c35" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.427s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:20:22 user nova-compute[72586]: INFO nova.compute.manager [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Took 16.86 seconds to spawn the instance on the hypervisor.
Aug 01 21:20:22 user nova-compute[72586]: DEBUG nova.compute.manager [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:20:22 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:20:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98345340-5fb3-41fe-aea9-770cf4585e86/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:20:22 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690924821.8332775, 9197638d-0c03-4b4e-876a-003bd8db3c35 => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:20:22 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] VM Started (Lifecycle Event)
Aug 01 21:20:22 user nova-compute[72586]: INFO nova.compute.manager [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Took 13.17 seconds to build instance.
Aug 01 21:20:22 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:20:22 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:20:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-50d6d924-0b97-4e87-a112-ebebbd3b2235 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Lock "25fb970a-0caf-41e8-8d58-259dbd9cf291" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.350s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:20:22 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690924821.9470208, 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4 => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:20:22 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] VM Resumed (Lifecycle Event)
Aug 01 21:20:22 user nova-compute[72586]: INFO nova.compute.manager [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Took 18.53 seconds to build instance.
Aug 01 21:20:22 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:20:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98345340-5fb3-41fe-aea9-770cf4585e86/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:20:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98345340-5fb3-41fe-aea9-770cf4585e86/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:20:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a4249f18-c2bc-417a-a92b-d83719c100f3 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Lock "3830c8b3-27b8-45f3-bbdb-8a081dfcadc4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.853s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:20:22 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:20:22 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690924821.9483402, 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4 => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:20:22 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] VM Started (Lifecycle Event)
Aug 01 21:20:22 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:20:22 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:20:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98345340-5fb3-41fe-aea9-770cf4585e86/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:20:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fde640d-b731-405d-af91-fb4ef85fe90a/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:20:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fde640d-b731-405d-af91-fb4ef85fe90a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:20:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fde640d-b731-405d-af91-fb4ef85fe90a/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:20:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fde640d-b731-405d-af91-fb4ef85fe90a/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:20:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:20:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:20:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:20:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:20:24 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:24 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:20:24 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:20:24 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Hypervisor/Node resource view: name=user free_ram=7706MB free_disk=25.786975860595703GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72586) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 21:20:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:20:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:20:24 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:24 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 042f0031-1e4d-41d0-8bfa-36001675cfe3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:20:24 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 98345340-5fb3-41fe-aea9-770cf4585e86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:20:24 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 413c3426-18ad-4a5c-af04-e0e7fc90f050 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:20:24 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance eccf50b0-9acc-49b6-8044-601e47d18c38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:20:24 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 0fde640d-b731-405d-af91-fb4ef85fe90a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:20:24 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 9197638d-0c03-4b4e-876a-003bd8db3c35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:20:24 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:20:24 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 34b640b7-1dec-4b31-b64b-f1dbee7f62f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:20:24 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 25fb970a-0caf-41e8-8d58-259dbd9cf291 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:20:24 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 21:20:24 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 21:20:24 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Refreshing inventories for resource provider ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 21:20:24 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Updating ProviderTree inventory for provider ca6775c1-2a64-43f9-9467-372aa0457b1d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 21:20:24 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Updating inventory in ProviderTree for provider ca6775c1-2a64-43f9-9467-372aa0457b1d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 21:20:24 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Refreshing aggregate associations for resource provider ca6775c1-2a64-43f9-9467-372aa0457b1d, aggregates: None {{(pid=72586) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 21:20:24 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Refreshing trait associations for resource provider ca6775c1-2a64-43f9-9467-372aa0457b1d, traits: COMPUTE_NODE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_TRUSTED_CERTS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AMI {{(pid=72586) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 21:20:25 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:20:25 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:20:25 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Compute_service record updated for user:user {{(pid=72586) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 21:20:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.295s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:20:26 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:20:26 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:20:26 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:20:26 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:20:26 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72586) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 21:20:28 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:34 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:20:38 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:43 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:44 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Acquiring lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:20:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:20:45 user nova-compute[72586]: DEBUG nova.compute.manager [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Starting instance... {{(pid=72586) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 21:20:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:20:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:20:45 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72586) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 21:20:45 user nova-compute[72586]: INFO nova.compute.claims [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Claim successful on node user
Aug 01 21:20:45 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:20:45 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:20:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.585s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:20:45 user nova-compute[72586]: DEBUG nova.compute.manager [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Start building networks asynchronously for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 21:20:45 user nova-compute[72586]: DEBUG nova.compute.manager [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Allocating IP information in the background. {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 21:20:45 user nova-compute[72586]: DEBUG nova.network.neutron [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] allocate_for_instance() {{(pid=72586) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 21:20:45 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 21:20:45 user nova-compute[72586]: DEBUG nova.compute.manager [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Start building block device mappings for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 21:20:46 user nova-compute[72586]: INFO nova.virt.block_device [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Booting with volume f4ecbe90-4aec-4946-8ae3-84a870533fce at /dev/vda
Aug 01 21:20:46 user nova-compute[72586]: DEBUG os_brick.utils [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:20:46 user nova-compute[72586]: INFO oslo.privsep.daemon [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpaam5qrs_/privsep.sock']
Aug 01 21:20:46 user sudo[83578]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpaam5qrs_/privsep.sock
Aug 01 21:20:46 user sudo[83578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 01 21:20:46 user nova-compute[72586]: DEBUG nova.policy [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8cc90afc26ca4b69b61b8c3c47aa2eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '420db45538ce406abe9e8186c4e3b447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72586) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 21:20:47 user nova-compute[72586]: DEBUG nova.network.neutron [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Successfully created port: 28d77550-badf-4c92-9b3d-2335ad88267a {{(pid=72586) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 21:20:47 user sudo[83578]: pam_unix(sudo:session): session closed for user root
Aug 01 21:20:47 user nova-compute[72586]: INFO oslo.privsep.daemon [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Spawned new privsep daemon via rootwrap
Aug 01 21:20:47 user nova-compute[72586]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 01 21:20:47 user nova-compute[72586]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 01 21:20:47 user nova-compute[72586]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 01 21:20:47 user nova-compute[72586]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83581
Aug 01 21:20:47 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ea79bb-0ebc-4569-8bc2-3c510cfe5a28]: (2,) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:20:48 user nova-compute[72586]: DEBUG nova.network.neutron [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Successfully created port: 9420c293-c443-4003-a54a-d6edbd12ddbc {{(pid=72586) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 21:20:48 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:20:48 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:20:48 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c4a88b-31e8-4103-a81e-631e7ac17d14]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4bc202fb9cb\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:20:48 user nova-compute[72586]: WARNING os_brick.initiator.connectors.nvmeof [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 01 21:20:48 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:20:48 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:20:48 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[80074680-cdc2-4624-b897-84f0b596b776]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:20:48 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:20:48 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:20:48 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac79484-02ff-42e0-a63d-a9b4bddc6056]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:20:48 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[2208dfae-ae9b-4728-8590-4303f1950deb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:20:48 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Running cmd (subprocess): nvme version {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:20:48 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] 'nvme version' failed. Not Retrying. {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:20:48 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] nvme not present on system {{(pid=72586) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 21:20:48 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:20:48 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:20:48 user nova-compute[72586]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 21:20:48 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5f2184-7fda-42ab-8b00-e8d58f8f8797]: (4, '') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:20:48 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72586) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 21:20:48 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 21:20:48 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] LIGHTOS: no hostnqn found. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 21:20:48 user nova-compute[72586]: DEBUG os_brick.utils [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] <== get_connector_properties: return (2084ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4bc202fb9cb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:20:48 user nova-compute[72586]: DEBUG nova.virt.block_device [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Updating existing volume attachment record: 11c6735d-26d4-46bc-b47c-3215965a440c {{(pid=72586) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 21:20:48 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:49 user nova-compute[72586]: DEBUG nova.network.neutron [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Successfully created port: a842fd3a-0b86-4008-8ae9-96ecbd5cb7e2 {{(pid=72586) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 21:20:49 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:50 user nova-compute[72586]: DEBUG nova.network.neutron [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Successfully created port: c71bda65-c16d-48f8-b66f-60d78a569ca3 {{(pid=72586) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 21:20:50 user nova-compute[72586]: DEBUG nova.network.neutron [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Successfully created port: 07f02376-9705-48a3-8434-f7ac557f7d5b {{(pid=72586) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 21:20:51 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Acquiring lock "420cd648-f3bb-49b0-a731-d2e4337367f6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:20:51 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Lock "420cd648-f3bb-49b0-a731-d2e4337367f6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:20:51 user nova-compute[72586]: DEBUG nova.compute.manager [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Starting instance... {{(pid=72586) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 21:20:51 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:20:51 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:20:51 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72586) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 21:20:51 user nova-compute[72586]: INFO nova.compute.claims [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Claim successful on node user
Aug 01 21:20:51 user nova-compute[72586]: DEBUG nova.network.neutron [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Successfully updated port: 28d77550-badf-4c92-9b3d-2335ad88267a {{(pid=72586) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 21:20:51 user nova-compute[72586]: DEBUG nova.compute.manager [req-1f24d091-c0c1-4544-ba28-336fe46d5734 req-b38b37d4-6b7f-4d6e-91fa-1ad42fdd9e69 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received event network-changed-28d77550-badf-4c92-9b3d-2335ad88267a {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:20:51 user nova-compute[72586]: DEBUG nova.compute.manager [req-1f24d091-c0c1-4544-ba28-336fe46d5734 req-b38b37d4-6b7f-4d6e-91fa-1ad42fdd9e69 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Refreshing instance network info cache due to event network-changed-28d77550-badf-4c92-9b3d-2335ad88267a. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:20:51 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-1f24d091-c0c1-4544-ba28-336fe46d5734 req-b38b37d4-6b7f-4d6e-91fa-1ad42fdd9e69 service nova] Acquiring lock "refresh_cache-4d8fb5ee-2b96-4824-bf5c-a5ebe507606e" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:20:51 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-1f24d091-c0c1-4544-ba28-336fe46d5734 req-b38b37d4-6b7f-4d6e-91fa-1ad42fdd9e69 service nova] Acquired lock "refresh_cache-4d8fb5ee-2b96-4824-bf5c-a5ebe507606e" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:20:51 user nova-compute[72586]: DEBUG nova.network.neutron [req-1f24d091-c0c1-4544-ba28-336fe46d5734 req-b38b37d4-6b7f-4d6e-91fa-1ad42fdd9e69 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Refreshing network info cache for port 28d77550-badf-4c92-9b3d-2335ad88267a {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:20:51 user nova-compute[72586]: DEBUG nova.network.neutron [req-1f24d091-c0c1-4544-ba28-336fe46d5734 req-b38b37d4-6b7f-4d6e-91fa-1ad42fdd9e69 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Instance cache missing network info. {{(pid=72586) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 21:20:51 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:20:51 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:20:51 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.482s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:20:51 user nova-compute[72586]: DEBUG nova.compute.manager [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Start building networks asynchronously for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 21:20:51 user nova-compute[72586]: DEBUG nova.compute.manager [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Allocating IP information in the background. {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 21:20:51 user nova-compute[72586]: DEBUG nova.network.neutron [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] allocate_for_instance() {{(pid=72586) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 21:20:51 user nova-compute[72586]: DEBUG nova.network.neutron [req-1f24d091-c0c1-4544-ba28-336fe46d5734 req-b38b37d4-6b7f-4d6e-91fa-1ad42fdd9e69 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:20:51 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 21:20:51 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-1f24d091-c0c1-4544-ba28-336fe46d5734 req-b38b37d4-6b7f-4d6e-91fa-1ad42fdd9e69 service nova] Releasing lock "refresh_cache-4d8fb5ee-2b96-4824-bf5c-a5ebe507606e" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:20:52 user nova-compute[72586]: DEBUG nova.compute.manager [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Start building block device mappings for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 21:20:52 user nova-compute[72586]: INFO nova.virt.block_device [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Booting with volume 8dca4146-b838-4652-af2d-aa2dcdd95e13 at /dev/vda
Aug 01 21:20:52 user nova-compute[72586]: DEBUG os_brick.utils [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:20:52 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:20:52 user nova-compute[72586]: DEBUG nova.policy [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e476921eeb9b4212a088e864a0b85117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46642f001d8644259eea283abaff6383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72586) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 21:20:52 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:20:52 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf49162-3068-451a-bd8f-54918cbc777b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4bc202fb9cb\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:20:52 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:20:52 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:20:52 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0761697d-377a-4a4c-a82a-2c5963c2db21]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:20:52 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:20:52 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:20:52 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14cc747-e20e-4981-bff9-c479184305b0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:20:52 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[29277bc9-71b6-4765-80df-c0d5a7d8fafe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:20:52 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Running cmd (subprocess): nvme version {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:20:52 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] 'nvme version' failed. Not Retrying. {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:20:52 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.nvmeof [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] nvme not present on system {{(pid=72586) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 21:20:52 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:20:52 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:20:52 user nova-compute[72586]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 21:20:52 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[696e9d01-d7aa-4371-baee-b6d1d5c9f76a]: (4, '') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:20:52 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72586) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 21:20:52 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 21:20:52 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] LIGHTOS: no hostnqn found. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 21:20:52 user nova-compute[72586]: DEBUG os_brick.utils [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4bc202fb9cb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:20:52 user nova-compute[72586]: DEBUG nova.virt.block_device [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Updating existing volume attachment record: 64f5e11e-6ecd-45b0-adb6-14d6eecbffcd {{(pid=72586) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 21:20:52 user nova-compute[72586]: DEBUG nova.network.neutron [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Successfully updated port: 0630d545-5545-4e43-96e7-1a0aed01ba9b {{(pid=72586) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 21:20:52 user nova-compute[72586]: DEBUG nova.network.neutron [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Successfully created port: cdf2815f-96ba-4cb9-a025-1436804117e7 {{(pid=72586) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 21:20:53 user nova-compute[72586]: DEBUG nova.compute.manager [req-01a84125-fe0f-41ac-85b0-ad760e008fde req-5619bbaa-a01b-47e5-8168-f488da455fe0 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received event network-changed-0630d545-5545-4e43-96e7-1a0aed01ba9b {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:20:53 user nova-compute[72586]: DEBUG nova.compute.manager [req-01a84125-fe0f-41ac-85b0-ad760e008fde req-5619bbaa-a01b-47e5-8168-f488da455fe0 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Refreshing instance network info cache due to event network-changed-0630d545-5545-4e43-96e7-1a0aed01ba9b. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:20:53 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-01a84125-fe0f-41ac-85b0-ad760e008fde req-5619bbaa-a01b-47e5-8168-f488da455fe0 service nova] Acquiring lock "refresh_cache-4d8fb5ee-2b96-4824-bf5c-a5ebe507606e" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:20:53 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-01a84125-fe0f-41ac-85b0-ad760e008fde req-5619bbaa-a01b-47e5-8168-f488da455fe0 service nova] Acquired lock "refresh_cache-4d8fb5ee-2b96-4824-bf5c-a5ebe507606e" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:20:53 user nova-compute[72586]: DEBUG nova.network.neutron [req-01a84125-fe0f-41ac-85b0-ad760e008fde req-5619bbaa-a01b-47e5-8168-f488da455fe0 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Refreshing network info cache for port 0630d545-5545-4e43-96e7-1a0aed01ba9b {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:20:53 user nova-compute[72586]: DEBUG nova.network.neutron [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Successfully created port: 65302d59-bf47-478e-be2e-37920bc76542 {{(pid=72586) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 21:20:53 user nova-compute[72586]: DEBUG nova.network.neutron [req-01a84125-fe0f-41ac-85b0-ad760e008fde req-5619bbaa-a01b-47e5-8168-f488da455fe0 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Instance cache missing network info. {{(pid=72586) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 21:20:53 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:53 user nova-compute[72586]: DEBUG nova.network.neutron [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Successfully updated port: e986409e-ff38-4dad-ba15-4338156ff5f7 {{(pid=72586) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 21:20:54 user nova-compute[72586]: DEBUG nova.network.neutron [req-01a84125-fe0f-41ac-85b0-ad760e008fde req-5619bbaa-a01b-47e5-8168-f488da455fe0 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:20:54 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-01a84125-fe0f-41ac-85b0-ad760e008fde req-5619bbaa-a01b-47e5-8168-f488da455fe0 service nova] Releasing lock "refresh_cache-4d8fb5ee-2b96-4824-bf5c-a5ebe507606e" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:20:54 user nova-compute[72586]: DEBUG nova.network.neutron [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Successfully created port: d823d714-835e-418a-85f2-e99504cc3f94 {{(pid=72586) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 21:20:54 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:20:54 user nova-compute[72586]: DEBUG nova.network.neutron [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Successfully updated port: 9420c293-c443-4003-a54a-d6edbd12ddbc {{(pid=72586) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 21:20:55 user nova-compute[72586]: DEBUG nova.network.neutron [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Successfully created port: abf0b845-110a-447f-b130-b1eeed139b29 {{(pid=72586) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 21:20:55 user nova-compute[72586]: DEBUG nova.compute.manager [req-afaef973-d70d-488f-a0b6-6ff44ea281f5 req-7f54817d-735c-435e-be93-9a60982066db service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received event network-changed-e986409e-ff38-4dad-ba15-4338156ff5f7 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:20:55 user nova-compute[72586]: DEBUG nova.compute.manager [req-afaef973-d70d-488f-a0b6-6ff44ea281f5 req-7f54817d-735c-435e-be93-9a60982066db service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Refreshing instance network info cache due to event network-changed-e986409e-ff38-4dad-ba15-4338156ff5f7. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:20:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-afaef973-d70d-488f-a0b6-6ff44ea281f5 req-7f54817d-735c-435e-be93-9a60982066db service nova] Acquiring lock "refresh_cache-4d8fb5ee-2b96-4824-bf5c-a5ebe507606e" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:20:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-afaef973-d70d-488f-a0b6-6ff44ea281f5 req-7f54817d-735c-435e-be93-9a60982066db service nova] Acquired lock "refresh_cache-4d8fb5ee-2b96-4824-bf5c-a5ebe507606e" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:20:55 user nova-compute[72586]: DEBUG nova.network.neutron [req-afaef973-d70d-488f-a0b6-6ff44ea281f5 req-7f54817d-735c-435e-be93-9a60982066db service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Refreshing network info cache for port e986409e-ff38-4dad-ba15-4338156ff5f7 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:20:55 user nova-compute[72586]: DEBUG nova.network.neutron [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Successfully updated port: a842fd3a-0b86-4008-8ae9-96ecbd5cb7e2 {{(pid=72586) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 21:20:55 user nova-compute[72586]: DEBUG nova.network.neutron [req-afaef973-d70d-488f-a0b6-6ff44ea281f5 req-7f54817d-735c-435e-be93-9a60982066db service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Instance cache missing network info. {{(pid=72586) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 21:20:56 user nova-compute[72586]: DEBUG nova.network.neutron [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Successfully created port: 3095c6ca-2bce-4216-9290-e1fc3fe17e03 {{(pid=72586) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 21:20:56 user nova-compute[72586]: DEBUG nova.network.neutron [req-afaef973-d70d-488f-a0b6-6ff44ea281f5 req-7f54817d-735c-435e-be93-9a60982066db service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:20:56 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-afaef973-d70d-488f-a0b6-6ff44ea281f5 req-7f54817d-735c-435e-be93-9a60982066db service nova] Releasing lock "refresh_cache-4d8fb5ee-2b96-4824-bf5c-a5ebe507606e" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:20:56 user nova-compute[72586]: DEBUG nova.compute.manager [req-afaef973-d70d-488f-a0b6-6ff44ea281f5 req-7f54817d-735c-435e-be93-9a60982066db service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received event network-changed-9420c293-c443-4003-a54a-d6edbd12ddbc {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:20:56 user nova-compute[72586]: DEBUG nova.compute.manager [req-afaef973-d70d-488f-a0b6-6ff44ea281f5 req-7f54817d-735c-435e-be93-9a60982066db service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Refreshing instance network info cache due to event network-changed-9420c293-c443-4003-a54a-d6edbd12ddbc. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:20:56 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-afaef973-d70d-488f-a0b6-6ff44ea281f5 req-7f54817d-735c-435e-be93-9a60982066db service nova] Acquiring lock "refresh_cache-4d8fb5ee-2b96-4824-bf5c-a5ebe507606e" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:20:56 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-afaef973-d70d-488f-a0b6-6ff44ea281f5 req-7f54817d-735c-435e-be93-9a60982066db service nova] Acquired lock "refresh_cache-4d8fb5ee-2b96-4824-bf5c-a5ebe507606e" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:20:56 user nova-compute[72586]: DEBUG nova.network.neutron [req-afaef973-d70d-488f-a0b6-6ff44ea281f5 req-7f54817d-735c-435e-be93-9a60982066db service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Refreshing network info cache for port 9420c293-c443-4003-a54a-d6edbd12ddbc {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:20:56 user nova-compute[72586]: DEBUG nova.network.neutron [req-afaef973-d70d-488f-a0b6-6ff44ea281f5 req-7f54817d-735c-435e-be93-9a60982066db service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Instance cache missing network info. {{(pid=72586) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 21:20:56 user nova-compute[72586]: DEBUG nova.network.neutron [req-afaef973-d70d-488f-a0b6-6ff44ea281f5 req-7f54817d-735c-435e-be93-9a60982066db service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:20:56 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-afaef973-d70d-488f-a0b6-6ff44ea281f5 req-7f54817d-735c-435e-be93-9a60982066db service nova] Releasing lock "refresh_cache-4d8fb5ee-2b96-4824-bf5c-a5ebe507606e" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:20:56 user nova-compute[72586]: INFO nova.virt.block_device [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Booting with volume d4c35416-07f0-4c10-86da-a4645d35ea7d at /dev/vdb
Aug 01 21:20:56 user nova-compute[72586]: DEBUG nova.network.neutron [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Successfully updated port: c71bda65-c16d-48f8-b66f-60d78a569ca3 {{(pid=72586) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 21:20:56 user nova-compute[72586]: DEBUG os_brick.utils [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:20:56 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:20:56 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:20:56 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a27811c-c64e-4f90-b4f8-923ba23ef635]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4bc202fb9cb\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:20:56 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:20:56 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:20:56 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1cde1c1-fcdc-41a9-9a4c-35d7fc49ffb6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:20:56 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:20:56 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:20:56 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e72b30-b807-446b-80f5-1a4bd12a2029]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:20:56 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2557eb1-2958-472b-8b86-98c034cba7bd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:20:56 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Running cmd (subprocess): nvme version {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:20:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] 'nvme version' failed. Not Retrying. {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:20:57 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] nvme not present on system {{(pid=72586) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 21:20:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:20:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:20:57 user nova-compute[72586]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 21:20:57 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a1ca70-3c9e-4d2e-8df3-4771df41a53a]: (4, '') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:20:57 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72586) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 21:20:57 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 21:20:57 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] LIGHTOS: no hostnqn found. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 21:20:57 user nova-compute[72586]: DEBUG os_brick.utils [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4bc202fb9cb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:20:57 user nova-compute[72586]: DEBUG nova.virt.block_device [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Updating existing volume attachment record: ab88b1a9-aa0e-4b7b-8900-3d2e0a1c8262 {{(pid=72586) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 21:20:57 user nova-compute[72586]: DEBUG nova.network.neutron [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Successfully updated port: cdf2815f-96ba-4cb9-a025-1436804117e7 {{(pid=72586) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 21:20:57 user nova-compute[72586]: DEBUG nova.compute.manager [req-d81d9ade-47ae-4405-a60b-26d301b78cea req-96407038-1c98-49fd-b0ce-bed7ccef825f service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received event network-changed-cdf2815f-96ba-4cb9-a025-1436804117e7 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:20:57 user nova-compute[72586]: DEBUG nova.compute.manager [req-d81d9ade-47ae-4405-a60b-26d301b78cea req-96407038-1c98-49fd-b0ce-bed7ccef825f service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Refreshing instance network info cache due to event network-changed-cdf2815f-96ba-4cb9-a025-1436804117e7. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:20:57 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d81d9ade-47ae-4405-a60b-26d301b78cea req-96407038-1c98-49fd-b0ce-bed7ccef825f service nova] Acquiring lock "refresh_cache-420cd648-f3bb-49b0-a731-d2e4337367f6" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:20:57 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d81d9ade-47ae-4405-a60b-26d301b78cea req-96407038-1c98-49fd-b0ce-bed7ccef825f service nova] Acquired lock "refresh_cache-420cd648-f3bb-49b0-a731-d2e4337367f6" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:20:57 user nova-compute[72586]: DEBUG nova.network.neutron [req-d81d9ade-47ae-4405-a60b-26d301b78cea req-96407038-1c98-49fd-b0ce-bed7ccef825f service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Refreshing network info cache for port cdf2815f-96ba-4cb9-a025-1436804117e7 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:20:57 user nova-compute[72586]: DEBUG nova.network.neutron [req-d81d9ade-47ae-4405-a60b-26d301b78cea req-96407038-1c98-49fd-b0ce-bed7ccef825f service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Instance cache missing network info. {{(pid=72586) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 21:20:57 user nova-compute[72586]: DEBUG nova.network.neutron [req-d81d9ade-47ae-4405-a60b-26d301b78cea req-96407038-1c98-49fd-b0ce-bed7ccef825f service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:20:57 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d81d9ade-47ae-4405-a60b-26d301b78cea req-96407038-1c98-49fd-b0ce-bed7ccef825f service nova] Releasing lock "refresh_cache-420cd648-f3bb-49b0-a731-d2e4337367f6" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:20:57 user nova-compute[72586]: DEBUG nova.compute.manager [req-5c59c6c9-8840-450d-b2e6-3fe5dc9061cf req-728f94cc-7906-4355-9d07-4959cde8710e service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received event network-changed-a842fd3a-0b86-4008-8ae9-96ecbd5cb7e2 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:20:57 user nova-compute[72586]: DEBUG nova.compute.manager [req-5c59c6c9-8840-450d-b2e6-3fe5dc9061cf req-728f94cc-7906-4355-9d07-4959cde8710e service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Refreshing instance network info cache due to event network-changed-a842fd3a-0b86-4008-8ae9-96ecbd5cb7e2. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:20:57 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-5c59c6c9-8840-450d-b2e6-3fe5dc9061cf req-728f94cc-7906-4355-9d07-4959cde8710e service nova] Acquiring lock "refresh_cache-4d8fb5ee-2b96-4824-bf5c-a5ebe507606e" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:20:57 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-5c59c6c9-8840-450d-b2e6-3fe5dc9061cf req-728f94cc-7906-4355-9d07-4959cde8710e service nova] Acquired lock "refresh_cache-4d8fb5ee-2b96-4824-bf5c-a5ebe507606e" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:20:57 user nova-compute[72586]: DEBUG nova.network.neutron [req-5c59c6c9-8840-450d-b2e6-3fe5dc9061cf req-728f94cc-7906-4355-9d07-4959cde8710e service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Refreshing network info cache for port a842fd3a-0b86-4008-8ae9-96ecbd5cb7e2 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:20:58 user nova-compute[72586]: DEBUG nova.network.neutron [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Successfully updated port: bdfc5e91-52c4-4071-8252-a7caa7b53d24 {{(pid=72586) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 21:20:58 user nova-compute[72586]: DEBUG nova.network.neutron [req-5c59c6c9-8840-450d-b2e6-3fe5dc9061cf req-728f94cc-7906-4355-9d07-4959cde8710e service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Instance cache missing network info. {{(pid=72586) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 21:20:58 user nova-compute[72586]: DEBUG nova.network.neutron [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Successfully updated port: 07f02376-9705-48a3-8434-f7ac557f7d5b {{(pid=72586) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 21:20:58 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Acquiring lock "refresh_cache-4d8fb5ee-2b96-4824-bf5c-a5ebe507606e" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:20:58 user nova-compute[72586]: DEBUG nova.network.neutron [req-5c59c6c9-8840-450d-b2e6-3fe5dc9061cf req-728f94cc-7906-4355-9d07-4959cde8710e service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:20:58 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-5c59c6c9-8840-450d-b2e6-3fe5dc9061cf req-728f94cc-7906-4355-9d07-4959cde8710e service nova] Releasing lock "refresh_cache-4d8fb5ee-2b96-4824-bf5c-a5ebe507606e" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:20:58 user nova-compute[72586]: DEBUG nova.compute.manager [req-5c59c6c9-8840-450d-b2e6-3fe5dc9061cf req-728f94cc-7906-4355-9d07-4959cde8710e service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received event network-changed-c71bda65-c16d-48f8-b66f-60d78a569ca3 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:20:58 user nova-compute[72586]: DEBUG nova.compute.manager [req-5c59c6c9-8840-450d-b2e6-3fe5dc9061cf req-728f94cc-7906-4355-9d07-4959cde8710e service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Refreshing instance network info cache due to event network-changed-c71bda65-c16d-48f8-b66f-60d78a569ca3. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:20:58 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-5c59c6c9-8840-450d-b2e6-3fe5dc9061cf req-728f94cc-7906-4355-9d07-4959cde8710e service nova] Acquiring lock "refresh_cache-4d8fb5ee-2b96-4824-bf5c-a5ebe507606e" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:20:58 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-5c59c6c9-8840-450d-b2e6-3fe5dc9061cf req-728f94cc-7906-4355-9d07-4959cde8710e service nova] Acquired lock "refresh_cache-4d8fb5ee-2b96-4824-bf5c-a5ebe507606e" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:20:58 user nova-compute[72586]: DEBUG nova.network.neutron [req-5c59c6c9-8840-450d-b2e6-3fe5dc9061cf req-728f94cc-7906-4355-9d07-4959cde8710e service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Refreshing network info cache for port c71bda65-c16d-48f8-b66f-60d78a569ca3 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:20:58 user nova-compute[72586]: DEBUG nova.network.neutron [req-5c59c6c9-8840-450d-b2e6-3fe5dc9061cf req-728f94cc-7906-4355-9d07-4959cde8710e service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Instance cache missing network info. {{(pid=72586) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 21:20:58 user nova-compute[72586]: DEBUG nova.network.neutron [req-5c59c6c9-8840-450d-b2e6-3fe5dc9061cf req-728f94cc-7906-4355-9d07-4959cde8710e service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:20:58 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-5c59c6c9-8840-450d-b2e6-3fe5dc9061cf req-728f94cc-7906-4355-9d07-4959cde8710e service nova] Releasing lock "refresh_cache-4d8fb5ee-2b96-4824-bf5c-a5ebe507606e" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:20:58 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Acquired lock "refresh_cache-4d8fb5ee-2b96-4824-bf5c-a5ebe507606e" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:20:58 user nova-compute[72586]: DEBUG nova.network.neutron [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:20:58 user nova-compute[72586]: DEBUG nova.network.neutron [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Instance cache missing network info. {{(pid=72586) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 21:20:58 user nova-compute[72586]: DEBUG nova.network.neutron [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Successfully updated port: 5ba1ef1d-6876-4756-86b2-0425ba5dfb39 {{(pid=72586) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 21:20:59 user nova-compute[72586]: DEBUG nova.compute.manager [req-57a6e9a7-f517-4245-a8cd-ed53fcc8c2aa req-aeb1677c-b74e-448a-95ae-8b0830195085 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received event network-changed-bdfc5e91-52c4-4071-8252-a7caa7b53d24 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:20:59 user nova-compute[72586]: DEBUG nova.compute.manager [req-57a6e9a7-f517-4245-a8cd-ed53fcc8c2aa req-aeb1677c-b74e-448a-95ae-8b0830195085 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Refreshing instance network info cache due to event network-changed-bdfc5e91-52c4-4071-8252-a7caa7b53d24. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:20:59 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-57a6e9a7-f517-4245-a8cd-ed53fcc8c2aa req-aeb1677c-b74e-448a-95ae-8b0830195085 service nova] Acquiring lock "refresh_cache-420cd648-f3bb-49b0-a731-d2e4337367f6" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:20:59 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-57a6e9a7-f517-4245-a8cd-ed53fcc8c2aa req-aeb1677c-b74e-448a-95ae-8b0830195085 service nova] Acquired lock "refresh_cache-420cd648-f3bb-49b0-a731-d2e4337367f6" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:20:59 user nova-compute[72586]: DEBUG nova.network.neutron [req-57a6e9a7-f517-4245-a8cd-ed53fcc8c2aa req-aeb1677c-b74e-448a-95ae-8b0830195085 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Refreshing network info cache for port bdfc5e91-52c4-4071-8252-a7caa7b53d24 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:20:59 user nova-compute[72586]: DEBUG nova.network.neutron [req-57a6e9a7-f517-4245-a8cd-ed53fcc8c2aa req-aeb1677c-b74e-448a-95ae-8b0830195085 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Instance cache missing network info. {{(pid=72586) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 21:20:59 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:20:59 user nova-compute[72586]: DEBUG nova.network.neutron [req-57a6e9a7-f517-4245-a8cd-ed53fcc8c2aa req-aeb1677c-b74e-448a-95ae-8b0830195085 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:20:59 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-57a6e9a7-f517-4245-a8cd-ed53fcc8c2aa req-aeb1677c-b74e-448a-95ae-8b0830195085 service nova] Releasing lock "refresh_cache-420cd648-f3bb-49b0-a731-d2e4337367f6" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:20:59 user nova-compute[72586]: DEBUG nova.compute.manager [req-57a6e9a7-f517-4245-a8cd-ed53fcc8c2aa req-aeb1677c-b74e-448a-95ae-8b0830195085 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received event network-changed-5ba1ef1d-6876-4756-86b2-0425ba5dfb39 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:20:59 user nova-compute[72586]: DEBUG nova.compute.manager [req-57a6e9a7-f517-4245-a8cd-ed53fcc8c2aa req-aeb1677c-b74e-448a-95ae-8b0830195085 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Refreshing instance network info cache due to event network-changed-5ba1ef1d-6876-4756-86b2-0425ba5dfb39. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:20:59 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-57a6e9a7-f517-4245-a8cd-ed53fcc8c2aa req-aeb1677c-b74e-448a-95ae-8b0830195085 service nova] Acquiring lock "refresh_cache-420cd648-f3bb-49b0-a731-d2e4337367f6" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:20:59 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-57a6e9a7-f517-4245-a8cd-ed53fcc8c2aa req-aeb1677c-b74e-448a-95ae-8b0830195085 service nova] Acquired lock "refresh_cache-420cd648-f3bb-49b0-a731-d2e4337367f6" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:20:59 user nova-compute[72586]: DEBUG nova.network.neutron [req-57a6e9a7-f517-4245-a8cd-ed53fcc8c2aa req-aeb1677c-b74e-448a-95ae-8b0830195085 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Refreshing network info cache for port 5ba1ef1d-6876-4756-86b2-0425ba5dfb39 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:20:59 user nova-compute[72586]: DEBUG nova.network.neutron [req-57a6e9a7-f517-4245-a8cd-ed53fcc8c2aa req-aeb1677c-b74e-448a-95ae-8b0830195085 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Instance cache missing network info. {{(pid=72586) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 21:20:59 user nova-compute[72586]: DEBUG nova.network.neutron [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Successfully updated port: 65302d59-bf47-478e-be2e-37920bc76542 {{(pid=72586) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 21:21:00 user nova-compute[72586]: DEBUG nova.compute.manager [req-f035a109-5aa2-4aec-9f9b-fcd7ba9944df req-1d93f5d8-a7b6-4eb7-8740-25c89b966a17 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received event network-changed-07f02376-9705-48a3-8434-f7ac557f7d5b {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:21:00 user nova-compute[72586]: DEBUG nova.compute.manager [req-f035a109-5aa2-4aec-9f9b-fcd7ba9944df req-1d93f5d8-a7b6-4eb7-8740-25c89b966a17 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Refreshing instance network info cache due to event network-changed-07f02376-9705-48a3-8434-f7ac557f7d5b. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:21:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-f035a109-5aa2-4aec-9f9b-fcd7ba9944df req-1d93f5d8-a7b6-4eb7-8740-25c89b966a17 service nova] Acquiring lock "refresh_cache-4d8fb5ee-2b96-4824-bf5c-a5ebe507606e" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:21:00 user nova-compute[72586]: DEBUG nova.network.neutron [req-57a6e9a7-f517-4245-a8cd-ed53fcc8c2aa req-aeb1677c-b74e-448a-95ae-8b0830195085 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:21:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-57a6e9a7-f517-4245-a8cd-ed53fcc8c2aa req-aeb1677c-b74e-448a-95ae-8b0830195085 service nova] Releasing lock "refresh_cache-420cd648-f3bb-49b0-a731-d2e4337367f6" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:21:00 user nova-compute[72586]: INFO nova.virt.block_device [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Booting with volume 5bf0c46e-827e-44eb-986e-53dec3bf35e3 at /dev/vdb
Aug 01 21:21:00 user nova-compute[72586]: DEBUG os_brick.utils [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:21:00 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:00 user nova-compute[72586]: DEBUG nova.network.neutron [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Successfully updated port: d823d714-835e-418a-85f2-e99504cc3f94 {{(pid=72586) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 21:21:00 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:00 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[57416dd9-7b4c-4427-add2-27d9aa1b55a0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4bc202fb9cb\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:00 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:00 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:00 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbdeabda-ebea-40dd-bfd9-f5c0c0edd2f6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:00 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:00 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:00 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[5656d079-5906-4777-96a9-39f85e2eccb8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:00 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[739ce11f-146f-48f9-bfdc-e2f1975fff37]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:00 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Running cmd (subprocess): nvme version {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:00 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] 'nvme version' failed. Not Retrying. {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:21:00 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.nvmeof [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] nvme not present on system {{(pid=72586) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 21:21:00 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:00 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:21:00 user nova-compute[72586]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 21:21:00 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[560573a2-d4b5-4690-b9c4-8a4581b7c933]: (4, '') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:00 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72586) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 21:21:00 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 21:21:00 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] LIGHTOS: no hostnqn found. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 21:21:00 user nova-compute[72586]: DEBUG os_brick.utils [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4bc202fb9cb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:21:00 user nova-compute[72586]: DEBUG nova.virt.block_device [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Updating existing volume attachment record: 6739ca6c-c8c7-437e-b577-82b50b4d9055 {{(pid=72586) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 21:21:01 user nova-compute[72586]: DEBUG nova.network.neutron [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Updating instance_info_cache with network_info: [{"id": "28d77550-badf-4c92-9b3d-2335ad88267a", "address": "fa:16:3e:a9:7c:cd", "network": {"id": "7a484128-086b-466a-a4f1-7ee335a489ac", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1177849467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28d77550-ba", "ovs_interfaceid": "28d77550-badf-4c92-9b3d-2335ad88267a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0630d545-5545-4e43-96e7-1a0aed01ba9b", "address": "fa:16:3e:6b:2e:9d", "network": {"id": "e4f2e657-3943-4157-85f2-95d34eebda68", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137166827", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0630d545-55", "ovs_interfaceid": "0630d545-5545-4e43-96e7-1a0aed01ba9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e986409e-ff38-4dad-ba15-4338156ff5f7", "address": "fa:16:3e:ac:26:34", "network": {"id": "e4f2e657-3943-4157-85f2-95d34eebda68", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137166827", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape986409e-ff", "ovs_interfaceid": "e986409e-ff38-4dad-ba15-4338156ff5f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9420c293-c443-4003-a54a-d6edbd12ddbc", "address": "fa:16:3e:f5:5b:b1", "network": {"id": "e4f2e657-3943-4157-85f2-95d34eebda68", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137166827", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9420c293-c4", "ovs_interfaceid": "9420c293-c443-4003-a54a-d6edbd12ddbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a842fd3a-0b86-4008-8ae9-96ecbd5cb7e2", "address": "fa:16:3e:e2:04:9a", "network": {"id": "e4f2e657-3943-4157-85f2-95d34eebda68", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137166827", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa842fd3a-0b", "ovs_interfaceid": "a842fd3a-0b86-4008-8ae9-96ecbd5cb7e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c71bda65-c16d-48f8-b66f-60d78a569ca3", "address": "fa:16:3e:45:96:2a", "network": {"id": "9c8aece4-aa0f-4431-9376-d0069c7e1003", "bridge": "br-int", "label": "tempest-device-tagging-net2-1263991370", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc71bda65-c1", "ovs_interfaceid": "c71bda65-c16d-48f8-b66f-60d78a569ca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "07f02376-9705-48a3-8434-f7ac557f7d5b", "address": "fa:16:3e:29:34:47", "network": {"id": "9c8aece4-aa0f-4431-9376-d0069c7e1003", "bridge": "br-int", "label": "tempest-device-tagging-net2-1263991370", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07f02376-97", "ovs_interfaceid": "07f02376-9705-48a3-8434-f7ac557f7d5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:21:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Releasing lock "refresh_cache-4d8fb5ee-2b96-4824-bf5c-a5ebe507606e" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:21:01 user nova-compute[72586]: DEBUG nova.compute.manager [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Instance network_info: |[{"id": "28d77550-badf-4c92-9b3d-2335ad88267a", "address": "fa:16:3e:a9:7c:cd", "network": {"id": "7a484128-086b-466a-a4f1-7ee335a489ac", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1177849467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28d77550-ba", "ovs_interfaceid": "28d77550-badf-4c92-9b3d-2335ad88267a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0630d545-5545-4e43-96e7-1a0aed01ba9b", "address": "fa:16:3e:6b:2e:9d", "network": {"id": "e4f2e657-3943-4157-85f2-95d34eebda68", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137166827", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0630d545-55", "ovs_interfaceid": "0630d545-5545-4e43-96e7-1a0aed01ba9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e986409e-ff38-4dad-ba15-4338156ff5f7", "address": "fa:16:3e:ac:26:34", "network": {"id": "e4f2e657-3943-4157-85f2-95d34eebda68", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137166827", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape986409e-ff", "ovs_interfaceid": "e986409e-ff38-4dad-ba15-4338156ff5f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9420c293-c443-4003-a54a-d6edbd12ddbc", "address": "fa:16:3e:f5:5b:b1", "network": {"id": "e4f2e657-3943-4157-85f2-95d34eebda68", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137166827", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9420c293-c4", "ovs_interfaceid": "9420c293-c443-4003-a54a-d6edbd12ddbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a842fd3a-0b86-4008-8ae9-96ecbd5cb7e2", "address": "fa:16:3e:e2:04:9a", "network": {"id": "e4f2e657-3943-4157-85f2-95d34eebda68", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137166827", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa842fd3a-0b", "ovs_interfaceid": "a842fd3a-0b86-4008-8ae9-96ecbd5cb7e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c71bda65-c16d-48f8-b66f-60d78a569ca3", "address": "fa:16:3e:45:96:2a", "network": {"id": "9c8aece4-aa0f-4431-9376-d0069c7e1003", "bridge": "br-int", "label": "tempest-device-tagging-net2-1263991370", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc71bda65-c1", "ovs_interfaceid": "c71bda65-c16d-48f8-b66f-60d78a569ca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "07f02376-9705-48a3-8434-f7ac557f7d5b", "address": "fa:16:3e:29:34:47", "network": {"id": "9c8aece4-aa0f-4431-9376-d0069c7e1003", "bridge": "br-int", "label": "tempest-device-tagging-net2-1263991370", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07f02376-97", "ovs_interfaceid": "07f02376-9705-48a3-8434-f7ac557f7d5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 21:21:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-f035a109-5aa2-4aec-9f9b-fcd7ba9944df req-1d93f5d8-a7b6-4eb7-8740-25c89b966a17 service nova] Acquired lock "refresh_cache-4d8fb5ee-2b96-4824-bf5c-a5ebe507606e" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:21:01 user nova-compute[72586]: DEBUG nova.network.neutron [req-f035a109-5aa2-4aec-9f9b-fcd7ba9944df req-1d93f5d8-a7b6-4eb7-8740-25c89b966a17 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Refreshing network info cache for port 07f02376-9705-48a3-8434-f7ac557f7d5b {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:21:01 user nova-compute[72586]: DEBUG nova.compute.manager [req-d3d14a8c-d0bc-41ed-8948-30103964d8af req-f98441ce-e521-410b-9414-7d361beae359 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received event network-changed-65302d59-bf47-478e-be2e-37920bc76542 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:21:01 user nova-compute[72586]: DEBUG nova.compute.manager [req-d3d14a8c-d0bc-41ed-8948-30103964d8af req-f98441ce-e521-410b-9414-7d361beae359 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Refreshing instance network info cache due to event network-changed-65302d59-bf47-478e-be2e-37920bc76542. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:21:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d3d14a8c-d0bc-41ed-8948-30103964d8af req-f98441ce-e521-410b-9414-7d361beae359 service nova] Acquiring lock "refresh_cache-420cd648-f3bb-49b0-a731-d2e4337367f6" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:21:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d3d14a8c-d0bc-41ed-8948-30103964d8af req-f98441ce-e521-410b-9414-7d361beae359 service nova] Acquired lock "refresh_cache-420cd648-f3bb-49b0-a731-d2e4337367f6" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:21:01 user nova-compute[72586]: DEBUG nova.network.neutron [req-d3d14a8c-d0bc-41ed-8948-30103964d8af req-f98441ce-e521-410b-9414-7d361beae359 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Refreshing network info cache for port 65302d59-bf47-478e-be2e-37920bc76542 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:21:01 user nova-compute[72586]: DEBUG nova.network.neutron [req-d3d14a8c-d0bc-41ed-8948-30103964d8af req-f98441ce-e521-410b-9414-7d361beae359 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Instance cache missing network info. {{(pid=72586) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 21:21:01 user nova-compute[72586]: DEBUG nova.network.neutron [req-d3d14a8c-d0bc-41ed-8948-30103964d8af req-f98441ce-e521-410b-9414-7d361beae359 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:21:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d3d14a8c-d0bc-41ed-8948-30103964d8af req-f98441ce-e521-410b-9414-7d361beae359 service nova] Releasing lock "refresh_cache-420cd648-f3bb-49b0-a731-d2e4337367f6" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:21:01 user nova-compute[72586]: DEBUG nova.compute.manager [req-d3d14a8c-d0bc-41ed-8948-30103964d8af req-f98441ce-e521-410b-9414-7d361beae359 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received event network-changed-d823d714-835e-418a-85f2-e99504cc3f94 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:21:01 user nova-compute[72586]: DEBUG nova.compute.manager [req-d3d14a8c-d0bc-41ed-8948-30103964d8af req-f98441ce-e521-410b-9414-7d361beae359 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Refreshing instance network info cache due to event network-changed-d823d714-835e-418a-85f2-e99504cc3f94. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:21:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d3d14a8c-d0bc-41ed-8948-30103964d8af req-f98441ce-e521-410b-9414-7d361beae359 service nova] Acquiring lock "refresh_cache-420cd648-f3bb-49b0-a731-d2e4337367f6" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:21:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d3d14a8c-d0bc-41ed-8948-30103964d8af req-f98441ce-e521-410b-9414-7d361beae359 service nova] Acquired lock "refresh_cache-420cd648-f3bb-49b0-a731-d2e4337367f6" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:21:01 user nova-compute[72586]: DEBUG nova.network.neutron [req-d3d14a8c-d0bc-41ed-8948-30103964d8af req-f98441ce-e521-410b-9414-7d361beae359 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Refreshing network info cache for port d823d714-835e-418a-85f2-e99504cc3f94 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:21:02 user nova-compute[72586]: DEBUG nova.network.neutron [req-d3d14a8c-d0bc-41ed-8948-30103964d8af req-f98441ce-e521-410b-9414-7d361beae359 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Instance cache missing network info. {{(pid=72586) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 21:21:02 user nova-compute[72586]: DEBUG nova.network.neutron [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Successfully updated port: abf0b845-110a-447f-b130-b1eeed139b29 {{(pid=72586) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 21:21:02 user nova-compute[72586]: DEBUG nova.network.neutron [req-f035a109-5aa2-4aec-9f9b-fcd7ba9944df req-1d93f5d8-a7b6-4eb7-8740-25c89b966a17 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Updated VIF entry in instance network info cache for port 07f02376-9705-48a3-8434-f7ac557f7d5b. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:21:02 user nova-compute[72586]: DEBUG nova.network.neutron [req-f035a109-5aa2-4aec-9f9b-fcd7ba9944df req-1d93f5d8-a7b6-4eb7-8740-25c89b966a17 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Updating instance_info_cache with network_info: [{"id": "28d77550-badf-4c92-9b3d-2335ad88267a", "address": "fa:16:3e:a9:7c:cd", "network": {"id": "7a484128-086b-466a-a4f1-7ee335a489ac", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1177849467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28d77550-ba", "ovs_interfaceid": "28d77550-badf-4c92-9b3d-2335ad88267a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0630d545-5545-4e43-96e7-1a0aed01ba9b", "address": "fa:16:3e:6b:2e:9d", "network": {"id": "e4f2e657-3943-4157-85f2-95d34eebda68", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137166827", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0630d545-55", "ovs_interfaceid": "0630d545-5545-4e43-96e7-1a0aed01ba9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e986409e-ff38-4dad-ba15-4338156ff5f7", "address": "fa:16:3e:ac:26:34", "network": {"id": "e4f2e657-3943-4157-85f2-95d34eebda68", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137166827", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape986409e-ff", "ovs_interfaceid": "e986409e-ff38-4dad-ba15-4338156ff5f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9420c293-c443-4003-a54a-d6edbd12ddbc", "address": "fa:16:3e:f5:5b:b1", "network": {"id": "e4f2e657-3943-4157-85f2-95d34eebda68", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137166827", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9420c293-c4", "ovs_interfaceid": "9420c293-c443-4003-a54a-d6edbd12ddbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a842fd3a-0b86-4008-8ae9-96ecbd5cb7e2", "address": "fa:16:3e:e2:04:9a", "network": {"id": "e4f2e657-3943-4157-85f2-95d34eebda68", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137166827", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa842fd3a-0b", "ovs_interfaceid": "a842fd3a-0b86-4008-8ae9-96ecbd5cb7e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c71bda65-c16d-48f8-b66f-60d78a569ca3", "address": "fa:16:3e:45:96:2a", "network": {"id": "9c8aece4-aa0f-4431-9376-d0069c7e1003", "bridge": "br-int", "label": "tempest-device-tagging-net2-1263991370", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc71bda65-c1", "ovs_interfaceid": "c71bda65-c16d-48f8-b66f-60d78a569ca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "07f02376-9705-48a3-8434-f7ac557f7d5b", "address": "fa:16:3e:29:34:47", "network": {"id": "9c8aece4-aa0f-4431-9376-d0069c7e1003", "bridge": "br-int", "label": "tempest-device-tagging-net2-1263991370", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07f02376-97", "ovs_interfaceid": "07f02376-9705-48a3-8434-f7ac557f7d5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:21:02 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-f035a109-5aa2-4aec-9f9b-fcd7ba9944df req-1d93f5d8-a7b6-4eb7-8740-25c89b966a17 service nova] Releasing lock "refresh_cache-4d8fb5ee-2b96-4824-bf5c-a5ebe507606e" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:21:02 user nova-compute[72586]: DEBUG nova.network.neutron [req-d3d14a8c-d0bc-41ed-8948-30103964d8af req-f98441ce-e521-410b-9414-7d361beae359 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:21:02 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d3d14a8c-d0bc-41ed-8948-30103964d8af req-f98441ce-e521-410b-9414-7d361beae359 service nova] Releasing lock "refresh_cache-420cd648-f3bb-49b0-a731-d2e4337367f6" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:21:03 user nova-compute[72586]: DEBUG nova.compute.manager [req-37b26bf8-1cfc-4ddc-abe1-927c5362544a req-3f42445a-9021-4b77-ab6b-6392d8f0cdc3 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received event network-changed-abf0b845-110a-447f-b130-b1eeed139b29 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:21:03 user nova-compute[72586]: DEBUG nova.compute.manager [req-37b26bf8-1cfc-4ddc-abe1-927c5362544a req-3f42445a-9021-4b77-ab6b-6392d8f0cdc3 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Refreshing instance network info cache due to event network-changed-abf0b845-110a-447f-b130-b1eeed139b29. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:21:03 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-37b26bf8-1cfc-4ddc-abe1-927c5362544a req-3f42445a-9021-4b77-ab6b-6392d8f0cdc3 service nova] Acquiring lock "refresh_cache-420cd648-f3bb-49b0-a731-d2e4337367f6" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:21:03 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-37b26bf8-1cfc-4ddc-abe1-927c5362544a req-3f42445a-9021-4b77-ab6b-6392d8f0cdc3 service nova] Acquired lock "refresh_cache-420cd648-f3bb-49b0-a731-d2e4337367f6" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:21:03 user nova-compute[72586]: DEBUG nova.network.neutron [req-37b26bf8-1cfc-4ddc-abe1-927c5362544a req-3f42445a-9021-4b77-ab6b-6392d8f0cdc3 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Refreshing network info cache for port abf0b845-110a-447f-b130-b1eeed139b29 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:21:03 user nova-compute[72586]: DEBUG nova.network.neutron [req-37b26bf8-1cfc-4ddc-abe1-927c5362544a req-3f42445a-9021-4b77-ab6b-6392d8f0cdc3 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Instance cache missing network info. {{(pid=72586) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 21:21:03 user nova-compute[72586]: DEBUG nova.network.neutron [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Successfully updated port: 3095c6ca-2bce-4216-9290-e1fc3fe17e03 {{(pid=72586) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 21:21:03 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Acquiring lock "refresh_cache-420cd648-f3bb-49b0-a731-d2e4337367f6" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:21:03 user nova-compute[72586]: DEBUG nova.network.neutron [req-37b26bf8-1cfc-4ddc-abe1-927c5362544a req-3f42445a-9021-4b77-ab6b-6392d8f0cdc3 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:21:03 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-37b26bf8-1cfc-4ddc-abe1-927c5362544a req-3f42445a-9021-4b77-ab6b-6392d8f0cdc3 service nova] Releasing lock "refresh_cache-420cd648-f3bb-49b0-a731-d2e4337367f6" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:21:03 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Acquired lock "refresh_cache-420cd648-f3bb-49b0-a731-d2e4337367f6" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:21:03 user nova-compute[72586]: DEBUG nova.network.neutron [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:21:03 user nova-compute[72586]: DEBUG nova.network.neutron [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Instance cache missing network info. {{(pid=72586) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 21:21:04 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:21:05 user nova-compute[72586]: DEBUG nova.compute.manager [req-9ae8f4be-90c8-48a8-ae01-533276ca5fc0 req-1c713ab0-35d8-4275-86bb-59cd6324bd04 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received event network-changed-3095c6ca-2bce-4216-9290-e1fc3fe17e03 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:21:05 user nova-compute[72586]: DEBUG nova.compute.manager [req-9ae8f4be-90c8-48a8-ae01-533276ca5fc0 req-1c713ab0-35d8-4275-86bb-59cd6324bd04 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Refreshing instance network info cache due to event network-changed-3095c6ca-2bce-4216-9290-e1fc3fe17e03. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:21:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-9ae8f4be-90c8-48a8-ae01-533276ca5fc0 req-1c713ab0-35d8-4275-86bb-59cd6324bd04 service nova] Acquiring lock "refresh_cache-420cd648-f3bb-49b0-a731-d2e4337367f6" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:21:05 user nova-compute[72586]: DEBUG nova.network.neutron [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Updating instance_info_cache with network_info: [{"id": "cdf2815f-96ba-4cb9-a025-1436804117e7", "address": "fa:16:3e:ae:ba:f8", "network": {"id": "871f534e-89b7-4186-a803-3bc9953b3b9c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-910794372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdf2815f-96", "ovs_interfaceid": "cdf2815f-96ba-4cb9-a025-1436804117e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bdfc5e91-52c4-4071-8252-a7caa7b53d24", "address": "fa:16:3e:2e:72:04", "network": {"id": "f744beb1-7d5f-4163-a4c7-807309ebcfec", "bridge": "br-int", "label": "tempest-device-tagging-net1-329951819", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdfc5e91-52", "ovs_interfaceid": "bdfc5e91-52c4-4071-8252-a7caa7b53d24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5ba1ef1d-6876-4756-86b2-0425ba5dfb39", "address": "fa:16:3e:7c:c9:b7", "network": {"id": "f744beb1-7d5f-4163-a4c7-807309ebcfec", "bridge": "br-int", "label": "tempest-device-tagging-net1-329951819", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ba1ef1d-68", "ovs_interfaceid": "5ba1ef1d-6876-4756-86b2-0425ba5dfb39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "65302d59-bf47-478e-be2e-37920bc76542", "address": "fa:16:3e:a4:c8:14", "network": {"id": "f744beb1-7d5f-4163-a4c7-807309ebcfec", "bridge": "br-int", "label": "tempest-device-tagging-net1-329951819", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65302d59-bf", "ovs_interfaceid": "65302d59-bf47-478e-be2e-37920bc76542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d823d714-835e-418a-85f2-e99504cc3f94", "address": "fa:16:3e:17:cd:33", "network": {"id": "f744beb1-7d5f-4163-a4c7-807309ebcfec", "bridge": "br-int", "label": "tempest-device-tagging-net1-329951819", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd823d714-83", "ovs_interfaceid": "d823d714-835e-418a-85f2-e99504cc3f94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "abf0b845-110a-447f-b130-b1eeed139b29", "address": "fa:16:3e:43:2b:85", "network": {"id": "3ae43cbc-2d22-465e-ba01-b2422e24134b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1150402374", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabf0b845-11", "ovs_interfaceid": "abf0b845-110a-447f-b130-b1eeed139b29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3095c6ca-2bce-4216-9290-e1fc3fe17e03", "address": "fa:16:3e:78:4c:6e", "network": {"id": "3ae43cbc-2d22-465e-ba01-b2422e24134b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1150402374", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3095c6ca-2b", "ovs_interfaceid": "3095c6ca-2bce-4216-9290-e1fc3fe17e03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:21:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Releasing lock "refresh_cache-420cd648-f3bb-49b0-a731-d2e4337367f6" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:21:05 user nova-compute[72586]: DEBUG nova.compute.manager [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Instance network_info: |[{"id": "cdf2815f-96ba-4cb9-a025-1436804117e7", "address": "fa:16:3e:ae:ba:f8", "network": {"id": "871f534e-89b7-4186-a803-3bc9953b3b9c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-910794372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdf2815f-96", "ovs_interfaceid": "cdf2815f-96ba-4cb9-a025-1436804117e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bdfc5e91-52c4-4071-8252-a7caa7b53d24", "address": "fa:16:3e:2e:72:04", "network": {"id": "f744beb1-7d5f-4163-a4c7-807309ebcfec", "bridge": "br-int", "label": "tempest-device-tagging-net1-329951819", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdfc5e91-52", "ovs_interfaceid": "bdfc5e91-52c4-4071-8252-a7caa7b53d24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5ba1ef1d-6876-4756-86b2-0425ba5dfb39", "address": "fa:16:3e:7c:c9:b7", "network": {"id": "f744beb1-7d5f-4163-a4c7-807309ebcfec", "bridge": "br-int", "label": "tempest-device-tagging-net1-329951819", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ba1ef1d-68", "ovs_interfaceid": "5ba1ef1d-6876-4756-86b2-0425ba5dfb39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "65302d59-bf47-478e-be2e-37920bc76542", "address": "fa:16:3e:a4:c8:14", "network": {"id": "f744beb1-7d5f-4163-a4c7-807309ebcfec", "bridge": "br-int", "label": "tempest-device-tagging-net1-329951819", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65302d59-bf", "ovs_interfaceid": "65302d59-bf47-478e-be2e-37920bc76542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d823d714-835e-418a-85f2-e99504cc3f94", "address": "fa:16:3e:17:cd:33", "network": {"id": "f744beb1-7d5f-4163-a4c7-807309ebcfec", "bridge": "br-int", "label": "tempest-device-tagging-net1-329951819", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd823d714-83", "ovs_interfaceid": "d823d714-835e-418a-85f2-e99504cc3f94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "abf0b845-110a-447f-b130-b1eeed139b29", "address": "fa:16:3e:43:2b:85", "network": {"id": "3ae43cbc-2d22-465e-ba01-b2422e24134b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1150402374", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabf0b845-11", "ovs_interfaceid": "abf0b845-110a-447f-b130-b1eeed139b29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3095c6ca-2bce-4216-9290-e1fc3fe17e03", "address": "fa:16:3e:78:4c:6e", "network": {"id": "3ae43cbc-2d22-465e-ba01-b2422e24134b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1150402374", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3095c6ca-2b", "ovs_interfaceid": "3095c6ca-2bce-4216-9290-e1fc3fe17e03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 21:21:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-9ae8f4be-90c8-48a8-ae01-533276ca5fc0 req-1c713ab0-35d8-4275-86bb-59cd6324bd04 service nova] Acquired lock "refresh_cache-420cd648-f3bb-49b0-a731-d2e4337367f6" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:21:05 user nova-compute[72586]: DEBUG nova.network.neutron [req-9ae8f4be-90c8-48a8-ae01-533276ca5fc0 req-1c713ab0-35d8-4275-86bb-59cd6324bd04 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Refreshing network info cache for port 3095c6ca-2bce-4216-9290-e1fc3fe17e03 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:21:06 user nova-compute[72586]: INFO nova.virt.block_device [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Booting with volume 531ff415-8aca-4d11-869c-5d5617b265eb at /dev/vdc
Aug 01 21:21:06 user nova-compute[72586]: DEBUG os_brick.utils [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:21:06 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:06 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:06 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc817cbf-786c-42cb-9b69-6bb1e6ffaf9f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4bc202fb9cb\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:06 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:06 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:06 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[3936cd0c-2125-44f8-b8ac-f652bd42beb5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:06 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:06 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:06 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9487d67-d298-468c-9aed-2b8d027ef195]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:06 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[64526d2b-a9d7-4523-bf4a-985a7cb67394]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:06 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Running cmd (subprocess): nvme version {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:06 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] 'nvme version' failed. Not Retrying. {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:21:06 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] nvme not present on system {{(pid=72586) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 21:21:06 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:06 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:21:06 user nova-compute[72586]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 21:21:06 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[38da0167-ee31-4586-8417-cfb52897c7ab]: (4, '') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:06 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72586) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 21:21:06 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 21:21:06 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] LIGHTOS: no hostnqn found. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 21:21:06 user nova-compute[72586]: DEBUG os_brick.utils [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4bc202fb9cb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:21:06 user nova-compute[72586]: DEBUG nova.virt.block_device [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Updating existing volume attachment record: 1826176b-5fc0-4781-9039-744e81d83bd5 {{(pid=72586) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 21:21:06 user nova-compute[72586]: DEBUG nova.network.neutron [req-9ae8f4be-90c8-48a8-ae01-533276ca5fc0 req-1c713ab0-35d8-4275-86bb-59cd6324bd04 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Updated VIF entry in instance network info cache for port 3095c6ca-2bce-4216-9290-e1fc3fe17e03. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:21:06 user nova-compute[72586]: DEBUG nova.network.neutron [req-9ae8f4be-90c8-48a8-ae01-533276ca5fc0 req-1c713ab0-35d8-4275-86bb-59cd6324bd04 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Updating instance_info_cache with network_info: [{"id": "cdf2815f-96ba-4cb9-a025-1436804117e7", "address": "fa:16:3e:ae:ba:f8", "network": {"id": "871f534e-89b7-4186-a803-3bc9953b3b9c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-910794372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdf2815f-96", "ovs_interfaceid": "cdf2815f-96ba-4cb9-a025-1436804117e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bdfc5e91-52c4-4071-8252-a7caa7b53d24", "address": "fa:16:3e:2e:72:04", "network": {"id": "f744beb1-7d5f-4163-a4c7-807309ebcfec", "bridge": "br-int", "label": "tempest-device-tagging-net1-329951819", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdfc5e91-52", "ovs_interfaceid": "bdfc5e91-52c4-4071-8252-a7caa7b53d24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5ba1ef1d-6876-4756-86b2-0425ba5dfb39", "address": "fa:16:3e:7c:c9:b7", "network": {"id": "f744beb1-7d5f-4163-a4c7-807309ebcfec", "bridge": "br-int", "label": "tempest-device-tagging-net1-329951819", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ba1ef1d-68", "ovs_interfaceid": "5ba1ef1d-6876-4756-86b2-0425ba5dfb39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "65302d59-bf47-478e-be2e-37920bc76542", "address": "fa:16:3e:a4:c8:14", "network": {"id": "f744beb1-7d5f-4163-a4c7-807309ebcfec", "bridge": "br-int", "label": "tempest-device-tagging-net1-329951819", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65302d59-bf", "ovs_interfaceid": "65302d59-bf47-478e-be2e-37920bc76542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d823d714-835e-418a-85f2-e99504cc3f94", "address": "fa:16:3e:17:cd:33", "network": {"id": "f744beb1-7d5f-4163-a4c7-807309ebcfec", "bridge": "br-int", "label": "tempest-device-tagging-net1-329951819", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd823d714-83", "ovs_interfaceid": "d823d714-835e-418a-85f2-e99504cc3f94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "abf0b845-110a-447f-b130-b1eeed139b29", "address": "fa:16:3e:43:2b:85", "network": {"id": "3ae43cbc-2d22-465e-ba01-b2422e24134b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1150402374", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabf0b845-11", "ovs_interfaceid": "abf0b845-110a-447f-b130-b1eeed139b29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3095c6ca-2bce-4216-9290-e1fc3fe17e03", "address": "fa:16:3e:78:4c:6e", "network": {"id": "3ae43cbc-2d22-465e-ba01-b2422e24134b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1150402374", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3095c6ca-2b", "ovs_interfaceid": "3095c6ca-2bce-4216-9290-e1fc3fe17e03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:21:06 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-9ae8f4be-90c8-48a8-ae01-533276ca5fc0 req-1c713ab0-35d8-4275-86bb-59cd6324bd04 service nova] Releasing lock "refresh_cache-420cd648-f3bb-49b0-a731-d2e4337367f6" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:21:08 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:09 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:09 user nova-compute[72586]: INFO nova.virt.block_device [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Booting with volume bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e at /dev/vdc
Aug 01 21:21:09 user nova-compute[72586]: DEBUG os_brick.utils [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:21:09 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:09 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:09 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e491329-522a-4e27-bb49-923fc54f1247]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4bc202fb9cb\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:09 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:09 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:09 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e952a01a-87f0-4092-80d9-0a11889221dc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:09 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:09 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:09 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1baad91d-4850-4672-b713-c292e3a367bf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:09 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[960f45db-b13e-426c-afe6-19b7f8705789]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:09 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Running cmd (subprocess): nvme version {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:09 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] 'nvme version' failed. Not Retrying. {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:21:09 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.nvmeof [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] nvme not present on system {{(pid=72586) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 21:21:09 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:09 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:21:09 user nova-compute[72586]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 21:21:09 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b742504-e1c5-406f-a1aa-99c6f3451549]: (4, '') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:09 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72586) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 21:21:09 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 21:21:09 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] LIGHTOS: no hostnqn found. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 21:21:09 user nova-compute[72586]: DEBUG os_brick.utils [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4bc202fb9cb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:21:09 user nova-compute[72586]: DEBUG nova.virt.block_device [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Updating existing volume attachment record: f62924e4-a2ed-4d8c-a06a-e5ba122efb80 {{(pid=72586) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 21:21:14 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:21:14 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:21:14 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72586) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 21:21:14 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72586) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 21:21:14 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72586) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 21:21:14 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:14 user nova-compute[72586]: DEBUG nova.compute.manager [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Start spawning the instance on the hypervisor. {{(pid=72586) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 21:21:14 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Creating instance directory {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 21:21:14 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Creating image(s)
Aug 01 21:21:14 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Did not create local disks {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 21:21:14 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Ensure instance console log exists: /opt/stack/data/nova/instances/4d8fb5ee-2b96-4824-bf5c-a5ebe507606e/console.log {{(pid=72586) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 21:21:14 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:21:14 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:21:14 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:21:14 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Start _get_guest_xml network_info=[{"id": "28d77550-badf-4c92-9b3d-2335ad88267a", "address": "fa:16:3e:a9:7c:cd", "network": {"id": "7a484128-086b-466a-a4f1-7ee335a489ac", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1177849467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28d77550-ba", "ovs_interfaceid": "28d77550-badf-4c92-9b3d-2335ad88267a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0630d545-5545-4e43-96e7-1a0aed01ba9b", "address": "fa:16:3e:6b:2e:9d", "network": {"id": "e4f2e657-3943-4157-85f2-95d34eebda68", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137166827", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0630d545-55", "ovs_interfaceid": "0630d545-5545-4e43-96e7-1a0aed01ba9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e986409e-ff38-4dad-ba15-4338156ff5f7", "address": "fa:16:3e:ac:26:34", "network": {"id": "e4f2e657-3943-4157-85f2-95d34eebda68", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137166827", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape986409e-ff", "ovs_interfaceid": "e986409e-ff38-4dad-ba15-4338156ff5f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9420c293-c443-4003-a54a-d6edbd12ddbc", "address": "fa:16:3e:f5:5b:b1", "network": {"id": "e4f2e657-3943-4157-85f2-95d34eebda68", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137166827", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9420c293-c4", "ovs_interfaceid": "9420c293-c443-4003-a54a-d6edbd12ddbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a842fd3a-0b86-4008-8ae9-96ecbd5cb7e2", "address": "fa:16:3e:e2:04:9a", "network": {"id": "e4f2e657-3943-4157-85f2-95d34eebda68", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137166827", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa842fd3a-0b", "ovs_interfaceid": "a842fd3a-0b86-4008-8ae9-96ecbd5cb7e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c71bda65-c16d-48f8-b66f-60d78a569ca3", "address": "fa:16:3e:45:96:2a", "network": {"id": "9c8aece4-aa0f-4431-9376-d0069c7e1003", "bridge": "br-int", "label": "tempest-device-tagging-net2-1263991370", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc71bda65-c1", "ovs_interfaceid": "c71bda65-c16d-48f8-b66f-60d78a569ca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "07f02376-9705-48a3-8434-f7ac557f7d5b", "address": "fa:16:3e:29:34:47", "network": {"id": "9c8aece4-aa0f-4431-9376-d0069c7e1003", "bridge": "br-int", "label": "tempest-device-tagging-net2-1263991370", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07f02376-97", "ovs_interfaceid": "07f02376-9705-48a3-8434-f7ac557f7d5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZKvSOuDI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4d8fb5ee-2b96-4824-bf5c-a5ebe507606e', 'attached_at': '', 'detached_at': '', 'volume_id': 'f4ecbe90-4aec-4946-8ae3-84a870533fce', 'serial': 'f4ecbe90-4aec-4946-8ae3-84a870533fce'}, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '11c6735d-26d4-46bc-b47c-3215965a440c', 'delete_on_termination': False, 'volume_type': None}, {'boot_index': 1, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jKuEmDJe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4d8fb5ee-2b96-4824-bf5c-a5ebe507606e', 'attached_at': '', 'detached_at': '', 'volume_id': 'd4c35416-07f0-4c10-86da-a4645d35ea7d', 'serial': 'd4c35416-07f0-4c10-86da-a4645d35ea7d'}, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'ab88b1a9-aa0e-4b7b-8900-3d2e0a1c8262', 'delete_on_termination': False, 'volume_type': None}, {'boot_index': 2, 'mount_device': '/dev/vdc', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XphWnVaz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4d8fb5ee-2b96-4824-bf5c-a5ebe507606e', 'attached_at': '', 'detached_at': '', 'volume_id': '531ff415-8aca-4d11-869c-5d5617b265eb', 'serial': '531ff415-8aca-4d11-869c-5d5617b265eb'}, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '1826176b-5fc0-4781-9039-744e81d83bd5', 'delete_on_termination': False, 'volume_type': None} {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:21:14 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:21:14 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:21:14 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:21:14 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:21:14 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:21:14 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:21:14 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:21:14 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:21:14 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:21:14 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:21:14 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:21:14 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:21:14 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:21:14 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:21:14 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:21:14 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:21:14 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:21:14 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:21:14 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:21:14 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:21:14 user nova-compute[72586]: DEBUG os_brick.initiator.connector [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Factory for ISCSI on None {{(pid=72586) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Aug 01 21:21:14 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.009s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:21:14 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Calling os-brick to attach iSCSI Volume {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 21:21:14 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZKvSOuDI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:21:14 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:21:14 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:21:14 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:21:14 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:21:14 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:21:14 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:21:14 user nova-compute[72586]: INFO os_brick.initiator.connectors.iscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 21:21:14 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce -p 172.16.0.220:3260 {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:14 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:14 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bcf1edc-bb8a-4902-a46f-cf582c0aedb8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:14 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 21:21:14 user nova-compute[72586]:  {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:14 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce -p 172.16.0.220:3260 --interface default --op new {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:14 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:14 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9f82aa-60bd-432b-b8b4-3427f250b4cc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce] added\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:14 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce] added
Aug 01 21:21:14 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:14 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:14 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:14 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[013f6f67-396b-49eb-971e-05e3c8e43353]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:14 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:14 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:14 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:14 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7aa73f-5408-45fb-a2ed-bb2609d0b26e]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:14 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:14 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZKvSOuDI {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZKvSOuDI" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:15 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b8b0533-66fb-48c4-bd5a-0e695e7a0195]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:15 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZKvSOuDI'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:15 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b15456-f433-4e1c-b05d-dd10007b46b0]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:15 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:15 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9317b42a-59b9-4dc2-ba0e-832f5c940743]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:15 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 21:21:15 user nova-compute[72586]:  {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:21:15 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 21:21:15 user nova-compute[72586]:  {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:21:15 user nova-compute[72586]: WARNING os_brick.initiator.connectors.iscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 21:21:15 user nova-compute[72586]: 
Aug 01 21:21:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce -p 172.16.0.220:3260 --login {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:15 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ac3578-ea04-4e50-b655-8c0650cd84a4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:15 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce, portal: 172.16.0.220,3260]
Aug 01 21:21:15 user nova-compute[72586]: Login to [iface: default, target: iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce, portal: 172.16.0.220,3260] successful.
Aug 01 21:21:15 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:15 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1aa685-c45a-4466-9ea0-8d794ab60c4d]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:15 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:15 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b1d5cd-d742-47b1-b576-57281187d781]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:15 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)
Aug 01 21:21:15 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:21:15 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)
Aug 01 21:21:15 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:21:15 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:21:15 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Connected to 172.16.0.220:3260 {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 21:21:15 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=72586) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 21:21:15 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72586) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 21:21:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:15 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a191b6-0b93-409b-a0af-2f2ff932a1f6]: (4, ('- - 0', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:15 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:21:15 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZKvSOuDI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 21:21:15 user nova-compute[72586]: INFO nova.compute.manager [None req-7210016d-e522-43dc-953c-c83db4155d44 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Rescuing
Aug 01 21:21:15 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-7210016d-e522-43dc-953c-c83db4155d44 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Acquiring lock "refresh_cache-413c3426-18ad-4a5c-af04-e0e7fc90f050" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:21:15 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-7210016d-e522-43dc-953c-c83db4155d44 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Acquired lock "refresh_cache-413c3426-18ad-4a5c-af04-e0e7fc90f050" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:21:15 user nova-compute[72586]: DEBUG nova.network.neutron [None req-7210016d-e522-43dc-953c-c83db4155d44 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:21:15 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:21:15 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23534626164616365', 'path': '/dev/sdb'} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23534626164616365', 'path': '/dev/sdb'} {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Calling os-brick to attach iSCSI Volume {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jKuEmDJe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:21:16 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:21:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:21:16 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:21:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:21:16 user nova-compute[72586]: INFO os_brick.initiator.connectors.iscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 21:21:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d -p 172.16.0.220:3260 {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[24312849-db79-4b3d-b3e5-8aa5e1a9fdee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 21:21:16 user nova-compute[72586]:  {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d -p 172.16.0.220:3260 --interface default --op new {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[79bc9abb-6a2e-49e2-86c1-f381534d5da5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d] added\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d] added
Aug 01 21:21:16 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG nova.network.neutron [None req-7210016d-e522-43dc-953c-c83db4155d44 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Updating instance_info_cache with network_info: [{"id": "38381409-a508-45f7-ad5c-53e84d2d5adb", "address": "fa:16:3e:73:a7:41", "network": {"id": "d229a8de-7a2b-4dcd-a9ac-44a40349676e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-67691992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b1a1d82f39347119a9fb49fb8e8893f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38381409-a5", "ovs_interfaceid": "38381409-a508-45f7-ad5c-53e84d2d5adb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cbacc94-2f77-41db-84b6-75453bc1ee2a]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-7210016d-e522-43dc-953c-c83db4155d44 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Releasing lock "refresh_cache-413c3426-18ad-4a5c-af04-e0e7fc90f050" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e345833-c11b-4001-a5ea-075e7b6e5162]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jKuEmDJe {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jKuEmDJe" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[13606809-2174-4e3a-b79f-842a3a5508ff]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jKuEmDJe'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[07492814-81fa-44a1-a83a-bd245bebbb63]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[edac8691-8193-4d90-8d52-3107bb320b77]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)
Aug 01 21:21:16 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)
Aug 01 21:21:16 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d -p 172.16.0.220:3260 --login {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[cccf640b-e474-41d5-be30-40c5b4032fe7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d, portal: 172.16.0.220,3260]
Aug 01 21:21:16 user nova-compute[72586]: Login to [iface: default, target: iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d, portal: 172.16.0.220,3260] successful.
Aug 01 21:21:16 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.090s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87f35ed-ed63-4724-a9f3-b456beee6f61]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[6585ec5a-78a9-45bd-be29-ade8e36147e8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)
Aug 01 21:21:16 user nova-compute[72586]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)
Aug 01 21:21:16 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)
Aug 01 21:21:16 user nova-compute[72586]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)
Aug 01 21:21:16 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.367s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Connected to 172.16.0.220:3260 {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=72586) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72586) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[015e0185-70fa-46bb-ac93-323538903e04]: (4, ('- - 0', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jKuEmDJe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG nova.compute.manager [req-270889b1-00e4-4545-8144-2578deace2d5 req-8616af90-7d33-4906-a3a1-ec0ff8ddcf99 service nova] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Received event network-vif-unplugged-38381409-a508-45f7-ad5c-53e84d2d5adb {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-270889b1-00e4-4545-8144-2578deace2d5 req-8616af90-7d33-4906-a3a1-ec0ff8ddcf99 service nova] Acquiring lock "413c3426-18ad-4a5c-af04-e0e7fc90f050-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-270889b1-00e4-4545-8144-2578deace2d5 req-8616af90-7d33-4906-a3a1-ec0ff8ddcf99 service nova] Lock "413c3426-18ad-4a5c-af04-e0e7fc90f050-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-270889b1-00e4-4545-8144-2578deace2d5 req-8616af90-7d33-4906-a3a1-ec0ff8ddcf99 service nova] Lock "413c3426-18ad-4a5c-af04-e0e7fc90f050-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG nova.compute.manager [req-270889b1-00e4-4545-8144-2578deace2d5 req-8616af90-7d33-4906-a3a1-ec0ff8ddcf99 service nova] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] No waiting events found dispatching network-vif-unplugged-38381409-a508-45f7-ad5c-53e84d2d5adb {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:21:16 user nova-compute[72586]: WARNING nova.compute.manager [req-270889b1-00e4-4545-8144-2578deace2d5 req-8616af90-7d33-4906-a3a1-ec0ff8ddcf99 service nova] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Received unexpected event network-vif-unplugged-38381409-a508-45f7-ad5c-53e84d2d5adb for instance with vm_state active and task_state rescuing.
Aug 01 21:21:16 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:16 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:17 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Instance destroyed successfully.
Aug 01 21:21:17 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-7210016d-e522-43dc-953c-c83db4155d44 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Attempting rescue
Aug 01 21:21:17 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-7210016d-e522-43dc-953c-c83db4155d44 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72586) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-7210016d-e522-43dc-953c-c83db4155d44 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Instance directory exists: not creating {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 01 21:21:17 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-7210016d-e522-43dc-953c-c83db4155d44 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Creating image(s)
Aug 01 21:21:17 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-7210016d-e522-43dc-953c-c83db4155d44 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Acquiring lock "/opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-7210016d-e522-43dc-953c-c83db4155d44 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "/opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-7210016d-e522-43dc-953c-c83db4155d44 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "/opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG nova.objects.instance [None req-7210016d-e522-43dc-953c-c83db4155d44 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lazy-loading 'trusted_certs' on Instance uuid 413c3426-18ad-4a5c-af04-e0e7fc90f050 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-7210016d-e522-43dc-953c-c83db4155d44 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Acquiring lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-7210016d-e522-43dc-953c-c83db4155d44 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-7210016d-e522-43dc-953c-c83db4155d44 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-7210016d-e522-43dc-953c-c83db4155d44 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.130s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-7210016d-e522-43dc-953c-c83db4155d44 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.rescue {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-7210016d-e522-43dc-953c-c83db4155d44 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.rescue" returned: 0 in 0.051s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-7210016d-e522-43dc-953c-c83db4155d44 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.187s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG nova.objects.instance [None req-7210016d-e522-43dc-953c-c83db4155d44 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lazy-loading 'migration_context' on Instance uuid 413c3426-18ad-4a5c-af04-e0e7fc90f050 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-7210016d-e522-43dc-953c-c83db4155d44 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Created local disks {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-7210016d-e522-43dc-953c-c83db4155d44 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Start _get_guest_xml network_info=[{"id": "38381409-a508-45f7-ad5c-53e84d2d5adb", "address": "fa:16:3e:73:a7:41", "network": {"id": "d229a8de-7a2b-4dcd-a9ac-44a40349676e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-67691992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-67691992-network", "vif_mac": "fa:16:3e:73:a7:41"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b1a1d82f39347119a9fb49fb8e8893f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38381409-a5", "ovs_interfaceid": "38381409-a508-45f7-ad5c-53e84d2d5adb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '0243d46b-6819-42a5-926f-42b71f0c97ad', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG nova.objects.instance [None req-7210016d-e522-43dc-953c-c83db4155d44 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lazy-loading 'resources' on Instance uuid 413c3426-18ad-4a5c-af04-e0e7fc90f050 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG nova.objects.instance [None req-7210016d-e522-43dc-953c-c83db4155d44 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lazy-loading 'numa_topology' on Instance uuid 413c3426-18ad-4a5c-af04-e0e7fc90f050 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:21:17 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-7210016d-e522-43dc-953c-c83db4155d44 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:21:17 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-7210016d-e522-43dc-953c-c83db4155d44 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:21:17 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-7210016d-e522-43dc-953c-c83db4155d44 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-7210016d-e522-43dc-953c-c83db4155d44 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-7210016d-e522-43dc-953c-c83db4155d44 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-7210016d-e522-43dc-953c-c83db4155d44 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-7210016d-e522-43dc-953c-c83db4155d44 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-7210016d-e522-43dc-953c-c83db4155d44 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-7210016d-e522-43dc-953c-c83db4155d44 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-7210016d-e522-43dc-953c-c83db4155d44 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-7210016d-e522-43dc-953c-c83db4155d44 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-7210016d-e522-43dc-953c-c83db4155d44 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-7210016d-e522-43dc-953c-c83db4155d44 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-7210016d-e522-43dc-953c-c83db4155d44 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-7210016d-e522-43dc-953c-c83db4155d44 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-7210016d-e522-43dc-953c-c83db4155d44 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-7210016d-e522-43dc-953c-c83db4155d44 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-7210016d-e522-43dc-953c-c83db4155d44 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG nova.objects.instance [None req-7210016d-e522-43dc-953c-c83db4155d44 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lazy-loading 'vcpu_model' on Instance uuid 413c3426-18ad-4a5c-af04-e0e7fc90f050 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-7210016d-e522-43dc-953c-c83db4155d44 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:19:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-472860044',display_name='tempest-ServerRescueNegativeTestJSON-server-472860044',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-472860044',id=3,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:19:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5b1a1d82f39347119a9fb49fb8e8893f',ramdisk_id='',reservation_id='r-vbt2qqk4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1258600061',owner_user_name='tempest-ServerRescueNegativeTestJSON-1258600061-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:19:44Z,user_data=None,user_id='0f678ac8999a42c4a383ee8b2976b4cc',uuid=413c3426-18ad-4a5c-af04-e0e7fc90f050,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "38381409-a508-45f7-ad5c-53e84d2d5adb", "address": "fa:16:3e:73:a7:41", "network": {"id": "d229a8de-7a2b-4dcd-a9ac-44a40349676e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-67691992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-67691992-network", "vif_mac": "fa:16:3e:73:a7:41"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b1a1d82f39347119a9fb49fb8e8893f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38381409-a5", "ovs_interfaceid": "38381409-a508-45f7-ad5c-53e84d2d5adb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-7210016d-e522-43dc-953c-c83db4155d44 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Converting VIF {"id": "38381409-a508-45f7-ad5c-53e84d2d5adb", "address": "fa:16:3e:73:a7:41", "network": {"id": "d229a8de-7a2b-4dcd-a9ac-44a40349676e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-67691992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-67691992-network", "vif_mac": "fa:16:3e:73:a7:41"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b1a1d82f39347119a9fb49fb8e8893f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38381409-a5", "ovs_interfaceid": "38381409-a508-45f7-ad5c-53e84d2d5adb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-7210016d-e522-43dc-953c-c83db4155d44 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:a7:41,bridge_name='br-int',has_traffic_filtering=True,id=38381409-a508-45f7-ad5c-53e84d2d5adb,network=Network(d229a8de-7a2b-4dcd-a9ac-44a40349676e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38381409-a5') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG nova.objects.instance [None req-7210016d-e522-43dc-953c-c83db4155d44 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lazy-loading 'pci_devices' on Instance uuid 413c3426-18ad-4a5c-af04-e0e7fc90f050 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-7210016d-e522-43dc-953c-c83db4155d44 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:21:17 user nova-compute[72586]:   <uuid>413c3426-18ad-4a5c-af04-e0e7fc90f050</uuid>
Aug 01 21:21:17 user nova-compute[72586]:   <name>instance-00000003</name>
Aug 01 21:21:17 user nova-compute[72586]:   <memory>524288</memory>
Aug 01 21:21:17 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:21:17 user nova-compute[72586]:   <metadata>
Aug 01 21:21:17 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:21:17 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:21:17 user nova-compute[72586]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-472860044</nova:name>
Aug 01 21:21:17 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:21:17</nova:creationTime>
Aug 01 21:21:17 user nova-compute[72586]:       <nova:flavor name="m1.tiny">
Aug 01 21:21:17 user nova-compute[72586]:         <nova:memory>512</nova:memory>
Aug 01 21:21:17 user nova-compute[72586]:         <nova:disk>1</nova:disk>
Aug 01 21:21:17 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:21:17 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:21:17 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:21:17 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:21:17 user nova-compute[72586]:       <nova:owner>
Aug 01 21:21:17 user nova-compute[72586]:         <nova:user uuid="0f678ac8999a42c4a383ee8b2976b4cc">tempest-ServerRescueNegativeTestJSON-1258600061-project-member</nova:user>
Aug 01 21:21:17 user nova-compute[72586]:         <nova:project uuid="5b1a1d82f39347119a9fb49fb8e8893f">tempest-ServerRescueNegativeTestJSON-1258600061</nova:project>
Aug 01 21:21:17 user nova-compute[72586]:       </nova:owner>
Aug 01 21:21:17 user nova-compute[72586]:       <nova:root type="image" uuid="0243d46b-6819-42a5-926f-42b71f0c97ad"/>
Aug 01 21:21:17 user nova-compute[72586]:       <nova:ports>
Aug 01 21:21:17 user nova-compute[72586]:         <nova:port uuid="38381409-a508-45f7-ad5c-53e84d2d5adb">
Aug 01 21:21:17 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 01 21:21:17 user nova-compute[72586]:         </nova:port>
Aug 01 21:21:17 user nova-compute[72586]:       </nova:ports>
Aug 01 21:21:17 user nova-compute[72586]:     </nova:instance>
Aug 01 21:21:17 user nova-compute[72586]:   </metadata>
Aug 01 21:21:17 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:21:17 user nova-compute[72586]:     <system>
Aug 01 21:21:17 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:21:17 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:21:17 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:21:17 user nova-compute[72586]:       <entry name="serial">413c3426-18ad-4a5c-af04-e0e7fc90f050</entry>
Aug 01 21:21:17 user nova-compute[72586]:       <entry name="uuid">413c3426-18ad-4a5c-af04-e0e7fc90f050</entry>
Aug 01 21:21:17 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:21:17 user nova-compute[72586]:     </system>
Aug 01 21:21:17 user nova-compute[72586]:   </sysinfo>
Aug 01 21:21:17 user nova-compute[72586]:   <os>
Aug 01 21:21:17 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:21:17 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:21:17 user nova-compute[72586]:   </os>
Aug 01 21:21:17 user nova-compute[72586]:   <features>
Aug 01 21:21:17 user nova-compute[72586]:     <acpi/>
Aug 01 21:21:17 user nova-compute[72586]:     <apic/>
Aug 01 21:21:17 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:21:17 user nova-compute[72586]:   </features>
Aug 01 21:21:17 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:21:17 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:21:17 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:21:17 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:21:17 user nova-compute[72586]:   </clock>
Aug 01 21:21:17 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:21:17 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:21:17 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:21:17 user nova-compute[72586]:   </cpu>
Aug 01 21:21:17 user nova-compute[72586]:   <devices>
Aug 01 21:21:17 user nova-compute[72586]:     <disk type="file" device="disk">
Aug 01 21:21:17 user nova-compute[72586]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 21:21:17 user nova-compute[72586]:       <source file="/opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.rescue"/>
Aug 01 21:21:17 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:21:17 user nova-compute[72586]:     </disk>
Aug 01 21:21:17 user nova-compute[72586]:     <disk type="file" device="disk">
Aug 01 21:21:17 user nova-compute[72586]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 21:21:17 user nova-compute[72586]:       <source file="/opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk"/>
Aug 01 21:21:17 user nova-compute[72586]:       <target dev="vdb" bus="virtio"/>
Aug 01 21:21:17 user nova-compute[72586]:     </disk>
Aug 01 21:21:17 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:21:17 user nova-compute[72586]:       <mac address="fa:16:3e:73:a7:41"/>
Aug 01 21:21:17 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:21:17 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:21:17 user nova-compute[72586]:       <target dev="tap38381409-a5"/>
Aug 01 21:21:17 user nova-compute[72586]:     </interface>
Aug 01 21:21:17 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:21:17 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/console.log" append="off"/>
Aug 01 21:21:17 user nova-compute[72586]:     </serial>
Aug 01 21:21:17 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:21:17 user nova-compute[72586]:     <video>
Aug 01 21:21:17 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:21:17 user nova-compute[72586]:     </video>
Aug 01 21:21:17 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:21:17 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:21:17 user nova-compute[72586]:     </rng>
Aug 01 21:21:17 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:21:17 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:21:17 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:21:17 user nova-compute[72586]:     </memballoon>
Aug 01 21:21:17 user nova-compute[72586]:   </devices>
Aug 01 21:21:17 user nova-compute[72586]: </domain>
Aug 01 21:21:17 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:21:17 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Instance destroyed successfully.
Aug 01 21:21:17 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.406s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] <== connect_volume: return (1408ms) {'type': 'block', 'scsi_wwn': '26532633132386635', 'path': '/dev/sdc'} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532633132386635', 'path': '/dev/sdc'} {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Calling os-brick to attach iSCSI Volume {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XphWnVaz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:21:17 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:21:17 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:21:17 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:21:17 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:21:17 user nova-compute[72586]: INFO os_brick.initiator.connectors.iscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 21:21:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb -p 172.16.0.220:3260 {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-7210016d-e522-43dc-953c-c83db4155d44 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-7210016d-e522-43dc-953c-c83db4155d44 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-7210016d-e522-43dc-953c-c83db4155d44 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] No VIF found with MAC fa:16:3e:73:a7:41, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e86a70-5921-4731-a8e8-be76fe8d26f6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 21:21:17 user nova-compute[72586]:  {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb -p 172.16.0.220:3260 --interface default --op new {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4a561a-861c-453c-9d93-03dcc60a4c66]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb] added\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb] added
Aug 01 21:21:17 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e230959e-28c5-4205-bf89-94df1d9aedab]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[551184c4-ae4d-40ac-be8c-932fa9972eca]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XphWnVaz {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XphWnVaz" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[5926d0ba-13ab-4051-b585-e6c3e7718635]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XphWnVaz'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb6256d-9502-4dac-9507-873e1deab6ec]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[c999d4f5-2701-4844-8ce2-4b248cdb7004]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)
Aug 01 21:21:17 user nova-compute[72586]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)
Aug 01 21:21:17 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)
Aug 01 21:21:17 user nova-compute[72586]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)
Aug 01 21:21:17 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb -p 172.16.0.220:3260 --login {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb05c1ca-7151-4208-8d71-f017fc8060c6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb, portal: 172.16.0.220,3260]
Aug 01 21:21:17 user nova-compute[72586]: Login to [iface: default, target: iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb, portal: 172.16.0.220,3260] successful.
Aug 01 21:21:17 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[12631f89-1aaa-4792-879d-24241964305f]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c0aacc-7823-4f42-b814-e8e62d836b54]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)
Aug 01 21:21:17 user nova-compute[72586]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)
Aug 01 21:21:17 user nova-compute[72586]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)
Aug 01 21:21:17 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)
Aug 01 21:21:17 user nova-compute[72586]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)
Aug 01 21:21:17 user nova-compute[72586]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)
Aug 01 21:21:17 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Connected to 172.16.0.220:3260 {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=72586) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72586) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae300f4-ea71-40ce-a70f-52861d8b05bb]: (4, ('- - 0', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:21:17 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XphWnVaz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 21:21:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-e3421a31-448a-4cf1-90a7-6d059323a779 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Acquiring lock "98345340-5fb3-41fe-aea9-770cf4585e86" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:21:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-e3421a31-448a-4cf1-90a7-6d059323a779 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Lock "98345340-5fb3-41fe-aea9-770cf4585e86" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:21:18 user nova-compute[72586]: DEBUG nova.objects.instance [None req-e3421a31-448a-4cf1-90a7-6d059323a779 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Lazy-loading 'flavor' on Instance uuid 98345340-5fb3-41fe-aea9-770cf4585e86 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:21:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-e3421a31-448a-4cf1-90a7-6d059323a779 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Lock "98345340-5fb3-41fe-aea9-770cf4585e86" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.096s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:21:18 user nova-compute[72586]: DEBUG nova.compute.manager [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Start spawning the instance on the hypervisor. {{(pid=72586) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 21:21:18 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Creating instance directory {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 21:21:18 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Creating image(s)
Aug 01 21:21:18 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Did not create local disks {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 21:21:18 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Ensure instance console log exists: /opt/stack/data/nova/instances/420cd648-f3bb-49b0-a731-d2e4337367f6/console.log {{(pid=72586) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 21:21:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:21:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:21:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:21:18 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Start _get_guest_xml network_info=[{"id": "cdf2815f-96ba-4cb9-a025-1436804117e7", "address": "fa:16:3e:ae:ba:f8", "network": {"id": "871f534e-89b7-4186-a803-3bc9953b3b9c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-910794372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdf2815f-96", "ovs_interfaceid": "cdf2815f-96ba-4cb9-a025-1436804117e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bdfc5e91-52c4-4071-8252-a7caa7b53d24", "address": "fa:16:3e:2e:72:04", "network": {"id": "f744beb1-7d5f-4163-a4c7-807309ebcfec", "bridge": "br-int", "label": "tempest-device-tagging-net1-329951819", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdfc5e91-52", "ovs_interfaceid": "bdfc5e91-52c4-4071-8252-a7caa7b53d24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5ba1ef1d-6876-4756-86b2-0425ba5dfb39", "address": "fa:16:3e:7c:c9:b7", "network": {"id": "f744beb1-7d5f-4163-a4c7-807309ebcfec", "bridge": "br-int", "label": "tempest-device-tagging-net1-329951819", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ba1ef1d-68", "ovs_interfaceid": "5ba1ef1d-6876-4756-86b2-0425ba5dfb39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "65302d59-bf47-478e-be2e-37920bc76542", "address": "fa:16:3e:a4:c8:14", "network": {"id": "f744beb1-7d5f-4163-a4c7-807309ebcfec", "bridge": "br-int", "label": "tempest-device-tagging-net1-329951819", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65302d59-bf", "ovs_interfaceid": "65302d59-bf47-478e-be2e-37920bc76542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d823d714-835e-418a-85f2-e99504cc3f94", "address": "fa:16:3e:17:cd:33", "network": {"id": "f744beb1-7d5f-4163-a4c7-807309ebcfec", "bridge": "br-int", "label": "tempest-device-tagging-net1-329951819", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd823d714-83", "ovs_interfaceid": "d823d714-835e-418a-85f2-e99504cc3f94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "abf0b845-110a-447f-b130-b1eeed139b29", "address": "fa:16:3e:43:2b:85", "network": {"id": "3ae43cbc-2d22-465e-ba01-b2422e24134b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1150402374", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabf0b845-11", "ovs_interfaceid": "abf0b845-110a-447f-b130-b1eeed139b29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3095c6ca-2bce-4216-9290-e1fc3fe17e03", "address": "fa:16:3e:78:4c:6e", "network": {"id": "3ae43cbc-2d22-465e-ba01-b2422e24134b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1150402374", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3095c6ca-2b", "ovs_interfaceid": "3095c6ca-2bce-4216-9290-e1fc3fe17e03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CsqEQfdn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '420cd648-f3bb-49b0-a731-d2e4337367f6', 'attached_at': '', 'detached_at': '', 'volume_id': '8dca4146-b838-4652-af2d-aa2dcdd95e13', 'serial': '8dca4146-b838-4652-af2d-aa2dcdd95e13'}, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '64f5e11e-6ecd-45b0-adb6-14d6eecbffcd', 'delete_on_termination': False, 'volume_type': None}, {'boot_index': 1, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lXUgimYK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '420cd648-f3bb-49b0-a731-d2e4337367f6', 'attached_at': '', 'detached_at': '', 'volume_id': '5bf0c46e-827e-44eb-986e-53dec3bf35e3', 'serial': '5bf0c46e-827e-44eb-986e-53dec3bf35e3'}, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '6739ca6c-c8c7-437e-b577-82b50b4d9055', 'delete_on_termination': False, 'volume_type': None}, {'boot_index': 2, 'mount_device': '/dev/vdc', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mCzBfics', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '420cd648-f3bb-49b0-a731-d2e4337367f6', 'attached_at': '', 'detached_at': '', 'volume_id': 'bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e', 'serial': 'bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e'}, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'f62924e4-a2ed-4d8c-a06a-e5ba122efb80', 'delete_on_termination': False, 'volume_type': None} {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:21:18 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:21:18 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:21:18 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:21:18 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:21:18 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:21:18 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:21:18 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:21:18 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:21:18 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:21:18 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:21:18 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:21:18 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:21:18 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:21:18 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:21:18 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:21:18 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:21:18 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:21:18 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:21:18 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Calling os-brick to attach iSCSI Volume {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 21:21:18 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CsqEQfdn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:21:18 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:21:18 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:21:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-e3421a31-448a-4cf1-90a7-6d059323a779 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Acquiring lock "98345340-5fb3-41fe-aea9-770cf4585e86" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:21:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-e3421a31-448a-4cf1-90a7-6d059323a779 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Lock "98345340-5fb3-41fe-aea9-770cf4585e86" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:21:18 user nova-compute[72586]: INFO nova.compute.manager [None req-e3421a31-448a-4cf1-90a7-6d059323a779 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Attaching volume f1d31ce1-bf97-419c-a986-97c00a6f8ad7 to /dev/vdb
Aug 01 21:21:18 user nova-compute[72586]: DEBUG os_brick.utils [None req-e3421a31-448a-4cf1-90a7-6d059323a779 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:21:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:18 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9b13d7-8361-40a7-bd1a-b969f85358f0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4bc202fb9cb\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:18 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:21:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:18 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[599c490d-6cd5-45c4-8337-d96b82be08f4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:18 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6013af-12c9-4a5a-bdc5-b1040562ef15]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:18 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0bdef0b-02a0-4990-b410-b323d59c9980]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-e3421a31-448a-4cf1-90a7-6d059323a779 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Running cmd (subprocess): nvme version {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-e3421a31-448a-4cf1-90a7-6d059323a779 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] 'nvme version' failed. Not Retrying. {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:21:18 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e3421a31-448a-4cf1-90a7-6d059323a779 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] nvme not present on system {{(pid=72586) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 21:21:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:21:18 user nova-compute[72586]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 21:21:18 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59097ea-6503-4bc9-906e-0a9fa1bac149]: (4, '') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:18 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-e3421a31-448a-4cf1-90a7-6d059323a779 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72586) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 21:21:18 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-e3421a31-448a-4cf1-90a7-6d059323a779 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 21:21:18 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-e3421a31-448a-4cf1-90a7-6d059323a779 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] LIGHTOS: no hostnqn found. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 21:21:18 user nova-compute[72586]: DEBUG os_brick.utils [None req-e3421a31-448a-4cf1-90a7-6d059323a779 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4bc202fb9cb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:21:18 user nova-compute[72586]: DEBUG nova.virt.block_device [None req-e3421a31-448a-4cf1-90a7-6d059323a779 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Updating existing volume attachment record: 84a8797f-c604-4732-9ffa-be69de56c348 {{(pid=72586) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 21:21:18 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:21:18 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23537623962653763', 'path': '/dev/sdd'} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:21:18 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537623962653763', 'path': '/dev/sdd'} {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.269s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:21:19 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:21:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:21:19 user nova-compute[72586]: INFO os_brick.initiator.connectors.iscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 21:21:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 -p 172.16.0.220:3260 {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed55a8ad-cc44-4cac-9c43-ccb3702eaac6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 21:21:19 user nova-compute[72586]:  {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 -p 172.16.0.220:3260 --interface default --op new {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T21:20:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-173590662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-173590662',id=10,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZmmWaf4o2+vepoSlCSvdhQnW0Ip8s2V4mKR4aDQ5fLtO6MyouBGx7OzU53scmj6G3TpyQRTILBn5stq45p5fvY9X/n+AtzlawrI2mVsOfI/+KhRVPQhj4yVIanSKzsXQ==',key_name='tempest-keypair-718734038',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='420db45538ce406abe9e8186c4e3b447',ramdisk_id='',reservation_id='r-6nkwelxb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1489054380',owner_user_name='tempest-TaggedBootDevicesTest-1489054380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:20:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8cc90afc26ca4b69b61b8c3c47aa2eaa',uuid=4d8fb5ee-2b96-4824-bf5c-a5ebe507606e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28d77550-badf-4c92-9b3d-2335ad88267a", "address": "fa:16:3e:a9:7c:cd", "network": {"id": "7a484128-086b-466a-a4f1-7ee335a489ac", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1177849467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28d77550-ba", "ovs_interfaceid": "28d77550-badf-4c92-9b3d-2335ad88267a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Converting VIF {"id": "28d77550-badf-4c92-9b3d-2335ad88267a", "address": "fa:16:3e:a9:7c:cd", "network": {"id": "7a484128-086b-466a-a4f1-7ee335a489ac", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1177849467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28d77550-ba", "ovs_interfaceid": "28d77550-badf-4c92-9b3d-2335ad88267a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:7c:cd,bridge_name='br-int',has_traffic_filtering=True,id=28d77550-badf-4c92-9b3d-2335ad88267a,network=Network(7a484128-086b-466a-a4f1-7ee335a489ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28d77550-ba') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T21:20:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-173590662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-173590662',id=10,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZmmWaf4o2+vepoSlCSvdhQnW0Ip8s2V4mKR4aDQ5fLtO6MyouBGx7OzU53scmj6G3TpyQRTILBn5stq45p5fvY9X/n+AtzlawrI2mVsOfI/+KhRVPQhj4yVIanSKzsXQ==',key_name='tempest-keypair-718734038',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='420db45538ce406abe9e8186c4e3b447',ramdisk_id='',reservation_id='r-6nkwelxb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1489054380',owner_user_name='tempest-TaggedBootDevicesTest-1489054380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:20:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8cc90afc26ca4b69b61b8c3c47aa2eaa',uuid=4d8fb5ee-2b96-4824-bf5c-a5ebe507606e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0630d545-5545-4e43-96e7-1a0aed01ba9b", "address": "fa:16:3e:6b:2e:9d", "network": {"id": "e4f2e657-3943-4157-85f2-95d34eebda68", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137166827", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0630d545-55", "ovs_interfaceid": "0630d545-5545-4e43-96e7-1a0aed01ba9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Converting VIF {"id": "0630d545-5545-4e43-96e7-1a0aed01ba9b", "address": "fa:16:3e:6b:2e:9d", "network": {"id": "e4f2e657-3943-4157-85f2-95d34eebda68", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137166827", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0630d545-55", "ovs_interfaceid": "0630d545-5545-4e43-96e7-1a0aed01ba9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:2e:9d,bridge_name='br-int',has_traffic_filtering=True,id=0630d545-5545-4e43-96e7-1a0aed01ba9b,network=Network(e4f2e657-3943-4157-85f2-95d34eebda68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0630d545-55') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T21:20:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-173590662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-173590662',id=10,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZmmWaf4o2+vepoSlCSvdhQnW0Ip8s2V4mKR4aDQ5fLtO6MyouBGx7OzU53scmj6G3TpyQRTILBn5stq45p5fvY9X/n+AtzlawrI2mVsOfI/+KhRVPQhj4yVIanSKzsXQ==',key_name='tempest-keypair-718734038',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='420db45538ce406abe9e8186c4e3b447',ramdisk_id='',reservation_id='r-6nkwelxb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1489054380',owner_user_name='tempest-TaggedBootDevicesTest-1489054380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:20:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8cc90afc26ca4b69b61b8c3c47aa2eaa',uuid=4d8fb5ee-2b96-4824-bf5c-a5ebe507606e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e986409e-ff38-4dad-ba15-4338156ff5f7", "address": "fa:16:3e:ac:26:34", "network": {"id": "e4f2e657-3943-4157-85f2-95d34eebda68", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137166827", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape986409e-ff", "ovs_interfaceid": "e986409e-ff38-4dad-ba15-4338156ff5f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Converting VIF {"id": "e986409e-ff38-4dad-ba15-4338156ff5f7", "address": "fa:16:3e:ac:26:34", "network": {"id": "e4f2e657-3943-4157-85f2-95d34eebda68", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137166827", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape986409e-ff", "ovs_interfaceid": "e986409e-ff38-4dad-ba15-4338156ff5f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:26:34,bridge_name='br-int',has_traffic_filtering=True,id=e986409e-ff38-4dad-ba15-4338156ff5f7,network=Network(e4f2e657-3943-4157-85f2-95d34eebda68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape986409e-ff') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T21:20:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-173590662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-173590662',id=10,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZmmWaf4o2+vepoSlCSvdhQnW0Ip8s2V4mKR4aDQ5fLtO6MyouBGx7OzU53scmj6G3TpyQRTILBn5stq45p5fvY9X/n+AtzlawrI2mVsOfI/+KhRVPQhj4yVIanSKzsXQ==',key_name='tempest-keypair-718734038',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='420db45538ce406abe9e8186c4e3b447',ramdisk_id='',reservation_id='r-6nkwelxb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1489054380',owner_user_name='tempest-TaggedBootDevicesTest-1489054380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:20:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8cc90afc26ca4b69b61b8c3c47aa2eaa',uuid=4d8fb5ee-2b96-4824-bf5c-a5ebe507606e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9420c293-c443-4003-a54a-d6edbd12ddbc", "address": "fa:16:3e:f5:5b:b1", "network": {"id": "e4f2e657-3943-4157-85f2-95d34eebda68", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137166827", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9420c293-c4", "ovs_interfaceid": "9420c293-c443-4003-a54a-d6edbd12ddbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Converting VIF {"id": "9420c293-c443-4003-a54a-d6edbd12ddbc", "address": "fa:16:3e:f5:5b:b1", "network": {"id": "e4f2e657-3943-4157-85f2-95d34eebda68", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137166827", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9420c293-c4", "ovs_interfaceid": "9420c293-c443-4003-a54a-d6edbd12ddbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:5b:b1,bridge_name='br-int',has_traffic_filtering=True,id=9420c293-c443-4003-a54a-d6edbd12ddbc,network=Network(e4f2e657-3943-4157-85f2-95d34eebda68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9420c293-c4') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T21:20:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-173590662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-173590662',id=10,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZmmWaf4o2+vepoSlCSvdhQnW0Ip8s2V4mKR4aDQ5fLtO6MyouBGx7OzU53scmj6G3TpyQRTILBn5stq45p5fvY9X/n+AtzlawrI2mVsOfI/+KhRVPQhj4yVIanSKzsXQ==',key_name='tempest-keypair-718734038',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='420db45538ce406abe9e8186c4e3b447',ramdisk_id='',reservation_id='r-6nkwelxb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1489054380',owner_user_name='tempest-TaggedBootDevicesTest-1489054380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:20:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8cc90afc26ca4b69b61b8c3c47aa2eaa',uuid=4d8fb5ee-2b96-4824-bf5c-a5ebe507606e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a842fd3a-0b86-4008-8ae9-96ecbd5cb7e2", "address": "fa:16:3e:e2:04:9a", "network": {"id": "e4f2e657-3943-4157-85f2-95d34eebda68", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137166827", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa842fd3a-0b", "ovs_interfaceid": "a842fd3a-0b86-4008-8ae9-96ecbd5cb7e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Converting VIF {"id": "a842fd3a-0b86-4008-8ae9-96ecbd5cb7e2", "address": "fa:16:3e:e2:04:9a", "network": {"id": "e4f2e657-3943-4157-85f2-95d34eebda68", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137166827", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa842fd3a-0b", "ovs_interfaceid": "a842fd3a-0b86-4008-8ae9-96ecbd5cb7e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:04:9a,bridge_name='br-int',has_traffic_filtering=True,id=a842fd3a-0b86-4008-8ae9-96ecbd5cb7e2,network=Network(e4f2e657-3943-4157-85f2-95d34eebda68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa842fd3a-0b') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T21:20:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-173590662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-173590662',id=10,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZmmWaf4o2+vepoSlCSvdhQnW0Ip8s2V4mKR4aDQ5fLtO6MyouBGx7OzU53scmj6G3TpyQRTILBn5stq45p5fvY9X/n+AtzlawrI2mVsOfI/+KhRVPQhj4yVIanSKzsXQ==',key_name='tempest-keypair-718734038',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='420db45538ce406abe9e8186c4e3b447',ramdisk_id='',reservation_id='r-6nkwelxb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1489054380',owner_user_name='tempest-TaggedBootDevicesTest-1489054380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:20:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8cc90afc26ca4b69b61b8c3c47aa2eaa',uuid=4d8fb5ee-2b96-4824-bf5c-a5ebe507606e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c71bda65-c16d-48f8-b66f-60d78a569ca3", "address": "fa:16:3e:45:96:2a", "network": {"id": "9c8aece4-aa0f-4431-9376-d0069c7e1003", "bridge": "br-int", "label": "tempest-device-tagging-net2-1263991370", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc71bda65-c1", "ovs_interfaceid": "c71bda65-c16d-48f8-b66f-60d78a569ca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Converting VIF {"id": "c71bda65-c16d-48f8-b66f-60d78a569ca3", "address": "fa:16:3e:45:96:2a", "network": {"id": "9c8aece4-aa0f-4431-9376-d0069c7e1003", "bridge": "br-int", "label": "tempest-device-tagging-net2-1263991370", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc71bda65-c1", "ovs_interfaceid": "c71bda65-c16d-48f8-b66f-60d78a569ca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:96:2a,bridge_name='br-int',has_traffic_filtering=True,id=c71bda65-c16d-48f8-b66f-60d78a569ca3,network=Network(9c8aece4-aa0f-4431-9376-d0069c7e1003),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc71bda65-c1') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T21:20:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-173590662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-173590662',id=10,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZmmWaf4o2+vepoSlCSvdhQnW0Ip8s2V4mKR4aDQ5fLtO6MyouBGx7OzU53scmj6G3TpyQRTILBn5stq45p5fvY9X/n+AtzlawrI2mVsOfI/+KhRVPQhj4yVIanSKzsXQ==',key_name='tempest-keypair-718734038',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='420db45538ce406abe9e8186c4e3b447',ramdisk_id='',reservation_id='r-6nkwelxb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1489054380',owner_user_name='tempest-TaggedBootDevicesTest-1489054380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:20:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8cc90afc26ca4b69b61b8c3c47aa2eaa',uuid=4d8fb5ee-2b96-4824-bf5c-a5ebe507606e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07f02376-9705-48a3-8434-f7ac557f7d5b", "address": "fa:16:3e:29:34:47", "network": {"id": "9c8aece4-aa0f-4431-9376-d0069c7e1003", "bridge": "br-int", "label": "tempest-device-tagging-net2-1263991370", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07f02376-97", "ovs_interfaceid": "07f02376-9705-48a3-8434-f7ac557f7d5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Converting VIF {"id": "07f02376-9705-48a3-8434-f7ac557f7d5b", "address": "fa:16:3e:29:34:47", "network": {"id": "9c8aece4-aa0f-4431-9376-d0069c7e1003", "bridge": "br-int", "label": "tempest-device-tagging-net2-1263991370", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07f02376-97", "ovs_interfaceid": "07f02376-9705-48a3-8434-f7ac557f7d5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:34:47,bridge_name='br-int',has_traffic_filtering=True,id=07f02376-9705-48a3-8434-f7ac557f7d5b,network=Network(9c8aece4-aa0f-4431-9376-d0069c7e1003),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07f02376-97') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG nova.objects.instance [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Lazy-loading 'pci_devices' on Instance uuid 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a89572-b05d-482f-998f-15b8cf9ec270]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13] added\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13] added
Aug 01 21:21:19 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9db4b0c-5439-4d5a-b113-e28cf40af1b5]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:21:19 user nova-compute[72586]:   <uuid>4d8fb5ee-2b96-4824-bf5c-a5ebe507606e</uuid>
Aug 01 21:21:19 user nova-compute[72586]:   <name>instance-0000000a</name>
Aug 01 21:21:19 user nova-compute[72586]:   <memory>524288</memory>
Aug 01 21:21:19 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:21:19 user nova-compute[72586]:   <metadata>
Aug 01 21:21:19 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:21:19 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:21:19 user nova-compute[72586]:       <nova:name>tempest-device-tagging-server-173590662</nova:name>
Aug 01 21:21:19 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:21:14</nova:creationTime>
Aug 01 21:21:19 user nova-compute[72586]:       <nova:flavor name="m1.tiny">
Aug 01 21:21:19 user nova-compute[72586]:         <nova:memory>512</nova:memory>
Aug 01 21:21:19 user nova-compute[72586]:         <nova:disk>1</nova:disk>
Aug 01 21:21:19 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:21:19 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:21:19 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:21:19 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:21:19 user nova-compute[72586]:       <nova:owner>
Aug 01 21:21:19 user nova-compute[72586]:         <nova:user uuid="8cc90afc26ca4b69b61b8c3c47aa2eaa">tempest-TaggedBootDevicesTest-1489054380-project-member</nova:user>
Aug 01 21:21:19 user nova-compute[72586]:         <nova:project uuid="420db45538ce406abe9e8186c4e3b447">tempest-TaggedBootDevicesTest-1489054380</nova:project>
Aug 01 21:21:19 user nova-compute[72586]:       </nova:owner>
Aug 01 21:21:19 user nova-compute[72586]:       <nova:root type="image" uuid="0243d46b-6819-42a5-926f-42b71f0c97ad"/>
Aug 01 21:21:19 user nova-compute[72586]:       <nova:ports>
Aug 01 21:21:19 user nova-compute[72586]:         <nova:port uuid="28d77550-badf-4c92-9b3d-2335ad88267a">
Aug 01 21:21:19 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 01 21:21:19 user nova-compute[72586]:         </nova:port>
Aug 01 21:21:19 user nova-compute[72586]:         <nova:port uuid="0630d545-5545-4e43-96e7-1a0aed01ba9b">
Aug 01 21:21:19 user nova-compute[72586]:           <nova:ip type="fixed" address="10.1.1.60" ipVersion="4"/>
Aug 01 21:21:19 user nova-compute[72586]:         </nova:port>
Aug 01 21:21:19 user nova-compute[72586]:         <nova:port uuid="e986409e-ff38-4dad-ba15-4338156ff5f7">
Aug 01 21:21:19 user nova-compute[72586]:           <nova:ip type="fixed" address="10.1.1.166" ipVersion="4"/>
Aug 01 21:21:19 user nova-compute[72586]:         </nova:port>
Aug 01 21:21:19 user nova-compute[72586]:         <nova:port uuid="9420c293-c443-4003-a54a-d6edbd12ddbc">
Aug 01 21:21:19 user nova-compute[72586]:           <nova:ip type="fixed" address="10.1.1.165" ipVersion="4"/>
Aug 01 21:21:19 user nova-compute[72586]:         </nova:port>
Aug 01 21:21:19 user nova-compute[72586]:         <nova:port uuid="a842fd3a-0b86-4008-8ae9-96ecbd5cb7e2">
Aug 01 21:21:19 user nova-compute[72586]:           <nova:ip type="fixed" address="10.1.1.89" ipVersion="4"/>
Aug 01 21:21:19 user nova-compute[72586]:         </nova:port>
Aug 01 21:21:19 user nova-compute[72586]:         <nova:port uuid="c71bda65-c16d-48f8-b66f-60d78a569ca3">
Aug 01 21:21:19 user nova-compute[72586]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 01 21:21:19 user nova-compute[72586]:         </nova:port>
Aug 01 21:21:19 user nova-compute[72586]:         <nova:port uuid="07f02376-9705-48a3-8434-f7ac557f7d5b">
Aug 01 21:21:19 user nova-compute[72586]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 01 21:21:19 user nova-compute[72586]:         </nova:port>
Aug 01 21:21:19 user nova-compute[72586]:       </nova:ports>
Aug 01 21:21:19 user nova-compute[72586]:     </nova:instance>
Aug 01 21:21:19 user nova-compute[72586]:   </metadata>
Aug 01 21:21:19 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:21:19 user nova-compute[72586]:     <system>
Aug 01 21:21:19 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:21:19 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:21:19 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:21:19 user nova-compute[72586]:       <entry name="serial">4d8fb5ee-2b96-4824-bf5c-a5ebe507606e</entry>
Aug 01 21:21:19 user nova-compute[72586]:       <entry name="uuid">4d8fb5ee-2b96-4824-bf5c-a5ebe507606e</entry>
Aug 01 21:21:19 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:21:19 user nova-compute[72586]:     </system>
Aug 01 21:21:19 user nova-compute[72586]:   </sysinfo>
Aug 01 21:21:19 user nova-compute[72586]:   <os>
Aug 01 21:21:19 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:21:19 user nova-compute[72586]:     <boot dev="hd"/>
Aug 01 21:21:19 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:21:19 user nova-compute[72586]:   </os>
Aug 01 21:21:19 user nova-compute[72586]:   <features>
Aug 01 21:21:19 user nova-compute[72586]:     <acpi/>
Aug 01 21:21:19 user nova-compute[72586]:     <apic/>
Aug 01 21:21:19 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:21:19 user nova-compute[72586]:   </features>
Aug 01 21:21:19 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:21:19 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:21:19 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:21:19 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:21:19 user nova-compute[72586]:   </clock>
Aug 01 21:21:19 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:21:19 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:21:19 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:21:19 user nova-compute[72586]:   </cpu>
Aug 01 21:21:19 user nova-compute[72586]:   <devices>
Aug 01 21:21:19 user nova-compute[72586]:     <disk type="file" device="cdrom">
Aug 01 21:21:19 user nova-compute[72586]:       <driver name="qemu" type="raw" cache="none"/>
Aug 01 21:21:19 user nova-compute[72586]:       <source file="/opt/stack/data/nova/instances/4d8fb5ee-2b96-4824-bf5c-a5ebe507606e/disk.config"/>
Aug 01 21:21:19 user nova-compute[72586]:       <target dev="hda" bus="ide"/>
Aug 01 21:21:19 user nova-compute[72586]:     </disk>
Aug 01 21:21:19 user nova-compute[72586]:     <disk type="block" device="disk">
Aug 01 21:21:19 user nova-compute[72586]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:21:19 user nova-compute[72586]:       <source dev="/dev/sdb"/>
Aug 01 21:21:19 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:21:19 user nova-compute[72586]:       <serial>f4ecbe90-4aec-4946-8ae3-84a870533fce</serial>
Aug 01 21:21:19 user nova-compute[72586]:     </disk>
Aug 01 21:21:19 user nova-compute[72586]:     <disk type="block" device="disk">
Aug 01 21:21:19 user nova-compute[72586]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:21:19 user nova-compute[72586]:       <source dev="/dev/sdc"/>
Aug 01 21:21:19 user nova-compute[72586]:       <target dev="vdb" bus="virtio"/>
Aug 01 21:21:19 user nova-compute[72586]:       <serial>d4c35416-07f0-4c10-86da-a4645d35ea7d</serial>
Aug 01 21:21:19 user nova-compute[72586]:     </disk>
Aug 01 21:21:19 user nova-compute[72586]:     <disk type="block" device="disk">
Aug 01 21:21:19 user nova-compute[72586]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:21:19 user nova-compute[72586]:       <source dev="/dev/sdd"/>
Aug 01 21:21:19 user nova-compute[72586]:       <target dev="vdc" bus="virtio"/>
Aug 01 21:21:19 user nova-compute[72586]:       <serial>531ff415-8aca-4d11-869c-5d5617b265eb</serial>
Aug 01 21:21:19 user nova-compute[72586]:     </disk>
Aug 01 21:21:19 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:21:19 user nova-compute[72586]:       <mac address="fa:16:3e:a9:7c:cd"/>
Aug 01 21:21:19 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:21:19 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:21:19 user nova-compute[72586]:       <target dev="tap28d77550-ba"/>
Aug 01 21:21:19 user nova-compute[72586]:     </interface>
Aug 01 21:21:19 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:21:19 user nova-compute[72586]:       <mac address="fa:16:3e:6b:2e:9d"/>
Aug 01 21:21:19 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:21:19 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:21:19 user nova-compute[72586]:       <target dev="tap0630d545-55"/>
Aug 01 21:21:19 user nova-compute[72586]:     </interface>
Aug 01 21:21:19 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:21:19 user nova-compute[72586]:       <mac address="fa:16:3e:ac:26:34"/>
Aug 01 21:21:19 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:21:19 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:21:19 user nova-compute[72586]:       <target dev="tape986409e-ff"/>
Aug 01 21:21:19 user nova-compute[72586]:     </interface>
Aug 01 21:21:19 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:21:19 user nova-compute[72586]:       <mac address="fa:16:3e:f5:5b:b1"/>
Aug 01 21:21:19 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:21:19 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:21:19 user nova-compute[72586]:       <target dev="tap9420c293-c4"/>
Aug 01 21:21:19 user nova-compute[72586]:     </interface>
Aug 01 21:21:19 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:21:19 user nova-compute[72586]:       <mac address="fa:16:3e:e2:04:9a"/>
Aug 01 21:21:19 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:21:19 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:21:19 user nova-compute[72586]:       <target dev="tapa842fd3a-0b"/>
Aug 01 21:21:19 user nova-compute[72586]:     </interface>
Aug 01 21:21:19 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:21:19 user nova-compute[72586]:       <mac address="fa:16:3e:45:96:2a"/>
Aug 01 21:21:19 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:21:19 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:21:19 user nova-compute[72586]:       <target dev="tapc71bda65-c1"/>
Aug 01 21:21:19 user nova-compute[72586]:     </interface>
Aug 01 21:21:19 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:21:19 user nova-compute[72586]:       <mac address="fa:16:3e:29:34:47"/>
Aug 01 21:21:19 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:21:19 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:21:19 user nova-compute[72586]:       <target dev="tap07f02376-97"/>
Aug 01 21:21:19 user nova-compute[72586]:     </interface>
Aug 01 21:21:19 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:21:19 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/4d8fb5ee-2b96-4824-bf5c-a5ebe507606e/console.log" append="off"/>
Aug 01 21:21:19 user nova-compute[72586]:     </serial>
Aug 01 21:21:19 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:21:19 user nova-compute[72586]:     <video>
Aug 01 21:21:19 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:21:19 user nova-compute[72586]:     </video>
Aug 01 21:21:19 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:21:19 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:21:19 user nova-compute[72586]:     </rng>
Aug 01 21:21:19 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:21:19 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:21:19 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:21:19 user nova-compute[72586]:     </memballoon>
Aug 01 21:21:19 user nova-compute[72586]:   </devices>
Aug 01 21:21:19 user nova-compute[72586]: </domain>
Aug 01 21:21:19 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T21:20:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-173590662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-173590662',id=10,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZmmWaf4o2+vepoSlCSvdhQnW0Ip8s2V4mKR4aDQ5fLtO6MyouBGx7OzU53scmj6G3TpyQRTILBn5stq45p5fvY9X/n+AtzlawrI2mVsOfI/+KhRVPQhj4yVIanSKzsXQ==',key_name='tempest-keypair-718734038',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='420db45538ce406abe9e8186c4e3b447',ramdisk_id='',reservation_id='r-6nkwelxb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1489054380',owner_user_name='tempest-TaggedBootDevicesTest-1489054380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:20:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8cc90afc26ca4b69b61b8c3c47aa2eaa',uuid=4d8fb5ee-2b96-4824-bf5c-a5ebe507606e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28d77550-badf-4c92-9b3d-2335ad88267a", "address": "fa:16:3e:a9:7c:cd", "network": {"id": "7a484128-086b-466a-a4f1-7ee335a489ac", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1177849467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28d77550-ba", "ovs_interfaceid": "28d77550-badf-4c92-9b3d-2335ad88267a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Converting VIF {"id": "28d77550-badf-4c92-9b3d-2335ad88267a", "address": "fa:16:3e:a9:7c:cd", "network": {"id": "7a484128-086b-466a-a4f1-7ee335a489ac", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1177849467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28d77550-ba", "ovs_interfaceid": "28d77550-badf-4c92-9b3d-2335ad88267a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:7c:cd,bridge_name='br-int',has_traffic_filtering=True,id=28d77550-badf-4c92-9b3d-2335ad88267a,network=Network(7a484128-086b-466a-a4f1-7ee335a489ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28d77550-ba') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG os_vif [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:7c:cd,bridge_name='br-int',has_traffic_filtering=True,id=28d77550-badf-4c92-9b3d-2335ad88267a,network=Network(7a484128-086b-466a-a4f1-7ee335a489ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28d77550-ba') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap28d77550-ba, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap28d77550-ba, col_values=(('external_ids', {'iface-id': '28d77550-badf-4c92-9b3d-2335ad88267a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:7c:cd', 'vm-uuid': '4d8fb5ee-2b96-4824-bf5c-a5ebe507606e'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[af109802-e607-45b7-8034-37c031ecaf2b]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CsqEQfdn {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG nova.compute.manager [req-753de070-a945-44f2-aa4c-9ea990603f64 req-4958f697-1418-4737-b15c-dcf6a3121cfd service nova] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Received event network-vif-plugged-38381409-a508-45f7-ad5c-53e84d2d5adb {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-753de070-a945-44f2-aa4c-9ea990603f64 req-4958f697-1418-4737-b15c-dcf6a3121cfd service nova] Acquiring lock "413c3426-18ad-4a5c-af04-e0e7fc90f050-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-753de070-a945-44f2-aa4c-9ea990603f64 req-4958f697-1418-4737-b15c-dcf6a3121cfd service nova] Lock "413c3426-18ad-4a5c-af04-e0e7fc90f050-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-753de070-a945-44f2-aa4c-9ea990603f64 req-4958f697-1418-4737-b15c-dcf6a3121cfd service nova] Lock "413c3426-18ad-4a5c-af04-e0e7fc90f050-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG nova.compute.manager [req-753de070-a945-44f2-aa4c-9ea990603f64 req-4958f697-1418-4737-b15c-dcf6a3121cfd service nova] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] No waiting events found dispatching network-vif-plugged-38381409-a508-45f7-ad5c-53e84d2d5adb {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:21:19 user nova-compute[72586]: WARNING nova.compute.manager [req-753de070-a945-44f2-aa4c-9ea990603f64 req-4958f697-1418-4737-b15c-dcf6a3121cfd service nova] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Received unexpected event network-vif-plugged-38381409-a508-45f7-ad5c-53e84d2d5adb for instance with vm_state active and task_state rescuing.
Aug 01 21:21:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:19 user nova-compute[72586]: INFO os_vif [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:7c:cd,bridge_name='br-int',has_traffic_filtering=True,id=28d77550-badf-4c92-9b3d-2335ad88267a,network=Network(7a484128-086b-466a-a4f1-7ee335a489ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28d77550-ba')
Aug 01 21:21:19 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T21:20:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-173590662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-173590662',id=10,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZmmWaf4o2+vepoSlCSvdhQnW0Ip8s2V4mKR4aDQ5fLtO6MyouBGx7OzU53scmj6G3TpyQRTILBn5stq45p5fvY9X/n+AtzlawrI2mVsOfI/+KhRVPQhj4yVIanSKzsXQ==',key_name='tempest-keypair-718734038',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='420db45538ce406abe9e8186c4e3b447',ramdisk_id='',reservation_id='r-6nkwelxb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1489054380',owner_user_name='tempest-TaggedBootDevicesTest-1489054380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:20:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8cc90afc26ca4b69b61b8c3c47aa2eaa',uuid=4d8fb5ee-2b96-4824-bf5c-a5ebe507606e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0630d545-5545-4e43-96e7-1a0aed01ba9b", "address": "fa:16:3e:6b:2e:9d", "network": {"id": "e4f2e657-3943-4157-85f2-95d34eebda68", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137166827", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0630d545-55", "ovs_interfaceid": "0630d545-5545-4e43-96e7-1a0aed01ba9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Converting VIF {"id": "0630d545-5545-4e43-96e7-1a0aed01ba9b", "address": "fa:16:3e:6b:2e:9d", "network": {"id": "e4f2e657-3943-4157-85f2-95d34eebda68", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137166827", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0630d545-55", "ovs_interfaceid": "0630d545-5545-4e43-96e7-1a0aed01ba9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:2e:9d,bridge_name='br-int',has_traffic_filtering=True,id=0630d545-5545-4e43-96e7-1a0aed01ba9b,network=Network(e4f2e657-3943-4157-85f2-95d34eebda68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0630d545-55') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG os_vif [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:2e:9d,bridge_name='br-int',has_traffic_filtering=True,id=0630d545-5545-4e43-96e7-1a0aed01ba9b,network=Network(e4f2e657-3943-4157-85f2-95d34eebda68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0630d545-55') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CsqEQfdn" returned: 0 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c53b50-b83e-44d8-90e3-09a24ebb453e]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CsqEQfdn'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0630d545-55, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0630d545-55, col_values=(('external_ids', {'iface-id': '0630d545-5545-4e43-96e7-1a0aed01ba9b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:2e:9d', 'vm-uuid': '4d8fb5ee-2b96-4824-bf5c-a5ebe507606e'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e4ca97-a211-45e4-926c-55179fdb9841]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:19 user nova-compute[72586]: INFO os_vif [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:2e:9d,bridge_name='br-int',has_traffic_filtering=True,id=0630d545-5545-4e43-96e7-1a0aed01ba9b,network=Network(e4f2e657-3943-4157-85f2-95d34eebda68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0630d545-55')
Aug 01 21:21:19 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T21:20:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-173590662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-173590662',id=10,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZmmWaf4o2+vepoSlCSvdhQnW0Ip8s2V4mKR4aDQ5fLtO6MyouBGx7OzU53scmj6G3TpyQRTILBn5stq45p5fvY9X/n+AtzlawrI2mVsOfI/+KhRVPQhj4yVIanSKzsXQ==',key_name='tempest-keypair-718734038',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='420db45538ce406abe9e8186c4e3b447',ramdisk_id='',reservation_id='r-6nkwelxb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1489054380',owner_user_name='tempest-TaggedBootDevicesTest-1489054380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:20:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8cc90afc26ca4b69b61b8c3c47aa2eaa',uuid=4d8fb5ee-2b96-4824-bf5c-a5ebe507606e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e986409e-ff38-4dad-ba15-4338156ff5f7", "address": "fa:16:3e:ac:26:34", "network": {"id": "e4f2e657-3943-4157-85f2-95d34eebda68", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137166827", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape986409e-ff", "ovs_interfaceid": "e986409e-ff38-4dad-ba15-4338156ff5f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Converting VIF {"id": "e986409e-ff38-4dad-ba15-4338156ff5f7", "address": "fa:16:3e:ac:26:34", "network": {"id": "e4f2e657-3943-4157-85f2-95d34eebda68", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137166827", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape986409e-ff", "ovs_interfaceid": "e986409e-ff38-4dad-ba15-4338156ff5f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:26:34,bridge_name='br-int',has_traffic_filtering=True,id=e986409e-ff38-4dad-ba15-4338156ff5f7,network=Network(e4f2e657-3943-4157-85f2-95d34eebda68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape986409e-ff') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG os_vif [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:26:34,bridge_name='br-int',has_traffic_filtering=True,id=e986409e-ff38-4dad-ba15-4338156ff5f7,network=Network(e4f2e657-3943-4157-85f2-95d34eebda68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape986409e-ff') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape986409e-ff, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape986409e-ff, col_values=(('external_ids', {'iface-id': 'e986409e-ff38-4dad-ba15-4338156ff5f7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:26:34', 'vm-uuid': '4d8fb5ee-2b96-4824-bf5c-a5ebe507606e'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[5826fbea-d11f-4494-95d1-469997d31c08]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)
Aug 01 21:21:19 user nova-compute[72586]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)
Aug 01 21:21:19 user nova-compute[72586]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)
Aug 01 21:21:19 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)
Aug 01 21:21:19 user nova-compute[72586]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)
Aug 01 21:21:19 user nova-compute[72586]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)
Aug 01 21:21:19 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 -p 172.16.0.220:3260 --login {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:19 user nova-compute[72586]: INFO os_vif [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:26:34,bridge_name='br-int',has_traffic_filtering=True,id=e986409e-ff38-4dad-ba15-4338156ff5f7,network=Network(e4f2e657-3943-4157-85f2-95d34eebda68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape986409e-ff')
Aug 01 21:21:19 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T21:20:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-173590662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-173590662',id=10,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZmmWaf4o2+vepoSlCSvdhQnW0Ip8s2V4mKR4aDQ5fLtO6MyouBGx7OzU53scmj6G3TpyQRTILBn5stq45p5fvY9X/n+AtzlawrI2mVsOfI/+KhRVPQhj4yVIanSKzsXQ==',key_name='tempest-keypair-718734038',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='420db45538ce406abe9e8186c4e3b447',ramdisk_id='',reservation_id='r-6nkwelxb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1489054380',owner_user_name='tempest-TaggedBootDevicesTest-1489054380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:20:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8cc90afc26ca4b69b61b8c3c47aa2eaa',uuid=4d8fb5ee-2b96-4824-bf5c-a5ebe507606e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9420c293-c443-4003-a54a-d6edbd12ddbc", "address": "fa:16:3e:f5:5b:b1", "network": {"id": "e4f2e657-3943-4157-85f2-95d34eebda68", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137166827", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9420c293-c4", "ovs_interfaceid": "9420c293-c443-4003-a54a-d6edbd12ddbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Converting VIF {"id": "9420c293-c443-4003-a54a-d6edbd12ddbc", "address": "fa:16:3e:f5:5b:b1", "network": {"id": "e4f2e657-3943-4157-85f2-95d34eebda68", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137166827", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9420c293-c4", "ovs_interfaceid": "9420c293-c443-4003-a54a-d6edbd12ddbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:5b:b1,bridge_name='br-int',has_traffic_filtering=True,id=9420c293-c443-4003-a54a-d6edbd12ddbc,network=Network(e4f2e657-3943-4157-85f2-95d34eebda68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9420c293-c4') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG os_vif [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:5b:b1,bridge_name='br-int',has_traffic_filtering=True,id=9420c293-c443-4003-a54a-d6edbd12ddbc,network=Network(e4f2e657-3943-4157-85f2-95d34eebda68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9420c293-c4') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9420c293-c4, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9420c293-c4, col_values=(('external_ids', {'iface-id': '9420c293-c443-4003-a54a-d6edbd12ddbc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:5b:b1', 'vm-uuid': '4d8fb5ee-2b96-4824-bf5c-a5ebe507606e'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[01542138-af3e-45df-b351-18937e293d38]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13, portal: 172.16.0.220,3260]
Aug 01 21:21:19 user nova-compute[72586]: Login to [iface: default, target: iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13, portal: 172.16.0.220,3260] successful.
Aug 01 21:21:19 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:19 user nova-compute[72586]: INFO os_vif [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:5b:b1,bridge_name='br-int',has_traffic_filtering=True,id=9420c293-c443-4003-a54a-d6edbd12ddbc,network=Network(e4f2e657-3943-4157-85f2-95d34eebda68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9420c293-c4')
Aug 01 21:21:19 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T21:20:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-173590662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-173590662',id=10,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZmmWaf4o2+vepoSlCSvdhQnW0Ip8s2V4mKR4aDQ5fLtO6MyouBGx7OzU53scmj6G3TpyQRTILBn5stq45p5fvY9X/n+AtzlawrI2mVsOfI/+KhRVPQhj4yVIanSKzsXQ==',key_name='tempest-keypair-718734038',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='420db45538ce406abe9e8186c4e3b447',ramdisk_id='',reservation_id='r-6nkwelxb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1489054380',owner_user_name='tempest-TaggedBootDevicesTest-1489054380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:20:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8cc90afc26ca4b69b61b8c3c47aa2eaa',uuid=4d8fb5ee-2b96-4824-bf5c-a5ebe507606e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a842fd3a-0b86-4008-8ae9-96ecbd5cb7e2", "address": "fa:16:3e:e2:04:9a", "network": {"id": "e4f2e657-3943-4157-85f2-95d34eebda68", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137166827", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa842fd3a-0b", "ovs_interfaceid": "a842fd3a-0b86-4008-8ae9-96ecbd5cb7e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Converting VIF {"id": "a842fd3a-0b86-4008-8ae9-96ecbd5cb7e2", "address": "fa:16:3e:e2:04:9a", "network": {"id": "e4f2e657-3943-4157-85f2-95d34eebda68", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137166827", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa842fd3a-0b", "ovs_interfaceid": "a842fd3a-0b86-4008-8ae9-96ecbd5cb7e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:04:9a,bridge_name='br-int',has_traffic_filtering=True,id=a842fd3a-0b86-4008-8ae9-96ecbd5cb7e2,network=Network(e4f2e657-3943-4157-85f2-95d34eebda68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa842fd3a-0b') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG os_vif [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:04:9a,bridge_name='br-int',has_traffic_filtering=True,id=a842fd3a-0b86-4008-8ae9-96ecbd5cb7e2,network=Network(e4f2e657-3943-4157-85f2-95d34eebda68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa842fd3a-0b') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa842fd3a-0b, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa842fd3a-0b, col_values=(('external_ids', {'iface-id': 'a842fd3a-0b86-4008-8ae9-96ecbd5cb7e2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:04:9a', 'vm-uuid': '4d8fb5ee-2b96-4824-bf5c-a5ebe507606e'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac83a15-e4e7-493f-9ffb-a87ff41596a4]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3100235-b80c-4ce4-93d5-0c432e04e869]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)
Aug 01 21:21:19 user nova-compute[72586]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)
Aug 01 21:21:19 user nova-compute[72586]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)
Aug 01 21:21:19 user nova-compute[72586]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)
Aug 01 21:21:19 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)
Aug 01 21:21:19 user nova-compute[72586]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)
Aug 01 21:21:19 user nova-compute[72586]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)
Aug 01 21:21:19 user nova-compute[72586]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)
Aug 01 21:21:19 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.388s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Connected to 172.16.0.220:3260 {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=72586) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72586) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:19 user nova-compute[72586]: INFO os_vif [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:04:9a,bridge_name='br-int',has_traffic_filtering=True,id=a842fd3a-0b86-4008-8ae9-96ecbd5cb7e2,network=Network(e4f2e657-3943-4157-85f2-95d34eebda68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa842fd3a-0b')
Aug 01 21:21:19 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T21:20:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-173590662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-173590662',id=10,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZmmWaf4o2+vepoSlCSvdhQnW0Ip8s2V4mKR4aDQ5fLtO6MyouBGx7OzU53scmj6G3TpyQRTILBn5stq45p5fvY9X/n+AtzlawrI2mVsOfI/+KhRVPQhj4yVIanSKzsXQ==',key_name='tempest-keypair-718734038',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='420db45538ce406abe9e8186c4e3b447',ramdisk_id='',reservation_id='r-6nkwelxb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1489054380',owner_user_name='tempest-TaggedBootDevicesTest-1489054380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:20:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8cc90afc26ca4b69b61b8c3c47aa2eaa',uuid=4d8fb5ee-2b96-4824-bf5c-a5ebe507606e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c71bda65-c16d-48f8-b66f-60d78a569ca3", "address": "fa:16:3e:45:96:2a", "network": {"id": "9c8aece4-aa0f-4431-9376-d0069c7e1003", "bridge": "br-int", "label": "tempest-device-tagging-net2-1263991370", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc71bda65-c1", "ovs_interfaceid": "c71bda65-c16d-48f8-b66f-60d78a569ca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Converting VIF {"id": "c71bda65-c16d-48f8-b66f-60d78a569ca3", "address": "fa:16:3e:45:96:2a", "network": {"id": "9c8aece4-aa0f-4431-9376-d0069c7e1003", "bridge": "br-int", "label": "tempest-device-tagging-net2-1263991370", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc71bda65-c1", "ovs_interfaceid": "c71bda65-c16d-48f8-b66f-60d78a569ca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:96:2a,bridge_name='br-int',has_traffic_filtering=True,id=c71bda65-c16d-48f8-b66f-60d78a569ca3,network=Network(9c8aece4-aa0f-4431-9376-d0069c7e1003),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc71bda65-c1') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG os_vif [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:96:2a,bridge_name='br-int',has_traffic_filtering=True,id=c71bda65-c16d-48f8-b66f-60d78a569ca3,network=Network(9c8aece4-aa0f-4431-9376-d0069c7e1003),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc71bda65-c1') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.023s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[329acd61-81f3-4803-a240-a852a54e1926]: (4, ('- - 0', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CsqEQfdn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc71bda65-c1, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc71bda65-c1, col_values=(('external_ids', {'iface-id': 'c71bda65-c16d-48f8-b66f-60d78a569ca3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:96:2a', 'vm-uuid': '4d8fb5ee-2b96-4824-bf5c-a5ebe507606e'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:19 user nova-compute[72586]: INFO os_vif [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:96:2a,bridge_name='br-int',has_traffic_filtering=True,id=c71bda65-c16d-48f8-b66f-60d78a569ca3,network=Network(9c8aece4-aa0f-4431-9376-d0069c7e1003),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc71bda65-c1')
Aug 01 21:21:19 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T21:20:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-173590662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-173590662',id=10,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZmmWaf4o2+vepoSlCSvdhQnW0Ip8s2V4mKR4aDQ5fLtO6MyouBGx7OzU53scmj6G3TpyQRTILBn5stq45p5fvY9X/n+AtzlawrI2mVsOfI/+KhRVPQhj4yVIanSKzsXQ==',key_name='tempest-keypair-718734038',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='420db45538ce406abe9e8186c4e3b447',ramdisk_id='',reservation_id='r-6nkwelxb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1489054380',owner_user_name='tempest-TaggedBootDevicesTest-1489054380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:20:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8cc90afc26ca4b69b61b8c3c47aa2eaa',uuid=4d8fb5ee-2b96-4824-bf5c-a5ebe507606e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07f02376-9705-48a3-8434-f7ac557f7d5b", "address": "fa:16:3e:29:34:47", "network": {"id": "9c8aece4-aa0f-4431-9376-d0069c7e1003", "bridge": "br-int", "label": "tempest-device-tagging-net2-1263991370", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07f02376-97", "ovs_interfaceid": "07f02376-9705-48a3-8434-f7ac557f7d5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Converting VIF {"id": "07f02376-9705-48a3-8434-f7ac557f7d5b", "address": "fa:16:3e:29:34:47", "network": {"id": "9c8aece4-aa0f-4431-9376-d0069c7e1003", "bridge": "br-int", "label": "tempest-device-tagging-net2-1263991370", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07f02376-97", "ovs_interfaceid": "07f02376-9705-48a3-8434-f7ac557f7d5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:34:47,bridge_name='br-int',has_traffic_filtering=True,id=07f02376-9705-48a3-8434-f7ac557f7d5b,network=Network(9c8aece4-aa0f-4431-9376-d0069c7e1003),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07f02376-97') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG os_vif [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:34:47,bridge_name='br-int',has_traffic_filtering=True,id=07f02376-9705-48a3-8434-f7ac557f7d5b,network=Network(9c8aece4-aa0f-4431-9376-d0069c7e1003),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07f02376-97') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap07f02376-97, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap07f02376-97, col_values=(('external_ids', {'iface-id': '07f02376-9705-48a3-8434-f7ac557f7d5b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:34:47', 'vm-uuid': '4d8fb5ee-2b96-4824-bf5c-a5ebe507606e'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:19 user nova-compute[72586]: INFO os_vif [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:34:47,bridge_name='br-int',has_traffic_filtering=True,id=07f02376-9705-48a3-8434-f7ac557f7d5b,network=Network(9c8aece4-aa0f-4431-9376-d0069c7e1003),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07f02376-97')
Aug 01 21:21:19 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] No BDM found with device name hda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] No VIF found with MAC fa:16:3e:a9:7c:cd, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] No VIF found with MAC fa:16:3e:e2:04:9a, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:21:19 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Using config drive
Aug 01 21:21:19 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Creating config drive at /opt/stack/data/nova/instances/4d8fb5ee-2b96-4824-bf5c-a5ebe507606e/disk.config
Aug 01 21:21:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4d8fb5ee-2b96-4824-bf5c-a5ebe507606e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpsvnjb3u0 {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Starting heal instance info cache {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 21:21:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4d8fb5ee-2b96-4824-bf5c-a5ebe507606e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpsvnjb3u0" returned: 0 in 0.057s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "refresh_cache-98345340-5fb3-41fe-aea9-770cf4585e86" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquired lock "refresh_cache-98345340-5fb3-41fe-aea9-770cf4585e86" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Forcefully refreshing network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.429s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] <== connect_volume: return (1699ms) {'type': 'block', 'scsi_wwn': '23365633434666366', 'path': '/dev/sde'} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365633434666366', 'path': '/dev/sde'} {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Updating instance_info_cache with network_info: [{"id": "417d1712-68ee-4850-b806-09d69ba1716f", "address": "fa:16:3e:6e:41:36", "network": {"id": "7e252667-8bb6-4657-9399-2026d81f4f07", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1441939601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efcd910da4d747078f86eec98beea523", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap417d1712-68", "ovs_interfaceid": "417d1712-68ee-4850-b806-09d69ba1716f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Calling os-brick to attach iSCSI Volume {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lXUgimYK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:21:20 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:21:20 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:21:20 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:21:20 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:21:20 user nova-compute[72586]: INFO os_brick.initiator.connectors.iscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 21:21:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 -p 172.16.0.220:3260 {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Releasing lock "refresh_cache-98345340-5fb3-41fe-aea9-770cf4585e86" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Updated the network info_cache for instance {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1864744b-bafa-4636-8450-9aac6f81aed0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 21:21:20 user nova-compute[72586]:  {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 -p 172.16.0.220:3260 --interface default --op new {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Auditing locally available compute resources for user (node: user) {{(pid=72586) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d84885-8418-481b-944b-3019863fc0ef]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3] added\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3] added
Aug 01 21:21:20 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[24fd80fe-1257-4a9e-99c2-387b84d12382]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3cecb8-74e5-4087-aaaa-d4f1ca5c138b]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lXUgimYK {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lXUgimYK" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e567c2-e838-463a-b8ad-100884a4196e]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lXUgimYK'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e8a1a0-7321-4792-b020-3e49bfc5e8fe]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[39df86c9-6d20-4fc9-9bba-788776df79b3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)
Aug 01 21:21:20 user nova-compute[72586]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)
Aug 01 21:21:20 user nova-compute[72586]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)
Aug 01 21:21:20 user nova-compute[72586]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)
Aug 01 21:21:20 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)
Aug 01 21:21:20 user nova-compute[72586]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)
Aug 01 21:21:20 user nova-compute[72586]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)
Aug 01 21:21:20 user nova-compute[72586]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)
Aug 01 21:21:20 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 -p 172.16.0.220:3260 --login {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43234b8-a0bf-47ca-98a0-fedce28392b2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3, portal: 172.16.0.220,3260]
Aug 01 21:21:20 user nova-compute[72586]: Login to [iface: default, target: iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3, portal: 172.16.0.220,3260] successful.
Aug 01 21:21:20 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d1da94-c3f5-4d3b-92f5-8570d203c8c9]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2654c0c-41bb-4431-9ec4-6c455c0e4d31]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)
Aug 01 21:21:20 user nova-compute[72586]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)
Aug 01 21:21:20 user nova-compute[72586]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)
Aug 01 21:21:20 user nova-compute[72586]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)
Aug 01 21:21:20 user nova-compute[72586]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)
Aug 01 21:21:20 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)
Aug 01 21:21:20 user nova-compute[72586]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)
Aug 01 21:21:20 user nova-compute[72586]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)
Aug 01 21:21:20 user nova-compute[72586]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)
Aug 01 21:21:20 user nova-compute[72586]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)
Aug 01 21:21:20 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Connected to 172.16.0.220:3260 {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=72586) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72586) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d3804e-e917-4f2e-9827-679b56e32229]: (4, ('- - 0', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:20 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: None {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:21:21 user nova-compute[72586]: DEBUG nova.compute.manager [req-1bfd9294-8b50-45c0-839e-04f3b363c6d1 req-f5af5b47-89a8-487e-ade7-d42673d49a54 service nova] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Received event network-vif-plugged-38381409-a508-45f7-ad5c-53e84d2d5adb {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:21:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-1bfd9294-8b50-45c0-839e-04f3b363c6d1 req-f5af5b47-89a8-487e-ade7-d42673d49a54 service nova] Acquiring lock "413c3426-18ad-4a5c-af04-e0e7fc90f050-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:21:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-1bfd9294-8b50-45c0-839e-04f3b363c6d1 req-f5af5b47-89a8-487e-ade7-d42673d49a54 service nova] Lock "413c3426-18ad-4a5c-af04-e0e7fc90f050-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:21:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-1bfd9294-8b50-45c0-839e-04f3b363c6d1 req-f5af5b47-89a8-487e-ade7-d42673d49a54 service nova] Lock "413c3426-18ad-4a5c-af04-e0e7fc90f050-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:21:21 user nova-compute[72586]: DEBUG nova.compute.manager [req-1bfd9294-8b50-45c0-839e-04f3b363c6d1 req-f5af5b47-89a8-487e-ade7-d42673d49a54 service nova] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] No waiting events found dispatching network-vif-plugged-38381409-a508-45f7-ad5c-53e84d2d5adb {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:21:21 user nova-compute[72586]: WARNING nova.compute.manager [req-1bfd9294-8b50-45c0-839e-04f3b363c6d1 req-f5af5b47-89a8-487e-ade7-d42673d49a54 service nova] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Received unexpected event network-vif-plugged-38381409-a508-45f7-ad5c-53e84d2d5adb for instance with vm_state active and task_state rescuing.
Aug 01 21:21:21 user nova-compute[72586]: DEBUG nova.compute.manager [req-1bfd9294-8b50-45c0-839e-04f3b363c6d1 req-f5af5b47-89a8-487e-ade7-d42673d49a54 service nova] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Received event network-vif-plugged-38381409-a508-45f7-ad5c-53e84d2d5adb {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:21:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-1bfd9294-8b50-45c0-839e-04f3b363c6d1 req-f5af5b47-89a8-487e-ade7-d42673d49a54 service nova] Acquiring lock "413c3426-18ad-4a5c-af04-e0e7fc90f050-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:21:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-1bfd9294-8b50-45c0-839e-04f3b363c6d1 req-f5af5b47-89a8-487e-ade7-d42673d49a54 service nova] Lock "413c3426-18ad-4a5c-af04-e0e7fc90f050-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:21:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-1bfd9294-8b50-45c0-839e-04f3b363c6d1 req-f5af5b47-89a8-487e-ade7-d42673d49a54 service nova] Lock "413c3426-18ad-4a5c-af04-e0e7fc90f050-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:21:21 user nova-compute[72586]: DEBUG nova.compute.manager [req-1bfd9294-8b50-45c0-839e-04f3b363c6d1 req-f5af5b47-89a8-487e-ade7-d42673d49a54 service nova] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] No waiting events found dispatching network-vif-plugged-38381409-a508-45f7-ad5c-53e84d2d5adb {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:21:21 user nova-compute[72586]: WARNING nova.compute.manager [req-1bfd9294-8b50-45c0-839e-04f3b363c6d1 req-f5af5b47-89a8-487e-ade7-d42673d49a54 service nova] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Received unexpected event network-vif-plugged-38381409-a508-45f7-ad5c-53e84d2d5adb for instance with vm_state active and task_state rescuing.
Aug 01 21:21:21 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:21 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:21 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:21 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Removed pending event for 413c3426-18ad-4a5c-af04-e0e7fc90f050 due to event {{(pid=72586) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 21:21:21 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690924881.4560578, 413c3426-18ad-4a5c-af04-e0e7fc90f050 => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:21:21 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] VM Resumed (Lifecycle Event)
Aug 01 21:21:21 user nova-compute[72586]: DEBUG nova.compute.manager [None req-7210016d-e522-43dc-953c-c83db4155d44 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:21:21 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:21:21 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:21:21 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 01 21:21:21 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690924881.4581149, 413c3426-18ad-4a5c-af04-e0e7fc90f050 => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:21:21 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] VM Started (Lifecycle Event)
Aug 01 21:21:21 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:21:21 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:21:21 user nova-compute[72586]: DEBUG nova.compute.manager [req-cd1b2130-cbbc-4307-a028-d45ff4dbb033 req-18d49fe6-3d73-4389-a547-f569af98ef0c service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received event network-vif-plugged-28d77550-badf-4c92-9b3d-2335ad88267a {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:21:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-cd1b2130-cbbc-4307-a028-d45ff4dbb033 req-18d49fe6-3d73-4389-a547-f569af98ef0c service nova] Acquiring lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:21:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-cd1b2130-cbbc-4307-a028-d45ff4dbb033 req-18d49fe6-3d73-4389-a547-f569af98ef0c service nova] Lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:21:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-cd1b2130-cbbc-4307-a028-d45ff4dbb033 req-18d49fe6-3d73-4389-a547-f569af98ef0c service nova] Lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:21:21 user nova-compute[72586]: DEBUG nova.compute.manager [req-cd1b2130-cbbc-4307-a028-d45ff4dbb033 req-18d49fe6-3d73-4389-a547-f569af98ef0c service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] No waiting events found dispatching network-vif-plugged-28d77550-badf-4c92-9b3d-2335ad88267a {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:21:21 user nova-compute[72586]: WARNING nova.compute.manager [req-cd1b2130-cbbc-4307-a028-d45ff4dbb033 req-18d49fe6-3d73-4389-a547-f569af98ef0c service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received unexpected event network-vif-plugged-28d77550-badf-4c92-9b3d-2335ad88267a for instance with vm_state building and task_state spawning.
Aug 01 21:21:21 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:21 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:21:21 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lXUgimYK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 21:21:21 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:21:21 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '23862663534303462', 'path': '/dev/sdf'} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:21:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23862663534303462', 'path': '/dev/sdf'} {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 21:21:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Calling os-brick to attach iSCSI Volume {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 21:21:21 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mCzBfics', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:21:21 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:21:21 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:21:21 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:21:21 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:21:21 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:21:21 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:21:21 user nova-compute[72586]: INFO os_brick.initiator.connectors.iscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 21:21:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e -p 172.16.0.220:3260 {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:21 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e019baf-b9eb-41d0-b178-60bee86bbe3a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:21 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 21:21:21 user nova-compute[72586]:  {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e -p 172.16.0.220:3260 --interface default --op new {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:21 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c3f524-778c-443a-b141-e3b86fb8761b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e] added\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:21 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e] added
Aug 01 21:21:21 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:21 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:21 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:21 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f71a81-ee44-4d6b-929d-f8c1724b36a6]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:21 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:21 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a44959-6167-4751-8fbb-80027074dd41]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:21 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mCzBfics {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mCzBfics" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:21 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9819c65-8275-4832-8c62-b2470f1d8200]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:21 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mCzBfics'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:22 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac15ccb8-708f-46cc-8fd8-fa707af6f831]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:22 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:22 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[efab89aa-93f0-40dc-be54-a1900d4658dc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:22 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)
Aug 01 21:21:22 user nova-compute[72586]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)
Aug 01 21:21:22 user nova-compute[72586]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)
Aug 01 21:21:22 user nova-compute[72586]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)
Aug 01 21:21:22 user nova-compute[72586]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)
Aug 01 21:21:22 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:21:22 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)
Aug 01 21:21:22 user nova-compute[72586]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)
Aug 01 21:21:22 user nova-compute[72586]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)
Aug 01 21:21:22 user nova-compute[72586]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)
Aug 01 21:21:22 user nova-compute[72586]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)
Aug 01 21:21:22 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:21:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e -p 172.16.0.220:3260 --login {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:22 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:22 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:22 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5ef70c-98e9-45d2-b6e0-e0573ca42759]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:22 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e, portal: 172.16.0.220,3260]
Aug 01 21:21:22 user nova-compute[72586]: Login to [iface: default, target: iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e, portal: 172.16.0.220,3260] successful.
Aug 01 21:21:22 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:22 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[df931252-29d3-481e-8e92-346215353915]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:22 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:22 user nova-compute[72586]: DEBUG nova.compute.manager [req-96daedd6-3664-480d-8ebf-5f33fcf7143f req-9313448f-4b0f-477e-b471-d2af2a8aaf3e service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received event network-vif-plugged-0630d545-5545-4e43-96e7-1a0aed01ba9b {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:21:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-96daedd6-3664-480d-8ebf-5f33fcf7143f req-9313448f-4b0f-477e-b471-d2af2a8aaf3e service nova] Acquiring lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:21:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-96daedd6-3664-480d-8ebf-5f33fcf7143f req-9313448f-4b0f-477e-b471-d2af2a8aaf3e service nova] Lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:21:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-96daedd6-3664-480d-8ebf-5f33fcf7143f req-9313448f-4b0f-477e-b471-d2af2a8aaf3e service nova] Lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:21:22 user nova-compute[72586]: DEBUG nova.compute.manager [req-96daedd6-3664-480d-8ebf-5f33fcf7143f req-9313448f-4b0f-477e-b471-d2af2a8aaf3e service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] No waiting events found dispatching network-vif-plugged-0630d545-5545-4e43-96e7-1a0aed01ba9b {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:21:22 user nova-compute[72586]: WARNING nova.compute.manager [req-96daedd6-3664-480d-8ebf-5f33fcf7143f req-9313448f-4b0f-477e-b471-d2af2a8aaf3e service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received unexpected event network-vif-plugged-0630d545-5545-4e43-96e7-1a0aed01ba9b for instance with vm_state building and task_state spawning.
Aug 01 21:21:22 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:22 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:22 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a328eaf-a773-41e3-9255-37afd567e8dd]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:22 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)
Aug 01 21:21:22 user nova-compute[72586]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)
Aug 01 21:21:22 user nova-compute[72586]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)
Aug 01 21:21:22 user nova-compute[72586]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)
Aug 01 21:21:22 user nova-compute[72586]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)
Aug 01 21:21:22 user nova-compute[72586]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)
Aug 01 21:21:22 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:21:22 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)
Aug 01 21:21:22 user nova-compute[72586]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)
Aug 01 21:21:22 user nova-compute[72586]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)
Aug 01 21:21:22 user nova-compute[72586]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)
Aug 01 21:21:22 user nova-compute[72586]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)
Aug 01 21:21:22 user nova-compute[72586]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)
Aug 01 21:21:22 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:21:22 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.349s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:21:22 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Connected to 172.16.0.220:3260 {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 21:21:22 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=72586) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 21:21:22 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72586) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 21:21:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.023s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:22 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe9b36e-6112-47da-9061-93b66eeb8a2b]: (4, ('- - 0', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:22 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:21:22 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mCzBfics', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 21:21:22 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:22 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:22 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:22 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:22 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:22 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:22 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:22 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:22 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:22 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.397s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] <== connect_volume: return (1399ms) {'type': 'block', 'scsi_wwn': '26634663262393736', 'path': '/dev/sdg'} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634663262393736', 'path': '/dev/sdg'} {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG nova.compute.manager [req-7ff3e9e7-96d6-46c5-9f6e-d5ea2b8199e9 req-04b754a3-cf78-4c62-99cf-e791c2462ced service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received event network-vif-plugged-e986409e-ff38-4dad-ba15-4338156ff5f7 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-7ff3e9e7-96d6-46c5-9f6e-d5ea2b8199e9 req-04b754a3-cf78-4c62-99cf-e791c2462ced service nova] Acquiring lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-7ff3e9e7-96d6-46c5-9f6e-d5ea2b8199e9 req-04b754a3-cf78-4c62-99cf-e791c2462ced service nova] Lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-7ff3e9e7-96d6-46c5-9f6e-d5ea2b8199e9 req-04b754a3-cf78-4c62-99cf-e791c2462ced service nova] Lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG nova.compute.manager [req-7ff3e9e7-96d6-46c5-9f6e-d5ea2b8199e9 req-04b754a3-cf78-4c62-99cf-e791c2462ced service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] No waiting events found dispatching network-vif-plugged-e986409e-ff38-4dad-ba15-4338156ff5f7 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:21:23 user nova-compute[72586]: WARNING nova.compute.manager [req-7ff3e9e7-96d6-46c5-9f6e-d5ea2b8199e9 req-04b754a3-cf78-4c62-99cf-e791c2462ced service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received unexpected event network-vif-plugged-e986409e-ff38-4dad-ba15-4338156ff5f7 for instance with vm_state building and task_state spawning.
Aug 01 21:21:23 user nova-compute[72586]: DEBUG nova.compute.manager [req-7ff3e9e7-96d6-46c5-9f6e-d5ea2b8199e9 req-04b754a3-cf78-4c62-99cf-e791c2462ced service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received event network-vif-plugged-e986409e-ff38-4dad-ba15-4338156ff5f7 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-7ff3e9e7-96d6-46c5-9f6e-d5ea2b8199e9 req-04b754a3-cf78-4c62-99cf-e791c2462ced service nova] Acquiring lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-7ff3e9e7-96d6-46c5-9f6e-d5ea2b8199e9 req-04b754a3-cf78-4c62-99cf-e791c2462ced service nova] Lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-7ff3e9e7-96d6-46c5-9f6e-d5ea2b8199e9 req-04b754a3-cf78-4c62-99cf-e791c2462ced service nova] Lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG nova.compute.manager [req-7ff3e9e7-96d6-46c5-9f6e-d5ea2b8199e9 req-04b754a3-cf78-4c62-99cf-e791c2462ced service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] No waiting events found dispatching network-vif-plugged-e986409e-ff38-4dad-ba15-4338156ff5f7 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:21:23 user nova-compute[72586]: WARNING nova.compute.manager [req-7ff3e9e7-96d6-46c5-9f6e-d5ea2b8199e9 req-04b754a3-cf78-4c62-99cf-e791c2462ced service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received unexpected event network-vif-plugged-e986409e-ff38-4dad-ba15-4338156ff5f7 for instance with vm_state building and task_state spawning.
Aug 01 21:21:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T21:20:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-217867043',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-217867043',id=11,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO76uCuhkjrWPkyXk6qmYQwxhaVjlKA+ce6UfOilBS2ShINaqd2kTHhw6N+tWxLYcCs1mxp+f1Hh10jwhbHka3cfTUcwK8jtYq/GKdIX+pjyujzcReByfdCEuUmQ8BfXbA==',key_name='tempest-keypair-1207086275',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46642f001d8644259eea283abaff6383',ramdisk_id='',reservation_id='r-ukz2hx41',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2021813946',owner_user_name='tempest-TaggedBootDevicesTest_v242-2021813946-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:20:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e476921eeb9b4212a088e864a0b85117',uuid=420cd648-f3bb-49b0-a731-d2e4337367f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cdf2815f-96ba-4cb9-a025-1436804117e7", "address": "fa:16:3e:ae:ba:f8", "network": {"id": "871f534e-89b7-4186-a803-3bc9953b3b9c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-910794372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdf2815f-96", "ovs_interfaceid": "cdf2815f-96ba-4cb9-a025-1436804117e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Converting VIF {"id": "cdf2815f-96ba-4cb9-a025-1436804117e7", "address": "fa:16:3e:ae:ba:f8", "network": {"id": "871f534e-89b7-4186-a803-3bc9953b3b9c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-910794372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdf2815f-96", "ovs_interfaceid": "cdf2815f-96ba-4cb9-a025-1436804117e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:ba:f8,bridge_name='br-int',has_traffic_filtering=True,id=cdf2815f-96ba-4cb9-a025-1436804117e7,network=Network(871f534e-89b7-4186-a803-3bc9953b3b9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdf2815f-96') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T21:20:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-217867043',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-217867043',id=11,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO76uCuhkjrWPkyXk6qmYQwxhaVjlKA+ce6UfOilBS2ShINaqd2kTHhw6N+tWxLYcCs1mxp+f1Hh10jwhbHka3cfTUcwK8jtYq/GKdIX+pjyujzcReByfdCEuUmQ8BfXbA==',key_name='tempest-keypair-1207086275',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46642f001d8644259eea283abaff6383',ramdisk_id='',reservation_id='r-ukz2hx41',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2021813946',owner_user_name='tempest-TaggedBootDevicesTest_v242-2021813946-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:20:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e476921eeb9b4212a088e864a0b85117',uuid=420cd648-f3bb-49b0-a731-d2e4337367f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bdfc5e91-52c4-4071-8252-a7caa7b53d24", "address": "fa:16:3e:2e:72:04", "network": {"id": "f744beb1-7d5f-4163-a4c7-807309ebcfec", "bridge": "br-int", "label": "tempest-device-tagging-net1-329951819", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdfc5e91-52", "ovs_interfaceid": "bdfc5e91-52c4-4071-8252-a7caa7b53d24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Converting VIF {"id": "bdfc5e91-52c4-4071-8252-a7caa7b53d24", "address": "fa:16:3e:2e:72:04", "network": {"id": "f744beb1-7d5f-4163-a4c7-807309ebcfec", "bridge": "br-int", "label": "tempest-device-tagging-net1-329951819", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdfc5e91-52", "ovs_interfaceid": "bdfc5e91-52c4-4071-8252-a7caa7b53d24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:72:04,bridge_name='br-int',has_traffic_filtering=True,id=bdfc5e91-52c4-4071-8252-a7caa7b53d24,network=Network(f744beb1-7d5f-4163-a4c7-807309ebcfec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbdfc5e91-52') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T21:20:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-217867043',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-217867043',id=11,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO76uCuhkjrWPkyXk6qmYQwxhaVjlKA+ce6UfOilBS2ShINaqd2kTHhw6N+tWxLYcCs1mxp+f1Hh10jwhbHka3cfTUcwK8jtYq/GKdIX+pjyujzcReByfdCEuUmQ8BfXbA==',key_name='tempest-keypair-1207086275',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46642f001d8644259eea283abaff6383',ramdisk_id='',reservation_id='r-ukz2hx41',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2021813946',owner_user_name='tempest-TaggedBootDevicesTest_v242-2021813946-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:20:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e476921eeb9b4212a088e864a0b85117',uuid=420cd648-f3bb-49b0-a731-d2e4337367f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ba1ef1d-6876-4756-86b2-0425ba5dfb39", "address": "fa:16:3e:7c:c9:b7", "network": {"id": "f744beb1-7d5f-4163-a4c7-807309ebcfec", "bridge": "br-int", "label": "tempest-device-tagging-net1-329951819", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ba1ef1d-68", "ovs_interfaceid": "5ba1ef1d-6876-4756-86b2-0425ba5dfb39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Converting VIF {"id": "5ba1ef1d-6876-4756-86b2-0425ba5dfb39", "address": "fa:16:3e:7c:c9:b7", "network": {"id": "f744beb1-7d5f-4163-a4c7-807309ebcfec", "bridge": "br-int", "label": "tempest-device-tagging-net1-329951819", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ba1ef1d-68", "ovs_interfaceid": "5ba1ef1d-6876-4756-86b2-0425ba5dfb39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:c9:b7,bridge_name='br-int',has_traffic_filtering=True,id=5ba1ef1d-6876-4756-86b2-0425ba5dfb39,network=Network(f744beb1-7d5f-4163-a4c7-807309ebcfec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5ba1ef1d-68') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T21:20:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-217867043',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-217867043',id=11,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO76uCuhkjrWPkyXk6qmYQwxhaVjlKA+ce6UfOilBS2ShINaqd2kTHhw6N+tWxLYcCs1mxp+f1Hh10jwhbHka3cfTUcwK8jtYq/GKdIX+pjyujzcReByfdCEuUmQ8BfXbA==',key_name='tempest-keypair-1207086275',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46642f001d8644259eea283abaff6383',ramdisk_id='',reservation_id='r-ukz2hx41',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2021813946',owner_user_name='tempest-TaggedBootDevicesTest_v242-2021813946-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:20:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e476921eeb9b4212a088e864a0b85117',uuid=420cd648-f3bb-49b0-a731-d2e4337367f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65302d59-bf47-478e-be2e-37920bc76542", "address": "fa:16:3e:a4:c8:14", "network": {"id": "f744beb1-7d5f-4163-a4c7-807309ebcfec", "bridge": "br-int", "label": "tempest-device-tagging-net1-329951819", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65302d59-bf", "ovs_interfaceid": "65302d59-bf47-478e-be2e-37920bc76542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Converting VIF {"id": "65302d59-bf47-478e-be2e-37920bc76542", "address": "fa:16:3e:a4:c8:14", "network": {"id": "f744beb1-7d5f-4163-a4c7-807309ebcfec", "bridge": "br-int", "label": "tempest-device-tagging-net1-329951819", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65302d59-bf", "ovs_interfaceid": "65302d59-bf47-478e-be2e-37920bc76542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:c8:14,bridge_name='br-int',has_traffic_filtering=True,id=65302d59-bf47-478e-be2e-37920bc76542,network=Network(f744beb1-7d5f-4163-a4c7-807309ebcfec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65302d59-bf') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T21:20:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-217867043',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-217867043',id=11,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO76uCuhkjrWPkyXk6qmYQwxhaVjlKA+ce6UfOilBS2ShINaqd2kTHhw6N+tWxLYcCs1mxp+f1Hh10jwhbHka3cfTUcwK8jtYq/GKdIX+pjyujzcReByfdCEuUmQ8BfXbA==',key_name='tempest-keypair-1207086275',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46642f001d8644259eea283abaff6383',ramdisk_id='',reservation_id='r-ukz2hx41',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2021813946',owner_user_name='tempest-TaggedBootDevicesTest_v242-2021813946-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:20:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e476921eeb9b4212a088e864a0b85117',uuid=420cd648-f3bb-49b0-a731-d2e4337367f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d823d714-835e-418a-85f2-e99504cc3f94", "address": "fa:16:3e:17:cd:33", "network": {"id": "f744beb1-7d5f-4163-a4c7-807309ebcfec", "bridge": "br-int", "label": "tempest-device-tagging-net1-329951819", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd823d714-83", "ovs_interfaceid": "d823d714-835e-418a-85f2-e99504cc3f94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Converting VIF {"id": "d823d714-835e-418a-85f2-e99504cc3f94", "address": "fa:16:3e:17:cd:33", "network": {"id": "f744beb1-7d5f-4163-a4c7-807309ebcfec", "bridge": "br-int", "label": "tempest-device-tagging-net1-329951819", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd823d714-83", "ovs_interfaceid": "d823d714-835e-418a-85f2-e99504cc3f94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:cd:33,bridge_name='br-int',has_traffic_filtering=True,id=d823d714-835e-418a-85f2-e99504cc3f94,network=Network(f744beb1-7d5f-4163-a4c7-807309ebcfec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd823d714-83') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T21:20:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-217867043',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-217867043',id=11,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO76uCuhkjrWPkyXk6qmYQwxhaVjlKA+ce6UfOilBS2ShINaqd2kTHhw6N+tWxLYcCs1mxp+f1Hh10jwhbHka3cfTUcwK8jtYq/GKdIX+pjyujzcReByfdCEuUmQ8BfXbA==',key_name='tempest-keypair-1207086275',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46642f001d8644259eea283abaff6383',ramdisk_id='',reservation_id='r-ukz2hx41',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2021813946',owner_user_name='tempest-TaggedBootDevicesTest_v242-2021813946-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:20:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e476921eeb9b4212a088e864a0b85117',uuid=420cd648-f3bb-49b0-a731-d2e4337367f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "abf0b845-110a-447f-b130-b1eeed139b29", "address": "fa:16:3e:43:2b:85", "network": {"id": "3ae43cbc-2d22-465e-ba01-b2422e24134b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1150402374", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabf0b845-11", "ovs_interfaceid": "abf0b845-110a-447f-b130-b1eeed139b29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Converting VIF {"id": "abf0b845-110a-447f-b130-b1eeed139b29", "address": "fa:16:3e:43:2b:85", "network": {"id": "3ae43cbc-2d22-465e-ba01-b2422e24134b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1150402374", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabf0b845-11", "ovs_interfaceid": "abf0b845-110a-447f-b130-b1eeed139b29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:2b:85,bridge_name='br-int',has_traffic_filtering=True,id=abf0b845-110a-447f-b130-b1eeed139b29,network=Network(3ae43cbc-2d22-465e-ba01-b2422e24134b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabf0b845-11') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T21:20:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-217867043',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-217867043',id=11,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO76uCuhkjrWPkyXk6qmYQwxhaVjlKA+ce6UfOilBS2ShINaqd2kTHhw6N+tWxLYcCs1mxp+f1Hh10jwhbHka3cfTUcwK8jtYq/GKdIX+pjyujzcReByfdCEuUmQ8BfXbA==',key_name='tempest-keypair-1207086275',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46642f001d8644259eea283abaff6383',ramdisk_id='',reservation_id='r-ukz2hx41',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2021813946',owner_user_name='tempest-TaggedBootDevicesTest_v242-2021813946-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:20:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e476921eeb9b4212a088e864a0b85117',uuid=420cd648-f3bb-49b0-a731-d2e4337367f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3095c6ca-2bce-4216-9290-e1fc3fe17e03", "address": "fa:16:3e:78:4c:6e", "network": {"id": "3ae43cbc-2d22-465e-ba01-b2422e24134b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1150402374", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3095c6ca-2b", "ovs_interfaceid": "3095c6ca-2bce-4216-9290-e1fc3fe17e03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Converting VIF {"id": "3095c6ca-2bce-4216-9290-e1fc3fe17e03", "address": "fa:16:3e:78:4c:6e", "network": {"id": "3ae43cbc-2d22-465e-ba01-b2422e24134b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1150402374", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3095c6ca-2b", "ovs_interfaceid": "3095c6ca-2bce-4216-9290-e1fc3fe17e03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:4c:6e,bridge_name='br-int',has_traffic_filtering=True,id=3095c6ca-2bce-4216-9290-e1fc3fe17e03,network=Network(3ae43cbc-2d22-465e-ba01-b2422e24134b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3095c6ca-2b') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG nova.objects.instance [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Lazy-loading 'pci_devices' on Instance uuid 420cd648-f3bb-49b0-a731-d2e4337367f6 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:21:23 user nova-compute[72586]:   <uuid>420cd648-f3bb-49b0-a731-d2e4337367f6</uuid>
Aug 01 21:21:23 user nova-compute[72586]:   <name>instance-0000000b</name>
Aug 01 21:21:23 user nova-compute[72586]:   <memory>524288</memory>
Aug 01 21:21:23 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:21:23 user nova-compute[72586]:   <metadata>
Aug 01 21:21:23 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:21:23 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:21:23 user nova-compute[72586]:       <nova:name>tempest-device-tagging-server-217867043</nova:name>
Aug 01 21:21:23 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:21:18</nova:creationTime>
Aug 01 21:21:23 user nova-compute[72586]:       <nova:flavor name="m1.tiny">
Aug 01 21:21:23 user nova-compute[72586]:         <nova:memory>512</nova:memory>
Aug 01 21:21:23 user nova-compute[72586]:         <nova:disk>1</nova:disk>
Aug 01 21:21:23 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:21:23 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:21:23 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:21:23 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:21:23 user nova-compute[72586]:       <nova:owner>
Aug 01 21:21:23 user nova-compute[72586]:         <nova:user uuid="e476921eeb9b4212a088e864a0b85117">tempest-TaggedBootDevicesTest_v242-2021813946-project-member</nova:user>
Aug 01 21:21:23 user nova-compute[72586]:         <nova:project uuid="46642f001d8644259eea283abaff6383">tempest-TaggedBootDevicesTest_v242-2021813946</nova:project>
Aug 01 21:21:23 user nova-compute[72586]:       </nova:owner>
Aug 01 21:21:23 user nova-compute[72586]:       <nova:root type="image" uuid="0243d46b-6819-42a5-926f-42b71f0c97ad"/>
Aug 01 21:21:23 user nova-compute[72586]:       <nova:ports>
Aug 01 21:21:23 user nova-compute[72586]:         <nova:port uuid="cdf2815f-96ba-4cb9-a025-1436804117e7">
Aug 01 21:21:23 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 01 21:21:23 user nova-compute[72586]:         </nova:port>
Aug 01 21:21:23 user nova-compute[72586]:         <nova:port uuid="bdfc5e91-52c4-4071-8252-a7caa7b53d24">
Aug 01 21:21:23 user nova-compute[72586]:           <nova:ip type="fixed" address="10.1.1.182" ipVersion="4"/>
Aug 01 21:21:23 user nova-compute[72586]:         </nova:port>
Aug 01 21:21:23 user nova-compute[72586]:         <nova:port uuid="5ba1ef1d-6876-4756-86b2-0425ba5dfb39">
Aug 01 21:21:23 user nova-compute[72586]:           <nova:ip type="fixed" address="10.1.1.72" ipVersion="4"/>
Aug 01 21:21:23 user nova-compute[72586]:         </nova:port>
Aug 01 21:21:23 user nova-compute[72586]:         <nova:port uuid="65302d59-bf47-478e-be2e-37920bc76542">
Aug 01 21:21:23 user nova-compute[72586]:           <nova:ip type="fixed" address="10.1.1.225" ipVersion="4"/>
Aug 01 21:21:23 user nova-compute[72586]:         </nova:port>
Aug 01 21:21:23 user nova-compute[72586]:         <nova:port uuid="d823d714-835e-418a-85f2-e99504cc3f94">
Aug 01 21:21:23 user nova-compute[72586]:           <nova:ip type="fixed" address="10.1.1.192" ipVersion="4"/>
Aug 01 21:21:23 user nova-compute[72586]:         </nova:port>
Aug 01 21:21:23 user nova-compute[72586]:         <nova:port uuid="abf0b845-110a-447f-b130-b1eeed139b29">
Aug 01 21:21:23 user nova-compute[72586]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 01 21:21:23 user nova-compute[72586]:         </nova:port>
Aug 01 21:21:23 user nova-compute[72586]:         <nova:port uuid="3095c6ca-2bce-4216-9290-e1fc3fe17e03">
Aug 01 21:21:23 user nova-compute[72586]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 01 21:21:23 user nova-compute[72586]:         </nova:port>
Aug 01 21:21:23 user nova-compute[72586]:       </nova:ports>
Aug 01 21:21:23 user nova-compute[72586]:     </nova:instance>
Aug 01 21:21:23 user nova-compute[72586]:   </metadata>
Aug 01 21:21:23 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:21:23 user nova-compute[72586]:     <system>
Aug 01 21:21:23 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:21:23 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:21:23 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:21:23 user nova-compute[72586]:       <entry name="serial">420cd648-f3bb-49b0-a731-d2e4337367f6</entry>
Aug 01 21:21:23 user nova-compute[72586]:       <entry name="uuid">420cd648-f3bb-49b0-a731-d2e4337367f6</entry>
Aug 01 21:21:23 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:21:23 user nova-compute[72586]:     </system>
Aug 01 21:21:23 user nova-compute[72586]:   </sysinfo>
Aug 01 21:21:23 user nova-compute[72586]:   <os>
Aug 01 21:21:23 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:21:23 user nova-compute[72586]:     <boot dev="hd"/>
Aug 01 21:21:23 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:21:23 user nova-compute[72586]:   </os>
Aug 01 21:21:23 user nova-compute[72586]:   <features>
Aug 01 21:21:23 user nova-compute[72586]:     <acpi/>
Aug 01 21:21:23 user nova-compute[72586]:     <apic/>
Aug 01 21:21:23 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:21:23 user nova-compute[72586]:   </features>
Aug 01 21:21:23 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:21:23 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:21:23 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:21:23 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:21:23 user nova-compute[72586]:   </clock>
Aug 01 21:21:23 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:21:23 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:21:23 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:21:23 user nova-compute[72586]:   </cpu>
Aug 01 21:21:23 user nova-compute[72586]:   <devices>
Aug 01 21:21:23 user nova-compute[72586]:     <disk type="file" device="cdrom">
Aug 01 21:21:23 user nova-compute[72586]:       <driver name="qemu" type="raw" cache="none"/>
Aug 01 21:21:23 user nova-compute[72586]:       <source file="/opt/stack/data/nova/instances/420cd648-f3bb-49b0-a731-d2e4337367f6/disk.config"/>
Aug 01 21:21:23 user nova-compute[72586]:       <target dev="hda" bus="ide"/>
Aug 01 21:21:23 user nova-compute[72586]:     </disk>
Aug 01 21:21:23 user nova-compute[72586]:     <disk type="block" device="disk">
Aug 01 21:21:23 user nova-compute[72586]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:21:23 user nova-compute[72586]:       <source dev="/dev/sde"/>
Aug 01 21:21:23 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:21:23 user nova-compute[72586]:       <serial>8dca4146-b838-4652-af2d-aa2dcdd95e13</serial>
Aug 01 21:21:23 user nova-compute[72586]:     </disk>
Aug 01 21:21:23 user nova-compute[72586]:     <disk type="block" device="disk">
Aug 01 21:21:23 user nova-compute[72586]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:21:23 user nova-compute[72586]:       <source dev="/dev/sdf"/>
Aug 01 21:21:23 user nova-compute[72586]:       <target dev="vdb" bus="virtio"/>
Aug 01 21:21:23 user nova-compute[72586]:       <serial>5bf0c46e-827e-44eb-986e-53dec3bf35e3</serial>
Aug 01 21:21:23 user nova-compute[72586]:     </disk>
Aug 01 21:21:23 user nova-compute[72586]:     <disk type="block" device="disk">
Aug 01 21:21:23 user nova-compute[72586]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:21:23 user nova-compute[72586]:       <source dev="/dev/sdg"/>
Aug 01 21:21:23 user nova-compute[72586]:       <target dev="vdc" bus="virtio"/>
Aug 01 21:21:23 user nova-compute[72586]:       <serial>bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e</serial>
Aug 01 21:21:23 user nova-compute[72586]:     </disk>
Aug 01 21:21:23 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:21:23 user nova-compute[72586]:       <mac address="fa:16:3e:ae:ba:f8"/>
Aug 01 21:21:23 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:21:23 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:21:23 user nova-compute[72586]:       <target dev="tapcdf2815f-96"/>
Aug 01 21:21:23 user nova-compute[72586]:     </interface>
Aug 01 21:21:23 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:21:23 user nova-compute[72586]:       <mac address="fa:16:3e:2e:72:04"/>
Aug 01 21:21:23 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:21:23 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:21:23 user nova-compute[72586]:       <target dev="tapbdfc5e91-52"/>
Aug 01 21:21:23 user nova-compute[72586]:     </interface>
Aug 01 21:21:23 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:21:23 user nova-compute[72586]:       <mac address="fa:16:3e:7c:c9:b7"/>
Aug 01 21:21:23 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:21:23 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:21:23 user nova-compute[72586]:       <target dev="tap5ba1ef1d-68"/>
Aug 01 21:21:23 user nova-compute[72586]:     </interface>
Aug 01 21:21:23 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:21:23 user nova-compute[72586]:       <mac address="fa:16:3e:a4:c8:14"/>
Aug 01 21:21:23 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:21:23 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:21:23 user nova-compute[72586]:       <target dev="tap65302d59-bf"/>
Aug 01 21:21:23 user nova-compute[72586]:     </interface>
Aug 01 21:21:23 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:21:23 user nova-compute[72586]:       <mac address="fa:16:3e:17:cd:33"/>
Aug 01 21:21:23 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:21:23 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:21:23 user nova-compute[72586]:       <target dev="tapd823d714-83"/>
Aug 01 21:21:23 user nova-compute[72586]:     </interface>
Aug 01 21:21:23 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:21:23 user nova-compute[72586]:       <mac address="fa:16:3e:43:2b:85"/>
Aug 01 21:21:23 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:21:23 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:21:23 user nova-compute[72586]:       <target dev="tapabf0b845-11"/>
Aug 01 21:21:23 user nova-compute[72586]:     </interface>
Aug 01 21:21:23 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:21:23 user nova-compute[72586]:       <mac address="fa:16:3e:78:4c:6e"/>
Aug 01 21:21:23 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:21:23 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:21:23 user nova-compute[72586]:       <target dev="tap3095c6ca-2b"/>
Aug 01 21:21:23 user nova-compute[72586]:     </interface>
Aug 01 21:21:23 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:21:23 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/420cd648-f3bb-49b0-a731-d2e4337367f6/console.log" append="off"/>
Aug 01 21:21:23 user nova-compute[72586]:     </serial>
Aug 01 21:21:23 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:21:23 user nova-compute[72586]:     <video>
Aug 01 21:21:23 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:21:23 user nova-compute[72586]:     </video>
Aug 01 21:21:23 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:21:23 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:21:23 user nova-compute[72586]:     </rng>
Aug 01 21:21:23 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:21:23 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:21:23 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:21:23 user nova-compute[72586]:     </memballoon>
Aug 01 21:21:23 user nova-compute[72586]:   </devices>
Aug 01 21:21:23 user nova-compute[72586]: </domain>
Aug 01 21:21:23 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T21:20:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-217867043',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-217867043',id=11,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO76uCuhkjrWPkyXk6qmYQwxhaVjlKA+ce6UfOilBS2ShINaqd2kTHhw6N+tWxLYcCs1mxp+f1Hh10jwhbHka3cfTUcwK8jtYq/GKdIX+pjyujzcReByfdCEuUmQ8BfXbA==',key_name='tempest-keypair-1207086275',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46642f001d8644259eea283abaff6383',ramdisk_id='',reservation_id='r-ukz2hx41',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2021813946',owner_user_name='tempest-TaggedBootDevicesTest_v242-2021813946-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:20:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e476921eeb9b4212a088e864a0b85117',uuid=420cd648-f3bb-49b0-a731-d2e4337367f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cdf2815f-96ba-4cb9-a025-1436804117e7", "address": "fa:16:3e:ae:ba:f8", "network": {"id": "871f534e-89b7-4186-a803-3bc9953b3b9c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-910794372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdf2815f-96", "ovs_interfaceid": "cdf2815f-96ba-4cb9-a025-1436804117e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Converting VIF {"id": "cdf2815f-96ba-4cb9-a025-1436804117e7", "address": "fa:16:3e:ae:ba:f8", "network": {"id": "871f534e-89b7-4186-a803-3bc9953b3b9c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-910794372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdf2815f-96", "ovs_interfaceid": "cdf2815f-96ba-4cb9-a025-1436804117e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:ba:f8,bridge_name='br-int',has_traffic_filtering=True,id=cdf2815f-96ba-4cb9-a025-1436804117e7,network=Network(871f534e-89b7-4186-a803-3bc9953b3b9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdf2815f-96') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG os_vif [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:ba:f8,bridge_name='br-int',has_traffic_filtering=True,id=cdf2815f-96ba-4cb9-a025-1436804117e7,network=Network(871f534e-89b7-4186-a803-3bc9953b3b9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdf2815f-96') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcdf2815f-96, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcdf2815f-96, col_values=(('external_ids', {'iface-id': 'cdf2815f-96ba-4cb9-a025-1436804117e7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:ba:f8', 'vm-uuid': '420cd648-f3bb-49b0-a731-d2e4337367f6'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:23 user nova-compute[72586]: INFO os_vif [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:ba:f8,bridge_name='br-int',has_traffic_filtering=True,id=cdf2815f-96ba-4cb9-a025-1436804117e7,network=Network(871f534e-89b7-4186-a803-3bc9953b3b9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdf2815f-96')
Aug 01 21:21:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T21:20:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-217867043',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-217867043',id=11,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO76uCuhkjrWPkyXk6qmYQwxhaVjlKA+ce6UfOilBS2ShINaqd2kTHhw6N+tWxLYcCs1mxp+f1Hh10jwhbHka3cfTUcwK8jtYq/GKdIX+pjyujzcReByfdCEuUmQ8BfXbA==',key_name='tempest-keypair-1207086275',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46642f001d8644259eea283abaff6383',ramdisk_id='',reservation_id='r-ukz2hx41',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2021813946',owner_user_name='tempest-TaggedBootDevicesTest_v242-2021813946-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:20:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e476921eeb9b4212a088e864a0b85117',uuid=420cd648-f3bb-49b0-a731-d2e4337367f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bdfc5e91-52c4-4071-8252-a7caa7b53d24", "address": "fa:16:3e:2e:72:04", "network": {"id": "f744beb1-7d5f-4163-a4c7-807309ebcfec", "bridge": "br-int", "label": "tempest-device-tagging-net1-329951819", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdfc5e91-52", "ovs_interfaceid": "bdfc5e91-52c4-4071-8252-a7caa7b53d24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Converting VIF {"id": "bdfc5e91-52c4-4071-8252-a7caa7b53d24", "address": "fa:16:3e:2e:72:04", "network": {"id": "f744beb1-7d5f-4163-a4c7-807309ebcfec", "bridge": "br-int", "label": "tempest-device-tagging-net1-329951819", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdfc5e91-52", "ovs_interfaceid": "bdfc5e91-52c4-4071-8252-a7caa7b53d24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:72:04,bridge_name='br-int',has_traffic_filtering=True,id=bdfc5e91-52c4-4071-8252-a7caa7b53d24,network=Network(f744beb1-7d5f-4163-a4c7-807309ebcfec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbdfc5e91-52') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG os_vif [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:72:04,bridge_name='br-int',has_traffic_filtering=True,id=bdfc5e91-52c4-4071-8252-a7caa7b53d24,network=Network(f744beb1-7d5f-4163-a4c7-807309ebcfec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbdfc5e91-52') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbdfc5e91-52, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbdfc5e91-52, col_values=(('external_ids', {'iface-id': 'bdfc5e91-52c4-4071-8252-a7caa7b53d24', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:72:04', 'vm-uuid': '420cd648-f3bb-49b0-a731-d2e4337367f6'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:23 user nova-compute[72586]: INFO os_vif [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:72:04,bridge_name='br-int',has_traffic_filtering=True,id=bdfc5e91-52c4-4071-8252-a7caa7b53d24,network=Network(f744beb1-7d5f-4163-a4c7-807309ebcfec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbdfc5e91-52')
Aug 01 21:21:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T21:20:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-217867043',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-217867043',id=11,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO76uCuhkjrWPkyXk6qmYQwxhaVjlKA+ce6UfOilBS2ShINaqd2kTHhw6N+tWxLYcCs1mxp+f1Hh10jwhbHka3cfTUcwK8jtYq/GKdIX+pjyujzcReByfdCEuUmQ8BfXbA==',key_name='tempest-keypair-1207086275',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46642f001d8644259eea283abaff6383',ramdisk_id='',reservation_id='r-ukz2hx41',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2021813946',owner_user_name='tempest-TaggedBootDevicesTest_v242-2021813946-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:20:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e476921eeb9b4212a088e864a0b85117',uuid=420cd648-f3bb-49b0-a731-d2e4337367f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ba1ef1d-6876-4756-86b2-0425ba5dfb39", "address": "fa:16:3e:7c:c9:b7", "network": {"id": "f744beb1-7d5f-4163-a4c7-807309ebcfec", "bridge": "br-int", "label": "tempest-device-tagging-net1-329951819", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ba1ef1d-68", "ovs_interfaceid": "5ba1ef1d-6876-4756-86b2-0425ba5dfb39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Converting VIF {"id": "5ba1ef1d-6876-4756-86b2-0425ba5dfb39", "address": "fa:16:3e:7c:c9:b7", "network": {"id": "f744beb1-7d5f-4163-a4c7-807309ebcfec", "bridge": "br-int", "label": "tempest-device-tagging-net1-329951819", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ba1ef1d-68", "ovs_interfaceid": "5ba1ef1d-6876-4756-86b2-0425ba5dfb39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:c9:b7,bridge_name='br-int',has_traffic_filtering=True,id=5ba1ef1d-6876-4756-86b2-0425ba5dfb39,network=Network(f744beb1-7d5f-4163-a4c7-807309ebcfec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5ba1ef1d-68') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG os_vif [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:c9:b7,bridge_name='br-int',has_traffic_filtering=True,id=5ba1ef1d-6876-4756-86b2-0425ba5dfb39,network=Network(f744beb1-7d5f-4163-a4c7-807309ebcfec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5ba1ef1d-68') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ba1ef1d-68, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5ba1ef1d-68, col_values=(('external_ids', {'iface-id': '5ba1ef1d-6876-4756-86b2-0425ba5dfb39', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:c9:b7', 'vm-uuid': '420cd648-f3bb-49b0-a731-d2e4337367f6'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:23 user nova-compute[72586]: INFO os_vif [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:c9:b7,bridge_name='br-int',has_traffic_filtering=True,id=5ba1ef1d-6876-4756-86b2-0425ba5dfb39,network=Network(f744beb1-7d5f-4163-a4c7-807309ebcfec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5ba1ef1d-68')
Aug 01 21:21:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T21:20:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-217867043',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-217867043',id=11,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO76uCuhkjrWPkyXk6qmYQwxhaVjlKA+ce6UfOilBS2ShINaqd2kTHhw6N+tWxLYcCs1mxp+f1Hh10jwhbHka3cfTUcwK8jtYq/GKdIX+pjyujzcReByfdCEuUmQ8BfXbA==',key_name='tempest-keypair-1207086275',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46642f001d8644259eea283abaff6383',ramdisk_id='',reservation_id='r-ukz2hx41',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2021813946',owner_user_name='tempest-TaggedBootDevicesTest_v242-2021813946-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:20:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e476921eeb9b4212a088e864a0b85117',uuid=420cd648-f3bb-49b0-a731-d2e4337367f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65302d59-bf47-478e-be2e-37920bc76542", "address": "fa:16:3e:a4:c8:14", "network": {"id": "f744beb1-7d5f-4163-a4c7-807309ebcfec", "bridge": "br-int", "label": "tempest-device-tagging-net1-329951819", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65302d59-bf", "ovs_interfaceid": "65302d59-bf47-478e-be2e-37920bc76542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Converting VIF {"id": "65302d59-bf47-478e-be2e-37920bc76542", "address": "fa:16:3e:a4:c8:14", "network": {"id": "f744beb1-7d5f-4163-a4c7-807309ebcfec", "bridge": "br-int", "label": "tempest-device-tagging-net1-329951819", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65302d59-bf", "ovs_interfaceid": "65302d59-bf47-478e-be2e-37920bc76542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:c8:14,bridge_name='br-int',has_traffic_filtering=True,id=65302d59-bf47-478e-be2e-37920bc76542,network=Network(f744beb1-7d5f-4163-a4c7-807309ebcfec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65302d59-bf') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG os_vif [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:c8:14,bridge_name='br-int',has_traffic_filtering=True,id=65302d59-bf47-478e-be2e-37920bc76542,network=Network(f744beb1-7d5f-4163-a4c7-807309ebcfec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65302d59-bf') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap65302d59-bf, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap65302d59-bf, col_values=(('external_ids', {'iface-id': '65302d59-bf47-478e-be2e-37920bc76542', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:c8:14', 'vm-uuid': '420cd648-f3bb-49b0-a731-d2e4337367f6'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:23 user nova-compute[72586]: INFO os_vif [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:c8:14,bridge_name='br-int',has_traffic_filtering=True,id=65302d59-bf47-478e-be2e-37920bc76542,network=Network(f744beb1-7d5f-4163-a4c7-807309ebcfec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65302d59-bf')
Aug 01 21:21:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T21:20:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-217867043',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-217867043',id=11,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO76uCuhkjrWPkyXk6qmYQwxhaVjlKA+ce6UfOilBS2ShINaqd2kTHhw6N+tWxLYcCs1mxp+f1Hh10jwhbHka3cfTUcwK8jtYq/GKdIX+pjyujzcReByfdCEuUmQ8BfXbA==',key_name='tempest-keypair-1207086275',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46642f001d8644259eea283abaff6383',ramdisk_id='',reservation_id='r-ukz2hx41',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2021813946',owner_user_name='tempest-TaggedBootDevicesTest_v242-2021813946-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:20:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e476921eeb9b4212a088e864a0b85117',uuid=420cd648-f3bb-49b0-a731-d2e4337367f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d823d714-835e-418a-85f2-e99504cc3f94", "address": "fa:16:3e:17:cd:33", "network": {"id": "f744beb1-7d5f-4163-a4c7-807309ebcfec", "bridge": "br-int", "label": "tempest-device-tagging-net1-329951819", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd823d714-83", "ovs_interfaceid": "d823d714-835e-418a-85f2-e99504cc3f94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Converting VIF {"id": "d823d714-835e-418a-85f2-e99504cc3f94", "address": "fa:16:3e:17:cd:33", "network": {"id": "f744beb1-7d5f-4163-a4c7-807309ebcfec", "bridge": "br-int", "label": "tempest-device-tagging-net1-329951819", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd823d714-83", "ovs_interfaceid": "d823d714-835e-418a-85f2-e99504cc3f94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:cd:33,bridge_name='br-int',has_traffic_filtering=True,id=d823d714-835e-418a-85f2-e99504cc3f94,network=Network(f744beb1-7d5f-4163-a4c7-807309ebcfec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd823d714-83') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG os_vif [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:cd:33,bridge_name='br-int',has_traffic_filtering=True,id=d823d714-835e-418a-85f2-e99504cc3f94,network=Network(f744beb1-7d5f-4163-a4c7-807309ebcfec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd823d714-83') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd823d714-83, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd823d714-83, col_values=(('external_ids', {'iface-id': 'd823d714-835e-418a-85f2-e99504cc3f94', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:cd:33', 'vm-uuid': '420cd648-f3bb-49b0-a731-d2e4337367f6'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG nova.compute.manager [req-60921d27-9a7e-4664-8d23-fc8a8b3d4749 req-f5418d8c-4dc4-4756-bc40-c447bfb60948 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received event network-vif-plugged-28d77550-badf-4c92-9b3d-2335ad88267a {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-60921d27-9a7e-4664-8d23-fc8a8b3d4749 req-f5418d8c-4dc4-4756-bc40-c447bfb60948 service nova] Acquiring lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-60921d27-9a7e-4664-8d23-fc8a8b3d4749 req-f5418d8c-4dc4-4756-bc40-c447bfb60948 service nova] Lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-60921d27-9a7e-4664-8d23-fc8a8b3d4749 req-f5418d8c-4dc4-4756-bc40-c447bfb60948 service nova] Lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG nova.compute.manager [req-60921d27-9a7e-4664-8d23-fc8a8b3d4749 req-f5418d8c-4dc4-4756-bc40-c447bfb60948 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] No waiting events found dispatching network-vif-plugged-28d77550-badf-4c92-9b3d-2335ad88267a {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:21:23 user nova-compute[72586]: WARNING nova.compute.manager [req-60921d27-9a7e-4664-8d23-fc8a8b3d4749 req-f5418d8c-4dc4-4756-bc40-c447bfb60948 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received unexpected event network-vif-plugged-28d77550-badf-4c92-9b3d-2335ad88267a for instance with vm_state building and task_state spawning.
Aug 01 21:21:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:23 user nova-compute[72586]: INFO os_vif [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:cd:33,bridge_name='br-int',has_traffic_filtering=True,id=d823d714-835e-418a-85f2-e99504cc3f94,network=Network(f744beb1-7d5f-4163-a4c7-807309ebcfec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd823d714-83')
Aug 01 21:21:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T21:20:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-217867043',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-217867043',id=11,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO76uCuhkjrWPkyXk6qmYQwxhaVjlKA+ce6UfOilBS2ShINaqd2kTHhw6N+tWxLYcCs1mxp+f1Hh10jwhbHka3cfTUcwK8jtYq/GKdIX+pjyujzcReByfdCEuUmQ8BfXbA==',key_name='tempest-keypair-1207086275',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46642f001d8644259eea283abaff6383',ramdisk_id='',reservation_id='r-ukz2hx41',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2021813946',owner_user_name='tempest-TaggedBootDevicesTest_v242-2021813946-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:20:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e476921eeb9b4212a088e864a0b85117',uuid=420cd648-f3bb-49b0-a731-d2e4337367f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "abf0b845-110a-447f-b130-b1eeed139b29", "address": "fa:16:3e:43:2b:85", "network": {"id": "3ae43cbc-2d22-465e-ba01-b2422e24134b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1150402374", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabf0b845-11", "ovs_interfaceid": "abf0b845-110a-447f-b130-b1eeed139b29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Converting VIF {"id": "abf0b845-110a-447f-b130-b1eeed139b29", "address": "fa:16:3e:43:2b:85", "network": {"id": "3ae43cbc-2d22-465e-ba01-b2422e24134b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1150402374", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabf0b845-11", "ovs_interfaceid": "abf0b845-110a-447f-b130-b1eeed139b29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:2b:85,bridge_name='br-int',has_traffic_filtering=True,id=abf0b845-110a-447f-b130-b1eeed139b29,network=Network(3ae43cbc-2d22-465e-ba01-b2422e24134b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabf0b845-11') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG os_vif [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:2b:85,bridge_name='br-int',has_traffic_filtering=True,id=abf0b845-110a-447f-b130-b1eeed139b29,network=Network(3ae43cbc-2d22-465e-ba01-b2422e24134b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabf0b845-11') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapabf0b845-11, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapabf0b845-11, col_values=(('external_ids', {'iface-id': 'abf0b845-110a-447f-b130-b1eeed139b29', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:2b:85', 'vm-uuid': '420cd648-f3bb-49b0-a731-d2e4337367f6'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:21:24 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:24 user nova-compute[72586]: INFO os_vif [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:2b:85,bridge_name='br-int',has_traffic_filtering=True,id=abf0b845-110a-447f-b130-b1eeed139b29,network=Network(3ae43cbc-2d22-465e-ba01-b2422e24134b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabf0b845-11')
Aug 01 21:21:24 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T21:20:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-217867043',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-217867043',id=11,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO76uCuhkjrWPkyXk6qmYQwxhaVjlKA+ce6UfOilBS2ShINaqd2kTHhw6N+tWxLYcCs1mxp+f1Hh10jwhbHka3cfTUcwK8jtYq/GKdIX+pjyujzcReByfdCEuUmQ8BfXbA==',key_name='tempest-keypair-1207086275',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46642f001d8644259eea283abaff6383',ramdisk_id='',reservation_id='r-ukz2hx41',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2021813946',owner_user_name='tempest-TaggedBootDevicesTest_v242-2021813946-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:20:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e476921eeb9b4212a088e864a0b85117',uuid=420cd648-f3bb-49b0-a731-d2e4337367f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3095c6ca-2bce-4216-9290-e1fc3fe17e03", "address": "fa:16:3e:78:4c:6e", "network": {"id": "3ae43cbc-2d22-465e-ba01-b2422e24134b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1150402374", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3095c6ca-2b", "ovs_interfaceid": "3095c6ca-2bce-4216-9290-e1fc3fe17e03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:21:24 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Converting VIF {"id": "3095c6ca-2bce-4216-9290-e1fc3fe17e03", "address": "fa:16:3e:78:4c:6e", "network": {"id": "3ae43cbc-2d22-465e-ba01-b2422e24134b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1150402374", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3095c6ca-2b", "ovs_interfaceid": "3095c6ca-2bce-4216-9290-e1fc3fe17e03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:21:24 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:4c:6e,bridge_name='br-int',has_traffic_filtering=True,id=3095c6ca-2bce-4216-9290-e1fc3fe17e03,network=Network(3ae43cbc-2d22-465e-ba01-b2422e24134b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3095c6ca-2b') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:21:24 user nova-compute[72586]: DEBUG os_vif [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:4c:6e,bridge_name='br-int',has_traffic_filtering=True,id=3095c6ca-2bce-4216-9290-e1fc3fe17e03,network=Network(3ae43cbc-2d22-465e-ba01-b2422e24134b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3095c6ca-2b') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:21:24 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:24 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:21:24 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:21:24 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:24 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3095c6ca-2b, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:21:24 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3095c6ca-2b, col_values=(('external_ids', {'iface-id': '3095c6ca-2bce-4216-9290-e1fc3fe17e03', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:4c:6e', 'vm-uuid': '420cd648-f3bb-49b0-a731-d2e4337367f6'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:21:24 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:24 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:21:24 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:24 user nova-compute[72586]: INFO os_vif [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:4c:6e,bridge_name='br-int',has_traffic_filtering=True,id=3095c6ca-2bce-4216-9290-e1fc3fe17e03,network=Network(3ae43cbc-2d22-465e-ba01-b2422e24134b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3095c6ca-2b')
Aug 01 21:21:24 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:24 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] No BDM found with device name hda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:21:24 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:21:24 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] No VIF found with MAC fa:16:3e:ae:ba:f8, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:21:24 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] No VIF found with MAC fa:16:3e:17:cd:33, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:21:24 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Using config drive
Aug 01 21:21:24 user nova-compute[72586]: DEBUG nova.compute.manager [req-b8a8b30c-55c7-4a30-9302-39ed3cac5f5b req-c648c650-6627-44d4-85a9-cd4274e0661c service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received event network-vif-plugged-0630d545-5545-4e43-96e7-1a0aed01ba9b {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:21:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-b8a8b30c-55c7-4a30-9302-39ed3cac5f5b req-c648c650-6627-44d4-85a9-cd4274e0661c service nova] Acquiring lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:21:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-b8a8b30c-55c7-4a30-9302-39ed3cac5f5b req-c648c650-6627-44d4-85a9-cd4274e0661c service nova] Lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:21:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-b8a8b30c-55c7-4a30-9302-39ed3cac5f5b req-c648c650-6627-44d4-85a9-cd4274e0661c service nova] Lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:21:24 user nova-compute[72586]: DEBUG nova.compute.manager [req-b8a8b30c-55c7-4a30-9302-39ed3cac5f5b req-c648c650-6627-44d4-85a9-cd4274e0661c service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] No waiting events found dispatching network-vif-plugged-0630d545-5545-4e43-96e7-1a0aed01ba9b {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:21:24 user nova-compute[72586]: WARNING nova.compute.manager [req-b8a8b30c-55c7-4a30-9302-39ed3cac5f5b req-c648c650-6627-44d4-85a9-cd4274e0661c service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received unexpected event network-vif-plugged-0630d545-5545-4e43-96e7-1a0aed01ba9b for instance with vm_state building and task_state spawning.
Aug 01 21:21:24 user nova-compute[72586]: DEBUG nova.compute.manager [req-b8a8b30c-55c7-4a30-9302-39ed3cac5f5b req-c648c650-6627-44d4-85a9-cd4274e0661c service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received event network-vif-plugged-9420c293-c443-4003-a54a-d6edbd12ddbc {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:21:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-b8a8b30c-55c7-4a30-9302-39ed3cac5f5b req-c648c650-6627-44d4-85a9-cd4274e0661c service nova] Acquiring lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:21:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-b8a8b30c-55c7-4a30-9302-39ed3cac5f5b req-c648c650-6627-44d4-85a9-cd4274e0661c service nova] Lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:21:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-b8a8b30c-55c7-4a30-9302-39ed3cac5f5b req-c648c650-6627-44d4-85a9-cd4274e0661c service nova] Lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:21:24 user nova-compute[72586]: DEBUG nova.compute.manager [req-b8a8b30c-55c7-4a30-9302-39ed3cac5f5b req-c648c650-6627-44d4-85a9-cd4274e0661c service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] No waiting events found dispatching network-vif-plugged-9420c293-c443-4003-a54a-d6edbd12ddbc {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:21:24 user nova-compute[72586]: WARNING nova.compute.manager [req-b8a8b30c-55c7-4a30-9302-39ed3cac5f5b req-c648c650-6627-44d4-85a9-cd4274e0661c service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received unexpected event network-vif-plugged-9420c293-c443-4003-a54a-d6edbd12ddbc for instance with vm_state building and task_state spawning.
Aug 01 21:21:24 user nova-compute[72586]: DEBUG nova.compute.manager [req-b8a8b30c-55c7-4a30-9302-39ed3cac5f5b req-c648c650-6627-44d4-85a9-cd4274e0661c service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received event network-vif-plugged-9420c293-c443-4003-a54a-d6edbd12ddbc {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:21:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-b8a8b30c-55c7-4a30-9302-39ed3cac5f5b req-c648c650-6627-44d4-85a9-cd4274e0661c service nova] Acquiring lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:21:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-b8a8b30c-55c7-4a30-9302-39ed3cac5f5b req-c648c650-6627-44d4-85a9-cd4274e0661c service nova] Lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:21:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-b8a8b30c-55c7-4a30-9302-39ed3cac5f5b req-c648c650-6627-44d4-85a9-cd4274e0661c service nova] Lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:21:24 user nova-compute[72586]: DEBUG nova.compute.manager [req-b8a8b30c-55c7-4a30-9302-39ed3cac5f5b req-c648c650-6627-44d4-85a9-cd4274e0661c service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] No waiting events found dispatching network-vif-plugged-9420c293-c443-4003-a54a-d6edbd12ddbc {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:21:24 user nova-compute[72586]: WARNING nova.compute.manager [req-b8a8b30c-55c7-4a30-9302-39ed3cac5f5b req-c648c650-6627-44d4-85a9-cd4274e0661c service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received unexpected event network-vif-plugged-9420c293-c443-4003-a54a-d6edbd12ddbc for instance with vm_state building and task_state spawning.
Aug 01 21:21:24 user nova-compute[72586]: DEBUG nova.compute.manager [req-b8a8b30c-55c7-4a30-9302-39ed3cac5f5b req-c648c650-6627-44d4-85a9-cd4274e0661c service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received event network-vif-plugged-a842fd3a-0b86-4008-8ae9-96ecbd5cb7e2 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:21:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-b8a8b30c-55c7-4a30-9302-39ed3cac5f5b req-c648c650-6627-44d4-85a9-cd4274e0661c service nova] Acquiring lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:21:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-b8a8b30c-55c7-4a30-9302-39ed3cac5f5b req-c648c650-6627-44d4-85a9-cd4274e0661c service nova] Lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:21:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-b8a8b30c-55c7-4a30-9302-39ed3cac5f5b req-c648c650-6627-44d4-85a9-cd4274e0661c service nova] Lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:21:24 user nova-compute[72586]: DEBUG nova.compute.manager [req-b8a8b30c-55c7-4a30-9302-39ed3cac5f5b req-c648c650-6627-44d4-85a9-cd4274e0661c service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] No waiting events found dispatching network-vif-plugged-a842fd3a-0b86-4008-8ae9-96ecbd5cb7e2 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:21:24 user nova-compute[72586]: WARNING nova.compute.manager [req-b8a8b30c-55c7-4a30-9302-39ed3cac5f5b req-c648c650-6627-44d4-85a9-cd4274e0661c service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received unexpected event network-vif-plugged-a842fd3a-0b86-4008-8ae9-96ecbd5cb7e2 for instance with vm_state building and task_state spawning.
Aug 01 21:21:24 user nova-compute[72586]: DEBUG nova.compute.manager [req-b8a8b30c-55c7-4a30-9302-39ed3cac5f5b req-c648c650-6627-44d4-85a9-cd4274e0661c service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received event network-vif-plugged-a842fd3a-0b86-4008-8ae9-96ecbd5cb7e2 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:21:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-b8a8b30c-55c7-4a30-9302-39ed3cac5f5b req-c648c650-6627-44d4-85a9-cd4274e0661c service nova] Acquiring lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:21:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-b8a8b30c-55c7-4a30-9302-39ed3cac5f5b req-c648c650-6627-44d4-85a9-cd4274e0661c service nova] Lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:21:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-b8a8b30c-55c7-4a30-9302-39ed3cac5f5b req-c648c650-6627-44d4-85a9-cd4274e0661c service nova] Lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:21:24 user nova-compute[72586]: DEBUG nova.compute.manager [req-b8a8b30c-55c7-4a30-9302-39ed3cac5f5b req-c648c650-6627-44d4-85a9-cd4274e0661c service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] No waiting events found dispatching network-vif-plugged-a842fd3a-0b86-4008-8ae9-96ecbd5cb7e2 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:21:24 user nova-compute[72586]: WARNING nova.compute.manager [req-b8a8b30c-55c7-4a30-9302-39ed3cac5f5b req-c648c650-6627-44d4-85a9-cd4274e0661c service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received unexpected event network-vif-plugged-a842fd3a-0b86-4008-8ae9-96ecbd5cb7e2 for instance with vm_state building and task_state spawning.
Aug 01 21:21:24 user nova-compute[72586]: DEBUG nova.compute.manager [req-b8a8b30c-55c7-4a30-9302-39ed3cac5f5b req-c648c650-6627-44d4-85a9-cd4274e0661c service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received event network-vif-plugged-c71bda65-c16d-48f8-b66f-60d78a569ca3 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:21:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-b8a8b30c-55c7-4a30-9302-39ed3cac5f5b req-c648c650-6627-44d4-85a9-cd4274e0661c service nova] Acquiring lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:21:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-b8a8b30c-55c7-4a30-9302-39ed3cac5f5b req-c648c650-6627-44d4-85a9-cd4274e0661c service nova] Lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:21:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-b8a8b30c-55c7-4a30-9302-39ed3cac5f5b req-c648c650-6627-44d4-85a9-cd4274e0661c service nova] Lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:21:24 user nova-compute[72586]: DEBUG nova.compute.manager [req-b8a8b30c-55c7-4a30-9302-39ed3cac5f5b req-c648c650-6627-44d4-85a9-cd4274e0661c service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] No waiting events found dispatching network-vif-plugged-c71bda65-c16d-48f8-b66f-60d78a569ca3 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:21:24 user nova-compute[72586]: WARNING nova.compute.manager [req-b8a8b30c-55c7-4a30-9302-39ed3cac5f5b req-c648c650-6627-44d4-85a9-cd4274e0661c service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received unexpected event network-vif-plugged-c71bda65-c16d-48f8-b66f-60d78a569ca3 for instance with vm_state building and task_state spawning.
Aug 01 21:21:24 user nova-compute[72586]: DEBUG nova.compute.manager [req-b8a8b30c-55c7-4a30-9302-39ed3cac5f5b req-c648c650-6627-44d4-85a9-cd4274e0661c service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received event network-vif-plugged-c71bda65-c16d-48f8-b66f-60d78a569ca3 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:21:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-b8a8b30c-55c7-4a30-9302-39ed3cac5f5b req-c648c650-6627-44d4-85a9-cd4274e0661c service nova] Acquiring lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:21:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-b8a8b30c-55c7-4a30-9302-39ed3cac5f5b req-c648c650-6627-44d4-85a9-cd4274e0661c service nova] Lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:21:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-b8a8b30c-55c7-4a30-9302-39ed3cac5f5b req-c648c650-6627-44d4-85a9-cd4274e0661c service nova] Lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:21:24 user nova-compute[72586]: DEBUG nova.compute.manager [req-b8a8b30c-55c7-4a30-9302-39ed3cac5f5b req-c648c650-6627-44d4-85a9-cd4274e0661c service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] No waiting events found dispatching network-vif-plugged-c71bda65-c16d-48f8-b66f-60d78a569ca3 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:21:24 user nova-compute[72586]: WARNING nova.compute.manager [req-b8a8b30c-55c7-4a30-9302-39ed3cac5f5b req-c648c650-6627-44d4-85a9-cd4274e0661c service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received unexpected event network-vif-plugged-c71bda65-c16d-48f8-b66f-60d78a569ca3 for instance with vm_state building and task_state spawning.
Aug 01 21:21:24 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:24 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Creating config drive at /opt/stack/data/nova/instances/420cd648-f3bb-49b0-a731-d2e4337367f6/disk.config
Aug 01 21:21:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/420cd648-f3bb-49b0-a731-d2e4337367f6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmplya42yco {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:24 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/420cd648-f3bb-49b0-a731-d2e4337367f6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmplya42yco" returned: 0 in 0.089s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:24 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:24 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:21:24 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:21:24 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:21:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eccf50b0-9acc-49b6-8044-601e47d18c38/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eccf50b0-9acc-49b6-8044-601e47d18c38/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eccf50b0-9acc-49b6-8044-601e47d18c38/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eccf50b0-9acc-49b6-8044-601e47d18c38/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b640b7-1dec-4b31-b64b-f1dbee7f62f6/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b640b7-1dec-4b31-b64b-f1dbee7f62f6/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b640b7-1dec-4b31-b64b-f1dbee7f62f6/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:25 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:25 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:25 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b640b7-1dec-4b31-b64b-f1dbee7f62f6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3830c8b3-27b8-45f3-bbdb-8a081dfcadc4/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:25 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:25 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3830c8b3-27b8-45f3-bbdb-8a081dfcadc4/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3830c8b3-27b8-45f3-bbdb-8a081dfcadc4/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3830c8b3-27b8-45f3-bbdb-8a081dfcadc4/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9197638d-0c03-4b4e-876a-003bd8db3c35/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:25 user nova-compute[72586]: DEBUG nova.compute.manager [req-0d5ead89-2855-483e-916e-f9811ff5911c req-962e3aab-e2f0-453c-9586-a495dc59f5e3 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received event network-vif-plugged-07f02376-9705-48a3-8434-f7ac557f7d5b {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:21:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-0d5ead89-2855-483e-916e-f9811ff5911c req-962e3aab-e2f0-453c-9586-a495dc59f5e3 service nova] Acquiring lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:21:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-0d5ead89-2855-483e-916e-f9811ff5911c req-962e3aab-e2f0-453c-9586-a495dc59f5e3 service nova] Lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:21:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-0d5ead89-2855-483e-916e-f9811ff5911c req-962e3aab-e2f0-453c-9586-a495dc59f5e3 service nova] Lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:21:25 user nova-compute[72586]: DEBUG nova.compute.manager [req-0d5ead89-2855-483e-916e-f9811ff5911c req-962e3aab-e2f0-453c-9586-a495dc59f5e3 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] No waiting events found dispatching network-vif-plugged-07f02376-9705-48a3-8434-f7ac557f7d5b {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:21:25 user nova-compute[72586]: WARNING nova.compute.manager [req-0d5ead89-2855-483e-916e-f9811ff5911c req-962e3aab-e2f0-453c-9586-a495dc59f5e3 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received unexpected event network-vif-plugged-07f02376-9705-48a3-8434-f7ac557f7d5b for instance with vm_state building and task_state spawning.
Aug 01 21:21:25 user nova-compute[72586]: DEBUG nova.compute.manager [req-0d5ead89-2855-483e-916e-f9811ff5911c req-962e3aab-e2f0-453c-9586-a495dc59f5e3 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received event network-vif-plugged-07f02376-9705-48a3-8434-f7ac557f7d5b {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:21:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-0d5ead89-2855-483e-916e-f9811ff5911c req-962e3aab-e2f0-453c-9586-a495dc59f5e3 service nova] Acquiring lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:21:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-0d5ead89-2855-483e-916e-f9811ff5911c req-962e3aab-e2f0-453c-9586-a495dc59f5e3 service nova] Lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:21:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-0d5ead89-2855-483e-916e-f9811ff5911c req-962e3aab-e2f0-453c-9586-a495dc59f5e3 service nova] Lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:21:25 user nova-compute[72586]: DEBUG nova.compute.manager [req-0d5ead89-2855-483e-916e-f9811ff5911c req-962e3aab-e2f0-453c-9586-a495dc59f5e3 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] No waiting events found dispatching network-vif-plugged-07f02376-9705-48a3-8434-f7ac557f7d5b {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:21:25 user nova-compute[72586]: WARNING nova.compute.manager [req-0d5ead89-2855-483e-916e-f9811ff5911c req-962e3aab-e2f0-453c-9586-a495dc59f5e3 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received unexpected event network-vif-plugged-07f02376-9705-48a3-8434-f7ac557f7d5b for instance with vm_state building and task_state spawning.
Aug 01 21:21:25 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:25 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9197638d-0c03-4b4e-876a-003bd8db3c35/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9197638d-0c03-4b4e-876a-003bd8db3c35/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:26 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690924886.120311, 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:21:26 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] VM Resumed (Lifecycle Event)
Aug 01 21:21:26 user nova-compute[72586]: DEBUG nova.compute.manager [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Instance event wait completed in 0 seconds for  {{(pid=72586) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 21:21:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Guest created on hypervisor {{(pid=72586) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 21:21:26 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Instance spawned successfully.
Aug 01 21:21:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 21:21:26 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:21:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Found default for hw_cdrom_bus of ide {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:21:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Found default for hw_disk_bus of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:21:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Found default for hw_input_bus of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:21:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Found default for hw_pointer_model of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:21:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Found default for hw_video_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:21:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Found default for hw_vif_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:21:26 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:21:26 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9197638d-0c03-4b4e-876a-003bd8db3c35/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25fb970a-0caf-41e8-8d58-259dbd9cf291/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:26 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:26 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:21:26 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690924886.12345, 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:21:26 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] VM Started (Lifecycle Event)
Aug 01 21:21:26 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:21:26 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:21:26 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:26 user nova-compute[72586]: INFO nova.compute.manager [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Took 11.62 seconds to spawn the instance on the hypervisor.
Aug 01 21:21:26 user nova-compute[72586]: DEBUG nova.compute.manager [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:21:26 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:26 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:21:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25fb970a-0caf-41e8-8d58-259dbd9cf291/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25fb970a-0caf-41e8-8d58-259dbd9cf291/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:26 user nova-compute[72586]: INFO nova.compute.manager [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Took 41.44 seconds to build instance.
Aug 01 21:21:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25fb970a-0caf-41e8-8d58-259dbd9cf291/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3dd1b3bf-c4d1-460c-9832-ae923a1e4afa tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 41.577s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:21:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98345340-5fb3-41fe-aea9-770cf4585e86/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:26 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98345340-5fb3-41fe-aea9-770cf4585e86/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98345340-5fb3-41fe-aea9-770cf4585e86/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:26 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98345340-5fb3-41fe-aea9-770cf4585e86/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fde640d-b731-405d-af91-fb4ef85fe90a/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:27 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:27 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:27 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fde640d-b731-405d-af91-fb4ef85fe90a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fde640d-b731-405d-af91-fb4ef85fe90a/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:27 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:27 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fde640d-b731-405d-af91-fb4ef85fe90a/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.rescue --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:27 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:27 user nova-compute[72586]: DEBUG nova.compute.manager [req-bd8496e8-cfa7-409e-b451-e3721bee8891 req-1d9c8a56-dc30-430c-8bd4-aefb68d764a3 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received event network-vif-plugged-5ba1ef1d-6876-4756-86b2-0425ba5dfb39 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:21:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-bd8496e8-cfa7-409e-b451-e3721bee8891 req-1d9c8a56-dc30-430c-8bd4-aefb68d764a3 service nova] Acquiring lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:21:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-bd8496e8-cfa7-409e-b451-e3721bee8891 req-1d9c8a56-dc30-430c-8bd4-aefb68d764a3 service nova] Lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:21:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-bd8496e8-cfa7-409e-b451-e3721bee8891 req-1d9c8a56-dc30-430c-8bd4-aefb68d764a3 service nova] Lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:21:27 user nova-compute[72586]: DEBUG nova.compute.manager [req-bd8496e8-cfa7-409e-b451-e3721bee8891 req-1d9c8a56-dc30-430c-8bd4-aefb68d764a3 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] No waiting events found dispatching network-vif-plugged-5ba1ef1d-6876-4756-86b2-0425ba5dfb39 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:21:27 user nova-compute[72586]: WARNING nova.compute.manager [req-bd8496e8-cfa7-409e-b451-e3721bee8891 req-1d9c8a56-dc30-430c-8bd4-aefb68d764a3 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received unexpected event network-vif-plugged-5ba1ef1d-6876-4756-86b2-0425ba5dfb39 for instance with vm_state building and task_state spawning.
Aug 01 21:21:27 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:27 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.rescue --force-share --output=json" returned: 0 in 0.233s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.rescue --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.rescue --force-share --output=json" returned: 0 in 0.227s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:28 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:28 user nova-compute[72586]: DEBUG nova.compute.manager [req-e40dd944-afc4-46b8-9d4b-ad1c531bb49e req-c2f9474d-f7bc-44ec-bbb0-1619d0e38ac7 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received event network-vif-plugged-cdf2815f-96ba-4cb9-a025-1436804117e7 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:21:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-e40dd944-afc4-46b8-9d4b-ad1c531bb49e req-c2f9474d-f7bc-44ec-bbb0-1619d0e38ac7 service nova] Acquiring lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:21:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-e40dd944-afc4-46b8-9d4b-ad1c531bb49e req-c2f9474d-f7bc-44ec-bbb0-1619d0e38ac7 service nova] Lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:21:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-e40dd944-afc4-46b8-9d4b-ad1c531bb49e req-c2f9474d-f7bc-44ec-bbb0-1619d0e38ac7 service nova] Lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:21:28 user nova-compute[72586]: DEBUG nova.compute.manager [req-e40dd944-afc4-46b8-9d4b-ad1c531bb49e req-c2f9474d-f7bc-44ec-bbb0-1619d0e38ac7 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] No waiting events found dispatching network-vif-plugged-cdf2815f-96ba-4cb9-a025-1436804117e7 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:21:28 user nova-compute[72586]: WARNING nova.compute.manager [req-e40dd944-afc4-46b8-9d4b-ad1c531bb49e req-c2f9474d-f7bc-44ec-bbb0-1619d0e38ac7 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received unexpected event network-vif-plugged-cdf2815f-96ba-4cb9-a025-1436804117e7 for instance with vm_state building and task_state spawning.
Aug 01 21:21:28 user nova-compute[72586]: DEBUG nova.compute.manager [req-e40dd944-afc4-46b8-9d4b-ad1c531bb49e req-c2f9474d-f7bc-44ec-bbb0-1619d0e38ac7 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received event network-vif-plugged-cdf2815f-96ba-4cb9-a025-1436804117e7 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:21:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-e40dd944-afc4-46b8-9d4b-ad1c531bb49e req-c2f9474d-f7bc-44ec-bbb0-1619d0e38ac7 service nova] Acquiring lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:21:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-e40dd944-afc4-46b8-9d4b-ad1c531bb49e req-c2f9474d-f7bc-44ec-bbb0-1619d0e38ac7 service nova] Lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:21:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-e40dd944-afc4-46b8-9d4b-ad1c531bb49e req-c2f9474d-f7bc-44ec-bbb0-1619d0e38ac7 service nova] Lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:21:28 user nova-compute[72586]: DEBUG nova.compute.manager [req-e40dd944-afc4-46b8-9d4b-ad1c531bb49e req-c2f9474d-f7bc-44ec-bbb0-1619d0e38ac7 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] No waiting events found dispatching network-vif-plugged-cdf2815f-96ba-4cb9-a025-1436804117e7 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:21:28 user nova-compute[72586]: WARNING nova.compute.manager [req-e40dd944-afc4-46b8-9d4b-ad1c531bb49e req-c2f9474d-f7bc-44ec-bbb0-1619d0e38ac7 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received unexpected event network-vif-plugged-cdf2815f-96ba-4cb9-a025-1436804117e7 for instance with vm_state building and task_state spawning.
Aug 01 21:21:28 user nova-compute[72586]: DEBUG nova.compute.manager [req-e40dd944-afc4-46b8-9d4b-ad1c531bb49e req-c2f9474d-f7bc-44ec-bbb0-1619d0e38ac7 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received event network-vif-plugged-bdfc5e91-52c4-4071-8252-a7caa7b53d24 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:21:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-e40dd944-afc4-46b8-9d4b-ad1c531bb49e req-c2f9474d-f7bc-44ec-bbb0-1619d0e38ac7 service nova] Acquiring lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:21:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-e40dd944-afc4-46b8-9d4b-ad1c531bb49e req-c2f9474d-f7bc-44ec-bbb0-1619d0e38ac7 service nova] Lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:21:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-e40dd944-afc4-46b8-9d4b-ad1c531bb49e req-c2f9474d-f7bc-44ec-bbb0-1619d0e38ac7 service nova] Lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:21:28 user nova-compute[72586]: DEBUG nova.compute.manager [req-e40dd944-afc4-46b8-9d4b-ad1c531bb49e req-c2f9474d-f7bc-44ec-bbb0-1619d0e38ac7 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] No waiting events found dispatching network-vif-plugged-bdfc5e91-52c4-4071-8252-a7caa7b53d24 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:21:28 user nova-compute[72586]: WARNING nova.compute.manager [req-e40dd944-afc4-46b8-9d4b-ad1c531bb49e req-c2f9474d-f7bc-44ec-bbb0-1619d0e38ac7 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received unexpected event network-vif-plugged-bdfc5e91-52c4-4071-8252-a7caa7b53d24 for instance with vm_state building and task_state spawning.
Aug 01 21:21:28 user nova-compute[72586]: DEBUG nova.compute.manager [req-e40dd944-afc4-46b8-9d4b-ad1c531bb49e req-c2f9474d-f7bc-44ec-bbb0-1619d0e38ac7 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received event network-vif-plugged-bdfc5e91-52c4-4071-8252-a7caa7b53d24 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:21:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-e40dd944-afc4-46b8-9d4b-ad1c531bb49e req-c2f9474d-f7bc-44ec-bbb0-1619d0e38ac7 service nova] Acquiring lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:21:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-e40dd944-afc4-46b8-9d4b-ad1c531bb49e req-c2f9474d-f7bc-44ec-bbb0-1619d0e38ac7 service nova] Lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:21:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-e40dd944-afc4-46b8-9d4b-ad1c531bb49e req-c2f9474d-f7bc-44ec-bbb0-1619d0e38ac7 service nova] Lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:21:28 user nova-compute[72586]: DEBUG nova.compute.manager [req-e40dd944-afc4-46b8-9d4b-ad1c531bb49e req-c2f9474d-f7bc-44ec-bbb0-1619d0e38ac7 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] No waiting events found dispatching network-vif-plugged-bdfc5e91-52c4-4071-8252-a7caa7b53d24 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:21:28 user nova-compute[72586]: WARNING nova.compute.manager [req-e40dd944-afc4-46b8-9d4b-ad1c531bb49e req-c2f9474d-f7bc-44ec-bbb0-1619d0e38ac7 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received unexpected event network-vif-plugged-bdfc5e91-52c4-4071-8252-a7caa7b53d24 for instance with vm_state building and task_state spawning.
Aug 01 21:21:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:28 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:28 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:28 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:28 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:28 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:28 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:28 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690924891.7019384, 420cd648-f3bb-49b0-a731-d2e4337367f6 => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:21:32 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] VM Resumed (Lifecycle Event)
Aug 01 21:21:32 user nova-compute[72586]: DEBUG nova.compute.manager [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Instance event wait completed in 0 seconds for  {{(pid=72586) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Guest created on hypervisor {{(pid=72586) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG nova.compute.manager [req-78a85e85-e28a-423f-b49a-f035aed9d556 req-f7003417-f529-47cf-bc48-738aab94e137 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received event network-vif-plugged-abf0b845-110a-447f-b130-b1eeed139b29 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-78a85e85-e28a-423f-b49a-f035aed9d556 req-f7003417-f529-47cf-bc48-738aab94e137 service nova] Acquiring lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-78a85e85-e28a-423f-b49a-f035aed9d556 req-f7003417-f529-47cf-bc48-738aab94e137 service nova] Lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-78a85e85-e28a-423f-b49a-f035aed9d556 req-f7003417-f529-47cf-bc48-738aab94e137 service nova] Lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG nova.compute.manager [req-78a85e85-e28a-423f-b49a-f035aed9d556 req-f7003417-f529-47cf-bc48-738aab94e137 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] No waiting events found dispatching network-vif-plugged-abf0b845-110a-447f-b130-b1eeed139b29 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:21:32 user nova-compute[72586]: WARNING nova.compute.manager [req-78a85e85-e28a-423f-b49a-f035aed9d556 req-f7003417-f529-47cf-bc48-738aab94e137 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received unexpected event network-vif-plugged-abf0b845-110a-447f-b130-b1eeed139b29 for instance with vm_state building and task_state spawning.
Aug 01 21:21:32 user nova-compute[72586]: DEBUG nova.compute.manager [req-ea79159f-7356-4f48-9580-022aeae89fbe req-894f0210-acf7-4eb0-8437-150eb2d6fcab service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received event network-vif-plugged-5ba1ef1d-6876-4756-86b2-0425ba5dfb39 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ea79159f-7356-4f48-9580-022aeae89fbe req-894f0210-acf7-4eb0-8437-150eb2d6fcab service nova] Acquiring lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ea79159f-7356-4f48-9580-022aeae89fbe req-894f0210-acf7-4eb0-8437-150eb2d6fcab service nova] Lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ea79159f-7356-4f48-9580-022aeae89fbe req-894f0210-acf7-4eb0-8437-150eb2d6fcab service nova] Lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG nova.compute.manager [req-ea79159f-7356-4f48-9580-022aeae89fbe req-894f0210-acf7-4eb0-8437-150eb2d6fcab service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] No waiting events found dispatching network-vif-plugged-5ba1ef1d-6876-4756-86b2-0425ba5dfb39 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:21:32 user nova-compute[72586]: WARNING nova.compute.manager [req-ea79159f-7356-4f48-9580-022aeae89fbe req-894f0210-acf7-4eb0-8437-150eb2d6fcab service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received unexpected event network-vif-plugged-5ba1ef1d-6876-4756-86b2-0425ba5dfb39 for instance with vm_state building and task_state spawning.
Aug 01 21:21:32 user nova-compute[72586]: DEBUG nova.compute.manager [req-ea79159f-7356-4f48-9580-022aeae89fbe req-894f0210-acf7-4eb0-8437-150eb2d6fcab service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received event network-vif-plugged-65302d59-bf47-478e-be2e-37920bc76542 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ea79159f-7356-4f48-9580-022aeae89fbe req-894f0210-acf7-4eb0-8437-150eb2d6fcab service nova] Acquiring lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ea79159f-7356-4f48-9580-022aeae89fbe req-894f0210-acf7-4eb0-8437-150eb2d6fcab service nova] Lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ea79159f-7356-4f48-9580-022aeae89fbe req-894f0210-acf7-4eb0-8437-150eb2d6fcab service nova] Lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG nova.compute.manager [req-ea79159f-7356-4f48-9580-022aeae89fbe req-894f0210-acf7-4eb0-8437-150eb2d6fcab service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] No waiting events found dispatching network-vif-plugged-65302d59-bf47-478e-be2e-37920bc76542 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:21:32 user nova-compute[72586]: WARNING nova.compute.manager [req-ea79159f-7356-4f48-9580-022aeae89fbe req-894f0210-acf7-4eb0-8437-150eb2d6fcab service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received unexpected event network-vif-plugged-65302d59-bf47-478e-be2e-37920bc76542 for instance with vm_state building and task_state spawning.
Aug 01 21:21:32 user nova-compute[72586]: DEBUG nova.compute.manager [req-ea79159f-7356-4f48-9580-022aeae89fbe req-894f0210-acf7-4eb0-8437-150eb2d6fcab service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received event network-vif-plugged-65302d59-bf47-478e-be2e-37920bc76542 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ea79159f-7356-4f48-9580-022aeae89fbe req-894f0210-acf7-4eb0-8437-150eb2d6fcab service nova] Acquiring lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ea79159f-7356-4f48-9580-022aeae89fbe req-894f0210-acf7-4eb0-8437-150eb2d6fcab service nova] Lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ea79159f-7356-4f48-9580-022aeae89fbe req-894f0210-acf7-4eb0-8437-150eb2d6fcab service nova] Lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG nova.compute.manager [req-ea79159f-7356-4f48-9580-022aeae89fbe req-894f0210-acf7-4eb0-8437-150eb2d6fcab service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] No waiting events found dispatching network-vif-plugged-65302d59-bf47-478e-be2e-37920bc76542 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:21:32 user nova-compute[72586]: WARNING nova.compute.manager [req-ea79159f-7356-4f48-9580-022aeae89fbe req-894f0210-acf7-4eb0-8437-150eb2d6fcab service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received unexpected event network-vif-plugged-65302d59-bf47-478e-be2e-37920bc76542 for instance with vm_state building and task_state spawning.
Aug 01 21:21:32 user nova-compute[72586]: DEBUG nova.compute.manager [req-ea79159f-7356-4f48-9580-022aeae89fbe req-894f0210-acf7-4eb0-8437-150eb2d6fcab service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received event network-vif-plugged-d823d714-835e-418a-85f2-e99504cc3f94 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ea79159f-7356-4f48-9580-022aeae89fbe req-894f0210-acf7-4eb0-8437-150eb2d6fcab service nova] Acquiring lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ea79159f-7356-4f48-9580-022aeae89fbe req-894f0210-acf7-4eb0-8437-150eb2d6fcab service nova] Lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ea79159f-7356-4f48-9580-022aeae89fbe req-894f0210-acf7-4eb0-8437-150eb2d6fcab service nova] Lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG nova.compute.manager [req-ea79159f-7356-4f48-9580-022aeae89fbe req-894f0210-acf7-4eb0-8437-150eb2d6fcab service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] No waiting events found dispatching network-vif-plugged-d823d714-835e-418a-85f2-e99504cc3f94 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:21:32 user nova-compute[72586]: WARNING nova.compute.manager [req-ea79159f-7356-4f48-9580-022aeae89fbe req-894f0210-acf7-4eb0-8437-150eb2d6fcab service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received unexpected event network-vif-plugged-d823d714-835e-418a-85f2-e99504cc3f94 for instance with vm_state building and task_state spawning.
Aug 01 21:21:32 user nova-compute[72586]: DEBUG nova.compute.manager [req-ea79159f-7356-4f48-9580-022aeae89fbe req-894f0210-acf7-4eb0-8437-150eb2d6fcab service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received event network-vif-plugged-d823d714-835e-418a-85f2-e99504cc3f94 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ea79159f-7356-4f48-9580-022aeae89fbe req-894f0210-acf7-4eb0-8437-150eb2d6fcab service nova] Acquiring lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ea79159f-7356-4f48-9580-022aeae89fbe req-894f0210-acf7-4eb0-8437-150eb2d6fcab service nova] Lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ea79159f-7356-4f48-9580-022aeae89fbe req-894f0210-acf7-4eb0-8437-150eb2d6fcab service nova] Lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG nova.compute.manager [req-ea79159f-7356-4f48-9580-022aeae89fbe req-894f0210-acf7-4eb0-8437-150eb2d6fcab service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] No waiting events found dispatching network-vif-plugged-d823d714-835e-418a-85f2-e99504cc3f94 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:21:32 user nova-compute[72586]: WARNING nova.compute.manager [req-ea79159f-7356-4f48-9580-022aeae89fbe req-894f0210-acf7-4eb0-8437-150eb2d6fcab service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received unexpected event network-vif-plugged-d823d714-835e-418a-85f2-e99504cc3f94 for instance with vm_state building and task_state spawning.
Aug 01 21:21:32 user nova-compute[72586]: DEBUG nova.compute.manager [req-90770f3c-ee9d-4086-9588-5d2b5517ecf4 req-4da251b7-2404-461a-94ab-fb48e266b0f2 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received event network-vif-plugged-3095c6ca-2bce-4216-9290-e1fc3fe17e03 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-90770f3c-ee9d-4086-9588-5d2b5517ecf4 req-4da251b7-2404-461a-94ab-fb48e266b0f2 service nova] Acquiring lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-90770f3c-ee9d-4086-9588-5d2b5517ecf4 req-4da251b7-2404-461a-94ab-fb48e266b0f2 service nova] Lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-90770f3c-ee9d-4086-9588-5d2b5517ecf4 req-4da251b7-2404-461a-94ab-fb48e266b0f2 service nova] Lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG nova.compute.manager [req-90770f3c-ee9d-4086-9588-5d2b5517ecf4 req-4da251b7-2404-461a-94ab-fb48e266b0f2 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] No waiting events found dispatching network-vif-plugged-3095c6ca-2bce-4216-9290-e1fc3fe17e03 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:21:32 user nova-compute[72586]: WARNING nova.compute.manager [req-90770f3c-ee9d-4086-9588-5d2b5517ecf4 req-4da251b7-2404-461a-94ab-fb48e266b0f2 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received unexpected event network-vif-plugged-3095c6ca-2bce-4216-9290-e1fc3fe17e03 for instance with vm_state building and task_state spawning.
Aug 01 21:21:32 user nova-compute[72586]: DEBUG nova.compute.manager [req-90770f3c-ee9d-4086-9588-5d2b5517ecf4 req-4da251b7-2404-461a-94ab-fb48e266b0f2 service nova] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Received event network-changed-a766e2fb-84bd-40c0-a6d7-cdd68b728cd9 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG nova.compute.manager [req-90770f3c-ee9d-4086-9588-5d2b5517ecf4 req-4da251b7-2404-461a-94ab-fb48e266b0f2 service nova] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Refreshing instance network info cache due to event network-changed-a766e2fb-84bd-40c0-a6d7-cdd68b728cd9. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-90770f3c-ee9d-4086-9588-5d2b5517ecf4 req-4da251b7-2404-461a-94ab-fb48e266b0f2 service nova] Acquiring lock "refresh_cache-eccf50b0-9acc-49b6-8044-601e47d18c38" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-90770f3c-ee9d-4086-9588-5d2b5517ecf4 req-4da251b7-2404-461a-94ab-fb48e266b0f2 service nova] Acquired lock "refresh_cache-eccf50b0-9acc-49b6-8044-601e47d18c38" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG nova.network.neutron [req-90770f3c-ee9d-4086-9588-5d2b5517ecf4 req-4da251b7-2404-461a-94ab-fb48e266b0f2 service nova] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Refreshing network info cache for port a766e2fb-84bd-40c0-a6d7-cdd68b728cd9 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG nova.compute.manager [req-a9deedbc-0566-418a-a1c3-375632ef5201 req-2e6052eb-c8fb-4381-8e71-77fbd6104623 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received event network-vif-plugged-abf0b845-110a-447f-b130-b1eeed139b29 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-a9deedbc-0566-418a-a1c3-375632ef5201 req-2e6052eb-c8fb-4381-8e71-77fbd6104623 service nova] Acquiring lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-a9deedbc-0566-418a-a1c3-375632ef5201 req-2e6052eb-c8fb-4381-8e71-77fbd6104623 service nova] Lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-a9deedbc-0566-418a-a1c3-375632ef5201 req-2e6052eb-c8fb-4381-8e71-77fbd6104623 service nova] Lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG nova.compute.manager [req-a9deedbc-0566-418a-a1c3-375632ef5201 req-2e6052eb-c8fb-4381-8e71-77fbd6104623 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] No waiting events found dispatching network-vif-plugged-abf0b845-110a-447f-b130-b1eeed139b29 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:21:32 user nova-compute[72586]: WARNING nova.compute.manager [req-a9deedbc-0566-418a-a1c3-375632ef5201 req-2e6052eb-c8fb-4381-8e71-77fbd6104623 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received unexpected event network-vif-plugged-abf0b845-110a-447f-b130-b1eeed139b29 for instance with vm_state building and task_state spawning.
Aug 01 21:21:32 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3421a31-448a-4cf1-90a7-6d059323a779 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Calling os-brick to attach iSCSI Volume {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3421a31-448a-4cf1-90a7-6d059323a779 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f1d31ce1-bf97-419c-a986-97c00a6f8ad7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dGSLKBlh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:21:32 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-e3421a31-448a-4cf1-90a7-6d059323a779 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:21:32 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-e3421a31-448a-4cf1-90a7-6d059323a779 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-e3421a31-448a-4cf1-90a7-6d059323a779 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:21:32 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-e3421a31-448a-4cf1-90a7-6d059323a779 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:21:32 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-e3421a31-448a-4cf1-90a7-6d059323a779 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1d31ce1-bf97-419c-a986-97c00a6f8ad7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-e3421a31-448a-4cf1-90a7-6d059323a779 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1d31ce1-bf97-419c-a986-97c00a6f8ad7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:21:32 user nova-compute[72586]: INFO os_brick.initiator.connectors.iscsi [None req-e3421a31-448a-4cf1-90a7-6d059323a779 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 21:21:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1d31ce1-bf97-419c-a986-97c00a6f8ad7 -p 172.16.0.220:3260 {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:32 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Instance spawned successfully.
Aug 01 21:21:32 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 21:21:32 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:21:32 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:21:32 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Hypervisor/Node resource view: name=user free_ram=7196MB free_disk=25.655128479003906GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72586) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1d31ce1-bf97-419c-a986-97c00a6f8ad7 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c238c9-12f6-444e-acf0-c64464853ce4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3421a31-448a-4cf1-90a7-6d059323a779 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 21:21:32 user nova-compute[72586]:  {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1d31ce1-bf97-419c-a986-97c00a6f8ad7 -p 172.16.0.220:3260 --interface default --op new {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:32 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:21:32 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690924891.7027493, 420cd648-f3bb-49b0-a731-d2e4337367f6 => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:21:32 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] VM Started (Lifecycle Event)
Aug 01 21:21:32 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Found default for hw_cdrom_bus of ide {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Found default for hw_disk_bus of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Found default for hw_input_bus of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Found default for hw_pointer_model of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Found default for hw_video_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Found default for hw_vif_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1d31ce1-bf97-419c-a986-97c00a6f8ad7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f8cd90-87f2-4f06-b0f5-2e9592011448]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1d31ce1-bf97-419c-a986-97c00a6f8ad7] added\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3421a31-448a-4cf1-90a7-6d059323a779 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1d31ce1-bf97-419c-a986-97c00a6f8ad7] added
Aug 01 21:21:32 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1d31ce1-bf97-419c-a986-97c00a6f8ad7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1d31ce1-bf97-419c-a986-97c00a6f8ad7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.036s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[8141e223-8b88-4c78-9074-0969bf04d436]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3421a31-448a-4cf1-90a7-6d059323a779 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1d31ce1-bf97-419c-a986-97c00a6f8ad7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:32 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:21:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1d31ce1-bf97-419c-a986-97c00a6f8ad7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.043s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:32 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[495048c6-835c-4e55-84d9-ea2f82e7662a]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:32 user nova-compute[72586]: INFO nova.compute.manager [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Took 14.33 seconds to spawn the instance on the hypervisor.
Aug 01 21:21:33 user nova-compute[72586]: DEBUG nova.compute.manager [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:21:33 user nova-compute[72586]: DEBUG nova.compute.manager [req-79bfc967-8df5-452a-87b8-d88f469738fe req-62e59a04-70ea-407e-a058-91afcb729610 service nova] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Received event network-changed-4a722ba3-a6e6-4e2f-963d-f4938bc14926 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:21:33 user nova-compute[72586]: DEBUG nova.compute.manager [req-79bfc967-8df5-452a-87b8-d88f469738fe req-62e59a04-70ea-407e-a058-91afcb729610 service nova] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Refreshing instance network info cache due to event network-changed-4a722ba3-a6e6-4e2f-963d-f4938bc14926. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:21:33 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-79bfc967-8df5-452a-87b8-d88f469738fe req-62e59a04-70ea-407e-a058-91afcb729610 service nova] Acquiring lock "refresh_cache-0fde640d-b731-405d-af91-fb4ef85fe90a" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:21:33 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-79bfc967-8df5-452a-87b8-d88f469738fe req-62e59a04-70ea-407e-a058-91afcb729610 service nova] Acquired lock "refresh_cache-0fde640d-b731-405d-af91-fb4ef85fe90a" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:21:33 user nova-compute[72586]: DEBUG nova.network.neutron [req-79bfc967-8df5-452a-87b8-d88f469738fe req-62e59a04-70ea-407e-a058-91afcb729610 service nova] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Refreshing network info cache for port 4a722ba3-a6e6-4e2f-963d-f4938bc14926 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:21:33 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3421a31-448a-4cf1-90a7-6d059323a779 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1d31ce1-bf97-419c-a986-97c00a6f8ad7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dGSLKBlh {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1d31ce1-bf97-419c-a986-97c00a6f8ad7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dGSLKBlh" returned: 0 in 0.049s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:33 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6fcc128-ca92-43a5-ab9e-7e64d9f39991]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:33 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3421a31-448a-4cf1-90a7-6d059323a779 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dGSLKBlh'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1d31ce1-bf97-419c-a986-97c00a6f8ad7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:33 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 042f0031-1e4d-41d0-8bfa-36001675cfe3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:21:33 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 98345340-5fb3-41fe-aea9-770cf4585e86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:21:33 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 413c3426-18ad-4a5c-af04-e0e7fc90f050 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:21:33 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance eccf50b0-9acc-49b6-8044-601e47d18c38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:21:33 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 0fde640d-b731-405d-af91-fb4ef85fe90a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:21:33 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 9197638d-0c03-4b4e-876a-003bd8db3c35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:21:33 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:21:33 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 34b640b7-1dec-4b31-b64b-f1dbee7f62f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:21:33 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 25fb970a-0caf-41e8-8d58-259dbd9cf291 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:21:33 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:21:33 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 420cd648-f3bb-49b0-a731-d2e4337367f6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:21:33 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 21:21:33 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 21:21:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1d31ce1-bf97-419c-a986-97c00a6f8ad7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:33 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[104f2db3-7124-4621-b8f0-b42767647d63]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:33 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3421a31-448a-4cf1-90a7-6d059323a779 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:33 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d19e92-c571-46a3-803e-67676aa5b722]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:33 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3421a31-448a-4cf1-90a7-6d059323a779 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)
Aug 01 21:21:33 user nova-compute[72586]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)
Aug 01 21:21:33 user nova-compute[72586]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)
Aug 01 21:21:33 user nova-compute[72586]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)
Aug 01 21:21:33 user nova-compute[72586]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)
Aug 01 21:21:33 user nova-compute[72586]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)
Aug 01 21:21:33 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:21:33 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3421a31-448a-4cf1-90a7-6d059323a779 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)
Aug 01 21:21:33 user nova-compute[72586]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)
Aug 01 21:21:33 user nova-compute[72586]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)
Aug 01 21:21:33 user nova-compute[72586]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)
Aug 01 21:21:33 user nova-compute[72586]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)
Aug 01 21:21:33 user nova-compute[72586]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)
Aug 01 21:21:33 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:21:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1d31ce1-bf97-419c-a986-97c00a6f8ad7 -p 172.16.0.220:3260 --login {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:33 user nova-compute[72586]: INFO nova.compute.manager [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Took 41.87 seconds to build instance.
Aug 01 21:21:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1d31ce1-bf97-419c-a986-97c00a6f8ad7 -p 172.16.0.220:3260 --login" returned: 0 in 0.107s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:33 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ef73c2-76c3-4b78-b29f-0481c081ca7d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1d31ce1-bf97-419c-a986-97c00a6f8ad7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f1d31ce1-bf97-419c-a986-97c00a6f8ad7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:33 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3421a31-448a-4cf1-90a7-6d059323a779 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1d31ce1-bf97-419c-a986-97c00a6f8ad7, portal: 172.16.0.220,3260]
Aug 01 21:21:33 user nova-compute[72586]: Login to [iface: default, target: iqn.2010-10.org.openstack:f1d31ce1-bf97-419c-a986-97c00a6f8ad7, portal: 172.16.0.220,3260] successful.
Aug 01 21:21:33 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1d31ce1-bf97-419c-a986-97c00a6f8ad7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:33 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-69a76172-d7f0-487e-88fa-26637cbb2163 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Lock "420cd648-f3bb-49b0-a731-d2e4337367f6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 42.013s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:21:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1d31ce1-bf97-419c-a986-97c00a6f8ad7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:33 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[88488287-a222-4457-a243-84a01cec8ef4]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:33 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3421a31-448a-4cf1-90a7-6d059323a779 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:33 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[2654c0ee-a88e-45f8-9f43-7f391c8382b9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1d31ce1-bf97-419c-a986-97c00a6f8ad7 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:33 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3421a31-448a-4cf1-90a7-6d059323a779 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)
Aug 01 21:21:33 user nova-compute[72586]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)
Aug 01 21:21:33 user nova-compute[72586]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)
Aug 01 21:21:33 user nova-compute[72586]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)
Aug 01 21:21:33 user nova-compute[72586]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)
Aug 01 21:21:33 user nova-compute[72586]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)
Aug 01 21:21:33 user nova-compute[72586]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1d31ce1-bf97-419c-a986-97c00a6f8ad7 (non-flash)
Aug 01 21:21:33 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:21:33 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3421a31-448a-4cf1-90a7-6d059323a779 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)
Aug 01 21:21:33 user nova-compute[72586]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)
Aug 01 21:21:33 user nova-compute[72586]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)
Aug 01 21:21:33 user nova-compute[72586]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)
Aug 01 21:21:33 user nova-compute[72586]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)
Aug 01 21:21:33 user nova-compute[72586]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)
Aug 01 21:21:33 user nova-compute[72586]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1d31ce1-bf97-419c-a986-97c00a6f8ad7 (non-flash)
Aug 01 21:21:33 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:21:33 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-e3421a31-448a-4cf1-90a7-6d059323a779 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1d31ce1-bf97-419c-a986-97c00a6f8ad7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.849s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:21:33 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3421a31-448a-4cf1-90a7-6d059323a779 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Connected to 172.16.0.220:3260 {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 21:21:33 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-e3421a31-448a-4cf1-90a7-6d059323a779 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=72586) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 21:21:33 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-e3421a31-448a-4cf1-90a7-6d059323a779 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72586) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 21:21:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:33 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59cf130-778b-4260-bc1b-c0e7c29abfa1]: (4, ('- - 0', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:33 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-e3421a31-448a-4cf1-90a7-6d059323a779 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:21:33 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3421a31-448a-4cf1-90a7-6d059323a779 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dGSLKBlh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 21:21:33 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:21:33 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:21:33 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Compute_service record updated for user:user {{(pid=72586) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 21:21:33 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.170s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:21:33 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:33 user nova-compute[72586]: DEBUG nova.network.neutron [req-79bfc967-8df5-452a-87b8-d88f469738fe req-62e59a04-70ea-407e-a058-91afcb729610 service nova] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Updated VIF entry in instance network info cache for port 4a722ba3-a6e6-4e2f-963d-f4938bc14926. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:21:33 user nova-compute[72586]: DEBUG nova.network.neutron [req-79bfc967-8df5-452a-87b8-d88f469738fe req-62e59a04-70ea-407e-a058-91afcb729610 service nova] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Updating instance_info_cache with network_info: [{"id": "4a722ba3-a6e6-4e2f-963d-f4938bc14926", "address": "fa:16:3e:f7:58:6a", "network": {"id": "d8cf5f10-6a59-4aa2-b8e8-b53932d3734e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1728024316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc531307652485c99598d21cacc2f93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a722ba3-a6", "ovs_interfaceid": "4a722ba3-a6e6-4e2f-963d-f4938bc14926", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:21:33 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-79bfc967-8df5-452a-87b8-d88f469738fe req-62e59a04-70ea-407e-a058-91afcb729610 service nova] Releasing lock "refresh_cache-0fde640d-b731-405d-af91-fb4ef85fe90a" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:21:34 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:21:34 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:21:34 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:21:34 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72586) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 21:21:34 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-e3421a31-448a-4cf1-90a7-6d059323a779 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.891s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:21:34 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3421a31-448a-4cf1-90a7-6d059323a779 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] <== connect_volume: return (1894ms) {'type': 'block', 'scsi_wwn': '23932313232353165', 'path': '/dev/sdh'} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:21:34 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3421a31-448a-4cf1-90a7-6d059323a779 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932313232353165', 'path': '/dev/sdh'} {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 21:21:34 user nova-compute[72586]: DEBUG nova.objects.instance [None req-e3421a31-448a-4cf1-90a7-6d059323a779 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Lazy-loading 'flavor' on Instance uuid 98345340-5fb3-41fe-aea9-770cf4585e86 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:21:34 user nova-compute[72586]: DEBUG nova.network.neutron [req-90770f3c-ee9d-4086-9588-5d2b5517ecf4 req-4da251b7-2404-461a-94ab-fb48e266b0f2 service nova] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Updated VIF entry in instance network info cache for port a766e2fb-84bd-40c0-a6d7-cdd68b728cd9. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:21:34 user nova-compute[72586]: DEBUG nova.network.neutron [req-90770f3c-ee9d-4086-9588-5d2b5517ecf4 req-4da251b7-2404-461a-94ab-fb48e266b0f2 service nova] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Updating instance_info_cache with network_info: [{"id": "a766e2fb-84bd-40c0-a6d7-cdd68b728cd9", "address": "fa:16:3e:fe:82:a2", "network": {"id": "a5da07bc-2f5d-461e-b31f-df624d9c6557", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948878141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae659e4ad43c44e2a8f6d48818bb796a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa766e2fb-84", "ovs_interfaceid": "a766e2fb-84bd-40c0-a6d7-cdd68b728cd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:21:34 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-90770f3c-ee9d-4086-9588-5d2b5517ecf4 req-4da251b7-2404-461a-94ab-fb48e266b0f2 service nova] Releasing lock "refresh_cache-eccf50b0-9acc-49b6-8044-601e47d18c38" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:21:34 user nova-compute[72586]: DEBUG nova.compute.manager [req-90770f3c-ee9d-4086-9588-5d2b5517ecf4 req-4da251b7-2404-461a-94ab-fb48e266b0f2 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received event network-vif-plugged-3095c6ca-2bce-4216-9290-e1fc3fe17e03 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:21:34 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-90770f3c-ee9d-4086-9588-5d2b5517ecf4 req-4da251b7-2404-461a-94ab-fb48e266b0f2 service nova] Acquiring lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:21:34 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-90770f3c-ee9d-4086-9588-5d2b5517ecf4 req-4da251b7-2404-461a-94ab-fb48e266b0f2 service nova] Lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:21:34 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-90770f3c-ee9d-4086-9588-5d2b5517ecf4 req-4da251b7-2404-461a-94ab-fb48e266b0f2 service nova] Lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:21:34 user nova-compute[72586]: DEBUG nova.compute.manager [req-90770f3c-ee9d-4086-9588-5d2b5517ecf4 req-4da251b7-2404-461a-94ab-fb48e266b0f2 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] No waiting events found dispatching network-vif-plugged-3095c6ca-2bce-4216-9290-e1fc3fe17e03 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:21:34 user nova-compute[72586]: WARNING nova.compute.manager [req-90770f3c-ee9d-4086-9588-5d2b5517ecf4 req-4da251b7-2404-461a-94ab-fb48e266b0f2 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received unexpected event network-vif-plugged-3095c6ca-2bce-4216-9290-e1fc3fe17e03 for instance with vm_state building and task_state spawning.
Aug 01 21:21:34 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-e3421a31-448a-4cf1-90a7-6d059323a779 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 21:21:34 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:21:34 user nova-compute[72586]:   <source dev="/dev/sdh"/>
Aug 01 21:21:34 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:21:34 user nova-compute[72586]:   <serial>f1d31ce1-bf97-419c-a986-97c00a6f8ad7</serial>
Aug 01 21:21:34 user nova-compute[72586]: </disk>
Aug 01 21:21:34 user nova-compute[72586]:  {{(pid=72586) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 21:21:35 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-e3421a31-448a-4cf1-90a7-6d059323a779 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:21:35 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-e3421a31-448a-4cf1-90a7-6d059323a779 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:21:35 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-e3421a31-448a-4cf1-90a7-6d059323a779 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] No VIF found with MAC fa:16:3e:6e:41:36, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:21:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-e3421a31-448a-4cf1-90a7-6d059323a779 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Lock "98345340-5fb3-41fe-aea9-770cf4585e86" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.467s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:21:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-cfd712ad-0b82-44ba-be48-b832bd283ecc tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Acquiring lock "eccf50b0-9acc-49b6-8044-601e47d18c38" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:21:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-cfd712ad-0b82-44ba-be48-b832bd283ecc tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "eccf50b0-9acc-49b6-8044-601e47d18c38" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.003s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:21:35 user nova-compute[72586]: INFO nova.compute.manager [None req-cfd712ad-0b82-44ba-be48-b832bd283ecc tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Shelving
Aug 01 21:21:35 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:35 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:35 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:35 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-13ec6bc0-b455-4436-b3fc-de829f30f399 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Acquiring lock "98345340-5fb3-41fe-aea9-770cf4585e86" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:21:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-13ec6bc0-b455-4436-b3fc-de829f30f399 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Lock "98345340-5fb3-41fe-aea9-770cf4585e86" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.006s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:21:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-13ec6bc0-b455-4436-b3fc-de829f30f399 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Acquiring lock "98345340-5fb3-41fe-aea9-770cf4585e86-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:21:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-13ec6bc0-b455-4436-b3fc-de829f30f399 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Lock "98345340-5fb3-41fe-aea9-770cf4585e86-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:21:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-13ec6bc0-b455-4436-b3fc-de829f30f399 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Lock "98345340-5fb3-41fe-aea9-770cf4585e86-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:21:35 user nova-compute[72586]: INFO nova.compute.manager [None req-13ec6bc0-b455-4436-b3fc-de829f30f399 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Terminating instance
Aug 01 21:21:35 user nova-compute[72586]: DEBUG nova.compute.manager [None req-13ec6bc0-b455-4436-b3fc-de829f30f399 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Start destroying the instance on the hypervisor. {{(pid=72586) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 21:21:35 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:35 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:36 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:36 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:36 user nova-compute[72586]: DEBUG nova.compute.manager [req-5230fb66-f527-4c50-a487-8111f16b8f8c req-40324f88-6c01-4b30-9c76-e38153a1df20 service nova] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Received event network-vif-unplugged-a766e2fb-84bd-40c0-a6d7-cdd68b728cd9 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:21:36 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-5230fb66-f527-4c50-a487-8111f16b8f8c req-40324f88-6c01-4b30-9c76-e38153a1df20 service nova] Acquiring lock "eccf50b0-9acc-49b6-8044-601e47d18c38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:21:36 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-5230fb66-f527-4c50-a487-8111f16b8f8c req-40324f88-6c01-4b30-9c76-e38153a1df20 service nova] Lock "eccf50b0-9acc-49b6-8044-601e47d18c38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:21:36 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-5230fb66-f527-4c50-a487-8111f16b8f8c req-40324f88-6c01-4b30-9c76-e38153a1df20 service nova] Lock "eccf50b0-9acc-49b6-8044-601e47d18c38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:21:36 user nova-compute[72586]: DEBUG nova.compute.manager [req-5230fb66-f527-4c50-a487-8111f16b8f8c req-40324f88-6c01-4b30-9c76-e38153a1df20 service nova] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] No waiting events found dispatching network-vif-unplugged-a766e2fb-84bd-40c0-a6d7-cdd68b728cd9 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:21:36 user nova-compute[72586]: WARNING nova.compute.manager [req-5230fb66-f527-4c50-a487-8111f16b8f8c req-40324f88-6c01-4b30-9c76-e38153a1df20 service nova] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Received unexpected event network-vif-unplugged-a766e2fb-84bd-40c0-a6d7-cdd68b728cd9 for instance with vm_state active and task_state shelving.
Aug 01 21:21:36 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Instance destroyed successfully.
Aug 01 21:21:36 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-cfd712ad-0b82-44ba-be48-b832bd283ecc tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Beginning cold snapshot process
Aug 01 21:21:36 user nova-compute[72586]: DEBUG nova.compute.manager [req-918f7d60-5267-46b8-82e3-b98d63ba372c req-d7a8acde-6e14-4f83-875d-b0c865a09ebb service nova] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Received event network-vif-unplugged-417d1712-68ee-4850-b806-09d69ba1716f {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:21:36 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-918f7d60-5267-46b8-82e3-b98d63ba372c req-d7a8acde-6e14-4f83-875d-b0c865a09ebb service nova] Acquiring lock "98345340-5fb3-41fe-aea9-770cf4585e86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:21:36 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-918f7d60-5267-46b8-82e3-b98d63ba372c req-d7a8acde-6e14-4f83-875d-b0c865a09ebb service nova] Lock "98345340-5fb3-41fe-aea9-770cf4585e86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:21:36 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-918f7d60-5267-46b8-82e3-b98d63ba372c req-d7a8acde-6e14-4f83-875d-b0c865a09ebb service nova] Lock "98345340-5fb3-41fe-aea9-770cf4585e86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:21:36 user nova-compute[72586]: DEBUG nova.compute.manager [req-918f7d60-5267-46b8-82e3-b98d63ba372c req-d7a8acde-6e14-4f83-875d-b0c865a09ebb service nova] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] No waiting events found dispatching network-vif-unplugged-417d1712-68ee-4850-b806-09d69ba1716f {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:21:36 user nova-compute[72586]: DEBUG nova.compute.manager [req-918f7d60-5267-46b8-82e3-b98d63ba372c req-d7a8acde-6e14-4f83-875d-b0c865a09ebb service nova] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Received event network-vif-unplugged-417d1712-68ee-4850-b806-09d69ba1716f for instance with task_state deleting. {{(pid=72586) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 21:21:36 user nova-compute[72586]: DEBUG nova.privsep.utils [None req-cfd712ad-0b82-44ba-be48-b832bd283ecc tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72586) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 21:21:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-cfd712ad-0b82-44ba-be48-b832bd283ecc tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/eccf50b0-9acc-49b6-8044-601e47d18c38/disk /opt/stack/data/nova/instances/snapshots/tmpumeuky1n/0791e1e748434bbaa21f1d2ca3619be9 {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:36 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Instance destroyed successfully.
Aug 01 21:21:36 user nova-compute[72586]: DEBUG nova.objects.instance [None req-13ec6bc0-b455-4436-b3fc-de829f30f399 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Lazy-loading 'resources' on Instance uuid 98345340-5fb3-41fe-aea9-770cf4585e86 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:21:36 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-13ec6bc0-b455-4436-b3fc-de829f30f399 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:19:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1462446557',display_name='tempest-DeleteServersTestJSON-server-1462446557',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1462446557',id=2,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:19:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='efcd910da4d747078f86eec98beea523',ramdisk_id='',reservation_id='r-rsqck9tm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-2041957045',owner_user_name='tempest-DeleteServersTestJSON-2041957045-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:19:43Z,user_data=None,user_id='df2af6a3f78c433790ebe6339a27f679',uuid=98345340-5fb3-41fe-aea9-770cf4585e86,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "417d1712-68ee-4850-b806-09d69ba1716f", "address": "fa:16:3e:6e:41:36", "network": {"id": "7e252667-8bb6-4657-9399-2026d81f4f07", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1441939601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efcd910da4d747078f86eec98beea523", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap417d1712-68", "ovs_interfaceid": "417d1712-68ee-4850-b806-09d69ba1716f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:21:36 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-13ec6bc0-b455-4436-b3fc-de829f30f399 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Converting VIF {"id": "417d1712-68ee-4850-b806-09d69ba1716f", "address": "fa:16:3e:6e:41:36", "network": {"id": "7e252667-8bb6-4657-9399-2026d81f4f07", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1441939601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efcd910da4d747078f86eec98beea523", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap417d1712-68", "ovs_interfaceid": "417d1712-68ee-4850-b806-09d69ba1716f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:21:36 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-13ec6bc0-b455-4436-b3fc-de829f30f399 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:41:36,bridge_name='br-int',has_traffic_filtering=True,id=417d1712-68ee-4850-b806-09d69ba1716f,network=Network(7e252667-8bb6-4657-9399-2026d81f4f07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap417d1712-68') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:21:36 user nova-compute[72586]: DEBUG os_vif [None req-13ec6bc0-b455-4436-b3fc-de829f30f399 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:41:36,bridge_name='br-int',has_traffic_filtering=True,id=417d1712-68ee-4850-b806-09d69ba1716f,network=Network(7e252667-8bb6-4657-9399-2026d81f4f07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap417d1712-68') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:21:36 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:36 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap417d1712-68, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:21:36 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:36 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:21:36 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:36 user nova-compute[72586]: INFO os_vif [None req-13ec6bc0-b455-4436-b3fc-de829f30f399 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:41:36,bridge_name='br-int',has_traffic_filtering=True,id=417d1712-68ee-4850-b806-09d69ba1716f,network=Network(7e252667-8bb6-4657-9399-2026d81f4f07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap417d1712-68')
Aug 01 21:21:36 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13ec6bc0-b455-4436-b3fc-de829f30f399 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] calling os-brick to detach iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 21:21:36 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-13ec6bc0-b455-4436-b3fc-de829f30f399 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, {'target_iqns': ['iqn.2010-10.org.openstack:f1d31ce1-bf97-419c-a986-97c00a6f8ad7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dGSLKBlh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:21:36 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-13ec6bc0-b455-4436-b3fc-de829f30f399 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:21:36 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-13ec6bc0-b455-4436-b3fc-de829f30f399 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:21:36 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-13ec6bc0-b455-4436-b3fc-de829f30f399 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:21:36 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-13ec6bc0-b455-4436-b3fc-de829f30f399 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1d31ce1-bf97-419c-a986-97c00a6f8ad7', 0)] {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 21:21:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:36 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[288bab6e-fc48-4034-9cfe-85ff2e3b198c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1d31ce1-bf97-419c-a986-97c00a6f8ad7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:36 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93708ce-cc68-41de-bdda-a95615a6967c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1d31ce1-bf97-419c-a986-97c00a6f8ad7 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:36 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-13ec6bc0-b455-4436-b3fc-de829f30f399 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)
Aug 01 21:21:36 user nova-compute[72586]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)
Aug 01 21:21:36 user nova-compute[72586]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)
Aug 01 21:21:36 user nova-compute[72586]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)
Aug 01 21:21:36 user nova-compute[72586]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)
Aug 01 21:21:36 user nova-compute[72586]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)
Aug 01 21:21:36 user nova-compute[72586]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1d31ce1-bf97-419c-a986-97c00a6f8ad7 (non-flash)
Aug 01 21:21:36 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:21:36 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-13ec6bc0-b455-4436-b3fc-de829f30f399 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)
Aug 01 21:21:36 user nova-compute[72586]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)
Aug 01 21:21:36 user nova-compute[72586]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)
Aug 01 21:21:36 user nova-compute[72586]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)
Aug 01 21:21:36 user nova-compute[72586]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)
Aug 01 21:21:36 user nova-compute[72586]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)
Aug 01 21:21:36 user nova-compute[72586]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1d31ce1-bf97-419c-a986-97c00a6f8ad7 (non-flash)
Aug 01 21:21:36 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:21:36 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-13ec6bc0-b455-4436-b3fc-de829f30f399 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ee81ed6c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1d31ce1-bf97-419c-a986-97c00a6f8ad7'): ({'sdh'}, set())}) {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 21:21:36 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-13ec6bc0-b455-4436-b3fc-de829f30f399 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Removing single pathed devices sdh {{(pid=72586) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 21:21:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:37 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[49978546-2b21-479b-b265-8d67d0455ee4]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.028s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:37 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80af871-020f-4c28-9ba5-dc1e5c4311a8]: (4, ('ok\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:37 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-13ec6bc0-b455-4436-b3fc-de829f30f399 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Flushing IO for device /dev/sdh {{(pid=72586) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 21:21:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.016s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:37 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[06507895-b2c4-4c3f-9776-d11eb9958b59]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:37 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-13ec6bc0-b455-4436-b3fc-de829f30f399 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72586) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 21:21:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.036s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:37 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[68304d2d-b9eb-48af-9c10-21a6cf90cf73]: (4, ('1', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:37 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-13ec6bc0-b455-4436-b3fc-de829f30f399 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 21:21:37 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-13ec6bc0-b455-4436-b3fc-de829f30f399 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] SCSI volumes sdh have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 21:21:37 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-13ec6bc0-b455-4436-b3fc-de829f30f399 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1d31ce1-bf97-419c-a986-97c00a6f8ad7')] {{(pid=72586) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 21:21:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1d31ce1-bf97-419c-a986-97c00a6f8ad7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1d31ce1-bf97-419c-a986-97c00a6f8ad7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:37 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[7752f25b-d72e-4359-a0bf-8f3c64e2afbf]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:37 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-13ec6bc0-b455-4436-b3fc-de829f30f399 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1d31ce1-bf97-419c-a986-97c00a6f8ad7 -p 172.16.0.220:3260 --logout {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1d31ce1-bf97-419c-a986-97c00a6f8ad7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:37 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0a7c6e-6262-4f47-8e60-8f4e39d45bd7]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:f1d31ce1-bf97-419c-a986-97c00a6f8ad7, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:f1d31ce1-bf97-419c-a986-97c00a6f8ad7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:37 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-13ec6bc0-b455-4436-b3fc-de829f30f399 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:f1d31ce1-bf97-419c-a986-97c00a6f8ad7, portal: 172.16.0.220,3260]
Aug 01 21:21:37 user nova-compute[72586]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:f1d31ce1-bf97-419c-a986-97c00a6f8ad7, portal: 172.16.0.220,3260] successful.
Aug 01 21:21:37 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1d31ce1-bf97-419c-a986-97c00a6f8ad7 -p 172.16.0.220:3260 --op delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1d31ce1-bf97-419c-a986-97c00a6f8ad7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:37 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a119c6-6c73-413b-90bf-ba0946bc1030]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:37 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-13ec6bc0-b455-4436-b3fc-de829f30f399 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:37 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-13ec6bc0-b455-4436-b3fc-de829f30f399 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:21:37 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-13ec6bc0-b455-4436-b3fc-de829f30f399 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] <== disconnect_volume: return (364ms) None {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:21:37 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13ec6bc0-b455-4436-b3fc-de829f30f399 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Disconnected iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 21:21:37 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-13ec6bc0-b455-4436-b3fc-de829f30f399 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Deleting instance files /opt/stack/data/nova/instances/98345340-5fb3-41fe-aea9-770cf4585e86_del
Aug 01 21:21:37 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-13ec6bc0-b455-4436-b3fc-de829f30f399 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Deletion of /opt/stack/data/nova/instances/98345340-5fb3-41fe-aea9-770cf4585e86_del complete
Aug 01 21:21:37 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-13ec6bc0-b455-4436-b3fc-de829f30f399 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Checking UEFI support for host arch (x86_64) {{(pid=72586) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 01 21:21:37 user nova-compute[72586]: INFO nova.virt.libvirt.host [None req-13ec6bc0-b455-4436-b3fc-de829f30f399 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] UEFI support detected
Aug 01 21:21:37 user nova-compute[72586]: INFO nova.compute.manager [None req-13ec6bc0-b455-4436-b3fc-de829f30f399 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Took 1.59 seconds to destroy the instance on the hypervisor.
Aug 01 21:21:37 user nova-compute[72586]: DEBUG oslo.service.loopingcall [None req-13ec6bc0-b455-4436-b3fc-de829f30f399 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72586) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 21:21:37 user nova-compute[72586]: DEBUG nova.compute.manager [-] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Deallocating network for instance {{(pid=72586) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 21:21:37 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] deallocate_for_instance() {{(pid=72586) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 21:21:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-cfd712ad-0b82-44ba-be48-b832bd283ecc tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/eccf50b0-9acc-49b6-8044-601e47d18c38/disk /opt/stack/data/nova/instances/snapshots/tmpumeuky1n/0791e1e748434bbaa21f1d2ca3619be9" returned: 0 in 1.190s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:37 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-cfd712ad-0b82-44ba-be48-b832bd283ecc tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Snapshot extracted, beginning image upload
Aug 01 21:21:38 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:21:38 user nova-compute[72586]: DEBUG nova.compute.manager [req-0458d450-83f2-4131-b17c-6cdae57b4be5 req-e39fbe57-db24-42cf-b9ae-bff70d4a9643 service nova] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Received event network-vif-plugged-a766e2fb-84bd-40c0-a6d7-cdd68b728cd9 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:21:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-0458d450-83f2-4131-b17c-6cdae57b4be5 req-e39fbe57-db24-42cf-b9ae-bff70d4a9643 service nova] Acquiring lock "eccf50b0-9acc-49b6-8044-601e47d18c38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:21:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-0458d450-83f2-4131-b17c-6cdae57b4be5 req-e39fbe57-db24-42cf-b9ae-bff70d4a9643 service nova] Lock "eccf50b0-9acc-49b6-8044-601e47d18c38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:21:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-0458d450-83f2-4131-b17c-6cdae57b4be5 req-e39fbe57-db24-42cf-b9ae-bff70d4a9643 service nova] Lock "eccf50b0-9acc-49b6-8044-601e47d18c38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:21:38 user nova-compute[72586]: DEBUG nova.compute.manager [req-0458d450-83f2-4131-b17c-6cdae57b4be5 req-e39fbe57-db24-42cf-b9ae-bff70d4a9643 service nova] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] No waiting events found dispatching network-vif-plugged-a766e2fb-84bd-40c0-a6d7-cdd68b728cd9 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:21:38 user nova-compute[72586]: WARNING nova.compute.manager [req-0458d450-83f2-4131-b17c-6cdae57b4be5 req-e39fbe57-db24-42cf-b9ae-bff70d4a9643 service nova] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Received unexpected event network-vif-plugged-a766e2fb-84bd-40c0-a6d7-cdd68b728cd9 for instance with vm_state active and task_state shelving_image_uploading.
Aug 01 21:21:38 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Took 0.84 seconds to deallocate network for instance.
Aug 01 21:21:38 user nova-compute[72586]: DEBUG nova.compute.manager [req-71635538-81cd-4d40-a6c5-e964b83ac711 req-5f90a1b2-d2e0-4a5f-9cdd-b9a5b2b7716f service nova] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Received event network-vif-deleted-417d1712-68ee-4850-b806-09d69ba1716f {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:21:38 user nova-compute[72586]: INFO nova.compute.manager [req-71635538-81cd-4d40-a6c5-e964b83ac711 req-5f90a1b2-d2e0-4a5f-9cdd-b9a5b2b7716f service nova] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Neutron deleted interface 417d1712-68ee-4850-b806-09d69ba1716f; detaching it from the instance and deleting it from the info cache
Aug 01 21:21:38 user nova-compute[72586]: DEBUG nova.network.neutron [req-71635538-81cd-4d40-a6c5-e964b83ac711 req-5f90a1b2-d2e0-4a5f-9cdd-b9a5b2b7716f service nova] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:21:38 user nova-compute[72586]: DEBUG nova.compute.manager [req-71635538-81cd-4d40-a6c5-e964b83ac711 req-5f90a1b2-d2e0-4a5f-9cdd-b9a5b2b7716f service nova] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Detach interface failed, port_id=417d1712-68ee-4850-b806-09d69ba1716f, reason: Instance 98345340-5fb3-41fe-aea9-770cf4585e86 could not be found. {{(pid=72586) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 21:21:38 user nova-compute[72586]: DEBUG nova.compute.manager [req-4eab0116-5c1f-4691-9784-101c6c476581 req-ac54279e-1231-4278-9679-05da852abfbc service nova] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Received event network-vif-plugged-417d1712-68ee-4850-b806-09d69ba1716f {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:21:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-4eab0116-5c1f-4691-9784-101c6c476581 req-ac54279e-1231-4278-9679-05da852abfbc service nova] Acquiring lock "98345340-5fb3-41fe-aea9-770cf4585e86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:21:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-4eab0116-5c1f-4691-9784-101c6c476581 req-ac54279e-1231-4278-9679-05da852abfbc service nova] Lock "98345340-5fb3-41fe-aea9-770cf4585e86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:21:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-4eab0116-5c1f-4691-9784-101c6c476581 req-ac54279e-1231-4278-9679-05da852abfbc service nova] Lock "98345340-5fb3-41fe-aea9-770cf4585e86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:21:38 user nova-compute[72586]: DEBUG nova.compute.manager [req-4eab0116-5c1f-4691-9784-101c6c476581 req-ac54279e-1231-4278-9679-05da852abfbc service nova] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] No waiting events found dispatching network-vif-plugged-417d1712-68ee-4850-b806-09d69ba1716f {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:21:38 user nova-compute[72586]: WARNING nova.compute.manager [req-4eab0116-5c1f-4691-9784-101c6c476581 req-ac54279e-1231-4278-9679-05da852abfbc service nova] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Received unexpected event network-vif-plugged-417d1712-68ee-4850-b806-09d69ba1716f for instance with vm_state active and task_state deleting.
Aug 01 21:21:38 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:39 user nova-compute[72586]: INFO nova.compute.manager [None req-13ec6bc0-b455-4436-b3fc-de829f30f399 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Took 0.92 seconds to detach 1 volumes for instance.
Aug 01 21:21:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-13ec6bc0-b455-4436-b3fc-de829f30f399 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:21:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-13ec6bc0-b455-4436-b3fc-de829f30f399 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:21:39 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-13ec6bc0-b455-4436-b3fc-de829f30f399 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:21:39 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-13ec6bc0-b455-4436-b3fc-de829f30f399 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:21:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-13ec6bc0-b455-4436-b3fc-de829f30f399 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.440s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:21:39 user nova-compute[72586]: INFO nova.scheduler.client.report [None req-13ec6bc0-b455-4436-b3fc-de829f30f399 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Deleted allocations for instance 98345340-5fb3-41fe-aea9-770cf4585e86
Aug 01 21:21:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-13ec6bc0-b455-4436-b3fc-de829f30f399 tempest-DeleteServersTestJSON-2041957045 tempest-DeleteServersTestJSON-2041957045-project-member] Lock "98345340-5fb3-41fe-aea9-770cf4585e86" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.097s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:21:40 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-cfd712ad-0b82-44ba-be48-b832bd283ecc tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Snapshot image upload complete
Aug 01 21:21:40 user nova-compute[72586]: DEBUG nova.compute.manager [None req-cfd712ad-0b82-44ba-be48-b832bd283ecc tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:21:40 user nova-compute[72586]: INFO nova.compute.manager [None req-cfd712ad-0b82-44ba-be48-b832bd283ecc tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Shelve offloading
Aug 01 21:21:40 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Instance destroyed successfully.
Aug 01 21:21:40 user nova-compute[72586]: DEBUG nova.compute.manager [None req-cfd712ad-0b82-44ba-be48-b832bd283ecc tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:21:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-cfd712ad-0b82-44ba-be48-b832bd283ecc tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Acquiring lock "refresh_cache-eccf50b0-9acc-49b6-8044-601e47d18c38" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:21:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-cfd712ad-0b82-44ba-be48-b832bd283ecc tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Acquired lock "refresh_cache-eccf50b0-9acc-49b6-8044-601e47d18c38" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:21:40 user nova-compute[72586]: DEBUG nova.network.neutron [None req-cfd712ad-0b82-44ba-be48-b832bd283ecc tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:21:41 user nova-compute[72586]: DEBUG nova.network.neutron [None req-cfd712ad-0b82-44ba-be48-b832bd283ecc tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Updating instance_info_cache with network_info: [{"id": "a766e2fb-84bd-40c0-a6d7-cdd68b728cd9", "address": "fa:16:3e:fe:82:a2", "network": {"id": "a5da07bc-2f5d-461e-b31f-df624d9c6557", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948878141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae659e4ad43c44e2a8f6d48818bb796a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa766e2fb-84", "ovs_interfaceid": "a766e2fb-84bd-40c0-a6d7-cdd68b728cd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:21:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-cfd712ad-0b82-44ba-be48-b832bd283ecc tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Releasing lock "refresh_cache-eccf50b0-9acc-49b6-8044-601e47d18c38" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:21:41 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:42 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Instance destroyed successfully.
Aug 01 21:21:42 user nova-compute[72586]: DEBUG nova.objects.instance [None req-cfd712ad-0b82-44ba-be48-b832bd283ecc tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lazy-loading 'resources' on Instance uuid eccf50b0-9acc-49b6-8044-601e47d18c38 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:21:42 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-cfd712ad-0b82-44ba-be48-b832bd283ecc tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:19:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1431613257',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1431613257',id=4,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAzEKXFXyPEjmIAPh8qhlm5PDtJ745fuzeyPBR5mURReQVRsVkj1Kaj9A+C0pWvsCvlNKTWjeyuZ2oyzNMfwG0yhQo8/3Rvrhu8rmxObx77lv5HbcJYhByjJ1JwrLFHn7w==',key_name='tempest-keypair-2087820494',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:19:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ae659e4ad43c44e2a8f6d48818bb796a',ramdisk_id='',reservation_id='r-kpiui11s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1935542868',owner_user_name='tempest-AttachVolumeShelveTestJSON-1935542868-project-member',shelved_at='2023-08-01T21:21:40.525441',shelved_host='user',shelved_image_id='b50f781a-5044-4423-8931-0cf905973972'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:21:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1a0d71c79c04216b9bf278f650aeb77',uuid=eccf50b0-9acc-49b6-8044-601e47d18c38,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "a766e2fb-84bd-40c0-a6d7-cdd68b728cd9", "address": "fa:16:3e:fe:82:a2", "network": {"id": "a5da07bc-2f5d-461e-b31f-df624d9c6557", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948878141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae659e4ad43c44e2a8f6d48818bb796a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa766e2fb-84", "ovs_interfaceid": "a766e2fb-84bd-40c0-a6d7-cdd68b728cd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:21:42 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-cfd712ad-0b82-44ba-be48-b832bd283ecc tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Converting VIF {"id": "a766e2fb-84bd-40c0-a6d7-cdd68b728cd9", "address": "fa:16:3e:fe:82:a2", "network": {"id": "a5da07bc-2f5d-461e-b31f-df624d9c6557", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948878141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae659e4ad43c44e2a8f6d48818bb796a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa766e2fb-84", "ovs_interfaceid": "a766e2fb-84bd-40c0-a6d7-cdd68b728cd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:21:42 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-cfd712ad-0b82-44ba-be48-b832bd283ecc tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:82:a2,bridge_name='br-int',has_traffic_filtering=True,id=a766e2fb-84bd-40c0-a6d7-cdd68b728cd9,network=Network(a5da07bc-2f5d-461e-b31f-df624d9c6557),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa766e2fb-84') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:21:42 user nova-compute[72586]: DEBUG os_vif [None req-cfd712ad-0b82-44ba-be48-b832bd283ecc tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:82:a2,bridge_name='br-int',has_traffic_filtering=True,id=a766e2fb-84bd-40c0-a6d7-cdd68b728cd9,network=Network(a5da07bc-2f5d-461e-b31f-df624d9c6557),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa766e2fb-84') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:21:42 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:42 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa766e2fb-84, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:21:42 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:42 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:21:42 user nova-compute[72586]: INFO os_vif [None req-cfd712ad-0b82-44ba-be48-b832bd283ecc tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:82:a2,bridge_name='br-int',has_traffic_filtering=True,id=a766e2fb-84bd-40c0-a6d7-cdd68b728cd9,network=Network(a5da07bc-2f5d-461e-b31f-df624d9c6557),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa766e2fb-84')
Aug 01 21:21:42 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-cfd712ad-0b82-44ba-be48-b832bd283ecc tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Deleting instance files /opt/stack/data/nova/instances/eccf50b0-9acc-49b6-8044-601e47d18c38_del
Aug 01 21:21:42 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-cfd712ad-0b82-44ba-be48-b832bd283ecc tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Deletion of /opt/stack/data/nova/instances/eccf50b0-9acc-49b6-8044-601e47d18c38_del complete
Aug 01 21:21:42 user nova-compute[72586]: DEBUG nova.compute.manager [req-f15e96b3-54aa-42d9-9a3f-14466d253b7b req-4608337b-c3f5-4ced-9281-0ae952b36910 service nova] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Received event network-changed-a766e2fb-84bd-40c0-a6d7-cdd68b728cd9 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:21:42 user nova-compute[72586]: DEBUG nova.compute.manager [req-f15e96b3-54aa-42d9-9a3f-14466d253b7b req-4608337b-c3f5-4ced-9281-0ae952b36910 service nova] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Refreshing instance network info cache due to event network-changed-a766e2fb-84bd-40c0-a6d7-cdd68b728cd9. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:21:42 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-f15e96b3-54aa-42d9-9a3f-14466d253b7b req-4608337b-c3f5-4ced-9281-0ae952b36910 service nova] Acquiring lock "refresh_cache-eccf50b0-9acc-49b6-8044-601e47d18c38" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:21:42 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-f15e96b3-54aa-42d9-9a3f-14466d253b7b req-4608337b-c3f5-4ced-9281-0ae952b36910 service nova] Acquired lock "refresh_cache-eccf50b0-9acc-49b6-8044-601e47d18c38" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:21:42 user nova-compute[72586]: DEBUG nova.network.neutron [req-f15e96b3-54aa-42d9-9a3f-14466d253b7b req-4608337b-c3f5-4ced-9281-0ae952b36910 service nova] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Refreshing network info cache for port a766e2fb-84bd-40c0-a6d7-cdd68b728cd9 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:21:42 user nova-compute[72586]: INFO nova.scheduler.client.report [None req-cfd712ad-0b82-44ba-be48-b832bd283ecc tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Deleted allocations for instance eccf50b0-9acc-49b6-8044-601e47d18c38
Aug 01 21:21:42 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-cfd712ad-0b82-44ba-be48-b832bd283ecc tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:21:42 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-cfd712ad-0b82-44ba-be48-b832bd283ecc tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:21:42 user nova-compute[72586]: DEBUG nova.objects.instance [None req-cfd712ad-0b82-44ba-be48-b832bd283ecc tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lazy-loading 'numa_topology' on Instance uuid eccf50b0-9acc-49b6-8044-601e47d18c38 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:21:42 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-cfd712ad-0b82-44ba-be48-b832bd283ecc tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:21:42 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-cfd712ad-0b82-44ba-be48-b832bd283ecc tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:21:42 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-cfd712ad-0b82-44ba-be48-b832bd283ecc tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.347s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:21:42 user nova-compute[72586]: DEBUG nova.network.neutron [req-f15e96b3-54aa-42d9-9a3f-14466d253b7b req-4608337b-c3f5-4ced-9281-0ae952b36910 service nova] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Updated VIF entry in instance network info cache for port a766e2fb-84bd-40c0-a6d7-cdd68b728cd9. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:21:42 user nova-compute[72586]: DEBUG nova.network.neutron [req-f15e96b3-54aa-42d9-9a3f-14466d253b7b req-4608337b-c3f5-4ced-9281-0ae952b36910 service nova] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Updating instance_info_cache with network_info: [{"id": "a766e2fb-84bd-40c0-a6d7-cdd68b728cd9", "address": "fa:16:3e:fe:82:a2", "network": {"id": "a5da07bc-2f5d-461e-b31f-df624d9c6557", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-948878141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae659e4ad43c44e2a8f6d48818bb796a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapa766e2fb-84", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:21:42 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-f15e96b3-54aa-42d9-9a3f-14466d253b7b req-4608337b-c3f5-4ced-9281-0ae952b36910 service nova] Releasing lock "refresh_cache-eccf50b0-9acc-49b6-8044-601e47d18c38" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:21:42 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-cfd712ad-0b82-44ba-be48-b832bd283ecc tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "eccf50b0-9acc-49b6-8044-601e47d18c38" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.201s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:21:43 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Acquiring lock "644c949c-3ac3-46ec-a62f-b38224f0a85c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:21:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Lock "644c949c-3ac3-46ec-a62f-b38224f0a85c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:21:45 user nova-compute[72586]: DEBUG nova.compute.manager [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Starting instance... {{(pid=72586) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 21:21:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:21:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:21:45 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72586) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 21:21:45 user nova-compute[72586]: INFO nova.compute.claims [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Claim successful on node user
Aug 01 21:21:46 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:21:46 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:21:46 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.601s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:21:46 user nova-compute[72586]: DEBUG nova.compute.manager [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Start building networks asynchronously for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 21:21:46 user nova-compute[72586]: DEBUG nova.compute.manager [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Allocating IP information in the background. {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 21:21:46 user nova-compute[72586]: DEBUG nova.network.neutron [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] allocate_for_instance() {{(pid=72586) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 21:21:46 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 21:21:46 user nova-compute[72586]: DEBUG nova.compute.manager [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Start building block device mappings for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 21:21:46 user nova-compute[72586]: INFO nova.virt.block_device [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Booting with volume 4a04f408-4471-4c55-8ba3-ac6f023f49bf at /dev/vda
Aug 01 21:21:46 user nova-compute[72586]: DEBUG nova.policy [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '89385b6c1686413db06c1c08a7c2e442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc531307652485c99598d21cacc2f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72586) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 21:21:46 user nova-compute[72586]: DEBUG os_brick.utils [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:21:46 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:46 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:46 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4a54ac-fe37-4c45-bf36-b005c06db395]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4bc202fb9cb\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:46 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:46 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.028s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:46 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e6d535-c4da-47ef-a2b0-e50acbb11d3b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:46 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:46 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:46 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf3489c-1eb1-4ca0-9579-ed6d8bdef925]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:46 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0bfcc08-3dd0-4523-8b89-509bcfe6eabd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:46 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Running cmd (subprocess): nvme version {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:46 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] 'nvme version' failed. Not Retrying. {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:21:46 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] nvme not present on system {{(pid=72586) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 21:21:46 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:46 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:21:46 user nova-compute[72586]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 21:21:46 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0835c3-6ae5-4b6a-b405-e4e44c5f6952]: (4, '') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:46 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72586) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 21:21:46 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 21:21:46 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] LIGHTOS: no hostnqn found. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 21:21:46 user nova-compute[72586]: DEBUG os_brick.utils [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] <== get_connector_properties: return (163ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4bc202fb9cb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:21:46 user nova-compute[72586]: DEBUG nova.virt.block_device [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Updating existing volume attachment record: 13031663-e787-4337-81ad-32ceb164a7be {{(pid=72586) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 21:21:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:47 user nova-compute[72586]: DEBUG nova.network.neutron [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Successfully created port: 8994785a-c6c5-4bb6-9709-4c1f802e47d6 {{(pid=72586) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 21:21:48 user nova-compute[72586]: DEBUG nova.network.neutron [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Successfully updated port: 8994785a-c6c5-4bb6-9709-4c1f802e47d6 {{(pid=72586) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 21:21:48 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Acquiring lock "refresh_cache-644c949c-3ac3-46ec-a62f-b38224f0a85c" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:21:48 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Acquired lock "refresh_cache-644c949c-3ac3-46ec-a62f-b38224f0a85c" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:21:48 user nova-compute[72586]: DEBUG nova.network.neutron [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:21:48 user nova-compute[72586]: DEBUG nova.compute.manager [req-1d083df6-03c2-497b-9f79-6bde53d7a85b req-b29775d6-1110-4c7f-be43-c0407de662dd service nova] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Received event network-changed-8994785a-c6c5-4bb6-9709-4c1f802e47d6 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:21:48 user nova-compute[72586]: DEBUG nova.compute.manager [req-1d083df6-03c2-497b-9f79-6bde53d7a85b req-b29775d6-1110-4c7f-be43-c0407de662dd service nova] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Refreshing instance network info cache due to event network-changed-8994785a-c6c5-4bb6-9709-4c1f802e47d6. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:21:48 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-1d083df6-03c2-497b-9f79-6bde53d7a85b req-b29775d6-1110-4c7f-be43-c0407de662dd service nova] Acquiring lock "refresh_cache-644c949c-3ac3-46ec-a62f-b38224f0a85c" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:21:48 user nova-compute[72586]: DEBUG nova.network.neutron [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Instance cache missing network info. {{(pid=72586) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 21:21:48 user nova-compute[72586]: DEBUG nova.network.neutron [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Updating instance_info_cache with network_info: [{"id": "8994785a-c6c5-4bb6-9709-4c1f802e47d6", "address": "fa:16:3e:b6:f1:83", "network": {"id": "d8cf5f10-6a59-4aa2-b8e8-b53932d3734e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1728024316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc531307652485c99598d21cacc2f93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8994785a-c6", "ovs_interfaceid": "8994785a-c6c5-4bb6-9709-4c1f802e47d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:21:48 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Releasing lock "refresh_cache-644c949c-3ac3-46ec-a62f-b38224f0a85c" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:21:48 user nova-compute[72586]: DEBUG nova.compute.manager [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Instance network_info: |[{"id": "8994785a-c6c5-4bb6-9709-4c1f802e47d6", "address": "fa:16:3e:b6:f1:83", "network": {"id": "d8cf5f10-6a59-4aa2-b8e8-b53932d3734e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1728024316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc531307652485c99598d21cacc2f93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8994785a-c6", "ovs_interfaceid": "8994785a-c6c5-4bb6-9709-4c1f802e47d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 21:21:48 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-1d083df6-03c2-497b-9f79-6bde53d7a85b req-b29775d6-1110-4c7f-be43-c0407de662dd service nova] Acquired lock "refresh_cache-644c949c-3ac3-46ec-a62f-b38224f0a85c" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:21:48 user nova-compute[72586]: DEBUG nova.network.neutron [req-1d083df6-03c2-497b-9f79-6bde53d7a85b req-b29775d6-1110-4c7f-be43-c0407de662dd service nova] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Refreshing network info cache for port 8994785a-c6c5-4bb6-9709-4c1f802e47d6 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:21:48 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:49 user nova-compute[72586]: DEBUG nova.network.neutron [req-1d083df6-03c2-497b-9f79-6bde53d7a85b req-b29775d6-1110-4c7f-be43-c0407de662dd service nova] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Updated VIF entry in instance network info cache for port 8994785a-c6c5-4bb6-9709-4c1f802e47d6. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:21:49 user nova-compute[72586]: DEBUG nova.network.neutron [req-1d083df6-03c2-497b-9f79-6bde53d7a85b req-b29775d6-1110-4c7f-be43-c0407de662dd service nova] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Updating instance_info_cache with network_info: [{"id": "8994785a-c6c5-4bb6-9709-4c1f802e47d6", "address": "fa:16:3e:b6:f1:83", "network": {"id": "d8cf5f10-6a59-4aa2-b8e8-b53932d3734e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1728024316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc531307652485c99598d21cacc2f93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8994785a-c6", "ovs_interfaceid": "8994785a-c6c5-4bb6-9709-4c1f802e47d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:21:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-1d083df6-03c2-497b-9f79-6bde53d7a85b req-b29775d6-1110-4c7f-be43-c0407de662dd service nova] Releasing lock "refresh_cache-644c949c-3ac3-46ec-a62f-b38224f0a85c" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:21:51 user nova-compute[72586]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690924896.1536393, eccf50b0-9acc-49b6-8044-601e47d18c38 => Stopped> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:21:51 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] VM Stopped (Lifecycle Event)
Aug 01 21:21:51 user nova-compute[72586]: DEBUG nova.compute.manager [None req-7b268948-098f-4dd2-b199-293d7afe027b None None] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:21:51 user nova-compute[72586]: DEBUG nova.compute.manager [req-9df47e60-bb69-43a8-8322-8c5095117df9 req-56c97137-4b37-4f5a-98e0-b2d236868475 service nova] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Received event network-changed-2c422520-a997-44b1-91dc-bfd781a5942d {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:21:51 user nova-compute[72586]: DEBUG nova.compute.manager [req-9df47e60-bb69-43a8-8322-8c5095117df9 req-56c97137-4b37-4f5a-98e0-b2d236868475 service nova] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Refreshing instance network info cache due to event network-changed-2c422520-a997-44b1-91dc-bfd781a5942d. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:21:51 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-9df47e60-bb69-43a8-8322-8c5095117df9 req-56c97137-4b37-4f5a-98e0-b2d236868475 service nova] Acquiring lock "refresh_cache-9197638d-0c03-4b4e-876a-003bd8db3c35" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:21:51 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-9df47e60-bb69-43a8-8322-8c5095117df9 req-56c97137-4b37-4f5a-98e0-b2d236868475 service nova] Acquired lock "refresh_cache-9197638d-0c03-4b4e-876a-003bd8db3c35" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:21:51 user nova-compute[72586]: DEBUG nova.network.neutron [req-9df47e60-bb69-43a8-8322-8c5095117df9 req-56c97137-4b37-4f5a-98e0-b2d236868475 service nova] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Refreshing network info cache for port 2c422520-a997-44b1-91dc-bfd781a5942d {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:21:51 user nova-compute[72586]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690924896.6587496, 98345340-5fb3-41fe-aea9-770cf4585e86 => Stopped> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:21:51 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] VM Stopped (Lifecycle Event)
Aug 01 21:21:51 user nova-compute[72586]: DEBUG nova.compute.manager [None req-d6279ffd-4a35-460f-9eaa-f590f8f50318 None None] [instance: 98345340-5fb3-41fe-aea9-770cf4585e86] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:21:52 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:52 user nova-compute[72586]: DEBUG nova.network.neutron [req-9df47e60-bb69-43a8-8322-8c5095117df9 req-56c97137-4b37-4f5a-98e0-b2d236868475 service nova] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Updated VIF entry in instance network info cache for port 2c422520-a997-44b1-91dc-bfd781a5942d. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:21:52 user nova-compute[72586]: DEBUG nova.network.neutron [req-9df47e60-bb69-43a8-8322-8c5095117df9 req-56c97137-4b37-4f5a-98e0-b2d236868475 service nova] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Updating instance_info_cache with network_info: [{"id": "2c422520-a997-44b1-91dc-bfd781a5942d", "address": "fa:16:3e:43:29:03", "network": {"id": "8e827e51-e845-4426-a503-c9885ce46971", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-638517071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efd1332e56dc4a158be5c285ce251f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c422520-a9", "ovs_interfaceid": "2c422520-a997-44b1-91dc-bfd781a5942d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:21:52 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-9df47e60-bb69-43a8-8322-8c5095117df9 req-56c97137-4b37-4f5a-98e0-b2d236868475 service nova] Releasing lock "refresh_cache-9197638d-0c03-4b4e-876a-003bd8db3c35" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:21:53 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:54 user nova-compute[72586]: DEBUG nova.compute.manager [req-3ff6be03-e7b9-4b62-a477-9810e07d2c5a req-fa12aa36-baab-4e71-ab8e-445b1a8fb360 service nova] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Received event network-changed-3a9c6772-38fc-4b17-9aee-089515b4a73e {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:21:54 user nova-compute[72586]: DEBUG nova.compute.manager [req-3ff6be03-e7b9-4b62-a477-9810e07d2c5a req-fa12aa36-baab-4e71-ab8e-445b1a8fb360 service nova] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Refreshing instance network info cache due to event network-changed-3a9c6772-38fc-4b17-9aee-089515b4a73e. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:21:54 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-3ff6be03-e7b9-4b62-a477-9810e07d2c5a req-fa12aa36-baab-4e71-ab8e-445b1a8fb360 service nova] Acquiring lock "refresh_cache-3830c8b3-27b8-45f3-bbdb-8a081dfcadc4" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:21:54 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-3ff6be03-e7b9-4b62-a477-9810e07d2c5a req-fa12aa36-baab-4e71-ab8e-445b1a8fb360 service nova] Acquired lock "refresh_cache-3830c8b3-27b8-45f3-bbdb-8a081dfcadc4" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:21:54 user nova-compute[72586]: DEBUG nova.network.neutron [req-3ff6be03-e7b9-4b62-a477-9810e07d2c5a req-fa12aa36-baab-4e71-ab8e-445b1a8fb360 service nova] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Refreshing network info cache for port 3a9c6772-38fc-4b17-9aee-089515b4a73e {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:21:54 user nova-compute[72586]: DEBUG nova.network.neutron [req-3ff6be03-e7b9-4b62-a477-9810e07d2c5a req-fa12aa36-baab-4e71-ab8e-445b1a8fb360 service nova] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Updated VIF entry in instance network info cache for port 3a9c6772-38fc-4b17-9aee-089515b4a73e. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:21:54 user nova-compute[72586]: DEBUG nova.network.neutron [req-3ff6be03-e7b9-4b62-a477-9810e07d2c5a req-fa12aa36-baab-4e71-ab8e-445b1a8fb360 service nova] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Updating instance_info_cache with network_info: [{"id": "3a9c6772-38fc-4b17-9aee-089515b4a73e", "address": "fa:16:3e:a5:91:07", "network": {"id": "198d348c-3661-477f-9e09-f9592f57c588", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1890713425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e128138ba483401895a8d8257d2a2600", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a9c6772-38", "ovs_interfaceid": "3a9c6772-38fc-4b17-9aee-089515b4a73e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:21:54 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-3ff6be03-e7b9-4b62-a477-9810e07d2c5a req-fa12aa36-baab-4e71-ab8e-445b1a8fb360 service nova] Releasing lock "refresh_cache-3830c8b3-27b8-45f3-bbdb-8a081dfcadc4" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:21:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-09c14a9b-1a00-4fc6-8310-7fd626503426 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Acquiring lock "9197638d-0c03-4b4e-876a-003bd8db3c35" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:21:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-09c14a9b-1a00-4fc6-8310-7fd626503426 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Lock "9197638d-0c03-4b4e-876a-003bd8db3c35" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:21:55 user nova-compute[72586]: DEBUG nova.objects.instance [None req-09c14a9b-1a00-4fc6-8310-7fd626503426 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Lazy-loading 'flavor' on Instance uuid 9197638d-0c03-4b4e-876a-003bd8db3c35 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:21:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-09c14a9b-1a00-4fc6-8310-7fd626503426 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Lock "9197638d-0c03-4b4e-876a-003bd8db3c35" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:21:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-09c14a9b-1a00-4fc6-8310-7fd626503426 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Acquiring lock "9197638d-0c03-4b4e-876a-003bd8db3c35" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:21:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-09c14a9b-1a00-4fc6-8310-7fd626503426 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Lock "9197638d-0c03-4b4e-876a-003bd8db3c35" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:21:55 user nova-compute[72586]: INFO nova.compute.manager [None req-09c14a9b-1a00-4fc6-8310-7fd626503426 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Attaching volume 508fdb07-368b-4561-bf47-5c1121c455ce to /dev/sdc
Aug 01 21:21:55 user nova-compute[72586]: DEBUG os_brick.utils [None req-09c14a9b-1a00-4fc6-8310-7fd626503426 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:21:55 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:55 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:55 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f495fa4e-5df5-45f5-a4ab-d7afba05d038]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4bc202fb9cb\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:55 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:55 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:55 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad46148c-0515-4caf-a166-4a869540a9d6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:55 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:55 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:55 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1883643c-714c-4abb-83e4-a80aac42ceea]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:55 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4d5eeb-36a8-4df3-aaf1-cc5d0442595c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:55 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-09c14a9b-1a00-4fc6-8310-7fd626503426 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Running cmd (subprocess): nvme version {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:55 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-09c14a9b-1a00-4fc6-8310-7fd626503426 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] 'nvme version' failed. Not Retrying. {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:21:55 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.nvmeof [None req-09c14a9b-1a00-4fc6-8310-7fd626503426 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] nvme not present on system {{(pid=72586) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 21:21:55 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:55 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:21:55 user nova-compute[72586]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 21:21:55 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d6213da-565f-487c-9d96-795aca91abcf]: (4, '') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:55 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-09c14a9b-1a00-4fc6-8310-7fd626503426 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72586) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 21:21:55 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-09c14a9b-1a00-4fc6-8310-7fd626503426 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 21:21:55 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-09c14a9b-1a00-4fc6-8310-7fd626503426 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] LIGHTOS: no hostnqn found. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 21:21:55 user nova-compute[72586]: DEBUG os_brick.utils [None req-09c14a9b-1a00-4fc6-8310-7fd626503426 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4bc202fb9cb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:21:55 user nova-compute[72586]: DEBUG nova.virt.block_device [None req-09c14a9b-1a00-4fc6-8310-7fd626503426 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Updating existing volume attachment record: 5cce8e5a-0ada-4cbd-b0f9-08ee09f82a90 {{(pid=72586) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG nova.compute.manager [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Start spawning the instance on the hypervisor. {{(pid=72586) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Creating instance directory {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 21:21:57 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Creating image(s)
Aug 01 21:21:57 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Did not create local disks {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Ensure instance console log exists: /opt/stack/data/nova/instances/644c949c-3ac3-46ec-a62f-b38224f0a85c/console.log {{(pid=72586) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Start _get_guest_xml network_info=[{"id": "8994785a-c6c5-4bb6-9709-4c1f802e47d6", "address": "fa:16:3e:b6:f1:83", "network": {"id": "d8cf5f10-6a59-4aa2-b8e8-b53932d3734e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1728024316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc531307652485c99598d21cacc2f93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8994785a-c6", "ovs_interfaceid": "8994785a-c6c5-4bb6-9709-4c1f802e47d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NiSdhavK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '644c949c-3ac3-46ec-a62f-b38224f0a85c', 'attached_at': '', 'detached_at': '', 'volume_id': '4a04f408-4471-4c55-8ba3-ac6f023f49bf', 'serial': '4a04f408-4471-4c55-8ba3-ac6f023f49bf'}, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '13031663-e787-4337-81ad-32ceb164a7be', 'delete_on_termination': True, 'volume_type': None} {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:21:57 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:21:57 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:21:57 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Calling os-brick to attach iSCSI Volume {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NiSdhavK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:21:57 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:21:57 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:21:57 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:21:57 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:21:57 user nova-compute[72586]: INFO os_brick.initiator.connectors.iscsi [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 21:21:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf -p 172.16.0.220:3260 {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcafc964-d66d-49ad-b6db-3cca5fdf3ae1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 21:21:57 user nova-compute[72586]:  {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf -p 172.16.0.220:3260 --interface default --op new {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf772f4-dd5d-40f0-8ebb-8a0c6b506562]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf] added\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf] added
Aug 01 21:21:57 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66af2c3-fe8a-407e-8e30-248702c2241a]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[56adddad-407f-4a69-a2bb-facb519854ec]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NiSdhavK {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NiSdhavK" returned: 0 in 0.023s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b41e14f-0a08-4b65-aca3-6df181c2d5a2]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NiSdhavK'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5655bd-5927-4864-905e-66ef673ca6d0]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[729d5642-58c3-454b-8862-8df1c96ba837]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)
Aug 01 21:21:57 user nova-compute[72586]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)
Aug 01 21:21:57 user nova-compute[72586]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)
Aug 01 21:21:57 user nova-compute[72586]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)
Aug 01 21:21:57 user nova-compute[72586]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)
Aug 01 21:21:57 user nova-compute[72586]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)
Aug 01 21:21:57 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)
Aug 01 21:21:57 user nova-compute[72586]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)
Aug 01 21:21:57 user nova-compute[72586]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)
Aug 01 21:21:57 user nova-compute[72586]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)
Aug 01 21:21:57 user nova-compute[72586]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)
Aug 01 21:21:57 user nova-compute[72586]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)
Aug 01 21:21:57 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf -p 172.16.0.220:3260 --login {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff796cb-ab94-4642-a0a3-9f190bf25c81]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf, portal: 172.16.0.220,3260]
Aug 01 21:21:57 user nova-compute[72586]: Login to [iface: default, target: iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf, portal: 172.16.0.220,3260] successful.
Aug 01 21:21:57 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0333ed93-eb07-4c8e-a6d9-28c34bbd46f9]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b2de21-d43b-4371-a81f-53dada570992]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)
Aug 01 21:21:57 user nova-compute[72586]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)
Aug 01 21:21:57 user nova-compute[72586]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)
Aug 01 21:21:57 user nova-compute[72586]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)
Aug 01 21:21:57 user nova-compute[72586]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)
Aug 01 21:21:57 user nova-compute[72586]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)
Aug 01 21:21:57 user nova-compute[72586]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)
Aug 01 21:21:57 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)
Aug 01 21:21:57 user nova-compute[72586]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)
Aug 01 21:21:57 user nova-compute[72586]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)
Aug 01 21:21:57 user nova-compute[72586]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)
Aug 01 21:21:57 user nova-compute[72586]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)
Aug 01 21:21:57 user nova-compute[72586]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)
Aug 01 21:21:57 user nova-compute[72586]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)
Aug 01 21:21:57 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Connected to 172.16.0.220:3260 {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=72586) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72586) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aed6e01-c429-4a36-ae16-341e0b9f2f5f]: (4, ('- - 0', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NiSdhavK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-18daca22-801c-420b-97a3-907363817589 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Acquiring lock "3830c8b3-27b8-45f3-bbdb-8a081dfcadc4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-18daca22-801c-420b-97a3-907363817589 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Lock "3830c8b3-27b8-45f3-bbdb-8a081dfcadc4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG nova.objects.instance [None req-18daca22-801c-420b-97a3-907363817589 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Lazy-loading 'flavor' on Instance uuid 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:21:57 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-18daca22-801c-420b-97a3-907363817589 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Lock "3830c8b3-27b8-45f3-bbdb-8a081dfcadc4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.083s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:21:58 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-18daca22-801c-420b-97a3-907363817589 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Acquiring lock "3830c8b3-27b8-45f3-bbdb-8a081dfcadc4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:21:58 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-18daca22-801c-420b-97a3-907363817589 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Lock "3830c8b3-27b8-45f3-bbdb-8a081dfcadc4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:21:58 user nova-compute[72586]: INFO nova.compute.manager [None req-18daca22-801c-420b-97a3-907363817589 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Attaching volume bafefb27-e9e8-4592-b90b-2cac437b9e7f to /dev/vdb
Aug 01 21:21:58 user nova-compute[72586]: DEBUG os_brick.utils [None req-18daca22-801c-420b-97a3-907363817589 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:21:58 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:58 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:58 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f5922fd-6a36-422b-b6fa-88831d7bc066]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4bc202fb9cb\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:58 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:58 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:58 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a3c63b-a02c-4242-b9a3-c7827fde6dfa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:58 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:58 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:21:58 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[564d2be6-a344-4095-a14e-158ac1ea7498]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:58 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a186475-c91c-45f2-8b11-d4d1ac82b25c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:58 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-18daca22-801c-420b-97a3-907363817589 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Running cmd (subprocess): nvme version {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:58 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-18daca22-801c-420b-97a3-907363817589 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] 'nvme version' failed. Not Retrying. {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:21:58 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.nvmeof [None req-18daca22-801c-420b-97a3-907363817589 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] nvme not present on system {{(pid=72586) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 21:21:58 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:21:58 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:21:58 user nova-compute[72586]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 21:21:58 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e91783b-3626-413a-aff2-b47d78d2935a]: (4, '') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:21:58 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-18daca22-801c-420b-97a3-907363817589 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72586) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 21:21:58 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-18daca22-801c-420b-97a3-907363817589 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 21:21:58 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-18daca22-801c-420b-97a3-907363817589 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] LIGHTOS: no hostnqn found. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 21:21:58 user nova-compute[72586]: DEBUG os_brick.utils [None req-18daca22-801c-420b-97a3-907363817589 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4bc202fb9cb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:21:58 user nova-compute[72586]: DEBUG nova.virt.block_device [None req-18daca22-801c-420b-97a3-907363817589 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Updating existing volume attachment record: 88d9458e-3fcc-433e-b882-afd8a23df71a {{(pid=72586) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 21:21:58 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:21:58 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '26236303839666638', 'path': '/dev/sdh'} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:21:58 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236303839666638', 'path': '/dev/sdh'} {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 21:21:58 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:21:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1632168252',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1632168252',id=12,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFN1pax4r2Rtmt0MkJzmJ/B3FoEGAYCOmWATKfk3X9qByC/jEbHy6mIDIfw7u2k/a61UypCjORkPhSH3mzITgt2N1Y/szofLIQYe2HUTFUXje2O0sR9hELC20XHTZIMgbQ==',key_name='tempest-keypair-16295814',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2fc531307652485c99598d21cacc2f93',ramdisk_id='',reservation_id='r-7sq1d2d0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-390719395',owner_user_name='tempest-ServerActionsV293TestJSON-390719395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:21:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89385b6c1686413db06c1c08a7c2e442',uuid=644c949c-3ac3-46ec-a62f-b38224f0a85c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8994785a-c6c5-4bb6-9709-4c1f802e47d6", "address": "fa:16:3e:b6:f1:83", "network": {"id": "d8cf5f10-6a59-4aa2-b8e8-b53932d3734e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1728024316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc531307652485c99598d21cacc2f93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8994785a-c6", "ovs_interfaceid": "8994785a-c6c5-4bb6-9709-4c1f802e47d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:21:58 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Converting VIF {"id": "8994785a-c6c5-4bb6-9709-4c1f802e47d6", "address": "fa:16:3e:b6:f1:83", "network": {"id": "d8cf5f10-6a59-4aa2-b8e8-b53932d3734e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1728024316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc531307652485c99598d21cacc2f93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8994785a-c6", "ovs_interfaceid": "8994785a-c6c5-4bb6-9709-4c1f802e47d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:21:58 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:f1:83,bridge_name='br-int',has_traffic_filtering=True,id=8994785a-c6c5-4bb6-9709-4c1f802e47d6,network=Network(d8cf5f10-6a59-4aa2-b8e8-b53932d3734e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8994785a-c6') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:21:58 user nova-compute[72586]: DEBUG nova.objects.instance [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Lazy-loading 'pci_devices' on Instance uuid 644c949c-3ac3-46ec-a62f-b38224f0a85c {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:21:58 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:21:58 user nova-compute[72586]:   <uuid>644c949c-3ac3-46ec-a62f-b38224f0a85c</uuid>
Aug 01 21:21:58 user nova-compute[72586]:   <name>instance-0000000c</name>
Aug 01 21:21:58 user nova-compute[72586]:   <memory>524288</memory>
Aug 01 21:21:58 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:21:58 user nova-compute[72586]:   <metadata>
Aug 01 21:21:58 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:21:58 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:21:58 user nova-compute[72586]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1632168252</nova:name>
Aug 01 21:21:58 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:21:57</nova:creationTime>
Aug 01 21:21:58 user nova-compute[72586]:       <nova:flavor name="m1.tiny">
Aug 01 21:21:58 user nova-compute[72586]:         <nova:memory>512</nova:memory>
Aug 01 21:21:58 user nova-compute[72586]:         <nova:disk>1</nova:disk>
Aug 01 21:21:58 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:21:58 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:21:58 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:21:58 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:21:58 user nova-compute[72586]:       <nova:owner>
Aug 01 21:21:58 user nova-compute[72586]:         <nova:user uuid="89385b6c1686413db06c1c08a7c2e442">tempest-ServerActionsV293TestJSON-390719395-project-member</nova:user>
Aug 01 21:21:58 user nova-compute[72586]:         <nova:project uuid="2fc531307652485c99598d21cacc2f93">tempest-ServerActionsV293TestJSON-390719395</nova:project>
Aug 01 21:21:58 user nova-compute[72586]:       </nova:owner>
Aug 01 21:21:58 user nova-compute[72586]:       <nova:ports>
Aug 01 21:21:58 user nova-compute[72586]:         <nova:port uuid="8994785a-c6c5-4bb6-9709-4c1f802e47d6">
Aug 01 21:21:58 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 01 21:21:58 user nova-compute[72586]:         </nova:port>
Aug 01 21:21:58 user nova-compute[72586]:       </nova:ports>
Aug 01 21:21:58 user nova-compute[72586]:     </nova:instance>
Aug 01 21:21:58 user nova-compute[72586]:   </metadata>
Aug 01 21:21:58 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:21:58 user nova-compute[72586]:     <system>
Aug 01 21:21:58 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:21:58 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:21:58 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:21:58 user nova-compute[72586]:       <entry name="serial">644c949c-3ac3-46ec-a62f-b38224f0a85c</entry>
Aug 01 21:21:58 user nova-compute[72586]:       <entry name="uuid">644c949c-3ac3-46ec-a62f-b38224f0a85c</entry>
Aug 01 21:21:58 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:21:58 user nova-compute[72586]:     </system>
Aug 01 21:21:58 user nova-compute[72586]:   </sysinfo>
Aug 01 21:21:58 user nova-compute[72586]:   <os>
Aug 01 21:21:58 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:21:58 user nova-compute[72586]:     <boot dev="hd"/>
Aug 01 21:21:58 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:21:58 user nova-compute[72586]:   </os>
Aug 01 21:21:58 user nova-compute[72586]:   <features>
Aug 01 21:21:58 user nova-compute[72586]:     <acpi/>
Aug 01 21:21:58 user nova-compute[72586]:     <apic/>
Aug 01 21:21:58 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:21:58 user nova-compute[72586]:   </features>
Aug 01 21:21:58 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:21:58 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:21:58 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:21:58 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:21:58 user nova-compute[72586]:   </clock>
Aug 01 21:21:58 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:21:58 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:21:58 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:21:58 user nova-compute[72586]:   </cpu>
Aug 01 21:21:58 user nova-compute[72586]:   <devices>
Aug 01 21:21:58 user nova-compute[72586]:     <disk type="block" device="disk">
Aug 01 21:21:58 user nova-compute[72586]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:21:58 user nova-compute[72586]:       <source dev="/dev/sdh"/>
Aug 01 21:21:58 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:21:58 user nova-compute[72586]:       <serial>4a04f408-4471-4c55-8ba3-ac6f023f49bf</serial>
Aug 01 21:21:58 user nova-compute[72586]:     </disk>
Aug 01 21:21:58 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:21:58 user nova-compute[72586]:       <mac address="fa:16:3e:b6:f1:83"/>
Aug 01 21:21:58 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:21:58 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:21:58 user nova-compute[72586]:       <target dev="tap8994785a-c6"/>
Aug 01 21:21:58 user nova-compute[72586]:     </interface>
Aug 01 21:21:58 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:21:58 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/644c949c-3ac3-46ec-a62f-b38224f0a85c/console.log" append="off"/>
Aug 01 21:21:58 user nova-compute[72586]:     </serial>
Aug 01 21:21:58 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:21:58 user nova-compute[72586]:     <video>
Aug 01 21:21:58 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:21:58 user nova-compute[72586]:     </video>
Aug 01 21:21:58 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:21:58 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:21:58 user nova-compute[72586]:     </rng>
Aug 01 21:21:58 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:21:58 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:21:58 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:21:58 user nova-compute[72586]:     </memballoon>
Aug 01 21:21:58 user nova-compute[72586]:   </devices>
Aug 01 21:21:58 user nova-compute[72586]: </domain>
Aug 01 21:21:58 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:21:58 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:21:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1632168252',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1632168252',id=12,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFN1pax4r2Rtmt0MkJzmJ/B3FoEGAYCOmWATKfk3X9qByC/jEbHy6mIDIfw7u2k/a61UypCjORkPhSH3mzITgt2N1Y/szofLIQYe2HUTFUXje2O0sR9hELC20XHTZIMgbQ==',key_name='tempest-keypair-16295814',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2fc531307652485c99598d21cacc2f93',ramdisk_id='',reservation_id='r-7sq1d2d0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-390719395',owner_user_name='tempest-ServerActionsV293TestJSON-390719395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:21:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89385b6c1686413db06c1c08a7c2e442',uuid=644c949c-3ac3-46ec-a62f-b38224f0a85c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8994785a-c6c5-4bb6-9709-4c1f802e47d6", "address": "fa:16:3e:b6:f1:83", "network": {"id": "d8cf5f10-6a59-4aa2-b8e8-b53932d3734e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1728024316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc531307652485c99598d21cacc2f93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8994785a-c6", "ovs_interfaceid": "8994785a-c6c5-4bb6-9709-4c1f802e47d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:21:58 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Converting VIF {"id": "8994785a-c6c5-4bb6-9709-4c1f802e47d6", "address": "fa:16:3e:b6:f1:83", "network": {"id": "d8cf5f10-6a59-4aa2-b8e8-b53932d3734e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1728024316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc531307652485c99598d21cacc2f93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8994785a-c6", "ovs_interfaceid": "8994785a-c6c5-4bb6-9709-4c1f802e47d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:21:58 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:f1:83,bridge_name='br-int',has_traffic_filtering=True,id=8994785a-c6c5-4bb6-9709-4c1f802e47d6,network=Network(d8cf5f10-6a59-4aa2-b8e8-b53932d3734e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8994785a-c6') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:21:58 user nova-compute[72586]: DEBUG os_vif [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:f1:83,bridge_name='br-int',has_traffic_filtering=True,id=8994785a-c6c5-4bb6-9709-4c1f802e47d6,network=Network(d8cf5f10-6a59-4aa2-b8e8-b53932d3734e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8994785a-c6') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:21:58 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:58 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:21:58 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:21:58 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:58 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8994785a-c6, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:21:58 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8994785a-c6, col_values=(('external_ids', {'iface-id': '8994785a-c6c5-4bb6-9709-4c1f802e47d6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:f1:83', 'vm-uuid': '644c949c-3ac3-46ec-a62f-b38224f0a85c'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:21:58 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:58 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:21:58 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:58 user nova-compute[72586]: INFO os_vif [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:f1:83,bridge_name='br-int',has_traffic_filtering=True,id=8994785a-c6c5-4bb6-9709-4c1f802e47d6,network=Network(d8cf5f10-6a59-4aa2-b8e8-b53932d3734e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8994785a-c6')
Aug 01 21:21:58 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:21:58 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] No VIF found with MAC fa:16:3e:b6:f1:83, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:21:58 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:59 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:59 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:21:59 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:00 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:00 user nova-compute[72586]: DEBUG nova.compute.manager [req-09f83c5d-6dbc-4cb6-9b79-b5e9a7206427 req-5a29ef3c-ddd4-4aa0-9039-26e06b3672ad service nova] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Received event network-changed-1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:22:00 user nova-compute[72586]: DEBUG nova.compute.manager [req-09f83c5d-6dbc-4cb6-9b79-b5e9a7206427 req-5a29ef3c-ddd4-4aa0-9039-26e06b3672ad service nova] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Refreshing instance network info cache due to event network-changed-1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:22:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-09f83c5d-6dbc-4cb6-9b79-b5e9a7206427 req-5a29ef3c-ddd4-4aa0-9039-26e06b3672ad service nova] Acquiring lock "refresh_cache-34b640b7-1dec-4b31-b64b-f1dbee7f62f6" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:22:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-09f83c5d-6dbc-4cb6-9b79-b5e9a7206427 req-5a29ef3c-ddd4-4aa0-9039-26e06b3672ad service nova] Acquired lock "refresh_cache-34b640b7-1dec-4b31-b64b-f1dbee7f62f6" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:22:00 user nova-compute[72586]: DEBUG nova.network.neutron [req-09f83c5d-6dbc-4cb6-9b79-b5e9a7206427 req-5a29ef3c-ddd4-4aa0-9039-26e06b3672ad service nova] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Refreshing network info cache for port 1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:22:00 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:00 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:00 user nova-compute[72586]: DEBUG nova.compute.manager [req-3797f1c6-41fd-4ece-bd13-41243bb2743e req-f9dbbfe5-7992-4093-8598-ec4a28875330 service nova] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Received event network-vif-plugged-8994785a-c6c5-4bb6-9709-4c1f802e47d6 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:22:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-3797f1c6-41fd-4ece-bd13-41243bb2743e req-f9dbbfe5-7992-4093-8598-ec4a28875330 service nova] Acquiring lock "644c949c-3ac3-46ec-a62f-b38224f0a85c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:22:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-3797f1c6-41fd-4ece-bd13-41243bb2743e req-f9dbbfe5-7992-4093-8598-ec4a28875330 service nova] Lock "644c949c-3ac3-46ec-a62f-b38224f0a85c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:22:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-3797f1c6-41fd-4ece-bd13-41243bb2743e req-f9dbbfe5-7992-4093-8598-ec4a28875330 service nova] Lock "644c949c-3ac3-46ec-a62f-b38224f0a85c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:22:00 user nova-compute[72586]: DEBUG nova.compute.manager [req-3797f1c6-41fd-4ece-bd13-41243bb2743e req-f9dbbfe5-7992-4093-8598-ec4a28875330 service nova] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] No waiting events found dispatching network-vif-plugged-8994785a-c6c5-4bb6-9709-4c1f802e47d6 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:22:00 user nova-compute[72586]: WARNING nova.compute.manager [req-3797f1c6-41fd-4ece-bd13-41243bb2743e req-f9dbbfe5-7992-4093-8598-ec4a28875330 service nova] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Received unexpected event network-vif-plugged-8994785a-c6c5-4bb6-9709-4c1f802e47d6 for instance with vm_state building and task_state spawning.
Aug 01 21:22:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-6af5c5f8-092a-4265-aa52-406b1372223f tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Acquiring lock "interface-34b640b7-1dec-4b31-b64b-f1dbee7f62f6-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:22:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-6af5c5f8-092a-4265-aa52-406b1372223f tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Lock "interface-34b640b7-1dec-4b31-b64b-f1dbee7f62f6-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:22:00 user nova-compute[72586]: DEBUG nova.objects.instance [None req-6af5c5f8-092a-4265-aa52-406b1372223f tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Lazy-loading 'flavor' on Instance uuid 34b640b7-1dec-4b31-b64b-f1dbee7f62f6 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:22:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1bb880c4-a665-47a2-834d-264c834e8133 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Acquiring lock "25fb970a-0caf-41e8-8d58-259dbd9cf291" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:22:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1bb880c4-a665-47a2-834d-264c834e8133 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Lock "25fb970a-0caf-41e8-8d58-259dbd9cf291" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:22:00 user nova-compute[72586]: DEBUG nova.objects.instance [None req-1bb880c4-a665-47a2-834d-264c834e8133 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Lazy-loading 'flavor' on Instance uuid 25fb970a-0caf-41e8-8d58-259dbd9cf291 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:22:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1bb880c4-a665-47a2-834d-264c834e8133 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Lock "25fb970a-0caf-41e8-8d58-259dbd9cf291" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:22:00 user nova-compute[72586]: DEBUG nova.network.neutron [req-09f83c5d-6dbc-4cb6-9b79-b5e9a7206427 req-5a29ef3c-ddd4-4aa0-9039-26e06b3672ad service nova] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Updated VIF entry in instance network info cache for port 1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:22:00 user nova-compute[72586]: DEBUG nova.network.neutron [req-09f83c5d-6dbc-4cb6-9b79-b5e9a7206427 req-5a29ef3c-ddd4-4aa0-9039-26e06b3672ad service nova] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Updating instance_info_cache with network_info: [{"id": "1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a", "address": "fa:16:3e:1b:58:f6", "network": {"id": "869076ac-07a1-49eb-9912-83f396d5b66d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2019500958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbe1daeb21ad4628841cbf8406131a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c85a8b5-9e", "ovs_interfaceid": "1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:22:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-09f83c5d-6dbc-4cb6-9b79-b5e9a7206427 req-5a29ef3c-ddd4-4aa0-9039-26e06b3672ad service nova] Releasing lock "refresh_cache-34b640b7-1dec-4b31-b64b-f1dbee7f62f6" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:22:00 user nova-compute[72586]: DEBUG nova.objects.instance [None req-6af5c5f8-092a-4265-aa52-406b1372223f tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Lazy-loading 'pci_requests' on Instance uuid 34b640b7-1dec-4b31-b64b-f1dbee7f62f6 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:22:00 user nova-compute[72586]: DEBUG nova.network.neutron [None req-6af5c5f8-092a-4265-aa52-406b1372223f tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] allocate_for_instance() {{(pid=72586) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 21:22:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1bb880c4-a665-47a2-834d-264c834e8133 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Acquiring lock "25fb970a-0caf-41e8-8d58-259dbd9cf291" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:22:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1bb880c4-a665-47a2-834d-264c834e8133 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Lock "25fb970a-0caf-41e8-8d58-259dbd9cf291" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:22:00 user nova-compute[72586]: INFO nova.compute.manager [None req-1bb880c4-a665-47a2-834d-264c834e8133 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Attaching volume e83d4aa1-7fe5-415e-96fc-4e413114e225 to /dev/vdb
Aug 01 21:22:01 user nova-compute[72586]: DEBUG nova.policy [None req-6af5c5f8-092a-4265-aa52-406b1372223f tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '25edfd4907cf4d6c816799babd01e662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe1daeb21ad4628841cbf8406131a88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72586) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 21:22:01 user nova-compute[72586]: DEBUG os_brick.utils [None req-1bb880c4-a665-47a2-834d-264c834e8133 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:22:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:01 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a19f982-6eb3-4510-a309-337a3d5fecec]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4bc202fb9cb\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:01 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3705811-ed59-4ab0-8f23-54870fdd79db]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:01 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a20bc8-0ab8-4c46-a3a6-a92f54427638]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:01 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17d2fe5-9c61-4cb3-888a-2e99c7b3dd53]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-1bb880c4-a665-47a2-834d-264c834e8133 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Running cmd (subprocess): nvme version {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-1bb880c4-a665-47a2-834d-264c834e8133 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] 'nvme version' failed. Not Retrying. {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:22:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1bb880c4-a665-47a2-834d-264c834e8133 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] nvme not present on system {{(pid=72586) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 21:22:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:22:01 user nova-compute[72586]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 21:22:01 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9878a2-562f-4379-b68b-07608aaba12f]: (4, '') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-1bb880c4-a665-47a2-834d-264c834e8133 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72586) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 21:22:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-1bb880c4-a665-47a2-834d-264c834e8133 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 21:22:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-1bb880c4-a665-47a2-834d-264c834e8133 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] LIGHTOS: no hostnqn found. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 21:22:01 user nova-compute[72586]: DEBUG os_brick.utils [None req-1bb880c4-a665-47a2-834d-264c834e8133 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4bc202fb9cb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:22:01 user nova-compute[72586]: DEBUG nova.virt.block_device [None req-1bb880c4-a665-47a2-834d-264c834e8133 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Updating existing volume attachment record: e4ec5e71-01b4-445c-9e4d-1d46e920feab {{(pid=72586) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 21:22:01 user nova-compute[72586]: DEBUG nova.network.neutron [None req-6af5c5f8-092a-4265-aa52-406b1372223f tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Successfully created port: 03e03a20-d14a-4605-ad03-adb3411a1d85 {{(pid=72586) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 21:22:02 user nova-compute[72586]: DEBUG nova.compute.manager [req-ed2591b1-e5c5-4184-9e49-3ba8a6eedcce req-17c75035-b6aa-4124-b28e-931d5fb6d598 service nova] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Received event network-changed-91634168-0e3d-42db-b0f4-af85d2673762 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:22:02 user nova-compute[72586]: DEBUG nova.compute.manager [req-ed2591b1-e5c5-4184-9e49-3ba8a6eedcce req-17c75035-b6aa-4124-b28e-931d5fb6d598 service nova] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Refreshing instance network info cache due to event network-changed-91634168-0e3d-42db-b0f4-af85d2673762. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:22:02 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ed2591b1-e5c5-4184-9e49-3ba8a6eedcce req-17c75035-b6aa-4124-b28e-931d5fb6d598 service nova] Acquiring lock "refresh_cache-25fb970a-0caf-41e8-8d58-259dbd9cf291" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:22:02 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ed2591b1-e5c5-4184-9e49-3ba8a6eedcce req-17c75035-b6aa-4124-b28e-931d5fb6d598 service nova] Acquired lock "refresh_cache-25fb970a-0caf-41e8-8d58-259dbd9cf291" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:22:02 user nova-compute[72586]: DEBUG nova.network.neutron [req-ed2591b1-e5c5-4184-9e49-3ba8a6eedcce req-17c75035-b6aa-4124-b28e-931d5fb6d598 service nova] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Refreshing network info cache for port 91634168-0e3d-42db-b0f4-af85d2673762 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:22:02 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690924922.5090775, 644c949c-3ac3-46ec-a62f-b38224f0a85c => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:22:02 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] VM Resumed (Lifecycle Event)
Aug 01 21:22:02 user nova-compute[72586]: DEBUG nova.compute.manager [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Instance event wait completed in 0 seconds for  {{(pid=72586) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 21:22:02 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Guest created on hypervisor {{(pid=72586) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 21:22:02 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Instance spawned successfully.
Aug 01 21:22:02 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 21:22:02 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:22:02 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:22:02 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Found default for hw_cdrom_bus of ide {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:22:02 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Found default for hw_disk_bus of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:22:02 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Found default for hw_input_bus of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:22:02 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Found default for hw_pointer_model of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:22:02 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Found default for hw_video_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:22:02 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Found default for hw_vif_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:22:02 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:22:02 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690924922.5094016, 644c949c-3ac3-46ec-a62f-b38224f0a85c => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:22:02 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] VM Started (Lifecycle Event)
Aug 01 21:22:02 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:22:02 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:22:02 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:22:02 user nova-compute[72586]: INFO nova.compute.manager [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Took 5.57 seconds to spawn the instance on the hypervisor.
Aug 01 21:22:02 user nova-compute[72586]: DEBUG nova.compute.manager [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:22:02 user nova-compute[72586]: DEBUG nova.network.neutron [None req-6af5c5f8-092a-4265-aa52-406b1372223f tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Successfully updated port: 03e03a20-d14a-4605-ad03-adb3411a1d85 {{(pid=72586) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 21:22:02 user nova-compute[72586]: INFO nova.compute.manager [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Took 17.19 seconds to build instance.
Aug 01 21:22:02 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-6af5c5f8-092a-4265-aa52-406b1372223f tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Acquiring lock "refresh_cache-34b640b7-1dec-4b31-b64b-f1dbee7f62f6" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:22:02 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-6af5c5f8-092a-4265-aa52-406b1372223f tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Acquired lock "refresh_cache-34b640b7-1dec-4b31-b64b-f1dbee7f62f6" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:22:02 user nova-compute[72586]: DEBUG nova.network.neutron [None req-6af5c5f8-092a-4265-aa52-406b1372223f tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:22:02 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c5471936-41eb-43d8-9109-26b77d82c3ac tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Lock "644c949c-3ac3-46ec-a62f-b38224f0a85c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.453s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:22:03 user nova-compute[72586]: DEBUG nova.network.neutron [req-ed2591b1-e5c5-4184-9e49-3ba8a6eedcce req-17c75035-b6aa-4124-b28e-931d5fb6d598 service nova] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Updated VIF entry in instance network info cache for port 91634168-0e3d-42db-b0f4-af85d2673762. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:22:03 user nova-compute[72586]: DEBUG nova.network.neutron [req-ed2591b1-e5c5-4184-9e49-3ba8a6eedcce req-17c75035-b6aa-4124-b28e-931d5fb6d598 service nova] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Updating instance_info_cache with network_info: [{"id": "91634168-0e3d-42db-b0f4-af85d2673762", "address": "fa:16:3e:a0:ef:27", "network": {"id": "3df6057c-0dba-4e06-bfe5-4df929c74a85", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2011731775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80dd67d749d04409923cd9b64691b638", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91634168-0e", "ovs_interfaceid": "91634168-0e3d-42db-b0f4-af85d2673762", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:22:03 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ed2591b1-e5c5-4184-9e49-3ba8a6eedcce req-17c75035-b6aa-4124-b28e-931d5fb6d598 service nova] Releasing lock "refresh_cache-25fb970a-0caf-41e8-8d58-259dbd9cf291" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:22:03 user nova-compute[72586]: DEBUG nova.compute.manager [req-ed2591b1-e5c5-4184-9e49-3ba8a6eedcce req-17c75035-b6aa-4124-b28e-931d5fb6d598 service nova] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Received event network-vif-plugged-8994785a-c6c5-4bb6-9709-4c1f802e47d6 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:22:03 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ed2591b1-e5c5-4184-9e49-3ba8a6eedcce req-17c75035-b6aa-4124-b28e-931d5fb6d598 service nova] Acquiring lock "644c949c-3ac3-46ec-a62f-b38224f0a85c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:22:03 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ed2591b1-e5c5-4184-9e49-3ba8a6eedcce req-17c75035-b6aa-4124-b28e-931d5fb6d598 service nova] Lock "644c949c-3ac3-46ec-a62f-b38224f0a85c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:22:03 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ed2591b1-e5c5-4184-9e49-3ba8a6eedcce req-17c75035-b6aa-4124-b28e-931d5fb6d598 service nova] Lock "644c949c-3ac3-46ec-a62f-b38224f0a85c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:22:03 user nova-compute[72586]: DEBUG nova.compute.manager [req-ed2591b1-e5c5-4184-9e49-3ba8a6eedcce req-17c75035-b6aa-4124-b28e-931d5fb6d598 service nova] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] No waiting events found dispatching network-vif-plugged-8994785a-c6c5-4bb6-9709-4c1f802e47d6 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:22:03 user nova-compute[72586]: WARNING nova.compute.manager [req-ed2591b1-e5c5-4184-9e49-3ba8a6eedcce req-17c75035-b6aa-4124-b28e-931d5fb6d598 service nova] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Received unexpected event network-vif-plugged-8994785a-c6c5-4bb6-9709-4c1f802e47d6 for instance with vm_state building and task_state spawning.
Aug 01 21:22:03 user nova-compute[72586]: DEBUG nova.network.neutron [None req-6af5c5f8-092a-4265-aa52-406b1372223f tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Updating instance_info_cache with network_info: [{"id": "1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a", "address": "fa:16:3e:1b:58:f6", "network": {"id": "869076ac-07a1-49eb-9912-83f396d5b66d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2019500958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbe1daeb21ad4628841cbf8406131a88", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c85a8b5-9e", "ovs_interfaceid": "1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "03e03a20-d14a-4605-ad03-adb3411a1d85", "address": "fa:16:3e:eb:a0:ea", "network": {"id": "8714a7f9-0535-4183-a3b0-5c85f6bdbd21", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-704681534", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fbe1daeb21ad4628841cbf8406131a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03e03a20-d1", "ovs_interfaceid": "03e03a20-d14a-4605-ad03-adb3411a1d85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:22:03 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-6af5c5f8-092a-4265-aa52-406b1372223f tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Releasing lock "refresh_cache-34b640b7-1dec-4b31-b64b-f1dbee7f62f6" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:22:03 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-6af5c5f8-092a-4265-aa52-406b1372223f tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T21:20:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1746161852',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1746161852',id=8,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPKzYl7JBQVoZJNm+4i5JYdGUIIrqn01ZBx9Dxn59EM/3bkIAv2U6qz+jMD9EtD+pH0t0lwSsBe6DmGDRqmtPx9+g58b8uj/ol6c7hfvBYUh2jxk2AjOzIXFtbR5OZW2WA==',key_name='tempest-keypair-1235433569',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:20:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fbe1daeb21ad4628841cbf8406131a88',ramdisk_id='',reservation_id='r-5lrvjzh8',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2000096306',owner_user_name='tempest-TaggedAttachmentsTest-2000096306-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:20:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25edfd4907cf4d6c816799babd01e662',uuid=34b640b7-1dec-4b31-b64b-f1dbee7f62f6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "03e03a20-d14a-4605-ad03-adb3411a1d85", "address": "fa:16:3e:eb:a0:ea", "network": {"id": "8714a7f9-0535-4183-a3b0-5c85f6bdbd21", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-704681534", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fbe1daeb21ad4628841cbf8406131a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03e03a20-d1", "ovs_interfaceid": "03e03a20-d14a-4605-ad03-adb3411a1d85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:22:03 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-6af5c5f8-092a-4265-aa52-406b1372223f tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Converting VIF {"id": "03e03a20-d14a-4605-ad03-adb3411a1d85", "address": "fa:16:3e:eb:a0:ea", "network": {"id": "8714a7f9-0535-4183-a3b0-5c85f6bdbd21", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-704681534", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fbe1daeb21ad4628841cbf8406131a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03e03a20-d1", "ovs_interfaceid": "03e03a20-d14a-4605-ad03-adb3411a1d85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:22:03 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-6af5c5f8-092a-4265-aa52-406b1372223f tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:a0:ea,bridge_name='br-int',has_traffic_filtering=True,id=03e03a20-d14a-4605-ad03-adb3411a1d85,network=Network(8714a7f9-0535-4183-a3b0-5c85f6bdbd21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03e03a20-d1') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:22:03 user nova-compute[72586]: DEBUG os_vif [None req-6af5c5f8-092a-4265-aa52-406b1372223f tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:a0:ea,bridge_name='br-int',has_traffic_filtering=True,id=03e03a20-d14a-4605-ad03-adb3411a1d85,network=Network(8714a7f9-0535-4183-a3b0-5c85f6bdbd21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03e03a20-d1') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:22:03 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:03 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:22:03 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:22:03 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:03 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap03e03a20-d1, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:22:03 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap03e03a20-d1, col_values=(('external_ids', {'iface-id': '03e03a20-d14a-4605-ad03-adb3411a1d85', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:a0:ea', 'vm-uuid': '34b640b7-1dec-4b31-b64b-f1dbee7f62f6'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:22:03 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:03 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:22:03 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:03 user nova-compute[72586]: INFO os_vif [None req-6af5c5f8-092a-4265-aa52-406b1372223f tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:a0:ea,bridge_name='br-int',has_traffic_filtering=True,id=03e03a20-d14a-4605-ad03-adb3411a1d85,network=Network(8714a7f9-0535-4183-a3b0-5c85f6bdbd21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03e03a20-d1')
Aug 01 21:22:03 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-6af5c5f8-092a-4265-aa52-406b1372223f tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T21:20:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1746161852',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1746161852',id=8,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPKzYl7JBQVoZJNm+4i5JYdGUIIrqn01ZBx9Dxn59EM/3bkIAv2U6qz+jMD9EtD+pH0t0lwSsBe6DmGDRqmtPx9+g58b8uj/ol6c7hfvBYUh2jxk2AjOzIXFtbR5OZW2WA==',key_name='tempest-keypair-1235433569',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:20:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fbe1daeb21ad4628841cbf8406131a88',ramdisk_id='',reservation_id='r-5lrvjzh8',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2000096306',owner_user_name='tempest-TaggedAttachmentsTest-2000096306-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:20:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25edfd4907cf4d6c816799babd01e662',uuid=34b640b7-1dec-4b31-b64b-f1dbee7f62f6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "03e03a20-d14a-4605-ad03-adb3411a1d85", "address": "fa:16:3e:eb:a0:ea", "network": {"id": "8714a7f9-0535-4183-a3b0-5c85f6bdbd21", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-704681534", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fbe1daeb21ad4628841cbf8406131a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03e03a20-d1", "ovs_interfaceid": "03e03a20-d14a-4605-ad03-adb3411a1d85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:22:03 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-6af5c5f8-092a-4265-aa52-406b1372223f tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Converting VIF {"id": "03e03a20-d14a-4605-ad03-adb3411a1d85", "address": "fa:16:3e:eb:a0:ea", "network": {"id": "8714a7f9-0535-4183-a3b0-5c85f6bdbd21", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-704681534", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fbe1daeb21ad4628841cbf8406131a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03e03a20-d1", "ovs_interfaceid": "03e03a20-d14a-4605-ad03-adb3411a1d85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:22:03 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-6af5c5f8-092a-4265-aa52-406b1372223f tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:a0:ea,bridge_name='br-int',has_traffic_filtering=True,id=03e03a20-d14a-4605-ad03-adb3411a1d85,network=Network(8714a7f9-0535-4183-a3b0-5c85f6bdbd21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03e03a20-d1') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:22:03 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-6af5c5f8-092a-4265-aa52-406b1372223f tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] attach device xml: <interface type="ethernet">
Aug 01 21:22:03 user nova-compute[72586]:   <mac address="fa:16:3e:eb:a0:ea"/>
Aug 01 21:22:03 user nova-compute[72586]:   <model type="virtio"/>
Aug 01 21:22:03 user nova-compute[72586]:   <mtu size="1442"/>
Aug 01 21:22:03 user nova-compute[72586]:   <target dev="tap03e03a20-d1"/>
Aug 01 21:22:03 user nova-compute[72586]: </interface>
Aug 01 21:22:03 user nova-compute[72586]:  {{(pid=72586) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 21:22:03 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:03 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:03 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:03 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:04 user nova-compute[72586]: DEBUG nova.compute.manager [req-577e9f44-ebd3-4574-89fa-95cff8a0b511 req-7812d671-0a1a-40da-a360-7daf526762ef service nova] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Received event network-vif-plugged-03e03a20-d14a-4605-ad03-adb3411a1d85 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:22:04 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-577e9f44-ebd3-4574-89fa-95cff8a0b511 req-7812d671-0a1a-40da-a360-7daf526762ef service nova] Acquiring lock "34b640b7-1dec-4b31-b64b-f1dbee7f62f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:22:04 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-577e9f44-ebd3-4574-89fa-95cff8a0b511 req-7812d671-0a1a-40da-a360-7daf526762ef service nova] Lock "34b640b7-1dec-4b31-b64b-f1dbee7f62f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:22:04 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-577e9f44-ebd3-4574-89fa-95cff8a0b511 req-7812d671-0a1a-40da-a360-7daf526762ef service nova] Lock "34b640b7-1dec-4b31-b64b-f1dbee7f62f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:22:04 user nova-compute[72586]: DEBUG nova.compute.manager [req-577e9f44-ebd3-4574-89fa-95cff8a0b511 req-7812d671-0a1a-40da-a360-7daf526762ef service nova] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] No waiting events found dispatching network-vif-plugged-03e03a20-d14a-4605-ad03-adb3411a1d85 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:22:04 user nova-compute[72586]: WARNING nova.compute.manager [req-577e9f44-ebd3-4574-89fa-95cff8a0b511 req-7812d671-0a1a-40da-a360-7daf526762ef service nova] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Received unexpected event network-vif-plugged-03e03a20-d14a-4605-ad03-adb3411a1d85 for instance with vm_state active and task_state None.
Aug 01 21:22:04 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-6af5c5f8-092a-4265-aa52-406b1372223f tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:22:04 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-6af5c5f8-092a-4265-aa52-406b1372223f tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] No BDM found with device name hda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:22:04 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-6af5c5f8-092a-4265-aa52-406b1372223f tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] No VIF found with MAC fa:16:3e:1b:58:f6, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:22:04 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-6af5c5f8-092a-4265-aa52-406b1372223f tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:22:04 user nova-compute[72586]:   <nova:package version="0.0.0"/>
Aug 01 21:22:04 user nova-compute[72586]:   <nova:name>tempest-device-tagging-server-1746161852</nova:name>
Aug 01 21:22:04 user nova-compute[72586]:   <nova:creationTime>2023-08-01 21:22:04</nova:creationTime>
Aug 01 21:22:04 user nova-compute[72586]:   <nova:flavor name="m1.tiny">
Aug 01 21:22:04 user nova-compute[72586]:     <nova:memory>512</nova:memory>
Aug 01 21:22:04 user nova-compute[72586]:     <nova:disk>1</nova:disk>
Aug 01 21:22:04 user nova-compute[72586]:     <nova:swap>0</nova:swap>
Aug 01 21:22:04 user nova-compute[72586]:     <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:22:04 user nova-compute[72586]:     <nova:vcpus>1</nova:vcpus>
Aug 01 21:22:04 user nova-compute[72586]:   </nova:flavor>
Aug 01 21:22:04 user nova-compute[72586]:   <nova:owner>
Aug 01 21:22:04 user nova-compute[72586]:     <nova:user uuid="25edfd4907cf4d6c816799babd01e662">tempest-TaggedAttachmentsTest-2000096306-project-member</nova:user>
Aug 01 21:22:04 user nova-compute[72586]:     <nova:project uuid="fbe1daeb21ad4628841cbf8406131a88">tempest-TaggedAttachmentsTest-2000096306</nova:project>
Aug 01 21:22:04 user nova-compute[72586]:   </nova:owner>
Aug 01 21:22:04 user nova-compute[72586]:   <nova:root type="image" uuid="0243d46b-6819-42a5-926f-42b71f0c97ad"/>
Aug 01 21:22:04 user nova-compute[72586]:   <nova:ports>
Aug 01 21:22:04 user nova-compute[72586]:     <nova:port uuid="1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a">
Aug 01 21:22:04 user nova-compute[72586]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 01 21:22:04 user nova-compute[72586]:     </nova:port>
Aug 01 21:22:04 user nova-compute[72586]:     <nova:port uuid="03e03a20-d14a-4605-ad03-adb3411a1d85">
Aug 01 21:22:04 user nova-compute[72586]:       <nova:ip type="fixed" address="10.10.10.27" ipVersion="4"/>
Aug 01 21:22:04 user nova-compute[72586]:     </nova:port>
Aug 01 21:22:04 user nova-compute[72586]:   </nova:ports>
Aug 01 21:22:04 user nova-compute[72586]: </nova:instance>
Aug 01 21:22:04 user nova-compute[72586]:  {{(pid=72586) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 01 21:22:04 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-6af5c5f8-092a-4265-aa52-406b1372223f tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Lock "interface-34b640b7-1dec-4b31-b64b-f1dbee7f62f6-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.643s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:22:04 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:04 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:04 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:04 user nova-compute[72586]: DEBUG nova.compute.manager [req-0567f433-adaa-4984-9ff9-6e5c309e1ff0 req-36bc6c1a-c0e6-4473-8f40-55865bc08e95 service nova] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Received event network-changed-03e03a20-d14a-4605-ad03-adb3411a1d85 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:22:04 user nova-compute[72586]: DEBUG nova.compute.manager [req-0567f433-adaa-4984-9ff9-6e5c309e1ff0 req-36bc6c1a-c0e6-4473-8f40-55865bc08e95 service nova] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Refreshing instance network info cache due to event network-changed-03e03a20-d14a-4605-ad03-adb3411a1d85. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:22:04 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-0567f433-adaa-4984-9ff9-6e5c309e1ff0 req-36bc6c1a-c0e6-4473-8f40-55865bc08e95 service nova] Acquiring lock "refresh_cache-34b640b7-1dec-4b31-b64b-f1dbee7f62f6" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:22:04 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-0567f433-adaa-4984-9ff9-6e5c309e1ff0 req-36bc6c1a-c0e6-4473-8f40-55865bc08e95 service nova] Acquired lock "refresh_cache-34b640b7-1dec-4b31-b64b-f1dbee7f62f6" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:22:04 user nova-compute[72586]: DEBUG nova.network.neutron [req-0567f433-adaa-4984-9ff9-6e5c309e1ff0 req-36bc6c1a-c0e6-4473-8f40-55865bc08e95 service nova] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Refreshing network info cache for port 03e03a20-d14a-4605-ad03-adb3411a1d85 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:22:04 user nova-compute[72586]: DEBUG nova.network.neutron [req-0567f433-adaa-4984-9ff9-6e5c309e1ff0 req-36bc6c1a-c0e6-4473-8f40-55865bc08e95 service nova] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Updated VIF entry in instance network info cache for port 03e03a20-d14a-4605-ad03-adb3411a1d85. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:22:04 user nova-compute[72586]: DEBUG nova.network.neutron [req-0567f433-adaa-4984-9ff9-6e5c309e1ff0 req-36bc6c1a-c0e6-4473-8f40-55865bc08e95 service nova] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Updating instance_info_cache with network_info: [{"id": "1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a", "address": "fa:16:3e:1b:58:f6", "network": {"id": "869076ac-07a1-49eb-9912-83f396d5b66d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2019500958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbe1daeb21ad4628841cbf8406131a88", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c85a8b5-9e", "ovs_interfaceid": "1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "03e03a20-d14a-4605-ad03-adb3411a1d85", "address": "fa:16:3e:eb:a0:ea", "network": {"id": "8714a7f9-0535-4183-a3b0-5c85f6bdbd21", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-704681534", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fbe1daeb21ad4628841cbf8406131a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03e03a20-d1", "ovs_interfaceid": "03e03a20-d14a-4605-ad03-adb3411a1d85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:22:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-0567f433-adaa-4984-9ff9-6e5c309e1ff0 req-36bc6c1a-c0e6-4473-8f40-55865bc08e95 service nova] Releasing lock "refresh_cache-34b640b7-1dec-4b31-b64b-f1dbee7f62f6" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:22:05 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09c14a9b-1a00-4fc6-8310-7fd626503426 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Calling os-brick to attach iSCSI Volume {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 21:22:05 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c14a9b-1a00-4fc6-8310-7fd626503426 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:508fdb07-368b-4561-bf47-5c1121c455ce'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DrgVKmtA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:22:05 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-09c14a9b-1a00-4fc6-8310-7fd626503426 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:22:05 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-09c14a9b-1a00-4fc6-8310-7fd626503426 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:22:05 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-09c14a9b-1a00-4fc6-8310-7fd626503426 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:22:05 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-09c14a9b-1a00-4fc6-8310-7fd626503426 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:22:05 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-09c14a9b-1a00-4fc6-8310-7fd626503426 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:508fdb07-368b-4561-bf47-5c1121c455ce" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:22:05 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-09c14a9b-1a00-4fc6-8310-7fd626503426 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:508fdb07-368b-4561-bf47-5c1121c455ce" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:22:05 user nova-compute[72586]: INFO os_brick.initiator.connectors.iscsi [None req-09c14a9b-1a00-4fc6-8310-7fd626503426 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 21:22:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:508fdb07-368b-4561-bf47-5c1121c455ce -p 172.16.0.220:3260 {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:508fdb07-368b-4561-bf47-5c1121c455ce -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:05 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c4be7d-1d49-43af-94a7-d441846ff427]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:05 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c14a9b-1a00-4fc6-8310-7fd626503426 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 21:22:05 user nova-compute[72586]:  {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:508fdb07-368b-4561-bf47-5c1121c455ce -p 172.16.0.220:3260 --interface default --op new {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:508fdb07-368b-4561-bf47-5c1121c455ce -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:05 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5b6bfa-f877-484b-b327-91cbe70e1c03]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:508fdb07-368b-4561-bf47-5c1121c455ce] added\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:05 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c14a9b-1a00-4fc6-8310-7fd626503426 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:508fdb07-368b-4561-bf47-5c1121c455ce] added
Aug 01 21:22:05 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:508fdb07-368b-4561-bf47-5c1121c455ce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:508fdb07-368b-4561-bf47-5c1121c455ce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:05 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1946037-0fd6-4681-88b5-24d161b8f667]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:05 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c14a9b-1a00-4fc6-8310-7fd626503426 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:508fdb07-368b-4561-bf47-5c1121c455ce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:508fdb07-368b-4561-bf47-5c1121c455ce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:05 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1920ee47-ff33-4ac6-a453-7d2ae1e839f6]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:05 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c14a9b-1a00-4fc6-8310-7fd626503426 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:508fdb07-368b-4561-bf47-5c1121c455ce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DrgVKmtA {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:508fdb07-368b-4561-bf47-5c1121c455ce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DrgVKmtA" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:05 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[384245cd-b468-461f-ba37-ce3a8800e5cc]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:05 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c14a9b-1a00-4fc6-8310-7fd626503426 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DrgVKmtA'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:508fdb07-368b-4561-bf47-5c1121c455ce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:508fdb07-368b-4561-bf47-5c1121c455ce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:05 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[77346bec-2b25-4b43-ac62-fd687c164ddf]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:05 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c14a9b-1a00-4fc6-8310-7fd626503426 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:05 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37be5b8-56ff-4ed4-97f1-8cf99bdd22be]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:05 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c14a9b-1a00-4fc6-8310-7fd626503426 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)
Aug 01 21:22:05 user nova-compute[72586]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)
Aug 01 21:22:05 user nova-compute[72586]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)
Aug 01 21:22:05 user nova-compute[72586]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)
Aug 01 21:22:05 user nova-compute[72586]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)
Aug 01 21:22:05 user nova-compute[72586]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)
Aug 01 21:22:05 user nova-compute[72586]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)
Aug 01 21:22:05 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:22:05 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c14a9b-1a00-4fc6-8310-7fd626503426 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)
Aug 01 21:22:05 user nova-compute[72586]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)
Aug 01 21:22:05 user nova-compute[72586]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)
Aug 01 21:22:05 user nova-compute[72586]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)
Aug 01 21:22:05 user nova-compute[72586]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)
Aug 01 21:22:05 user nova-compute[72586]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)
Aug 01 21:22:05 user nova-compute[72586]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)
Aug 01 21:22:05 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:22:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:508fdb07-368b-4561-bf47-5c1121c455ce -p 172.16.0.220:3260 --login {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-dfbc6618-2f5c-4983-88ac-517578f91a6c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Acquiring lock "34b640b7-1dec-4b31-b64b-f1dbee7f62f6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:22:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-dfbc6618-2f5c-4983-88ac-517578f91a6c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Lock "34b640b7-1dec-4b31-b64b-f1dbee7f62f6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:22:05 user nova-compute[72586]: DEBUG nova.objects.instance [None req-dfbc6618-2f5c-4983-88ac-517578f91a6c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Lazy-loading 'flavor' on Instance uuid 34b640b7-1dec-4b31-b64b-f1dbee7f62f6 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:22:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:508fdb07-368b-4561-bf47-5c1121c455ce -p 172.16.0.220:3260 --login" returned: 0 in 0.115s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:05 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[7465c9b2-f8ec-4ce1-9c55-7c491c4210b5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:508fdb07-368b-4561-bf47-5c1121c455ce, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:508fdb07-368b-4561-bf47-5c1121c455ce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:05 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c14a9b-1a00-4fc6-8310-7fd626503426 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:508fdb07-368b-4561-bf47-5c1121c455ce, portal: 172.16.0.220,3260]
Aug 01 21:22:05 user nova-compute[72586]: Login to [iface: default, target: iqn.2010-10.org.openstack:508fdb07-368b-4561-bf47-5c1121c455ce, portal: 172.16.0.220,3260] successful.
Aug 01 21:22:05 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:508fdb07-368b-4561-bf47-5c1121c455ce -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-dfbc6618-2f5c-4983-88ac-517578f91a6c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Lock "34b640b7-1dec-4b31-b64b-f1dbee7f62f6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:22:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:508fdb07-368b-4561-bf47-5c1121c455ce -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:05 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc292d93-c4e8-448d-813a-af77c39851ab]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:05 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c14a9b-1a00-4fc6-8310-7fd626503426 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:06 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:06 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[48fe2af7-f812-4142-8f89-46c95dafdff4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:508fdb07-368b-4561-bf47-5c1121c455ce (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:06 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c14a9b-1a00-4fc6-8310-7fd626503426 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:508fdb07-368b-4561-bf47-5c1121c455ce (non-flash)
Aug 01 21:22:06 user nova-compute[72586]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)
Aug 01 21:22:06 user nova-compute[72586]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)
Aug 01 21:22:06 user nova-compute[72586]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)
Aug 01 21:22:06 user nova-compute[72586]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)
Aug 01 21:22:06 user nova-compute[72586]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)
Aug 01 21:22:06 user nova-compute[72586]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)
Aug 01 21:22:06 user nova-compute[72586]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)
Aug 01 21:22:06 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:22:06 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c14a9b-1a00-4fc6-8310-7fd626503426 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:508fdb07-368b-4561-bf47-5c1121c455ce (non-flash)
Aug 01 21:22:06 user nova-compute[72586]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)
Aug 01 21:22:06 user nova-compute[72586]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)
Aug 01 21:22:06 user nova-compute[72586]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)
Aug 01 21:22:06 user nova-compute[72586]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)
Aug 01 21:22:06 user nova-compute[72586]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)
Aug 01 21:22:06 user nova-compute[72586]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)
Aug 01 21:22:06 user nova-compute[72586]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)
Aug 01 21:22:06 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:22:06 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-09c14a9b-1a00-4fc6-8310-7fd626503426 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:508fdb07-368b-4561-bf47-5c1121c455ce" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.400s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:22:06 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c14a9b-1a00-4fc6-8310-7fd626503426 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Connected to 172.16.0.220:3260 {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 21:22:06 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-09c14a9b-1a00-4fc6-8310-7fd626503426 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=72586) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 21:22:06 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-09c14a9b-1a00-4fc6-8310-7fd626503426 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=72586) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 21:22:06 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:06 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.023s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:06 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[08163093-954e-4352-91a3-e16300857ec9]: (4, ('- - 0', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:06 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-09c14a9b-1a00-4fc6-8310-7fd626503426 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:22:06 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c14a9b-1a00-4fc6-8310-7fd626503426 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DrgVKmtA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 21:22:06 user nova-compute[72586]: DEBUG nova.compute.manager [req-47136233-7a8a-4334-b629-4fe7f5921861 req-06265470-9bf9-4c6e-bb18-258476825f28 service nova] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Received event network-vif-plugged-03e03a20-d14a-4605-ad03-adb3411a1d85 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:22:06 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-47136233-7a8a-4334-b629-4fe7f5921861 req-06265470-9bf9-4c6e-bb18-258476825f28 service nova] Acquiring lock "34b640b7-1dec-4b31-b64b-f1dbee7f62f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:22:06 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-47136233-7a8a-4334-b629-4fe7f5921861 req-06265470-9bf9-4c6e-bb18-258476825f28 service nova] Lock "34b640b7-1dec-4b31-b64b-f1dbee7f62f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:22:06 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-47136233-7a8a-4334-b629-4fe7f5921861 req-06265470-9bf9-4c6e-bb18-258476825f28 service nova] Lock "34b640b7-1dec-4b31-b64b-f1dbee7f62f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:22:06 user nova-compute[72586]: DEBUG nova.compute.manager [req-47136233-7a8a-4334-b629-4fe7f5921861 req-06265470-9bf9-4c6e-bb18-258476825f28 service nova] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] No waiting events found dispatching network-vif-plugged-03e03a20-d14a-4605-ad03-adb3411a1d85 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:22:06 user nova-compute[72586]: WARNING nova.compute.manager [req-47136233-7a8a-4334-b629-4fe7f5921861 req-06265470-9bf9-4c6e-bb18-258476825f28 service nova] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Received unexpected event network-vif-plugged-03e03a20-d14a-4605-ad03-adb3411a1d85 for instance with vm_state active and task_state None.
Aug 01 21:22:06 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-dfbc6618-2f5c-4983-88ac-517578f91a6c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Acquiring lock "34b640b7-1dec-4b31-b64b-f1dbee7f62f6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:22:06 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-dfbc6618-2f5c-4983-88ac-517578f91a6c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Lock "34b640b7-1dec-4b31-b64b-f1dbee7f62f6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:22:06 user nova-compute[72586]: INFO nova.compute.manager [None req-dfbc6618-2f5c-4983-88ac-517578f91a6c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Attaching volume 25ea9428-d17d-448b-b8a2-a25e77c1a8b4 to /dev/vdb
Aug 01 21:22:06 user nova-compute[72586]: DEBUG os_brick.utils [None req-dfbc6618-2f5c-4983-88ac-517578f91a6c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:22:06 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:06 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:06 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1eae36-2cf4-47ef-b234-35253a028166]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4bc202fb9cb\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:06 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:06 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:06 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52b9c49-65d3-404e-9fbf-088283beff3f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:06 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:06 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:06 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2eb2fb-e212-4fee-80c8-773c48d8418d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:06 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5843fe-5461-495f-95a7-233c4161ce4e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:06 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-dfbc6618-2f5c-4983-88ac-517578f91a6c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Running cmd (subprocess): nvme version {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:06 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-dfbc6618-2f5c-4983-88ac-517578f91a6c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] 'nvme version' failed. Not Retrying. {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:22:06 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dfbc6618-2f5c-4983-88ac-517578f91a6c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] nvme not present on system {{(pid=72586) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 21:22:06 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:06 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:22:06 user nova-compute[72586]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 21:22:06 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[614a3e36-1222-4afe-a87c-4501bd9df58c]: (4, '') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:06 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-dfbc6618-2f5c-4983-88ac-517578f91a6c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72586) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 21:22:06 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-dfbc6618-2f5c-4983-88ac-517578f91a6c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 21:22:06 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-dfbc6618-2f5c-4983-88ac-517578f91a6c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] LIGHTOS: no hostnqn found. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 21:22:06 user nova-compute[72586]: DEBUG os_brick.utils [None req-dfbc6618-2f5c-4983-88ac-517578f91a6c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4bc202fb9cb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:22:06 user nova-compute[72586]: DEBUG nova.virt.block_device [None req-dfbc6618-2f5c-4983-88ac-517578f91a6c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Updating existing volume attachment record: dbf860d9-41d1-4bec-80e1-4dd2f8ff84c1 {{(pid=72586) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 21:22:07 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-09c14a9b-1a00-4fc6-8310-7fd626503426 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.449s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:22:07 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c14a9b-1a00-4fc6-8310-7fd626503426 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] <== connect_volume: return (1451ms) {'type': 'block', 'scsi_wwn': '23566336238633137', 'path': '/dev/sdi'} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:22:07 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09c14a9b-1a00-4fc6-8310-7fd626503426 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23566336238633137', 'path': '/dev/sdi'} {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 21:22:07 user nova-compute[72586]: DEBUG nova.objects.instance [None req-09c14a9b-1a00-4fc6-8310-7fd626503426 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Lazy-loading 'flavor' on Instance uuid 9197638d-0c03-4b4e-876a-003bd8db3c35 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:22:07 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-09c14a9b-1a00-4fc6-8310-7fd626503426 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 21:22:07 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:22:07 user nova-compute[72586]:   <source dev="/dev/sdi"/>
Aug 01 21:22:07 user nova-compute[72586]:   <target dev="sdc" bus="scsi"/>
Aug 01 21:22:07 user nova-compute[72586]:   <serial>508fdb07-368b-4561-bf47-5c1121c455ce</serial>
Aug 01 21:22:07 user nova-compute[72586]:   <address type="drive" controller="0" unit="2"/>
Aug 01 21:22:07 user nova-compute[72586]: </disk>
Aug 01 21:22:07 user nova-compute[72586]:  {{(pid=72586) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 21:22:07 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-09c14a9b-1a00-4fc6-8310-7fd626503426 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] No BDM found with device name sda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:22:07 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-09c14a9b-1a00-4fc6-8310-7fd626503426 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:22:07 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-09c14a9b-1a00-4fc6-8310-7fd626503426 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] No BDM found with device name sdc, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:22:07 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-09c14a9b-1a00-4fc6-8310-7fd626503426 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] No VIF found with MAC fa:16:3e:43:29:03, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:22:08 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18daca22-801c-420b-97a3-907363817589 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Calling os-brick to attach iSCSI Volume {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 21:22:08 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-18daca22-801c-420b-97a3-907363817589 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bafefb27-e9e8-4592-b90b-2cac437b9e7f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MrtCbWTJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:22:08 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-18daca22-801c-420b-97a3-907363817589 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:22:08 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-18daca22-801c-420b-97a3-907363817589 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:22:08 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-18daca22-801c-420b-97a3-907363817589 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:22:08 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-18daca22-801c-420b-97a3-907363817589 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:22:08 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-18daca22-801c-420b-97a3-907363817589 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bafefb27-e9e8-4592-b90b-2cac437b9e7f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:22:08 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-18daca22-801c-420b-97a3-907363817589 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bafefb27-e9e8-4592-b90b-2cac437b9e7f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:22:08 user nova-compute[72586]: INFO os_brick.initiator.connectors.iscsi [None req-18daca22-801c-420b-97a3-907363817589 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 21:22:08 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bafefb27-e9e8-4592-b90b-2cac437b9e7f -p 172.16.0.220:3260 {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:08 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bafefb27-e9e8-4592-b90b-2cac437b9e7f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:08 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cba3ec8-4b06-41f1-befa-61ddb642396b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:08 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-18daca22-801c-420b-97a3-907363817589 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 21:22:08 user nova-compute[72586]:  {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:08 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bafefb27-e9e8-4592-b90b-2cac437b9e7f -p 172.16.0.220:3260 --interface default --op new {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:08 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bafefb27-e9e8-4592-b90b-2cac437b9e7f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:08 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfa6343-cbc2-4e46-9de9-795ce451e258]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bafefb27-e9e8-4592-b90b-2cac437b9e7f] added\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:08 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-18daca22-801c-420b-97a3-907363817589 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bafefb27-e9e8-4592-b90b-2cac437b9e7f] added
Aug 01 21:22:08 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:08 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bafefb27-e9e8-4592-b90b-2cac437b9e7f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:08 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bafefb27-e9e8-4592-b90b-2cac437b9e7f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.068s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:08 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b5e4aa-5288-4c43-84c1-0a87ff1ae959]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:08 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-18daca22-801c-420b-97a3-907363817589 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:08 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bafefb27-e9e8-4592-b90b-2cac437b9e7f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:08 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bafefb27-e9e8-4592-b90b-2cac437b9e7f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:08 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7b27fd-203e-4c60-8028-cf4ea8fa35fd]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:08 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-18daca22-801c-420b-97a3-907363817589 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:08 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bafefb27-e9e8-4592-b90b-2cac437b9e7f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MrtCbWTJ {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:08 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bafefb27-e9e8-4592-b90b-2cac437b9e7f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MrtCbWTJ" returned: 0 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:08 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4ab8c2-b52d-41e0-95d8-74f1754a5055]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:08 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-18daca22-801c-420b-97a3-907363817589 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MrtCbWTJ'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:08 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bafefb27-e9e8-4592-b90b-2cac437b9e7f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:08 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bafefb27-e9e8-4592-b90b-2cac437b9e7f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:08 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d109503-dfaa-48e8-8f21-7d472c5a730b]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:08 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-18daca22-801c-420b-97a3-907363817589 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:08 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:08 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:08 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[7429e1ee-48ab-4faf-a9c9-5e9e375a076d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:508fdb07-368b-4561-bf47-5c1121c455ce (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:08 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-18daca22-801c-420b-97a3-907363817589 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:508fdb07-368b-4561-bf47-5c1121c455ce (non-flash)
Aug 01 21:22:08 user nova-compute[72586]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)
Aug 01 21:22:08 user nova-compute[72586]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)
Aug 01 21:22:08 user nova-compute[72586]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)
Aug 01 21:22:08 user nova-compute[72586]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)
Aug 01 21:22:08 user nova-compute[72586]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)
Aug 01 21:22:08 user nova-compute[72586]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)
Aug 01 21:22:08 user nova-compute[72586]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)
Aug 01 21:22:08 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:22:08 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-18daca22-801c-420b-97a3-907363817589 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:508fdb07-368b-4561-bf47-5c1121c455ce (non-flash)
Aug 01 21:22:08 user nova-compute[72586]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)
Aug 01 21:22:08 user nova-compute[72586]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)
Aug 01 21:22:08 user nova-compute[72586]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)
Aug 01 21:22:08 user nova-compute[72586]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)
Aug 01 21:22:08 user nova-compute[72586]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)
Aug 01 21:22:08 user nova-compute[72586]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)
Aug 01 21:22:08 user nova-compute[72586]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)
Aug 01 21:22:08 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:22:08 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bafefb27-e9e8-4592-b90b-2cac437b9e7f -p 172.16.0.220:3260 --login {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:08 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bafefb27-e9e8-4592-b90b-2cac437b9e7f -p 172.16.0.220:3260 --login" returned: 0 in 0.099s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:08 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[44cebfa6-1f4e-4c69-b5d1-6cf895af664a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bafefb27-e9e8-4592-b90b-2cac437b9e7f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bafefb27-e9e8-4592-b90b-2cac437b9e7f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:08 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-18daca22-801c-420b-97a3-907363817589 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bafefb27-e9e8-4592-b90b-2cac437b9e7f, portal: 172.16.0.220,3260]
Aug 01 21:22:08 user nova-compute[72586]: Login to [iface: default, target: iqn.2010-10.org.openstack:bafefb27-e9e8-4592-b90b-2cac437b9e7f, portal: 172.16.0.220,3260] successful.
Aug 01 21:22:08 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:08 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bafefb27-e9e8-4592-b90b-2cac437b9e7f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:08 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-09c14a9b-1a00-4fc6-8310-7fd626503426 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Lock "9197638d-0c03-4b4e-876a-003bd8db3c35" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.713s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:22:08 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bafefb27-e9e8-4592-b90b-2cac437b9e7f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:08 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b15d21-9ab3-46ba-9239-417f6aa62fd2]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:08 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-18daca22-801c-420b-97a3-907363817589 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:08 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:08 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:08 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1117fbb-4315-41e4-86b4-a118f3876ab4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:508fdb07-368b-4561-bf47-5c1121c455ce (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bafefb27-e9e8-4592-b90b-2cac437b9e7f (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:08 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-18daca22-801c-420b-97a3-907363817589 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:508fdb07-368b-4561-bf47-5c1121c455ce (non-flash)
Aug 01 21:22:08 user nova-compute[72586]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bafefb27-e9e8-4592-b90b-2cac437b9e7f (non-flash)
Aug 01 21:22:08 user nova-compute[72586]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)
Aug 01 21:22:08 user nova-compute[72586]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)
Aug 01 21:22:08 user nova-compute[72586]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)
Aug 01 21:22:08 user nova-compute[72586]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)
Aug 01 21:22:08 user nova-compute[72586]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)
Aug 01 21:22:08 user nova-compute[72586]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)
Aug 01 21:22:08 user nova-compute[72586]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)
Aug 01 21:22:08 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:22:08 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-18daca22-801c-420b-97a3-907363817589 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:508fdb07-368b-4561-bf47-5c1121c455ce (non-flash)
Aug 01 21:22:08 user nova-compute[72586]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bafefb27-e9e8-4592-b90b-2cac437b9e7f (non-flash)
Aug 01 21:22:08 user nova-compute[72586]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)
Aug 01 21:22:08 user nova-compute[72586]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)
Aug 01 21:22:08 user nova-compute[72586]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)
Aug 01 21:22:08 user nova-compute[72586]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)
Aug 01 21:22:08 user nova-compute[72586]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)
Aug 01 21:22:08 user nova-compute[72586]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)
Aug 01 21:22:08 user nova-compute[72586]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)
Aug 01 21:22:08 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:22:08 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-18daca22-801c-420b-97a3-907363817589 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bafefb27-e9e8-4592-b90b-2cac437b9e7f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.421s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:22:08 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-18daca22-801c-420b-97a3-907363817589 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Connected to 172.16.0.220:3260 {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 21:22:08 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-18daca22-801c-420b-97a3-907363817589 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=72586) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 21:22:08 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-18daca22-801c-420b-97a3-907363817589 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=72586) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 21:22:08 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:08 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:08 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[5509b776-24f2-421f-992e-247bf9690467]: (4, ('- - 0', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:08 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-18daca22-801c-420b-97a3-907363817589 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:22:08 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-18daca22-801c-420b-97a3-907363817589 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MrtCbWTJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 21:22:08 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:08 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:09 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-18daca22-801c-420b-97a3-907363817589 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.458s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:22:09 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-18daca22-801c-420b-97a3-907363817589 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] <== connect_volume: return (1460ms) {'type': 'block', 'scsi_wwn': '23764653534393133', 'path': '/dev/sdj'} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:22:09 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18daca22-801c-420b-97a3-907363817589 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23764653534393133', 'path': '/dev/sdj'} {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 21:22:09 user nova-compute[72586]: DEBUG nova.objects.instance [None req-18daca22-801c-420b-97a3-907363817589 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Lazy-loading 'flavor' on Instance uuid 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:22:09 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-18daca22-801c-420b-97a3-907363817589 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 21:22:09 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:22:09 user nova-compute[72586]:   <source dev="/dev/sdj"/>
Aug 01 21:22:09 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:22:09 user nova-compute[72586]:   <serial>bafefb27-e9e8-4592-b90b-2cac437b9e7f</serial>
Aug 01 21:22:09 user nova-compute[72586]: </disk>
Aug 01 21:22:09 user nova-compute[72586]:  {{(pid=72586) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 21:22:09 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-d30dc2a5-4f2e-4c5b-8d83-7610b44be818 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Acquiring lock "9197638d-0c03-4b4e-876a-003bd8db3c35" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:22:09 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-d30dc2a5-4f2e-4c5b-8d83-7610b44be818 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Lock "9197638d-0c03-4b4e-876a-003bd8db3c35" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:22:09 user nova-compute[72586]: INFO nova.compute.manager [None req-d30dc2a5-4f2e-4c5b-8d83-7610b44be818 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Detaching volume 508fdb07-368b-4561-bf47-5c1121c455ce
Aug 01 21:22:09 user nova-compute[72586]: INFO nova.virt.block_device [None req-d30dc2a5-4f2e-4c5b-8d83-7610b44be818 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Attempting to driver detach volume 508fdb07-368b-4561-bf47-5c1121c455ce from mountpoint /dev/sdc
Aug 01 21:22:09 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-d30dc2a5-4f2e-4c5b-8d83-7610b44be818 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Attempting to detach device sdc from instance 9197638d-0c03-4b4e-876a-003bd8db3c35 from the persistent domain config. {{(pid=72586) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 21:22:09 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-d30dc2a5-4f2e-4c5b-8d83-7610b44be818 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 21:22:09 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:22:09 user nova-compute[72586]:   <source dev="/dev/sdi"/>
Aug 01 21:22:09 user nova-compute[72586]:   <target dev="sdc" bus="scsi"/>
Aug 01 21:22:09 user nova-compute[72586]:   <serial>508fdb07-368b-4561-bf47-5c1121c455ce</serial>
Aug 01 21:22:09 user nova-compute[72586]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 01 21:22:09 user nova-compute[72586]: </disk>
Aug 01 21:22:09 user nova-compute[72586]:  {{(pid=72586) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 21:22:09 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-d30dc2a5-4f2e-4c5b-8d83-7610b44be818 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Successfully detached device sdc from instance 9197638d-0c03-4b4e-876a-003bd8db3c35 from the persistent domain config.
Aug 01 21:22:09 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-d30dc2a5-4f2e-4c5b-8d83-7610b44be818 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 9197638d-0c03-4b4e-876a-003bd8db3c35 from the live domain config. {{(pid=72586) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 21:22:09 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-d30dc2a5-4f2e-4c5b-8d83-7610b44be818 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 21:22:09 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:22:09 user nova-compute[72586]:   <source dev="/dev/sdi"/>
Aug 01 21:22:09 user nova-compute[72586]:   <target dev="sdc" bus="scsi"/>
Aug 01 21:22:09 user nova-compute[72586]:   <serial>508fdb07-368b-4561-bf47-5c1121c455ce</serial>
Aug 01 21:22:09 user nova-compute[72586]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 01 21:22:09 user nova-compute[72586]: </disk>
Aug 01 21:22:09 user nova-compute[72586]:  {{(pid=72586) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 21:22:09 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-18daca22-801c-420b-97a3-907363817589 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:22:09 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-18daca22-801c-420b-97a3-907363817589 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:22:09 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-18daca22-801c-420b-97a3-907363817589 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] No VIF found with MAC fa:16:3e:a5:91:07, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:22:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-18daca22-801c-420b-97a3-907363817589 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Lock "3830c8b3-27b8-45f3-bbdb-8a081dfcadc4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.063s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:22:10 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Received event <DeviceRemovedEvent: 1690924930.3175075, 9197638d-0c03-4b4e-876a-003bd8db3c35 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72586) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 21:22:10 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-d30dc2a5-4f2e-4c5b-8d83-7610b44be818 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 9197638d-0c03-4b4e-876a-003bd8db3c35 {{(pid=72586) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 21:22:10 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-d30dc2a5-4f2e-4c5b-8d83-7610b44be818 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Successfully detached device sdc from instance 9197638d-0c03-4b4e-876a-003bd8db3c35 from the live domain config.
Aug 01 21:22:10 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d30dc2a5-4f2e-4c5b-8d83-7610b44be818 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] calling os-brick to detach iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 21:22:10 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30dc2a5-4f2e-4c5b-8d83-7610b44be818 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, {'target_iqns': ['iqn.2010-10.org.openstack:508fdb07-368b-4561-bf47-5c1121c455ce'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DrgVKmtA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:22:10 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-d30dc2a5-4f2e-4c5b-8d83-7610b44be818 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:22:10 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-d30dc2a5-4f2e-4c5b-8d83-7610b44be818 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:22:10 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-d30dc2a5-4f2e-4c5b-8d83-7610b44be818 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:22:10 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30dc2a5-4f2e-4c5b-8d83-7610b44be818 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:508fdb07-368b-4561-bf47-5c1121c455ce', 0)] {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 21:22:10 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:10 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:10 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6e9ac4-6280-4bad-98d0-061126a1d098]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:508fdb07-368b-4561-bf47-5c1121c455ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bafefb27-e9e8-4592-b90b-2cac437b9e7f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:10 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:10 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:10 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d652013-428d-4fe2-8933-dc3e13bcfb96]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:508fdb07-368b-4561-bf47-5c1121c455ce (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bafefb27-e9e8-4592-b90b-2cac437b9e7f (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:10 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30dc2a5-4f2e-4c5b-8d83-7610b44be818 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:508fdb07-368b-4561-bf47-5c1121c455ce (non-flash)
Aug 01 21:22:10 user nova-compute[72586]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bafefb27-e9e8-4592-b90b-2cac437b9e7f (non-flash)
Aug 01 21:22:10 user nova-compute[72586]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)
Aug 01 21:22:10 user nova-compute[72586]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)
Aug 01 21:22:10 user nova-compute[72586]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)
Aug 01 21:22:10 user nova-compute[72586]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)
Aug 01 21:22:10 user nova-compute[72586]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)
Aug 01 21:22:10 user nova-compute[72586]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)
Aug 01 21:22:10 user nova-compute[72586]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)
Aug 01 21:22:10 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:22:10 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30dc2a5-4f2e-4c5b-8d83-7610b44be818 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:508fdb07-368b-4561-bf47-5c1121c455ce (non-flash)
Aug 01 21:22:10 user nova-compute[72586]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bafefb27-e9e8-4592-b90b-2cac437b9e7f (non-flash)
Aug 01 21:22:10 user nova-compute[72586]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)
Aug 01 21:22:10 user nova-compute[72586]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)
Aug 01 21:22:10 user nova-compute[72586]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)
Aug 01 21:22:10 user nova-compute[72586]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)
Aug 01 21:22:10 user nova-compute[72586]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)
Aug 01 21:22:10 user nova-compute[72586]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)
Aug 01 21:22:10 user nova-compute[72586]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)
Aug 01 21:22:10 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:22:10 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30dc2a5-4f2e-4c5b-8d83-7610b44be818 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ed065c1f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:508fdb07-368b-4561-bf47-5c1121c455ce'): ({'sdi'}, set())}) {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 21:22:10 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-d30dc2a5-4f2e-4c5b-8d83-7610b44be818 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Removing single pathed devices sdi {{(pid=72586) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 21:22:10 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:10 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:10 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9257d2a-b0c8-44c7-bd14-c096494df390]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:10 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:10 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:10 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e180a3a6-c0d4-475d-bb11-473d458a3d23]: (4, ('ok\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:10 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-d30dc2a5-4f2e-4c5b-8d83-7610b44be818 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Flushing IO for device /dev/sdi {{(pid=72586) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 21:22:10 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:10 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:10 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[284fe7c8-29e6-4965-a9a7-aa3ba33c1816]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:10 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-d30dc2a5-4f2e-4c5b-8d83-7610b44be818 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=72586) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 21:22:10 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:10 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.045s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:10 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc28ab2a-7b81-4186-a68a-571c34a54a3a]: (4, ('1', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:10 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-d30dc2a5-4f2e-4c5b-8d83-7610b44be818 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 21:22:10 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-d30dc2a5-4f2e-4c5b-8d83-7610b44be818 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] SCSI volumes sdi have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 21:22:10 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30dc2a5-4f2e-4c5b-8d83-7610b44be818 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:508fdb07-368b-4561-bf47-5c1121c455ce')] {{(pid=72586) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 21:22:10 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:508fdb07-368b-4561-bf47-5c1121c455ce -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:10 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:508fdb07-368b-4561-bf47-5c1121c455ce -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:10 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d6b66b-7ffe-4577-86e6-6e81771ec97c]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:10 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30dc2a5-4f2e-4c5b-8d83-7610b44be818 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:10 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:508fdb07-368b-4561-bf47-5c1121c455ce -p 172.16.0.220:3260 --logout {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:10 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:508fdb07-368b-4561-bf47-5c1121c455ce -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:10 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a1386e-153a-4c74-8739-d50a73fffa05]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:508fdb07-368b-4561-bf47-5c1121c455ce, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:508fdb07-368b-4561-bf47-5c1121c455ce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:10 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30dc2a5-4f2e-4c5b-8d83-7610b44be818 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:508fdb07-368b-4561-bf47-5c1121c455ce, portal: 172.16.0.220,3260]
Aug 01 21:22:10 user nova-compute[72586]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:508fdb07-368b-4561-bf47-5c1121c455ce, portal: 172.16.0.220,3260] successful.
Aug 01 21:22:10 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:10 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:508fdb07-368b-4561-bf47-5c1121c455ce -p 172.16.0.220:3260 --op delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:10 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:508fdb07-368b-4561-bf47-5c1121c455ce -p 172.16.0.220:3260 --op delete" returned: 0 in 0.048s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:10 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a3ec9c-1018-42f8-a2fc-e9ccc183f3c5]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:10 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30dc2a5-4f2e-4c5b-8d83-7610b44be818 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:10 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-d30dc2a5-4f2e-4c5b-8d83-7610b44be818 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.378s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:22:10 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30dc2a5-4f2e-4c5b-8d83-7610b44be818 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] <== disconnect_volume: return (379ms) None {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:22:10 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d30dc2a5-4f2e-4c5b-8d83-7610b44be818 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Disconnected iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 21:22:11 user nova-compute[72586]: DEBUG nova.objects.instance [None req-d30dc2a5-4f2e-4c5b-8d83-7610b44be818 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Lazy-loading 'flavor' on Instance uuid 9197638d-0c03-4b4e-876a-003bd8db3c35 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:22:11 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-d30dc2a5-4f2e-4c5b-8d83-7610b44be818 tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Lock "9197638d-0c03-4b4e-876a-003bd8db3c35" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.031s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:22:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-30881a69-71be-4be4-b9e9-33f512b680bb tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Acquiring lock "9197638d-0c03-4b4e-876a-003bd8db3c35" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:22:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-30881a69-71be-4be4-b9e9-33f512b680bb tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Lock "9197638d-0c03-4b4e-876a-003bd8db3c35" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:22:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-30881a69-71be-4be4-b9e9-33f512b680bb tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Acquiring lock "9197638d-0c03-4b4e-876a-003bd8db3c35-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:22:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-30881a69-71be-4be4-b9e9-33f512b680bb tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Lock "9197638d-0c03-4b4e-876a-003bd8db3c35-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:22:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-30881a69-71be-4be4-b9e9-33f512b680bb tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Lock "9197638d-0c03-4b4e-876a-003bd8db3c35-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:22:12 user nova-compute[72586]: INFO nova.compute.manager [None req-30881a69-71be-4be4-b9e9-33f512b680bb tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Terminating instance
Aug 01 21:22:12 user nova-compute[72586]: DEBUG nova.compute.manager [None req-30881a69-71be-4be4-b9e9-33f512b680bb tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Start destroying the instance on the hypervisor. {{(pid=72586) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 21:22:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-24539ed9-b5f6-46cb-9764-ce40f4a24824 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Acquiring lock "3830c8b3-27b8-45f3-bbdb-8a081dfcadc4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:22:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-24539ed9-b5f6-46cb-9764-ce40f4a24824 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Lock "3830c8b3-27b8-45f3-bbdb-8a081dfcadc4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:22:12 user nova-compute[72586]: INFO nova.compute.manager [None req-24539ed9-b5f6-46cb-9764-ce40f4a24824 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Detaching volume bafefb27-e9e8-4592-b90b-2cac437b9e7f
Aug 01 21:22:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:12 user nova-compute[72586]: INFO nova.virt.block_device [None req-24539ed9-b5f6-46cb-9764-ce40f4a24824 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Attempting to driver detach volume bafefb27-e9e8-4592-b90b-2cac437b9e7f from mountpoint /dev/vdb
Aug 01 21:22:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:12 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-24539ed9-b5f6-46cb-9764-ce40f4a24824 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Attempting to detach device vdb from instance 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4 from the persistent domain config. {{(pid=72586) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 21:22:12 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-24539ed9-b5f6-46cb-9764-ce40f4a24824 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 21:22:12 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:22:12 user nova-compute[72586]:   <source dev="/dev/sdj"/>
Aug 01 21:22:12 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:22:12 user nova-compute[72586]:   <serial>bafefb27-e9e8-4592-b90b-2cac437b9e7f</serial>
Aug 01 21:22:12 user nova-compute[72586]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 21:22:12 user nova-compute[72586]: </disk>
Aug 01 21:22:12 user nova-compute[72586]:  {{(pid=72586) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 21:22:12 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-24539ed9-b5f6-46cb-9764-ce40f4a24824 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Successfully detached device vdb from instance 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4 from the persistent domain config.
Aug 01 21:22:12 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-24539ed9-b5f6-46cb-9764-ce40f4a24824 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4 from the live domain config. {{(pid=72586) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 21:22:12 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-24539ed9-b5f6-46cb-9764-ce40f4a24824 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 21:22:12 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:22:12 user nova-compute[72586]:   <source dev="/dev/sdj"/>
Aug 01 21:22:12 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:22:12 user nova-compute[72586]:   <serial>bafefb27-e9e8-4592-b90b-2cac437b9e7f</serial>
Aug 01 21:22:12 user nova-compute[72586]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 21:22:12 user nova-compute[72586]: </disk>
Aug 01 21:22:12 user nova-compute[72586]:  {{(pid=72586) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 21:22:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:12 user nova-compute[72586]: DEBUG nova.compute.manager [req-ab97815a-e2ba-4056-967f-c65bb9e4c9a9 req-60c719d3-1c1c-4ef5-8743-e98954e661d0 service nova] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Received event network-vif-unplugged-2c422520-a997-44b1-91dc-bfd781a5942d {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:22:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ab97815a-e2ba-4056-967f-c65bb9e4c9a9 req-60c719d3-1c1c-4ef5-8743-e98954e661d0 service nova] Acquiring lock "9197638d-0c03-4b4e-876a-003bd8db3c35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:22:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ab97815a-e2ba-4056-967f-c65bb9e4c9a9 req-60c719d3-1c1c-4ef5-8743-e98954e661d0 service nova] Lock "9197638d-0c03-4b4e-876a-003bd8db3c35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:22:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ab97815a-e2ba-4056-967f-c65bb9e4c9a9 req-60c719d3-1c1c-4ef5-8743-e98954e661d0 service nova] Lock "9197638d-0c03-4b4e-876a-003bd8db3c35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:22:12 user nova-compute[72586]: DEBUG nova.compute.manager [req-ab97815a-e2ba-4056-967f-c65bb9e4c9a9 req-60c719d3-1c1c-4ef5-8743-e98954e661d0 service nova] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] No waiting events found dispatching network-vif-unplugged-2c422520-a997-44b1-91dc-bfd781a5942d {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:22:12 user nova-compute[72586]: DEBUG nova.compute.manager [req-ab97815a-e2ba-4056-967f-c65bb9e4c9a9 req-60c719d3-1c1c-4ef5-8743-e98954e661d0 service nova] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Received event network-vif-unplugged-2c422520-a997-44b1-91dc-bfd781a5942d for instance with task_state deleting. {{(pid=72586) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 21:22:13 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Received event <DeviceRemovedEvent: 1690924933.0501614, 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72586) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 21:22:13 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-24539ed9-b5f6-46cb-9764-ce40f4a24824 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4 {{(pid=72586) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 21:22:13 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-24539ed9-b5f6-46cb-9764-ce40f4a24824 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Successfully detached device vdb from instance 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4 from the live domain config.
Aug 01 21:22:13 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24539ed9-b5f6-46cb-9764-ce40f4a24824 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] calling os-brick to detach iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 21:22:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-24539ed9-b5f6-46cb-9764-ce40f4a24824 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, {'target_iqns': ['iqn.2010-10.org.openstack:bafefb27-e9e8-4592-b90b-2cac437b9e7f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MrtCbWTJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:22:13 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-24539ed9-b5f6-46cb-9764-ce40f4a24824 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:22:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-24539ed9-b5f6-46cb-9764-ce40f4a24824 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:22:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-24539ed9-b5f6-46cb-9764-ce40f4a24824 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:22:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-24539ed9-b5f6-46cb-9764-ce40f4a24824 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bafefb27-e9e8-4592-b90b-2cac437b9e7f', 0)] {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 21:22:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:13 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d845a113-e8ed-4237-bff1-67ddfa8297b6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bafefb27-e9e8-4592-b90b-2cac437b9e7f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:13 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[8128874d-9879-4843-a861-f1c355a8306f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bafefb27-e9e8-4592-b90b-2cac437b9e7f (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-24539ed9-b5f6-46cb-9764-ce40f4a24824 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bafefb27-e9e8-4592-b90b-2cac437b9e7f (non-flash)
Aug 01 21:22:13 user nova-compute[72586]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)
Aug 01 21:22:13 user nova-compute[72586]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)
Aug 01 21:22:13 user nova-compute[72586]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)
Aug 01 21:22:13 user nova-compute[72586]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)
Aug 01 21:22:13 user nova-compute[72586]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)
Aug 01 21:22:13 user nova-compute[72586]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)
Aug 01 21:22:13 user nova-compute[72586]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)
Aug 01 21:22:13 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:22:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-24539ed9-b5f6-46cb-9764-ce40f4a24824 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bafefb27-e9e8-4592-b90b-2cac437b9e7f (non-flash)
Aug 01 21:22:13 user nova-compute[72586]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)
Aug 01 21:22:13 user nova-compute[72586]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)
Aug 01 21:22:13 user nova-compute[72586]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)
Aug 01 21:22:13 user nova-compute[72586]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)
Aug 01 21:22:13 user nova-compute[72586]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)
Aug 01 21:22:13 user nova-compute[72586]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)
Aug 01 21:22:13 user nova-compute[72586]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)
Aug 01 21:22:13 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:22:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-24539ed9-b5f6-46cb-9764-ce40f4a24824 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ee837acb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bafefb27-e9e8-4592-b90b-2cac437b9e7f'): ({'sdj'}, set())}) {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 21:22:13 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-24539ed9-b5f6-46cb-9764-ce40f4a24824 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Removing single pathed devices sdj {{(pid=72586) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 21:22:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:13 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d923acb-ab7d-4f6f-9eea-ca91599b77a7]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.023s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:13 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42c0a60-97e3-4a80-aa01-35bfd9edeb16]: (4, ('ok\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:13 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-24539ed9-b5f6-46cb-9764-ce40f4a24824 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Flushing IO for device /dev/sdj {{(pid=72586) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 21:22:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.023s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:13 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[42bc3862-47c1-4c88-aef2-634e9b315ffd]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:13 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-24539ed9-b5f6-46cb-9764-ce40f4a24824 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=72586) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 21:22:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.050s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:13 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[18afb1b4-56da-483d-9da7-555209376c85]: (4, ('1', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:13 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-24539ed9-b5f6-46cb-9764-ce40f4a24824 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 21:22:13 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-24539ed9-b5f6-46cb-9764-ce40f4a24824 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] SCSI volumes sdj have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 21:22:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-24539ed9-b5f6-46cb-9764-ce40f4a24824 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bafefb27-e9e8-4592-b90b-2cac437b9e7f')] {{(pid=72586) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 21:22:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bafefb27-e9e8-4592-b90b-2cac437b9e7f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bafefb27-e9e8-4592-b90b-2cac437b9e7f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:13 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a38da06-880d-4763-bd2b-385e2773ae5d]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-24539ed9-b5f6-46cb-9764-ce40f4a24824 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bafefb27-e9e8-4592-b90b-2cac437b9e7f -p 172.16.0.220:3260 --logout {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bafefb27-e9e8-4592-b90b-2cac437b9e7f -p 172.16.0.220:3260 --logout" returned: 0 in 0.115s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:13 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[81bf49e2-c5f1-4721-ab78-d9d4c61fba24]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:bafefb27-e9e8-4592-b90b-2cac437b9e7f, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:bafefb27-e9e8-4592-b90b-2cac437b9e7f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-24539ed9-b5f6-46cb-9764-ce40f4a24824 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:bafefb27-e9e8-4592-b90b-2cac437b9e7f, portal: 172.16.0.220,3260]
Aug 01 21:22:13 user nova-compute[72586]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:bafefb27-e9e8-4592-b90b-2cac437b9e7f, portal: 172.16.0.220,3260] successful.
Aug 01 21:22:13 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bafefb27-e9e8-4592-b90b-2cac437b9e7f -p 172.16.0.220:3260 --op delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bafefb27-e9e8-4592-b90b-2cac437b9e7f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.062s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:13 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef775d4-5880-4dd2-939e-9e16b8e5aa90]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-24539ed9-b5f6-46cb-9764-ce40f4a24824 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-24539ed9-b5f6-46cb-9764-ce40f4a24824 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.424s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:22:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-24539ed9-b5f6-46cb-9764-ce40f4a24824 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] <== disconnect_volume: return (425ms) None {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:22:13 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24539ed9-b5f6-46cb-9764-ce40f4a24824 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Disconnected iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 21:22:13 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Instance destroyed successfully.
Aug 01 21:22:13 user nova-compute[72586]: DEBUG nova.objects.instance [None req-30881a69-71be-4be4-b9e9-33f512b680bb tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Lazy-loading 'resources' on Instance uuid 9197638d-0c03-4b4e-876a-003bd8db3c35 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:22:13 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-30881a69-71be-4be4-b9e9-33f512b680bb tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T21:19:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1344020572',display_name='tempest-AttachSCSIVolumeTestJSON-server-1344020572',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1344020572',id=6,image_ref='9f619018-9915-4d87-ac1d-9572432baab6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMoTU7MKLzZum72kXrSTvDdkSp+qmLqlGiCGNlYCdHKCbKm6HlcbdKXg6mp3WXdh4KEz3LJZUlNcbMYMvqzsrQFmOc8SM6NYft086Z1eAmsH5N044ZCWezW/UkzOCWGy1Q==',key_name='tempest-keypair-906710204',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:20:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='efd1332e56dc4a158be5c285ce251f5f',ramdisk_id='',reservation_id='r-renvgnhk',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9f619018-9915-4d87-ac1d-9572432baab6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-646238755',owner_user_name='tempest-AttachSCSIVolumeTestJSON-646238755-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:20:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2736ebf83dc482281755eb266739a11',uuid=9197638d-0c03-4b4e-876a-003bd8db3c35,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2c422520-a997-44b1-91dc-bfd781a5942d", "address": "fa:16:3e:43:29:03", "network": {"id": "8e827e51-e845-4426-a503-c9885ce46971", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-638517071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efd1332e56dc4a158be5c285ce251f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c422520-a9", "ovs_interfaceid": "2c422520-a997-44b1-91dc-bfd781a5942d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:22:13 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-30881a69-71be-4be4-b9e9-33f512b680bb tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Converting VIF {"id": "2c422520-a997-44b1-91dc-bfd781a5942d", "address": "fa:16:3e:43:29:03", "network": {"id": "8e827e51-e845-4426-a503-c9885ce46971", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-638517071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efd1332e56dc4a158be5c285ce251f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c422520-a9", "ovs_interfaceid": "2c422520-a997-44b1-91dc-bfd781a5942d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:22:13 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-30881a69-71be-4be4-b9e9-33f512b680bb tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:29:03,bridge_name='br-int',has_traffic_filtering=True,id=2c422520-a997-44b1-91dc-bfd781a5942d,network=Network(8e827e51-e845-4426-a503-c9885ce46971),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c422520-a9') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:22:13 user nova-compute[72586]: DEBUG os_vif [None req-30881a69-71be-4be4-b9e9-33f512b680bb tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:29:03,bridge_name='br-int',has_traffic_filtering=True,id=2c422520-a997-44b1-91dc-bfd781a5942d,network=Network(8e827e51-e845-4426-a503-c9885ce46971),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c422520-a9') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:22:13 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:13 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2c422520-a9, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:22:13 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:13 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:13 user nova-compute[72586]: INFO os_vif [None req-30881a69-71be-4be4-b9e9-33f512b680bb tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:29:03,bridge_name='br-int',has_traffic_filtering=True,id=2c422520-a997-44b1-91dc-bfd781a5942d,network=Network(8e827e51-e845-4426-a503-c9885ce46971),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c422520-a9')
Aug 01 21:22:13 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-30881a69-71be-4be4-b9e9-33f512b680bb tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Deleting instance files /opt/stack/data/nova/instances/9197638d-0c03-4b4e-876a-003bd8db3c35_del
Aug 01 21:22:13 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-30881a69-71be-4be4-b9e9-33f512b680bb tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Deletion of /opt/stack/data/nova/instances/9197638d-0c03-4b4e-876a-003bd8db3c35_del complete
Aug 01 21:22:13 user nova-compute[72586]: INFO nova.compute.manager [None req-30881a69-71be-4be4-b9e9-33f512b680bb tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Took 1.22 seconds to destroy the instance on the hypervisor.
Aug 01 21:22:13 user nova-compute[72586]: DEBUG oslo.service.loopingcall [None req-30881a69-71be-4be4-b9e9-33f512b680bb tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72586) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 21:22:13 user nova-compute[72586]: DEBUG nova.compute.manager [-] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Deallocating network for instance {{(pid=72586) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 21:22:13 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] deallocate_for_instance() {{(pid=72586) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 21:22:13 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:14 user nova-compute[72586]: DEBUG nova.objects.instance [None req-24539ed9-b5f6-46cb-9764-ce40f4a24824 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Lazy-loading 'flavor' on Instance uuid 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:22:14 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-24539ed9-b5f6-46cb-9764-ce40f4a24824 tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Lock "3830c8b3-27b8-45f3-bbdb-8a081dfcadc4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.907s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:22:14 user nova-compute[72586]: DEBUG nova.compute.manager [req-389fe83b-4140-4f6f-8708-854a58006da7 req-8104618e-ba64-42ee-a9e3-59996c373040 service nova] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Received event network-vif-plugged-2c422520-a997-44b1-91dc-bfd781a5942d {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:22:14 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-389fe83b-4140-4f6f-8708-854a58006da7 req-8104618e-ba64-42ee-a9e3-59996c373040 service nova] Acquiring lock "9197638d-0c03-4b4e-876a-003bd8db3c35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:22:14 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-389fe83b-4140-4f6f-8708-854a58006da7 req-8104618e-ba64-42ee-a9e3-59996c373040 service nova] Lock "9197638d-0c03-4b4e-876a-003bd8db3c35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:22:14 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-389fe83b-4140-4f6f-8708-854a58006da7 req-8104618e-ba64-42ee-a9e3-59996c373040 service nova] Lock "9197638d-0c03-4b4e-876a-003bd8db3c35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:22:14 user nova-compute[72586]: DEBUG nova.compute.manager [req-389fe83b-4140-4f6f-8708-854a58006da7 req-8104618e-ba64-42ee-a9e3-59996c373040 service nova] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] No waiting events found dispatching network-vif-plugged-2c422520-a997-44b1-91dc-bfd781a5942d {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:22:14 user nova-compute[72586]: WARNING nova.compute.manager [req-389fe83b-4140-4f6f-8708-854a58006da7 req-8104618e-ba64-42ee-a9e3-59996c373040 service nova] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Received unexpected event network-vif-plugged-2c422520-a997-44b1-91dc-bfd781a5942d for instance with vm_state active and task_state deleting.
Aug 01 21:22:14 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:22:14 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Took 1.29 seconds to deallocate network for instance.
Aug 01 21:22:14 user nova-compute[72586]: DEBUG nova.compute.manager [req-ed98896d-26f0-4de5-a653-b3362ce1d41a req-d6f1ab9f-ee2b-472f-9ed6-9c442f921981 service nova] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Received event network-vif-deleted-2c422520-a997-44b1-91dc-bfd781a5942d {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:22:14 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-30881a69-71be-4be4-b9e9-33f512b680bb tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:22:14 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-30881a69-71be-4be4-b9e9-33f512b680bb tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:22:15 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-30881a69-71be-4be4-b9e9-33f512b680bb tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:22:15 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-30881a69-71be-4be4-b9e9-33f512b680bb tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:22:15 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-30881a69-71be-4be4-b9e9-33f512b680bb tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.384s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:22:15 user nova-compute[72586]: INFO nova.scheduler.client.report [None req-30881a69-71be-4be4-b9e9-33f512b680bb tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Deleted allocations for instance 9197638d-0c03-4b4e-876a-003bd8db3c35
Aug 01 21:22:15 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-30881a69-71be-4be4-b9e9-33f512b680bb tempest-AttachSCSIVolumeTestJSON-646238755 tempest-AttachSCSIVolumeTestJSON-646238755-project-member] Lock "9197638d-0c03-4b4e-876a-003bd8db3c35" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.172s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:22:15 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfbc6618-2f5c-4983-88ac-517578f91a6c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Calling os-brick to attach iSCSI Volume {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 21:22:15 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfbc6618-2f5c-4983-88ac-517578f91a6c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:25ea9428-d17d-448b-b8a2-a25e77c1a8b4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PCSqmfLG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:22:15 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-dfbc6618-2f5c-4983-88ac-517578f91a6c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:22:15 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-dfbc6618-2f5c-4983-88ac-517578f91a6c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:22:15 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-dfbc6618-2f5c-4983-88ac-517578f91a6c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:22:15 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-dfbc6618-2f5c-4983-88ac-517578f91a6c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:22:15 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-dfbc6618-2f5c-4983-88ac-517578f91a6c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25ea9428-d17d-448b-b8a2-a25e77c1a8b4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:22:15 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-dfbc6618-2f5c-4983-88ac-517578f91a6c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25ea9428-d17d-448b-b8a2-a25e77c1a8b4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:22:15 user nova-compute[72586]: INFO os_brick.initiator.connectors.iscsi [None req-dfbc6618-2f5c-4983-88ac-517578f91a6c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 21:22:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25ea9428-d17d-448b-b8a2-a25e77c1a8b4 -p 172.16.0.220:3260 {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25ea9428-d17d-448b-b8a2-a25e77c1a8b4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:15 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[31899064-9dfa-4336-851f-c049f7ceab15]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:15 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfbc6618-2f5c-4983-88ac-517578f91a6c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 21:22:15 user nova-compute[72586]:  {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25ea9428-d17d-448b-b8a2-a25e77c1a8b4 -p 172.16.0.220:3260 --interface default --op new {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25ea9428-d17d-448b-b8a2-a25e77c1a8b4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:15 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd2ca5f-3acd-46ad-b2a9-53eb27cbb940]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:25ea9428-d17d-448b-b8a2-a25e77c1a8b4] added\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:15 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfbc6618-2f5c-4983-88ac-517578f91a6c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:25ea9428-d17d-448b-b8a2-a25e77c1a8b4] added
Aug 01 21:22:15 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25ea9428-d17d-448b-b8a2-a25e77c1a8b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:15 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:22:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25ea9428-d17d-448b-b8a2-a25e77c1a8b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:15 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ecb4fd-835f-4bb3-b7f6-bcd134130576]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:15 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfbc6618-2f5c-4983-88ac-517578f91a6c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25ea9428-d17d-448b-b8a2-a25e77c1a8b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25ea9428-d17d-448b-b8a2-a25e77c1a8b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:15 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b19538-47e7-4b24-b991-3c3416d9596f]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:15 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfbc6618-2f5c-4983-88ac-517578f91a6c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25ea9428-d17d-448b-b8a2-a25e77c1a8b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PCSqmfLG {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25ea9428-d17d-448b-b8a2-a25e77c1a8b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PCSqmfLG" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:15 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fca224a-6e69-4f8f-8a82-308dad60f723]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:15 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfbc6618-2f5c-4983-88ac-517578f91a6c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PCSqmfLG'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25ea9428-d17d-448b-b8a2-a25e77c1a8b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25ea9428-d17d-448b-b8a2-a25e77c1a8b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:15 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a54f22c-bd77-4b98-8652-1853ebd06d1a]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:15 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfbc6618-2f5c-4983-88ac-517578f91a6c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:16 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c3de66-f622-4212-ad84-e87e736bb860]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfbc6618-2f5c-4983-88ac-517578f91a6c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)
Aug 01 21:22:16 user nova-compute[72586]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)
Aug 01 21:22:16 user nova-compute[72586]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)
Aug 01 21:22:16 user nova-compute[72586]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)
Aug 01 21:22:16 user nova-compute[72586]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)
Aug 01 21:22:16 user nova-compute[72586]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)
Aug 01 21:22:16 user nova-compute[72586]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)
Aug 01 21:22:16 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:22:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfbc6618-2f5c-4983-88ac-517578f91a6c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)
Aug 01 21:22:16 user nova-compute[72586]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)
Aug 01 21:22:16 user nova-compute[72586]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)
Aug 01 21:22:16 user nova-compute[72586]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)
Aug 01 21:22:16 user nova-compute[72586]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)
Aug 01 21:22:16 user nova-compute[72586]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)
Aug 01 21:22:16 user nova-compute[72586]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)
Aug 01 21:22:16 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:22:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25ea9428-d17d-448b-b8a2-a25e77c1a8b4 -p 172.16.0.220:3260 --login {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25ea9428-d17d-448b-b8a2-a25e77c1a8b4 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:16 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2fe9c05-cb42-4f8e-ae0e-94303460a138]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:25ea9428-d17d-448b-b8a2-a25e77c1a8b4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:25ea9428-d17d-448b-b8a2-a25e77c1a8b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfbc6618-2f5c-4983-88ac-517578f91a6c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:25ea9428-d17d-448b-b8a2-a25e77c1a8b4, portal: 172.16.0.220,3260]
Aug 01 21:22:16 user nova-compute[72586]: Login to [iface: default, target: iqn.2010-10.org.openstack:25ea9428-d17d-448b-b8a2-a25e77c1a8b4, portal: 172.16.0.220,3260] successful.
Aug 01 21:22:16 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25ea9428-d17d-448b-b8a2-a25e77c1a8b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25ea9428-d17d-448b-b8a2-a25e77c1a8b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:16 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9659b7-05e2-4326-bbcb-60ca91610b83]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfbc6618-2f5c-4983-88ac-517578f91a6c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:16 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc65d147-12a5-421d-9027-a72fba4fbdfd]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25ea9428-d17d-448b-b8a2-a25e77c1a8b4 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfbc6618-2f5c-4983-88ac-517578f91a6c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25ea9428-d17d-448b-b8a2-a25e77c1a8b4 (non-flash)
Aug 01 21:22:16 user nova-compute[72586]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)
Aug 01 21:22:16 user nova-compute[72586]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)
Aug 01 21:22:16 user nova-compute[72586]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)
Aug 01 21:22:16 user nova-compute[72586]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)
Aug 01 21:22:16 user nova-compute[72586]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)
Aug 01 21:22:16 user nova-compute[72586]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)
Aug 01 21:22:16 user nova-compute[72586]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)
Aug 01 21:22:16 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:22:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfbc6618-2f5c-4983-88ac-517578f91a6c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25ea9428-d17d-448b-b8a2-a25e77c1a8b4 (non-flash)
Aug 01 21:22:16 user nova-compute[72586]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)
Aug 01 21:22:16 user nova-compute[72586]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)
Aug 01 21:22:16 user nova-compute[72586]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)
Aug 01 21:22:16 user nova-compute[72586]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)
Aug 01 21:22:16 user nova-compute[72586]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)
Aug 01 21:22:16 user nova-compute[72586]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)
Aug 01 21:22:16 user nova-compute[72586]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)
Aug 01 21:22:16 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:22:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-dfbc6618-2f5c-4983-88ac-517578f91a6c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25ea9428-d17d-448b-b8a2-a25e77c1a8b4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:22:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfbc6618-2f5c-4983-88ac-517578f91a6c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Connected to 172.16.0.220:3260 {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 21:22:16 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-dfbc6618-2f5c-4983-88ac-517578f91a6c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] HCTL ('40', '-', '-', 0) found on session 12 with lun 0 {{(pid=72586) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 21:22:16 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-dfbc6618-2f5c-4983-88ac-517578f91a6c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=72586) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 21:22:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:16 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fdd74de-8c0a-476b-8a1c-533190e175b0]: (4, ('- - 0', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:16 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-dfbc6618-2f5c-4983-88ac-517578f91a6c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Searching for a device in session 12 and hctl ['40', '*', '*', 0] yield: None {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:22:16 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:22:17 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-dfbc6618-2f5c-4983-88ac-517578f91a6c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Searching for a device in session 12 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:22:17 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfbc6618-2f5c-4983-88ac-517578f91a6c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PCSqmfLG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 21:22:17 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-dfbc6618-2f5c-4983-88ac-517578f91a6c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:22:17 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfbc6618-2f5c-4983-88ac-517578f91a6c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '23731353537363366', 'path': '/dev/sdi'} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:22:17 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfbc6618-2f5c-4983-88ac-517578f91a6c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23731353537363366', 'path': '/dev/sdi'} {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 21:22:17 user nova-compute[72586]: DEBUG nova.objects.instance [None req-dfbc6618-2f5c-4983-88ac-517578f91a6c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Lazy-loading 'flavor' on Instance uuid 34b640b7-1dec-4b31-b64b-f1dbee7f62f6 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:22:17 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-dfbc6618-2f5c-4983-88ac-517578f91a6c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 21:22:17 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:22:17 user nova-compute[72586]:   <source dev="/dev/sdi"/>
Aug 01 21:22:17 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:22:17 user nova-compute[72586]:   <serial>25ea9428-d17d-448b-b8a2-a25e77c1a8b4</serial>
Aug 01 21:22:17 user nova-compute[72586]: </disk>
Aug 01 21:22:17 user nova-compute[72586]:  {{(pid=72586) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 21:22:17 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-dfbc6618-2f5c-4983-88ac-517578f91a6c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:22:17 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-dfbc6618-2f5c-4983-88ac-517578f91a6c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] No BDM found with device name hda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:22:17 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-dfbc6618-2f5c-4983-88ac-517578f91a6c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] No VIF found with MAC fa:16:3e:1b:58:f6, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:22:17 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-dfbc6618-2f5c-4983-88ac-517578f91a6c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Lock "34b640b7-1dec-4b31-b64b-f1dbee7f62f6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.689s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:22:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:19 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-02733292-b893-466a-be44-b2f280b00e8c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Acquiring lock "34b640b7-1dec-4b31-b64b-f1dbee7f62f6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:22:19 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-02733292-b893-466a-be44-b2f280b00e8c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Lock "34b640b7-1dec-4b31-b64b-f1dbee7f62f6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:22:19 user nova-compute[72586]: INFO nova.compute.manager [None req-02733292-b893-466a-be44-b2f280b00e8c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Detaching volume 25ea9428-d17d-448b-b8a2-a25e77c1a8b4
Aug 01 21:22:19 user nova-compute[72586]: INFO nova.virt.block_device [None req-02733292-b893-466a-be44-b2f280b00e8c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Attempting to driver detach volume 25ea9428-d17d-448b-b8a2-a25e77c1a8b4 from mountpoint /dev/vdb
Aug 01 21:22:19 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-02733292-b893-466a-be44-b2f280b00e8c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Attempting to detach device vdb from instance 34b640b7-1dec-4b31-b64b-f1dbee7f62f6 from the persistent domain config. {{(pid=72586) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 21:22:19 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-02733292-b893-466a-be44-b2f280b00e8c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 21:22:19 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:22:19 user nova-compute[72586]:   <source dev="/dev/sdi"/>
Aug 01 21:22:19 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:22:19 user nova-compute[72586]:   <serial>25ea9428-d17d-448b-b8a2-a25e77c1a8b4</serial>
Aug 01 21:22:19 user nova-compute[72586]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 01 21:22:19 user nova-compute[72586]: </disk>
Aug 01 21:22:19 user nova-compute[72586]:  {{(pid=72586) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 21:22:19 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-02733292-b893-466a-be44-b2f280b00e8c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Successfully detached device vdb from instance 34b640b7-1dec-4b31-b64b-f1dbee7f62f6 from the persistent domain config.
Aug 01 21:22:19 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-02733292-b893-466a-be44-b2f280b00e8c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 34b640b7-1dec-4b31-b64b-f1dbee7f62f6 from the live domain config. {{(pid=72586) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 21:22:19 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-02733292-b893-466a-be44-b2f280b00e8c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 21:22:19 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:22:19 user nova-compute[72586]:   <source dev="/dev/sdi"/>
Aug 01 21:22:19 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:22:19 user nova-compute[72586]:   <serial>25ea9428-d17d-448b-b8a2-a25e77c1a8b4</serial>
Aug 01 21:22:19 user nova-compute[72586]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 01 21:22:19 user nova-compute[72586]: </disk>
Aug 01 21:22:19 user nova-compute[72586]:  {{(pid=72586) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 21:22:19 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:22:19 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:22:19 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:22:19 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:22:19 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:22:19 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Auditing locally available compute resources for user (node: user) {{(pid=72586) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 21:22:19 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Received event <DeviceRemovedEvent: 1690924939.9172935, 34b640b7-1dec-4b31-b64b-f1dbee7f62f6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72586) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 21:22:19 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-02733292-b893-466a-be44-b2f280b00e8c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 34b640b7-1dec-4b31-b64b-f1dbee7f62f6 {{(pid=72586) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 21:22:19 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-02733292-b893-466a-be44-b2f280b00e8c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Successfully detached device vdb from instance 34b640b7-1dec-4b31-b64b-f1dbee7f62f6 from the live domain config.
Aug 01 21:22:19 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02733292-b893-466a-be44-b2f280b00e8c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] calling os-brick to detach iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 21:22:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-02733292-b893-466a-be44-b2f280b00e8c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, {'target_iqns': ['iqn.2010-10.org.openstack:25ea9428-d17d-448b-b8a2-a25e77c1a8b4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PCSqmfLG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:22:19 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-02733292-b893-466a-be44-b2f280b00e8c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:22:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-02733292-b893-466a-be44-b2f280b00e8c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:22:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-02733292-b893-466a-be44-b2f280b00e8c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:22:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-02733292-b893-466a-be44-b2f280b00e8c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25ea9428-d17d-448b-b8a2-a25e77c1a8b4', 0)] {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 21:22:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:19 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed68027-6fcc-4239-9660-a588e8eaaa7c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25ea9428-d17d-448b-b8a2-a25e77c1a8b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:19 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3819b5-c9a4-4a49-890c-451feae5f73a]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25ea9428-d17d-448b-b8a2-a25e77c1a8b4 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-02733292-b893-466a-be44-b2f280b00e8c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25ea9428-d17d-448b-b8a2-a25e77c1a8b4 (non-flash)
Aug 01 21:22:19 user nova-compute[72586]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)
Aug 01 21:22:19 user nova-compute[72586]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)
Aug 01 21:22:19 user nova-compute[72586]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)
Aug 01 21:22:19 user nova-compute[72586]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)
Aug 01 21:22:19 user nova-compute[72586]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)
Aug 01 21:22:19 user nova-compute[72586]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)
Aug 01 21:22:19 user nova-compute[72586]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)
Aug 01 21:22:19 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:22:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-02733292-b893-466a-be44-b2f280b00e8c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25ea9428-d17d-448b-b8a2-a25e77c1a8b4 (non-flash)
Aug 01 21:22:19 user nova-compute[72586]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)
Aug 01 21:22:19 user nova-compute[72586]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)
Aug 01 21:22:19 user nova-compute[72586]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)
Aug 01 21:22:19 user nova-compute[72586]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)
Aug 01 21:22:19 user nova-compute[72586]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)
Aug 01 21:22:19 user nova-compute[72586]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)
Aug 01 21:22:19 user nova-compute[72586]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)
Aug 01 21:22:19 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:22:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-02733292-b893-466a-be44-b2f280b00e8c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ee80e13f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25ea9428-d17d-448b-b8a2-a25e77c1a8b4'): ({'sdi'}, set())}) {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 21:22:19 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-02733292-b893-466a-be44-b2f280b00e8c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Removing single pathed devices sdi {{(pid=72586) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 21:22:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:20 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b5a275-40c0-4ac7-a56a-13e5eee057c1]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:20 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[964b7b4e-758d-4508-b972-2b3828b78cd5]: (4, ('ok\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:20 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-02733292-b893-466a-be44-b2f280b00e8c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Flushing IO for device /dev/sdi {{(pid=72586) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 21:22:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.012s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:20 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54eb871-c973-43ef-afe1-315d7860be9d]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:20 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-02733292-b893-466a-be44-b2f280b00e8c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=72586) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 21:22:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.062s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:20 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[25fe0c41-9bc1-4130-8e5b-0f0c99b664a1]: (4, ('1', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:20 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-02733292-b893-466a-be44-b2f280b00e8c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 21:22:20 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-02733292-b893-466a-be44-b2f280b00e8c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] SCSI volumes sdi have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 21:22:20 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-02733292-b893-466a-be44-b2f280b00e8c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25ea9428-d17d-448b-b8a2-a25e77c1a8b4')] {{(pid=72586) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 21:22:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25ea9428-d17d-448b-b8a2-a25e77c1a8b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25ea9428-d17d-448b-b8a2-a25e77c1a8b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:20 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d802b6-ab8d-4b09-bccd-47f3592d648a]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:20 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-02733292-b893-466a-be44-b2f280b00e8c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25ea9428-d17d-448b-b8a2-a25e77c1a8b4 -p 172.16.0.220:3260 --logout {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25ea9428-d17d-448b-b8a2-a25e77c1a8b4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:20 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[a36a023a-c78f-496e-afc2-d45a98c8a781]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:25ea9428-d17d-448b-b8a2-a25e77c1a8b4, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:25ea9428-d17d-448b-b8a2-a25e77c1a8b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:20 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-02733292-b893-466a-be44-b2f280b00e8c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:25ea9428-d17d-448b-b8a2-a25e77c1a8b4, portal: 172.16.0.220,3260]
Aug 01 21:22:20 user nova-compute[72586]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:25ea9428-d17d-448b-b8a2-a25e77c1a8b4, portal: 172.16.0.220,3260] successful.
Aug 01 21:22:20 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25ea9428-d17d-448b-b8a2-a25e77c1a8b4 -p 172.16.0.220:3260 --op delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25ea9428-d17d-448b-b8a2-a25e77c1a8b4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:20 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e19f6f-bc38-4d42-a1bc-9751db73c21c]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:20 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-02733292-b893-466a-be44-b2f280b00e8c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:20 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-02733292-b893-466a-be44-b2f280b00e8c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:22:20 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-02733292-b893-466a-be44-b2f280b00e8c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] <== disconnect_volume: return (374ms) None {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:22:20 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02733292-b893-466a-be44-b2f280b00e8c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Disconnected iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 21:22:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:20 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:22:20 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:22:20 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:22:20 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:22:20 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:22:20 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:22:20 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:22:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b640b7-1dec-4b31-b64b-f1dbee7f62f6/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b640b7-1dec-4b31-b64b-f1dbee7f62f6/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b640b7-1dec-4b31-b64b-f1dbee7f62f6/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b640b7-1dec-4b31-b64b-f1dbee7f62f6/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3830c8b3-27b8-45f3-bbdb-8a081dfcadc4/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3830c8b3-27b8-45f3-bbdb-8a081dfcadc4/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3830c8b3-27b8-45f3-bbdb-8a081dfcadc4/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3830c8b3-27b8-45f3-bbdb-8a081dfcadc4/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25fb970a-0caf-41e8-8d58-259dbd9cf291/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:21 user nova-compute[72586]: DEBUG nova.objects.instance [None req-02733292-b893-466a-be44-b2f280b00e8c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Lazy-loading 'flavor' on Instance uuid 34b640b7-1dec-4b31-b64b-f1dbee7f62f6 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:22:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25fb970a-0caf-41e8-8d58-259dbd9cf291/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25fb970a-0caf-41e8-8d58-259dbd9cf291/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-02733292-b893-466a-be44-b2f280b00e8c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Lock "34b640b7-1dec-4b31-b64b-f1dbee7f62f6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.826s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:22:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25fb970a-0caf-41e8-8d58-259dbd9cf291/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fde640d-b731-405d-af91-fb4ef85fe90a/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fde640d-b731-405d-af91-fb4ef85fe90a/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fde640d-b731-405d-af91-fb4ef85fe90a/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fde640d-b731-405d-af91-fb4ef85fe90a/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.rescue --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.rescue --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-8c55d20c-aaa8-4db2-a2af-e499e43bd18c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Acquiring lock "interface-34b640b7-1dec-4b31-b64b-f1dbee7f62f6-03e03a20-d14a-4605-ad03-adb3411a1d85" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:22:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-8c55d20c-aaa8-4db2-a2af-e499e43bd18c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Lock "interface-34b640b7-1dec-4b31-b64b-f1dbee7f62f6-03e03a20-d14a-4605-ad03-adb3411a1d85" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:22:21 user nova-compute[72586]: DEBUG nova.objects.instance [None req-8c55d20c-aaa8-4db2-a2af-e499e43bd18c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Lazy-loading 'flavor' on Instance uuid 34b640b7-1dec-4b31-b64b-f1dbee7f62f6 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:22:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-8c55d20c-aaa8-4db2-a2af-e499e43bd18c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T21:20:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1746161852',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1746161852',id=8,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPKzYl7JBQVoZJNm+4i5JYdGUIIrqn01ZBx9Dxn59EM/3bkIAv2U6qz+jMD9EtD+pH0t0lwSsBe6DmGDRqmtPx9+g58b8uj/ol6c7hfvBYUh2jxk2AjOzIXFtbR5OZW2WA==',key_name='tempest-keypair-1235433569',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:20:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fbe1daeb21ad4628841cbf8406131a88',ramdisk_id='',reservation_id='r-5lrvjzh8',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2000096306',owner_user_name='tempest-TaggedAttachmentsTest-2000096306-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:20:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25edfd4907cf4d6c816799babd01e662',uuid=34b640b7-1dec-4b31-b64b-f1dbee7f62f6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "03e03a20-d14a-4605-ad03-adb3411a1d85", "address": "fa:16:3e:eb:a0:ea", "network": {"id": "8714a7f9-0535-4183-a3b0-5c85f6bdbd21", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-704681534", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fbe1daeb21ad4628841cbf8406131a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03e03a20-d1", "ovs_interfaceid": "03e03a20-d14a-4605-ad03-adb3411a1d85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:22:21 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-8c55d20c-aaa8-4db2-a2af-e499e43bd18c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Converting VIF {"id": "03e03a20-d14a-4605-ad03-adb3411a1d85", "address": "fa:16:3e:eb:a0:ea", "network": {"id": "8714a7f9-0535-4183-a3b0-5c85f6bdbd21", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-704681534", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fbe1daeb21ad4628841cbf8406131a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03e03a20-d1", "ovs_interfaceid": "03e03a20-d14a-4605-ad03-adb3411a1d85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:22:21 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-8c55d20c-aaa8-4db2-a2af-e499e43bd18c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:a0:ea,bridge_name='br-int',has_traffic_filtering=True,id=03e03a20-d14a-4605-ad03-adb3411a1d85,network=Network(8714a7f9-0535-4183-a3b0-5c85f6bdbd21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03e03a20-d1') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:22:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-8c55d20c-aaa8-4db2-a2af-e499e43bd18c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:eb:a0:ea"/><model type="virtio"/><mtu size="1442"/><target dev="tap03e03a20-d1"/></interface> {{(pid=72586) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 01 21:22:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-8c55d20c-aaa8-4db2-a2af-e499e43bd18c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:eb:a0:ea"/><model type="virtio"/><mtu size="1442"/><target dev="tap03e03a20-d1"/></interface> {{(pid=72586) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 01 21:22:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-8c55d20c-aaa8-4db2-a2af-e499e43bd18c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Attempting to detach device tap03e03a20-d1 from instance 34b640b7-1dec-4b31-b64b-f1dbee7f62f6 from the persistent domain config. {{(pid=72586) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 21:22:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-8c55d20c-aaa8-4db2-a2af-e499e43bd18c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] detach device xml: <interface type="ethernet">
Aug 01 21:22:21 user nova-compute[72586]:   <mac address="fa:16:3e:eb:a0:ea"/>
Aug 01 21:22:21 user nova-compute[72586]:   <model type="virtio"/>
Aug 01 21:22:21 user nova-compute[72586]:   <mtu size="1442"/>
Aug 01 21:22:21 user nova-compute[72586]:   <target dev="tap03e03a20-d1"/>
Aug 01 21:22:21 user nova-compute[72586]: </interface>
Aug 01 21:22:21 user nova-compute[72586]:  {{(pid=72586) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 21:22:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-8c55d20c-aaa8-4db2-a2af-e499e43bd18c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:eb:a0:ea"/><model type="virtio"/><mtu size="1442"/><target dev="tap03e03a20-d1"/></interface> {{(pid=72586) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 01 21:22:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-8c55d20c-aaa8-4db2-a2af-e499e43bd18c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:eb:a0:ea"/><model type="virtio"/><mtu size="1442"/><target dev="tap03e03a20-d1"/></interface>not found in domain: <domain type='kvm' id='7'>
Aug 01 21:22:21 user nova-compute[72586]:   <name>instance-00000008</name>
Aug 01 21:22:21 user nova-compute[72586]:   <uuid>34b640b7-1dec-4b31-b64b-f1dbee7f62f6</uuid>
Aug 01 21:22:21 user nova-compute[72586]:   <metadata>
Aug 01 21:22:21 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:22:21 user nova-compute[72586]:   <nova:package version="0.0.0"/>
Aug 01 21:22:21 user nova-compute[72586]:   <nova:name>tempest-device-tagging-server-1746161852</nova:name>
Aug 01 21:22:21 user nova-compute[72586]:   <nova:creationTime>2023-08-01 21:22:04</nova:creationTime>
Aug 01 21:22:21 user nova-compute[72586]:   <nova:flavor name="m1.tiny">
Aug 01 21:22:21 user nova-compute[72586]:     <nova:memory>512</nova:memory>
Aug 01 21:22:21 user nova-compute[72586]:     <nova:disk>1</nova:disk>
Aug 01 21:22:21 user nova-compute[72586]:     <nova:swap>0</nova:swap>
Aug 01 21:22:21 user nova-compute[72586]:     <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:22:21 user nova-compute[72586]:     <nova:vcpus>1</nova:vcpus>
Aug 01 21:22:21 user nova-compute[72586]:   </nova:flavor>
Aug 01 21:22:21 user nova-compute[72586]:   <nova:owner>
Aug 01 21:22:21 user nova-compute[72586]:     <nova:user uuid="25edfd4907cf4d6c816799babd01e662">tempest-TaggedAttachmentsTest-2000096306-project-member</nova:user>
Aug 01 21:22:21 user nova-compute[72586]:     <nova:project uuid="fbe1daeb21ad4628841cbf8406131a88">tempest-TaggedAttachmentsTest-2000096306</nova:project>
Aug 01 21:22:21 user nova-compute[72586]:   </nova:owner>
Aug 01 21:22:21 user nova-compute[72586]:   <nova:root type="image" uuid="0243d46b-6819-42a5-926f-42b71f0c97ad"/>
Aug 01 21:22:21 user nova-compute[72586]:   <nova:ports>
Aug 01 21:22:21 user nova-compute[72586]:     <nova:port uuid="1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a">
Aug 01 21:22:21 user nova-compute[72586]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 01 21:22:21 user nova-compute[72586]:     </nova:port>
Aug 01 21:22:21 user nova-compute[72586]:     <nova:port uuid="03e03a20-d14a-4605-ad03-adb3411a1d85">
Aug 01 21:22:21 user nova-compute[72586]:       <nova:ip type="fixed" address="10.10.10.27" ipVersion="4"/>
Aug 01 21:22:21 user nova-compute[72586]:     </nova:port>
Aug 01 21:22:21 user nova-compute[72586]:   </nova:ports>
Aug 01 21:22:21 user nova-compute[72586]: </nova:instance>
Aug 01 21:22:21 user nova-compute[72586]:   </metadata>
Aug 01 21:22:21 user nova-compute[72586]:   <memory unit='KiB'>524288</memory>
Aug 01 21:22:21 user nova-compute[72586]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 01 21:22:21 user nova-compute[72586]:   <vcpu placement='static'>1</vcpu>
Aug 01 21:22:21 user nova-compute[72586]:   <resource>
Aug 01 21:22:21 user nova-compute[72586]:     <partition>/machine</partition>
Aug 01 21:22:21 user nova-compute[72586]:   </resource>
Aug 01 21:22:21 user nova-compute[72586]:   <sysinfo type='smbios'>
Aug 01 21:22:21 user nova-compute[72586]:     <system>
Aug 01 21:22:21 user nova-compute[72586]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 01 21:22:21 user nova-compute[72586]:       <entry name='product'>OpenStack Nova</entry>
Aug 01 21:22:21 user nova-compute[72586]:       <entry name='version'>0.0.0</entry>
Aug 01 21:22:21 user nova-compute[72586]:       <entry name='serial'>34b640b7-1dec-4b31-b64b-f1dbee7f62f6</entry>
Aug 01 21:22:21 user nova-compute[72586]:       <entry name='uuid'>34b640b7-1dec-4b31-b64b-f1dbee7f62f6</entry>
Aug 01 21:22:21 user nova-compute[72586]:       <entry name='family'>Virtual Machine</entry>
Aug 01 21:22:21 user nova-compute[72586]:     </system>
Aug 01 21:22:21 user nova-compute[72586]:   </sysinfo>
Aug 01 21:22:21 user nova-compute[72586]:   <os>
Aug 01 21:22:21 user nova-compute[72586]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 01 21:22:21 user nova-compute[72586]:     <boot dev='hd'/>
Aug 01 21:22:21 user nova-compute[72586]:     <smbios mode='sysinfo'/>
Aug 01 21:22:21 user nova-compute[72586]:   </os>
Aug 01 21:22:21 user nova-compute[72586]:   <features>
Aug 01 21:22:21 user nova-compute[72586]:     <acpi/>
Aug 01 21:22:21 user nova-compute[72586]:     <apic/>
Aug 01 21:22:21 user nova-compute[72586]:     <vmcoreinfo state='on'/>
Aug 01 21:22:21 user nova-compute[72586]:   </features>
Aug 01 21:22:21 user nova-compute[72586]:   <cpu mode='custom' match='exact' check='full'>
Aug 01 21:22:21 user nova-compute[72586]:     <model fallback='forbid'>Nehalem</model>
Aug 01 21:22:21 user nova-compute[72586]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 01 21:22:21 user nova-compute[72586]:     <feature policy='require' name='vme'/>
Aug 01 21:22:21 user nova-compute[72586]:     <feature policy='require' name='x2apic'/>
Aug 01 21:22:21 user nova-compute[72586]:     <feature policy='require' name='hypervisor'/>
Aug 01 21:22:21 user nova-compute[72586]:   </cpu>
Aug 01 21:22:21 user nova-compute[72586]:   <clock offset='utc'>
Aug 01 21:22:21 user nova-compute[72586]:     <timer name='pit' tickpolicy='delay'/>
Aug 01 21:22:21 user nova-compute[72586]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 01 21:22:21 user nova-compute[72586]:     <timer name='hpet' present='no'/>
Aug 01 21:22:21 user nova-compute[72586]:   </clock>
Aug 01 21:22:21 user nova-compute[72586]:   <on_poweroff>destroy</on_poweroff>
Aug 01 21:22:21 user nova-compute[72586]:   <on_reboot>restart</on_reboot>
Aug 01 21:22:21 user nova-compute[72586]:   <on_crash>destroy</on_crash>
Aug 01 21:22:21 user nova-compute[72586]:   <devices>
Aug 01 21:22:21 user nova-compute[72586]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 01 21:22:21 user nova-compute[72586]:     <disk type='file' device='disk'>
Aug 01 21:22:21 user nova-compute[72586]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 01 21:22:21 user nova-compute[72586]:       <source file='/opt/stack/data/nova/instances/34b640b7-1dec-4b31-b64b-f1dbee7f62f6/disk' index='2'/>
Aug 01 21:22:21 user nova-compute[72586]:       <backingStore type='file' index='3'>
Aug 01 21:22:21 user nova-compute[72586]:         <format type='raw'/>
Aug 01 21:22:21 user nova-compute[72586]:         <source file='/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08'/>
Aug 01 21:22:21 user nova-compute[72586]:         <backingStore/>
Aug 01 21:22:21 user nova-compute[72586]:       </backingStore>
Aug 01 21:22:21 user nova-compute[72586]:       <target dev='vda' bus='virtio'/>
Aug 01 21:22:21 user nova-compute[72586]:       <alias name='virtio-disk0'/>
Aug 01 21:22:21 user nova-compute[72586]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 01 21:22:21 user nova-compute[72586]:     </disk>
Aug 01 21:22:21 user nova-compute[72586]:     <disk type='file' device='cdrom'>
Aug 01 21:22:21 user nova-compute[72586]:       <driver name='qemu' type='raw' cache='none'/>
Aug 01 21:22:21 user nova-compute[72586]:       <source file='/opt/stack/data/nova/instances/34b640b7-1dec-4b31-b64b-f1dbee7f62f6/disk.config' index='1'/>
Aug 01 21:22:21 user nova-compute[72586]:       <backingStore/>
Aug 01 21:22:21 user nova-compute[72586]:       <target dev='hda' bus='ide'/>
Aug 01 21:22:21 user nova-compute[72586]:       <readonly/>
Aug 01 21:22:21 user nova-compute[72586]:       <alias name='ide0-0-0'/>
Aug 01 21:22:21 user nova-compute[72586]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 01 21:22:21 user nova-compute[72586]:     </disk>
Aug 01 21:22:21 user nova-compute[72586]:     <controller type='usb' index='0' model='none'>
Aug 01 21:22:21 user nova-compute[72586]:       <alias name='usb'/>
Aug 01 21:22:21 user nova-compute[72586]:     </controller>
Aug 01 21:22:21 user nova-compute[72586]:     <controller type='pci' index='0' model='pci-root'>
Aug 01 21:22:21 user nova-compute[72586]:       <alias name='pci.0'/>
Aug 01 21:22:21 user nova-compute[72586]:     </controller>
Aug 01 21:22:21 user nova-compute[72586]:     <controller type='ide' index='0'>
Aug 01 21:22:21 user nova-compute[72586]:       <alias name='ide'/>
Aug 01 21:22:21 user nova-compute[72586]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 01 21:22:21 user nova-compute[72586]:     </controller>
Aug 01 21:22:21 user nova-compute[72586]:     <interface type='ethernet'>
Aug 01 21:22:21 user nova-compute[72586]:       <mac address='fa:16:3e:1b:58:f6'/>
Aug 01 21:22:21 user nova-compute[72586]:       <target dev='tap1c85a8b5-9e'/>
Aug 01 21:22:21 user nova-compute[72586]:       <model type='virtio'/>
Aug 01 21:22:21 user nova-compute[72586]:       <mtu size='1442'/>
Aug 01 21:22:21 user nova-compute[72586]:       <alias name='net0'/>
Aug 01 21:22:21 user nova-compute[72586]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 01 21:22:21 user nova-compute[72586]:     </interface>
Aug 01 21:22:21 user nova-compute[72586]:     <interface type='ethernet'>
Aug 01 21:22:21 user nova-compute[72586]:       <mac address='fa:16:3e:eb:a0:ea'/>
Aug 01 21:22:21 user nova-compute[72586]:       <target dev='tap03e03a20-d1'/>
Aug 01 21:22:21 user nova-compute[72586]:       <model type='virtio'/>
Aug 01 21:22:21 user nova-compute[72586]:       <mtu size='1442'/>
Aug 01 21:22:21 user nova-compute[72586]:       <alias name='net1'/>
Aug 01 21:22:21 user nova-compute[72586]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 01 21:22:21 user nova-compute[72586]:     </interface>
Aug 01 21:22:21 user nova-compute[72586]:     <serial type='pty'>
Aug 01 21:22:21 user nova-compute[72586]:       <source path='/dev/pts/5'/>
Aug 01 21:22:21 user nova-compute[72586]:       <log file='/opt/stack/data/nova/instances/34b640b7-1dec-4b31-b64b-f1dbee7f62f6/console.log' append='off'/>
Aug 01 21:22:21 user nova-compute[72586]:       <target type='isa-serial' port='0'>
Aug 01 21:22:21 user nova-compute[72586]:         <model name='isa-serial'/>
Aug 01 21:22:21 user nova-compute[72586]:       </target>
Aug 01 21:22:21 user nova-compute[72586]:       <alias name='serial0'/>
Aug 01 21:22:21 user nova-compute[72586]:     </serial>
Aug 01 21:22:21 user nova-compute[72586]:     <console type='pty' tty='/dev/pts/5'>
Aug 01 21:22:21 user nova-compute[72586]:       <source path='/dev/pts/5'/>
Aug 01 21:22:21 user nova-compute[72586]:       <log file='/opt/stack/data/nova/instances/34b640b7-1dec-4b31-b64b-f1dbee7f62f6/console.log' append='off'/>
Aug 01 21:22:21 user nova-compute[72586]:       <target type='serial' port='0'/>
Aug 01 21:22:21 user nova-compute[72586]:       <alias name='serial0'/>
Aug 01 21:22:21 user nova-compute[72586]:     </console>
Aug 01 21:22:21 user nova-compute[72586]:     <input type='mouse' bus='ps2'>
Aug 01 21:22:21 user nova-compute[72586]:       <alias name='input0'/>
Aug 01 21:22:21 user nova-compute[72586]:     </input>
Aug 01 21:22:21 user nova-compute[72586]:     <input type='keyboard' bus='ps2'>
Aug 01 21:22:21 user nova-compute[72586]:       <alias name='input1'/>
Aug 01 21:22:21 user nova-compute[72586]:     </input>
Aug 01 21:22:21 user nova-compute[72586]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Aug 01 21:22:21 user nova-compute[72586]:       <listen type='address' address='0.0.0.0'/>
Aug 01 21:22:21 user nova-compute[72586]:     </graphics>
Aug 01 21:22:21 user nova-compute[72586]:     <audio id='1' type='none'/>
Aug 01 21:22:21 user nova-compute[72586]:     <video>
Aug 01 21:22:21 user nova-compute[72586]:       <model type='virtio' heads='1' primary='yes'/>
Aug 01 21:22:21 user nova-compute[72586]:       <alias name='video0'/>
Aug 01 21:22:21 user nova-compute[72586]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 01 21:22:21 user nova-compute[72586]:     </video>
Aug 01 21:22:21 user nova-compute[72586]:     <memballoon model='virtio'>
Aug 01 21:22:21 user nova-compute[72586]:       <stats period='10'/>
Aug 01 21:22:21 user nova-compute[72586]:       <alias name='balloon0'/>
Aug 01 21:22:21 user nova-compute[72586]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 01 21:22:21 user nova-compute[72586]:     </memballoon>
Aug 01 21:22:21 user nova-compute[72586]:     <rng model='virtio'>
Aug 01 21:22:21 user nova-compute[72586]:       <backend model='random'>/dev/urandom</backend>
Aug 01 21:22:21 user nova-compute[72586]:       <alias name='rng0'/>
Aug 01 21:22:21 user nova-compute[72586]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 01 21:22:21 user nova-compute[72586]:     </rng>
Aug 01 21:22:21 user nova-compute[72586]:   </devices>
Aug 01 21:22:21 user nova-compute[72586]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 01 21:22:21 user nova-compute[72586]:     <label>libvirt-34b640b7-1dec-4b31-b64b-f1dbee7f62f6</label>
Aug 01 21:22:21 user nova-compute[72586]:     <imagelabel>libvirt-34b640b7-1dec-4b31-b64b-f1dbee7f62f6</imagelabel>
Aug 01 21:22:21 user nova-compute[72586]:   </seclabel>
Aug 01 21:22:21 user nova-compute[72586]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 01 21:22:21 user nova-compute[72586]:     <label>+64055:+108</label>
Aug 01 21:22:21 user nova-compute[72586]:     <imagelabel>+64055:+108</imagelabel>
Aug 01 21:22:21 user nova-compute[72586]:   </seclabel>
Aug 01 21:22:21 user nova-compute[72586]: </domain>
Aug 01 21:22:21 user nova-compute[72586]:  {{(pid=72586) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 01 21:22:21 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-8c55d20c-aaa8-4db2-a2af-e499e43bd18c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Successfully detached device tap03e03a20-d1 from instance 34b640b7-1dec-4b31-b64b-f1dbee7f62f6 from the persistent domain config.
Aug 01 21:22:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-8c55d20c-aaa8-4db2-a2af-e499e43bd18c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] (1/8): Attempting to detach device tap03e03a20-d1 with device alias net1 from instance 34b640b7-1dec-4b31-b64b-f1dbee7f62f6 from the live domain config. {{(pid=72586) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 21:22:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-8c55d20c-aaa8-4db2-a2af-e499e43bd18c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] detach device xml: <interface type="ethernet">
Aug 01 21:22:21 user nova-compute[72586]:   <mac address="fa:16:3e:eb:a0:ea"/>
Aug 01 21:22:21 user nova-compute[72586]:   <model type="virtio"/>
Aug 01 21:22:21 user nova-compute[72586]:   <mtu size="1442"/>
Aug 01 21:22:21 user nova-compute[72586]:   <target dev="tap03e03a20-d1"/>
Aug 01 21:22:21 user nova-compute[72586]: </interface>
Aug 01 21:22:21 user nova-compute[72586]:  {{(pid=72586) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 21:22:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:22 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:22 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:22 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:22 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Received event <DeviceRemovedEvent: 1690924942.1837337, 34b640b7-1dec-4b31-b64b-f1dbee7f62f6 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72586) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 21:22:22 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-8c55d20c-aaa8-4db2-a2af-e499e43bd18c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Start waiting for the detach event from libvirt for device tap03e03a20-d1 with device alias net1 for instance 34b640b7-1dec-4b31-b64b-f1dbee7f62f6 {{(pid=72586) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 21:22:22 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-8c55d20c-aaa8-4db2-a2af-e499e43bd18c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:eb:a0:ea"/><model type="virtio"/><mtu size="1442"/><target dev="tap03e03a20-d1"/></interface> {{(pid=72586) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 01 21:22:22 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-8c55d20c-aaa8-4db2-a2af-e499e43bd18c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:eb:a0:ea"/><model type="virtio"/><mtu size="1442"/><target dev="tap03e03a20-d1"/></interface>not found in domain: <domain type='kvm' id='7'>
Aug 01 21:22:22 user nova-compute[72586]:   <name>instance-00000008</name>
Aug 01 21:22:22 user nova-compute[72586]:   <uuid>34b640b7-1dec-4b31-b64b-f1dbee7f62f6</uuid>
Aug 01 21:22:22 user nova-compute[72586]:   <metadata>
Aug 01 21:22:22 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:22:22 user nova-compute[72586]:   <nova:package version="0.0.0"/>
Aug 01 21:22:22 user nova-compute[72586]:   <nova:name>tempest-device-tagging-server-1746161852</nova:name>
Aug 01 21:22:22 user nova-compute[72586]:   <nova:creationTime>2023-08-01 21:22:04</nova:creationTime>
Aug 01 21:22:22 user nova-compute[72586]:   <nova:flavor name="m1.tiny">
Aug 01 21:22:22 user nova-compute[72586]:     <nova:memory>512</nova:memory>
Aug 01 21:22:22 user nova-compute[72586]:     <nova:disk>1</nova:disk>
Aug 01 21:22:22 user nova-compute[72586]:     <nova:swap>0</nova:swap>
Aug 01 21:22:22 user nova-compute[72586]:     <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:22:22 user nova-compute[72586]:     <nova:vcpus>1</nova:vcpus>
Aug 01 21:22:22 user nova-compute[72586]:   </nova:flavor>
Aug 01 21:22:22 user nova-compute[72586]:   <nova:owner>
Aug 01 21:22:22 user nova-compute[72586]:     <nova:user uuid="25edfd4907cf4d6c816799babd01e662">tempest-TaggedAttachmentsTest-2000096306-project-member</nova:user>
Aug 01 21:22:22 user nova-compute[72586]:     <nova:project uuid="fbe1daeb21ad4628841cbf8406131a88">tempest-TaggedAttachmentsTest-2000096306</nova:project>
Aug 01 21:22:22 user nova-compute[72586]:   </nova:owner>
Aug 01 21:22:22 user nova-compute[72586]:   <nova:root type="image" uuid="0243d46b-6819-42a5-926f-42b71f0c97ad"/>
Aug 01 21:22:22 user nova-compute[72586]:   <nova:ports>
Aug 01 21:22:22 user nova-compute[72586]:     <nova:port uuid="1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a">
Aug 01 21:22:22 user nova-compute[72586]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 01 21:22:22 user nova-compute[72586]:     </nova:port>
Aug 01 21:22:22 user nova-compute[72586]:     <nova:port uuid="03e03a20-d14a-4605-ad03-adb3411a1d85">
Aug 01 21:22:22 user nova-compute[72586]:       <nova:ip type="fixed" address="10.10.10.27" ipVersion="4"/>
Aug 01 21:22:22 user nova-compute[72586]:     </nova:port>
Aug 01 21:22:22 user nova-compute[72586]:   </nova:ports>
Aug 01 21:22:22 user nova-compute[72586]: </nova:instance>
Aug 01 21:22:22 user nova-compute[72586]:   </metadata>
Aug 01 21:22:22 user nova-compute[72586]:   <memory unit='KiB'>524288</memory>
Aug 01 21:22:22 user nova-compute[72586]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 01 21:22:22 user nova-compute[72586]:   <vcpu placement='static'>1</vcpu>
Aug 01 21:22:22 user nova-compute[72586]:   <resource>
Aug 01 21:22:22 user nova-compute[72586]:     <partition>/machine</partition>
Aug 01 21:22:22 user nova-compute[72586]:   </resource>
Aug 01 21:22:22 user nova-compute[72586]:   <sysinfo type='smbios'>
Aug 01 21:22:22 user nova-compute[72586]:     <system>
Aug 01 21:22:22 user nova-compute[72586]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 01 21:22:22 user nova-compute[72586]:       <entry name='product'>OpenStack Nova</entry>
Aug 01 21:22:22 user nova-compute[72586]:       <entry name='version'>0.0.0</entry>
Aug 01 21:22:22 user nova-compute[72586]:       <entry name='serial'>34b640b7-1dec-4b31-b64b-f1dbee7f62f6</entry>
Aug 01 21:22:22 user nova-compute[72586]:       <entry name='uuid'>34b640b7-1dec-4b31-b64b-f1dbee7f62f6</entry>
Aug 01 21:22:22 user nova-compute[72586]:       <entry name='family'>Virtual Machine</entry>
Aug 01 21:22:22 user nova-compute[72586]:     </system>
Aug 01 21:22:22 user nova-compute[72586]:   </sysinfo>
Aug 01 21:22:22 user nova-compute[72586]:   <os>
Aug 01 21:22:22 user nova-compute[72586]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 01 21:22:22 user nova-compute[72586]:     <boot dev='hd'/>
Aug 01 21:22:22 user nova-compute[72586]:     <smbios mode='sysinfo'/>
Aug 01 21:22:22 user nova-compute[72586]:   </os>
Aug 01 21:22:22 user nova-compute[72586]:   <features>
Aug 01 21:22:22 user nova-compute[72586]:     <acpi/>
Aug 01 21:22:22 user nova-compute[72586]:     <apic/>
Aug 01 21:22:22 user nova-compute[72586]:     <vmcoreinfo state='on'/>
Aug 01 21:22:22 user nova-compute[72586]:   </features>
Aug 01 21:22:22 user nova-compute[72586]:   <cpu mode='custom' match='exact' check='full'>
Aug 01 21:22:22 user nova-compute[72586]:     <model fallback='forbid'>Nehalem</model>
Aug 01 21:22:22 user nova-compute[72586]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 01 21:22:22 user nova-compute[72586]:     <feature policy='require' name='vme'/>
Aug 01 21:22:22 user nova-compute[72586]:     <feature policy='require' name='x2apic'/>
Aug 01 21:22:22 user nova-compute[72586]:     <feature policy='require' name='hypervisor'/>
Aug 01 21:22:22 user nova-compute[72586]:   </cpu>
Aug 01 21:22:22 user nova-compute[72586]:   <clock offset='utc'>
Aug 01 21:22:22 user nova-compute[72586]:     <timer name='pit' tickpolicy='delay'/>
Aug 01 21:22:22 user nova-compute[72586]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 01 21:22:22 user nova-compute[72586]:     <timer name='hpet' present='no'/>
Aug 01 21:22:22 user nova-compute[72586]:   </clock>
Aug 01 21:22:22 user nova-compute[72586]:   <on_poweroff>destroy</on_poweroff>
Aug 01 21:22:22 user nova-compute[72586]:   <on_reboot>restart</on_reboot>
Aug 01 21:22:22 user nova-compute[72586]:   <on_crash>destroy</on_crash>
Aug 01 21:22:22 user nova-compute[72586]:   <devices>
Aug 01 21:22:22 user nova-compute[72586]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 01 21:22:22 user nova-compute[72586]:     <disk type='file' device='disk'>
Aug 01 21:22:22 user nova-compute[72586]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 01 21:22:22 user nova-compute[72586]:       <source file='/opt/stack/data/nova/instances/34b640b7-1dec-4b31-b64b-f1dbee7f62f6/disk' index='2'/>
Aug 01 21:22:22 user nova-compute[72586]:       <backingStore type='file' index='3'>
Aug 01 21:22:22 user nova-compute[72586]:         <format type='raw'/>
Aug 01 21:22:22 user nova-compute[72586]:         <source file='/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08'/>
Aug 01 21:22:22 user nova-compute[72586]:         <backingStore/>
Aug 01 21:22:22 user nova-compute[72586]:       </backingStore>
Aug 01 21:22:22 user nova-compute[72586]:       <target dev='vda' bus='virtio'/>
Aug 01 21:22:22 user nova-compute[72586]:       <alias name='virtio-disk0'/>
Aug 01 21:22:22 user nova-compute[72586]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 01 21:22:22 user nova-compute[72586]:     </disk>
Aug 01 21:22:22 user nova-compute[72586]:     <disk type='file' device='cdrom'>
Aug 01 21:22:22 user nova-compute[72586]:       <driver name='qemu' type='raw' cache='none'/>
Aug 01 21:22:22 user nova-compute[72586]:       <source file='/opt/stack/data/nova/instances/34b640b7-1dec-4b31-b64b-f1dbee7f62f6/disk.config' index='1'/>
Aug 01 21:22:22 user nova-compute[72586]:       <backingStore/>
Aug 01 21:22:22 user nova-compute[72586]:       <target dev='hda' bus='ide'/>
Aug 01 21:22:22 user nova-compute[72586]:       <readonly/>
Aug 01 21:22:22 user nova-compute[72586]:       <alias name='ide0-0-0'/>
Aug 01 21:22:22 user nova-compute[72586]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 01 21:22:22 user nova-compute[72586]:     </disk>
Aug 01 21:22:22 user nova-compute[72586]:     <controller type='usb' index='0' model='none'>
Aug 01 21:22:22 user nova-compute[72586]:       <alias name='usb'/>
Aug 01 21:22:22 user nova-compute[72586]:     </controller>
Aug 01 21:22:22 user nova-compute[72586]:     <controller type='pci' index='0' model='pci-root'>
Aug 01 21:22:22 user nova-compute[72586]:       <alias name='pci.0'/>
Aug 01 21:22:22 user nova-compute[72586]:     </controller>
Aug 01 21:22:22 user nova-compute[72586]:     <controller type='ide' index='0'>
Aug 01 21:22:22 user nova-compute[72586]:       <alias name='ide'/>
Aug 01 21:22:22 user nova-compute[72586]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 01 21:22:22 user nova-compute[72586]:     </controller>
Aug 01 21:22:22 user nova-compute[72586]:     <interface type='ethernet'>
Aug 01 21:22:22 user nova-compute[72586]:       <mac address='fa:16:3e:1b:58:f6'/>
Aug 01 21:22:22 user nova-compute[72586]:       <target dev='tap1c85a8b5-9e'/>
Aug 01 21:22:22 user nova-compute[72586]:       <model type='virtio'/>
Aug 01 21:22:22 user nova-compute[72586]:       <mtu size='1442'/>
Aug 01 21:22:22 user nova-compute[72586]:       <alias name='net0'/>
Aug 01 21:22:22 user nova-compute[72586]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 01 21:22:22 user nova-compute[72586]:     </interface>
Aug 01 21:22:22 user nova-compute[72586]:     <serial type='pty'>
Aug 01 21:22:22 user nova-compute[72586]:       <source path='/dev/pts/5'/>
Aug 01 21:22:22 user nova-compute[72586]:       <log file='/opt/stack/data/nova/instances/34b640b7-1dec-4b31-b64b-f1dbee7f62f6/console.log' append='off'/>
Aug 01 21:22:22 user nova-compute[72586]:       <target type='isa-serial' port='0'>
Aug 01 21:22:22 user nova-compute[72586]:         <model name='isa-serial'/>
Aug 01 21:22:22 user nova-compute[72586]:       </target>
Aug 01 21:22:22 user nova-compute[72586]:       <alias name='serial0'/>
Aug 01 21:22:22 user nova-compute[72586]:     </serial>
Aug 01 21:22:22 user nova-compute[72586]:     <console type='pty' tty='/dev/pts/5'>
Aug 01 21:22:22 user nova-compute[72586]:       <source path='/dev/pts/5'/>
Aug 01 21:22:22 user nova-compute[72586]:       <log file='/opt/stack/data/nova/instances/34b640b7-1dec-4b31-b64b-f1dbee7f62f6/console.log' append='off'/>
Aug 01 21:22:22 user nova-compute[72586]:       <target type='serial' port='0'/>
Aug 01 21:22:22 user nova-compute[72586]:       <alias name='serial0'/>
Aug 01 21:22:22 user nova-compute[72586]:     </console>
Aug 01 21:22:22 user nova-compute[72586]:     <input type='mouse' bus='ps2'>
Aug 01 21:22:22 user nova-compute[72586]:       <alias name='input0'/>
Aug 01 21:22:22 user nova-compute[72586]:     </input>
Aug 01 21:22:22 user nova-compute[72586]:     <input type='keyboard' bus='ps2'>
Aug 01 21:22:22 user nova-compute[72586]:       <alias name='input1'/>
Aug 01 21:22:22 user nova-compute[72586]:     </input>
Aug 01 21:22:22 user nova-compute[72586]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Aug 01 21:22:22 user nova-compute[72586]:       <listen type='address' address='0.0.0.0'/>
Aug 01 21:22:22 user nova-compute[72586]:     </graphics>
Aug 01 21:22:22 user nova-compute[72586]:     <audio id='1' type='none'/>
Aug 01 21:22:22 user nova-compute[72586]:     <video>
Aug 01 21:22:22 user nova-compute[72586]:       <model type='virtio' heads='1' primary='yes'/>
Aug 01 21:22:22 user nova-compute[72586]:       <alias name='video0'/>
Aug 01 21:22:22 user nova-compute[72586]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 01 21:22:22 user nova-compute[72586]:     </video>
Aug 01 21:22:22 user nova-compute[72586]:     <memballoon model='virtio'>
Aug 01 21:22:22 user nova-compute[72586]:       <stats period='10'/>
Aug 01 21:22:22 user nova-compute[72586]:       <alias name='balloon0'/>
Aug 01 21:22:22 user nova-compute[72586]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 01 21:22:22 user nova-compute[72586]:     </memballoon>
Aug 01 21:22:22 user nova-compute[72586]:     <rng model='virtio'>
Aug 01 21:22:22 user nova-compute[72586]:       <backend model='random'>/dev/urandom</backend>
Aug 01 21:22:22 user nova-compute[72586]:       <alias name='rng0'/>
Aug 01 21:22:22 user nova-compute[72586]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 01 21:22:22 user nova-compute[72586]:     </rng>
Aug 01 21:22:22 user nova-compute[72586]:   </devices>
Aug 01 21:22:22 user nova-compute[72586]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 01 21:22:22 user nova-compute[72586]:     <label>libvirt-34b640b7-1dec-4b31-b64b-f1dbee7f62f6</label>
Aug 01 21:22:22 user nova-compute[72586]:     <imagelabel>libvirt-34b640b7-1dec-4b31-b64b-f1dbee7f62f6</imagelabel>
Aug 01 21:22:22 user nova-compute[72586]:   </seclabel>
Aug 01 21:22:22 user nova-compute[72586]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 01 21:22:22 user nova-compute[72586]:     <label>+64055:+108</label>
Aug 01 21:22:22 user nova-compute[72586]:     <imagelabel>+64055:+108</imagelabel>
Aug 01 21:22:22 user nova-compute[72586]:   </seclabel>
Aug 01 21:22:22 user nova-compute[72586]: </domain>
Aug 01 21:22:22 user nova-compute[72586]:  {{(pid=72586) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 01 21:22:22 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-8c55d20c-aaa8-4db2-a2af-e499e43bd18c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Successfully detached device tap03e03a20-d1 from instance 34b640b7-1dec-4b31-b64b-f1dbee7f62f6 from the live domain config.
Aug 01 21:22:22 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-8c55d20c-aaa8-4db2-a2af-e499e43bd18c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T21:20:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1746161852',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1746161852',id=8,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPKzYl7JBQVoZJNm+4i5JYdGUIIrqn01ZBx9Dxn59EM/3bkIAv2U6qz+jMD9EtD+pH0t0lwSsBe6DmGDRqmtPx9+g58b8uj/ol6c7hfvBYUh2jxk2AjOzIXFtbR5OZW2WA==',key_name='tempest-keypair-1235433569',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:20:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fbe1daeb21ad4628841cbf8406131a88',ramdisk_id='',reservation_id='r-5lrvjzh8',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2000096306',owner_user_name='tempest-TaggedAttachmentsTest-2000096306-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:20:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25edfd4907cf4d6c816799babd01e662',uuid=34b640b7-1dec-4b31-b64b-f1dbee7f62f6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "03e03a20-d14a-4605-ad03-adb3411a1d85", "address": "fa:16:3e:eb:a0:ea", "network": {"id": "8714a7f9-0535-4183-a3b0-5c85f6bdbd21", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-704681534", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fbe1daeb21ad4628841cbf8406131a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03e03a20-d1", "ovs_interfaceid": "03e03a20-d14a-4605-ad03-adb3411a1d85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:22:22 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-8c55d20c-aaa8-4db2-a2af-e499e43bd18c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Converting VIF {"id": "03e03a20-d14a-4605-ad03-adb3411a1d85", "address": "fa:16:3e:eb:a0:ea", "network": {"id": "8714a7f9-0535-4183-a3b0-5c85f6bdbd21", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-704681534", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fbe1daeb21ad4628841cbf8406131a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03e03a20-d1", "ovs_interfaceid": "03e03a20-d14a-4605-ad03-adb3411a1d85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:22:22 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-8c55d20c-aaa8-4db2-a2af-e499e43bd18c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:a0:ea,bridge_name='br-int',has_traffic_filtering=True,id=03e03a20-d14a-4605-ad03-adb3411a1d85,network=Network(8714a7f9-0535-4183-a3b0-5c85f6bdbd21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03e03a20-d1') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:22:22 user nova-compute[72586]: DEBUG os_vif [None req-8c55d20c-aaa8-4db2-a2af-e499e43bd18c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:a0:ea,bridge_name='br-int',has_traffic_filtering=True,id=03e03a20-d14a-4605-ad03-adb3411a1d85,network=Network(8714a7f9-0535-4183-a3b0-5c85f6bdbd21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03e03a20-d1') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:22:22 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:22 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap03e03a20-d1, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:22:22 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:22 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:22 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bb880c4-a665-47a2-834d-264c834e8133 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Calling os-brick to attach iSCSI Volume {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 21:22:22 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb880c4-a665-47a2-834d-264c834e8133 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QhPHJSjs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:22:22 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-1bb880c4-a665-47a2-834d-264c834e8133 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:22:22 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-1bb880c4-a665-47a2-834d-264c834e8133 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:22:22 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-1bb880c4-a665-47a2-834d-264c834e8133 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:22:22 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-1bb880c4-a665-47a2-834d-264c834e8133 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:22:22 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-1bb880c4-a665-47a2-834d-264c834e8133 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:22:22 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-1bb880c4-a665-47a2-834d-264c834e8133 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:22:22 user nova-compute[72586]: INFO os_brick.initiator.connectors.iscsi [None req-1bb880c4-a665-47a2-834d-264c834e8133 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 21:22:22 user nova-compute[72586]: DEBUG nova.compute.manager [req-0ca12b42-c02c-41ba-9381-c3046e265fe0 req-40d21a37-c4b3-431e-ad34-807c65d94f5b service nova] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Received event network-vif-unplugged-03e03a20-d14a-4605-ad03-adb3411a1d85 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:22:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-0ca12b42-c02c-41ba-9381-c3046e265fe0 req-40d21a37-c4b3-431e-ad34-807c65d94f5b service nova] Acquiring lock "34b640b7-1dec-4b31-b64b-f1dbee7f62f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:22:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-0ca12b42-c02c-41ba-9381-c3046e265fe0 req-40d21a37-c4b3-431e-ad34-807c65d94f5b service nova] Lock "34b640b7-1dec-4b31-b64b-f1dbee7f62f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:22:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-0ca12b42-c02c-41ba-9381-c3046e265fe0 req-40d21a37-c4b3-431e-ad34-807c65d94f5b service nova] Lock "34b640b7-1dec-4b31-b64b-f1dbee7f62f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:22:22 user nova-compute[72586]: DEBUG nova.compute.manager [req-0ca12b42-c02c-41ba-9381-c3046e265fe0 req-40d21a37-c4b3-431e-ad34-807c65d94f5b service nova] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] No waiting events found dispatching network-vif-unplugged-03e03a20-d14a-4605-ad03-adb3411a1d85 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:22:22 user nova-compute[72586]: WARNING nova.compute.manager [req-0ca12b42-c02c-41ba-9381-c3046e265fe0 req-40d21a37-c4b3-431e-ad34-807c65d94f5b service nova] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Received unexpected event network-vif-unplugged-03e03a20-d14a-4605-ad03-adb3411a1d85 for instance with vm_state active and task_state None.
Aug 01 21:22:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 -p 172.16.0.220:3260 {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:22 user nova-compute[72586]: INFO os_vif [None req-8c55d20c-aaa8-4db2-a2af-e499e43bd18c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:a0:ea,bridge_name='br-int',has_traffic_filtering=True,id=03e03a20-d14a-4605-ad03-adb3411a1d85,network=Network(8714a7f9-0535-4183-a3b0-5c85f6bdbd21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03e03a20-d1')
Aug 01 21:22:22 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-8c55d20c-aaa8-4db2-a2af-e499e43bd18c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:22:22 user nova-compute[72586]:   <nova:package version="0.0.0"/>
Aug 01 21:22:22 user nova-compute[72586]:   <nova:name>tempest-device-tagging-server-1746161852</nova:name>
Aug 01 21:22:22 user nova-compute[72586]:   <nova:creationTime>2023-08-01 21:22:22</nova:creationTime>
Aug 01 21:22:22 user nova-compute[72586]:   <nova:flavor name="m1.tiny">
Aug 01 21:22:22 user nova-compute[72586]:     <nova:memory>512</nova:memory>
Aug 01 21:22:22 user nova-compute[72586]:     <nova:disk>1</nova:disk>
Aug 01 21:22:22 user nova-compute[72586]:     <nova:swap>0</nova:swap>
Aug 01 21:22:22 user nova-compute[72586]:     <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:22:22 user nova-compute[72586]:     <nova:vcpus>1</nova:vcpus>
Aug 01 21:22:22 user nova-compute[72586]:   </nova:flavor>
Aug 01 21:22:22 user nova-compute[72586]:   <nova:owner>
Aug 01 21:22:22 user nova-compute[72586]:     <nova:user uuid="25edfd4907cf4d6c816799babd01e662">tempest-TaggedAttachmentsTest-2000096306-project-member</nova:user>
Aug 01 21:22:22 user nova-compute[72586]:     <nova:project uuid="fbe1daeb21ad4628841cbf8406131a88">tempest-TaggedAttachmentsTest-2000096306</nova:project>
Aug 01 21:22:22 user nova-compute[72586]:   </nova:owner>
Aug 01 21:22:22 user nova-compute[72586]:   <nova:root type="image" uuid="0243d46b-6819-42a5-926f-42b71f0c97ad"/>
Aug 01 21:22:22 user nova-compute[72586]:   <nova:ports>
Aug 01 21:22:22 user nova-compute[72586]:     <nova:port uuid="1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a">
Aug 01 21:22:22 user nova-compute[72586]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 01 21:22:22 user nova-compute[72586]:     </nova:port>
Aug 01 21:22:22 user nova-compute[72586]:   </nova:ports>
Aug 01 21:22:22 user nova-compute[72586]: </nova:instance>
Aug 01 21:22:22 user nova-compute[72586]:  {{(pid=72586) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 01 21:22:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:22 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49c3ef4-8f85-46ab-878d-1a653c14dd0a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:22 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb880c4-a665-47a2-834d-264c834e8133 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 21:22:22 user nova-compute[72586]:  {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:22 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:22:22 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:22:22 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Hypervisor/Node resource view: name=user free_ram=7204MB free_disk=25.65768814086914GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72586) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 21:22:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:22:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:22:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 -p 172.16.0.220:3260 --interface default --op new {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:22 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06907a3-7729-4d5b-867b-eba0170d63ce]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225] added\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:22 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb880c4-a665-47a2-834d-264c834e8133 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225] added
Aug 01 21:22:22 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:22 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[31841081-1b82-4d66-8924-c0782abb8f19]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:22 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb880c4-a665-47a2-834d-264c834e8133 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:22 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b096e6b4-fad3-4e35-96f3-4826a53b5e74]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:22 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb880c4-a665-47a2-834d-264c834e8133 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QhPHJSjs {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QhPHJSjs" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:22 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6744c6-cf96-4711-be82-f39edfb0c645]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:22 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb880c4-a665-47a2-834d-264c834e8133 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QhPHJSjs'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c580175-e468-47c9-93dc-387207aba63a]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb880c4-a665-47a2-834d-264c834e8133 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 042f0031-1e4d-41d0-8bfa-36001675cfe3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 413c3426-18ad-4a5c-af04-e0e7fc90f050 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 0fde640d-b731-405d-af91-fb4ef85fe90a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 34b640b7-1dec-4b31-b64b-f1dbee7f62f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 25fb970a-0caf-41e8-8d58-259dbd9cf291 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 420cd648-f3bb-49b0-a731-d2e4337367f6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 644c949c-3ac3-46ec-a62f-b38224f0a85c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[865fe5ef-f360-4bf6-b1b7-5d97b9d8cc1c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb880c4-a665-47a2-834d-264c834e8133 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)
Aug 01 21:22:23 user nova-compute[72586]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)
Aug 01 21:22:23 user nova-compute[72586]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)
Aug 01 21:22:23 user nova-compute[72586]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)
Aug 01 21:22:23 user nova-compute[72586]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)
Aug 01 21:22:23 user nova-compute[72586]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)
Aug 01 21:22:23 user nova-compute[72586]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)
Aug 01 21:22:23 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb880c4-a665-47a2-834d-264c834e8133 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)
Aug 01 21:22:23 user nova-compute[72586]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)
Aug 01 21:22:23 user nova-compute[72586]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)
Aug 01 21:22:23 user nova-compute[72586]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)
Aug 01 21:22:23 user nova-compute[72586]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)
Aug 01 21:22:23 user nova-compute[72586]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)
Aug 01 21:22:23 user nova-compute[72586]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)
Aug 01 21:22:23 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 -p 172.16.0.220:3260 --login {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fdb5fd1-3bd7-4d93-96ed-ae107871fe91]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb880c4-a665-47a2-834d-264c834e8133 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225, portal: 172.16.0.220,3260]
Aug 01 21:22:23 user nova-compute[72586]: Login to [iface: default, target: iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225, portal: 172.16.0.220,3260] successful.
Aug 01 21:22:23 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c274a4-b602-4ff3-91a3-a6b8801788d5]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb880c4-a665-47a2-834d-264c834e8133 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f299321b-d154-4730-94cf-d802197c7977]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb880c4-a665-47a2-834d-264c834e8133 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 (non-flash)
Aug 01 21:22:23 user nova-compute[72586]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)
Aug 01 21:22:23 user nova-compute[72586]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)
Aug 01 21:22:23 user nova-compute[72586]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)
Aug 01 21:22:23 user nova-compute[72586]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)
Aug 01 21:22:23 user nova-compute[72586]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)
Aug 01 21:22:23 user nova-compute[72586]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)
Aug 01 21:22:23 user nova-compute[72586]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)
Aug 01 21:22:23 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb880c4-a665-47a2-834d-264c834e8133 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 (non-flash)
Aug 01 21:22:23 user nova-compute[72586]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)
Aug 01 21:22:23 user nova-compute[72586]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)
Aug 01 21:22:23 user nova-compute[72586]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)
Aug 01 21:22:23 user nova-compute[72586]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)
Aug 01 21:22:23 user nova-compute[72586]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)
Aug 01 21:22:23 user nova-compute[72586]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)
Aug 01 21:22:23 user nova-compute[72586]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)
Aug 01 21:22:23 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-1bb880c4-a665-47a2-834d-264c834e8133 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.351s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb880c4-a665-47a2-834d-264c834e8133 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Connected to 172.16.0.220:3260 {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-1bb880c4-a665-47a2-834d-264c834e8133 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] HCTL ('40', '-', '-', 0) found on session 13 with lun 0 {{(pid=72586) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-1bb880c4-a665-47a2-834d-264c834e8133 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=72586) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4f26e8-dbd3-46de-bf8b-5dff19605560]: (4, ('- - 0', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-1bb880c4-a665-47a2-834d-264c834e8133 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Searching for a device in session 13 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb880c4-a665-47a2-834d-264c834e8133 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QhPHJSjs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG nova.compute.manager [req-70505756-b653-4bc3-87ae-4711adecd551 req-69229a8a-7880-4638-b3e5-3dcfef317cd4 service nova] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Received event network-vif-deleted-03e03a20-d14a-4605-ad03-adb3411a1d85 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:22:23 user nova-compute[72586]: INFO nova.compute.manager [req-70505756-b653-4bc3-87ae-4711adecd551 req-69229a8a-7880-4638-b3e5-3dcfef317cd4 service nova] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Neutron deleted interface 03e03a20-d14a-4605-ad03-adb3411a1d85; detaching it from the instance and deleting it from the info cache
Aug 01 21:22:23 user nova-compute[72586]: DEBUG nova.network.neutron [req-70505756-b653-4bc3-87ae-4711adecd551 req-69229a8a-7880-4638-b3e5-3dcfef317cd4 service nova] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Updating instance_info_cache with network_info: [{"id": "1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a", "address": "fa:16:3e:1b:58:f6", "network": {"id": "869076ac-07a1-49eb-9912-83f396d5b66d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2019500958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbe1daeb21ad4628841cbf8406131a88", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c85a8b5-9e", "ovs_interfaceid": "1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-8c55d20c-aaa8-4db2-a2af-e499e43bd18c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Acquiring lock "refresh_cache-34b640b7-1dec-4b31-b64b-f1dbee7f62f6" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-8c55d20c-aaa8-4db2-a2af-e499e43bd18c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Acquired lock "refresh_cache-34b640b7-1dec-4b31-b64b-f1dbee7f62f6" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG nova.network.neutron [None req-8c55d20c-aaa8-4db2-a2af-e499e43bd18c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Compute_service record updated for user:user {{(pid=72586) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.481s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG nova.objects.instance [req-70505756-b653-4bc3-87ae-4711adecd551 req-69229a8a-7880-4638-b3e5-3dcfef317cd4 service nova] Lazy-loading 'system_metadata' on Instance uuid 34b640b7-1dec-4b31-b64b-f1dbee7f62f6 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG nova.objects.instance [req-70505756-b653-4bc3-87ae-4711adecd551 req-69229a8a-7880-4638-b3e5-3dcfef317cd4 service nova] Lazy-loading 'flavor' on Instance uuid 34b640b7-1dec-4b31-b64b-f1dbee7f62f6 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [req-70505756-b653-4bc3-87ae-4711adecd551 req-69229a8a-7880-4638-b3e5-3dcfef317cd4 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T21:20:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1746161852',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1746161852',id=8,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPKzYl7JBQVoZJNm+4i5JYdGUIIrqn01ZBx9Dxn59EM/3bkIAv2U6qz+jMD9EtD+pH0t0lwSsBe6DmGDRqmtPx9+g58b8uj/ol6c7hfvBYUh2jxk2AjOzIXFtbR5OZW2WA==',key_name='tempest-keypair-1235433569',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:20:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fbe1daeb21ad4628841cbf8406131a88',ramdisk_id='',reservation_id='r-5lrvjzh8',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2000096306',owner_user_name='tempest-TaggedAttachmentsTest-2000096306-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:20:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25edfd4907cf4d6c816799babd01e662',uuid=34b640b7-1dec-4b31-b64b-f1dbee7f62f6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "03e03a20-d14a-4605-ad03-adb3411a1d85", "address": "fa:16:3e:eb:a0:ea", "network": {"id": "8714a7f9-0535-4183-a3b0-5c85f6bdbd21", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-704681534", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fbe1daeb21ad4628841cbf8406131a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03e03a20-d1", "ovs_interfaceid": "03e03a20-d14a-4605-ad03-adb3411a1d85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG nova.network.os_vif_util [req-70505756-b653-4bc3-87ae-4711adecd551 req-69229a8a-7880-4638-b3e5-3dcfef317cd4 service nova] Converting VIF {"id": "03e03a20-d14a-4605-ad03-adb3411a1d85", "address": "fa:16:3e:eb:a0:ea", "network": {"id": "8714a7f9-0535-4183-a3b0-5c85f6bdbd21", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-704681534", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fbe1daeb21ad4628841cbf8406131a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03e03a20-d1", "ovs_interfaceid": "03e03a20-d14a-4605-ad03-adb3411a1d85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG nova.network.os_vif_util [req-70505756-b653-4bc3-87ae-4711adecd551 req-69229a8a-7880-4638-b3e5-3dcfef317cd4 service nova] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:a0:ea,bridge_name='br-int',has_traffic_filtering=True,id=03e03a20-d14a-4605-ad03-adb3411a1d85,network=Network(8714a7f9-0535-4183-a3b0-5c85f6bdbd21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03e03a20-d1') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [req-70505756-b653-4bc3-87ae-4711adecd551 req-69229a8a-7880-4638-b3e5-3dcfef317cd4 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:eb:a0:ea"/><model type="virtio"/><mtu size="1442"/><target dev="tap03e03a20-d1"/></interface> {{(pid=72586) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [req-70505756-b653-4bc3-87ae-4711adecd551 req-69229a8a-7880-4638-b3e5-3dcfef317cd4 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:eb:a0:ea"/><model type="virtio"/><mtu size="1442"/><target dev="tap03e03a20-d1"/></interface>not found in domain: <domain type='kvm' id='7'>
Aug 01 21:22:23 user nova-compute[72586]:   <name>instance-00000008</name>
Aug 01 21:22:23 user nova-compute[72586]:   <uuid>34b640b7-1dec-4b31-b64b-f1dbee7f62f6</uuid>
Aug 01 21:22:23 user nova-compute[72586]:   <metadata>
Aug 01 21:22:23 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:22:23 user nova-compute[72586]:   <nova:package version="0.0.0"/>
Aug 01 21:22:23 user nova-compute[72586]:   <nova:name>tempest-device-tagging-server-1746161852</nova:name>
Aug 01 21:22:23 user nova-compute[72586]:   <nova:creationTime>2023-08-01 21:22:22</nova:creationTime>
Aug 01 21:22:23 user nova-compute[72586]:   <nova:flavor name="m1.tiny">
Aug 01 21:22:23 user nova-compute[72586]:     <nova:memory>512</nova:memory>
Aug 01 21:22:23 user nova-compute[72586]:     <nova:disk>1</nova:disk>
Aug 01 21:22:23 user nova-compute[72586]:     <nova:swap>0</nova:swap>
Aug 01 21:22:23 user nova-compute[72586]:     <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:22:23 user nova-compute[72586]:     <nova:vcpus>1</nova:vcpus>
Aug 01 21:22:23 user nova-compute[72586]:   </nova:flavor>
Aug 01 21:22:23 user nova-compute[72586]:   <nova:owner>
Aug 01 21:22:23 user nova-compute[72586]:     <nova:user uuid="25edfd4907cf4d6c816799babd01e662">tempest-TaggedAttachmentsTest-2000096306-project-member</nova:user>
Aug 01 21:22:23 user nova-compute[72586]:     <nova:project uuid="fbe1daeb21ad4628841cbf8406131a88">tempest-TaggedAttachmentsTest-2000096306</nova:project>
Aug 01 21:22:23 user nova-compute[72586]:   </nova:owner>
Aug 01 21:22:23 user nova-compute[72586]:   <nova:root type="image" uuid="0243d46b-6819-42a5-926f-42b71f0c97ad"/>
Aug 01 21:22:23 user nova-compute[72586]:   <nova:ports>
Aug 01 21:22:23 user nova-compute[72586]:     <nova:port uuid="1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a">
Aug 01 21:22:23 user nova-compute[72586]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 01 21:22:23 user nova-compute[72586]:     </nova:port>
Aug 01 21:22:23 user nova-compute[72586]:   </nova:ports>
Aug 01 21:22:23 user nova-compute[72586]: </nova:instance>
Aug 01 21:22:23 user nova-compute[72586]:   </metadata>
Aug 01 21:22:23 user nova-compute[72586]:   <memory unit='KiB'>524288</memory>
Aug 01 21:22:23 user nova-compute[72586]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 01 21:22:23 user nova-compute[72586]:   <vcpu placement='static'>1</vcpu>
Aug 01 21:22:23 user nova-compute[72586]:   <resource>
Aug 01 21:22:23 user nova-compute[72586]:     <partition>/machine</partition>
Aug 01 21:22:23 user nova-compute[72586]:   </resource>
Aug 01 21:22:23 user nova-compute[72586]:   <sysinfo type='smbios'>
Aug 01 21:22:23 user nova-compute[72586]:     <system>
Aug 01 21:22:23 user nova-compute[72586]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 01 21:22:23 user nova-compute[72586]:       <entry name='product'>OpenStack Nova</entry>
Aug 01 21:22:23 user nova-compute[72586]:       <entry name='version'>0.0.0</entry>
Aug 01 21:22:23 user nova-compute[72586]:       <entry name='serial'>34b640b7-1dec-4b31-b64b-f1dbee7f62f6</entry>
Aug 01 21:22:23 user nova-compute[72586]:       <entry name='uuid'>34b640b7-1dec-4b31-b64b-f1dbee7f62f6</entry>
Aug 01 21:22:23 user nova-compute[72586]:       <entry name='family'>Virtual Machine</entry>
Aug 01 21:22:23 user nova-compute[72586]:     </system>
Aug 01 21:22:23 user nova-compute[72586]:   </sysinfo>
Aug 01 21:22:23 user nova-compute[72586]:   <os>
Aug 01 21:22:23 user nova-compute[72586]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 01 21:22:23 user nova-compute[72586]:     <boot dev='hd'/>
Aug 01 21:22:23 user nova-compute[72586]:     <smbios mode='sysinfo'/>
Aug 01 21:22:23 user nova-compute[72586]:   </os>
Aug 01 21:22:23 user nova-compute[72586]:   <features>
Aug 01 21:22:23 user nova-compute[72586]:     <acpi/>
Aug 01 21:22:23 user nova-compute[72586]:     <apic/>
Aug 01 21:22:23 user nova-compute[72586]:     <vmcoreinfo state='on'/>
Aug 01 21:22:23 user nova-compute[72586]:   </features>
Aug 01 21:22:23 user nova-compute[72586]:   <cpu mode='custom' match='exact' check='full'>
Aug 01 21:22:23 user nova-compute[72586]:     <model fallback='forbid'>Nehalem</model>
Aug 01 21:22:23 user nova-compute[72586]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 01 21:22:23 user nova-compute[72586]:     <feature policy='require' name='vme'/>
Aug 01 21:22:23 user nova-compute[72586]:     <feature policy='require' name='x2apic'/>
Aug 01 21:22:23 user nova-compute[72586]:     <feature policy='require' name='hypervisor'/>
Aug 01 21:22:23 user nova-compute[72586]:   </cpu>
Aug 01 21:22:23 user nova-compute[72586]:   <clock offset='utc'>
Aug 01 21:22:23 user nova-compute[72586]:     <timer name='pit' tickpolicy='delay'/>
Aug 01 21:22:23 user nova-compute[72586]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 01 21:22:23 user nova-compute[72586]:     <timer name='hpet' present='no'/>
Aug 01 21:22:23 user nova-compute[72586]:   </clock>
Aug 01 21:22:23 user nova-compute[72586]:   <on_poweroff>destroy</on_poweroff>
Aug 01 21:22:23 user nova-compute[72586]:   <on_reboot>restart</on_reboot>
Aug 01 21:22:23 user nova-compute[72586]:   <on_crash>destroy</on_crash>
Aug 01 21:22:23 user nova-compute[72586]:   <devices>
Aug 01 21:22:23 user nova-compute[72586]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 01 21:22:23 user nova-compute[72586]:     <disk type='file' device='disk'>
Aug 01 21:22:23 user nova-compute[72586]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 01 21:22:23 user nova-compute[72586]:       <source file='/opt/stack/data/nova/instances/34b640b7-1dec-4b31-b64b-f1dbee7f62f6/disk' index='2'/>
Aug 01 21:22:23 user nova-compute[72586]:       <backingStore type='file' index='3'>
Aug 01 21:22:23 user nova-compute[72586]:         <format type='raw'/>
Aug 01 21:22:23 user nova-compute[72586]:         <source file='/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08'/>
Aug 01 21:22:23 user nova-compute[72586]:         <backingStore/>
Aug 01 21:22:23 user nova-compute[72586]:       </backingStore>
Aug 01 21:22:23 user nova-compute[72586]:       <target dev='vda' bus='virtio'/>
Aug 01 21:22:23 user nova-compute[72586]:       <alias name='virtio-disk0'/>
Aug 01 21:22:23 user nova-compute[72586]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 01 21:22:23 user nova-compute[72586]:     </disk>
Aug 01 21:22:23 user nova-compute[72586]:     <disk type='file' device='cdrom'>
Aug 01 21:22:23 user nova-compute[72586]:       <driver name='qemu' type='raw' cache='none'/>
Aug 01 21:22:23 user nova-compute[72586]:       <source file='/opt/stack/data/nova/instances/34b640b7-1dec-4b31-b64b-f1dbee7f62f6/disk.config' index='1'/>
Aug 01 21:22:23 user nova-compute[72586]:       <backingStore/>
Aug 01 21:22:23 user nova-compute[72586]:       <target dev='hda' bus='ide'/>
Aug 01 21:22:23 user nova-compute[72586]:       <readonly/>
Aug 01 21:22:23 user nova-compute[72586]:       <alias name='ide0-0-0'/>
Aug 01 21:22:23 user nova-compute[72586]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 01 21:22:23 user nova-compute[72586]:     </disk>
Aug 01 21:22:23 user nova-compute[72586]:     <controller type='usb' index='0' model='none'>
Aug 01 21:22:23 user nova-compute[72586]:       <alias name='usb'/>
Aug 01 21:22:23 user nova-compute[72586]:     </controller>
Aug 01 21:22:23 user nova-compute[72586]:     <controller type='pci' index='0' model='pci-root'>
Aug 01 21:22:23 user nova-compute[72586]:       <alias name='pci.0'/>
Aug 01 21:22:23 user nova-compute[72586]:     </controller>
Aug 01 21:22:23 user nova-compute[72586]:     <controller type='ide' index='0'>
Aug 01 21:22:23 user nova-compute[72586]:       <alias name='ide'/>
Aug 01 21:22:23 user nova-compute[72586]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 01 21:22:23 user nova-compute[72586]:     </controller>
Aug 01 21:22:23 user nova-compute[72586]:     <interface type='ethernet'>
Aug 01 21:22:23 user nova-compute[72586]:       <mac address='fa:16:3e:1b:58:f6'/>
Aug 01 21:22:23 user nova-compute[72586]:       <target dev='tap1c85a8b5-9e'/>
Aug 01 21:22:23 user nova-compute[72586]:       <model type='virtio'/>
Aug 01 21:22:23 user nova-compute[72586]:       <mtu size='1442'/>
Aug 01 21:22:23 user nova-compute[72586]:       <alias name='net0'/>
Aug 01 21:22:23 user nova-compute[72586]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 01 21:22:23 user nova-compute[72586]:     </interface>
Aug 01 21:22:23 user nova-compute[72586]:     <serial type='pty'>
Aug 01 21:22:23 user nova-compute[72586]:       <source path='/dev/pts/5'/>
Aug 01 21:22:23 user nova-compute[72586]:       <log file='/opt/stack/data/nova/instances/34b640b7-1dec-4b31-b64b-f1dbee7f62f6/console.log' append='off'/>
Aug 01 21:22:23 user nova-compute[72586]:       <target type='isa-serial' port='0'>
Aug 01 21:22:23 user nova-compute[72586]:         <model name='isa-serial'/>
Aug 01 21:22:23 user nova-compute[72586]:       </target>
Aug 01 21:22:23 user nova-compute[72586]:       <alias name='serial0'/>
Aug 01 21:22:23 user nova-compute[72586]:     </serial>
Aug 01 21:22:23 user nova-compute[72586]:     <console type='pty' tty='/dev/pts/5'>
Aug 01 21:22:23 user nova-compute[72586]:       <source path='/dev/pts/5'/>
Aug 01 21:22:23 user nova-compute[72586]:       <log file='/opt/stack/data/nova/instances/34b640b7-1dec-4b31-b64b-f1dbee7f62f6/console.log' append='off'/>
Aug 01 21:22:23 user nova-compute[72586]:       <target type='serial' port='0'/>
Aug 01 21:22:23 user nova-compute[72586]:       <alias name='serial0'/>
Aug 01 21:22:23 user nova-compute[72586]:     </console>
Aug 01 21:22:23 user nova-compute[72586]:     <input type='mouse' bus='ps2'>
Aug 01 21:22:23 user nova-compute[72586]:       <alias name='input0'/>
Aug 01 21:22:23 user nova-compute[72586]:     </input>
Aug 01 21:22:23 user nova-compute[72586]:     <input type='keyboard' bus='ps2'>
Aug 01 21:22:23 user nova-compute[72586]:       <alias name='input1'/>
Aug 01 21:22:23 user nova-compute[72586]:     </input>
Aug 01 21:22:23 user nova-compute[72586]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Aug 01 21:22:23 user nova-compute[72586]:       <listen type='address' address='0.0.0.0'/>
Aug 01 21:22:23 user nova-compute[72586]:     </graphics>
Aug 01 21:22:23 user nova-compute[72586]:     <audio id='1' type='none'/>
Aug 01 21:22:23 user nova-compute[72586]:     <video>
Aug 01 21:22:23 user nova-compute[72586]:       <model type='virtio' heads='1' primary='yes'/>
Aug 01 21:22:23 user nova-compute[72586]:       <alias name='video0'/>
Aug 01 21:22:23 user nova-compute[72586]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 01 21:22:23 user nova-compute[72586]:     </video>
Aug 01 21:22:23 user nova-compute[72586]:     <memballoon model='virtio'>
Aug 01 21:22:23 user nova-compute[72586]:       <stats period='10'/>
Aug 01 21:22:23 user nova-compute[72586]:       <alias name='balloon0'/>
Aug 01 21:22:23 user nova-compute[72586]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 01 21:22:23 user nova-compute[72586]:     </memballoon>
Aug 01 21:22:23 user nova-compute[72586]:     <rng model='virtio'>
Aug 01 21:22:23 user nova-compute[72586]:       <backend model='random'>/dev/urandom</backend>
Aug 01 21:22:23 user nova-compute[72586]:       <alias name='rng0'/>
Aug 01 21:22:23 user nova-compute[72586]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 01 21:22:23 user nova-compute[72586]:     </rng>
Aug 01 21:22:23 user nova-compute[72586]:   </devices>
Aug 01 21:22:23 user nova-compute[72586]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 01 21:22:23 user nova-compute[72586]:     <label>libvirt-34b640b7-1dec-4b31-b64b-f1dbee7f62f6</label>
Aug 01 21:22:23 user nova-compute[72586]:     <imagelabel>libvirt-34b640b7-1dec-4b31-b64b-f1dbee7f62f6</imagelabel>
Aug 01 21:22:23 user nova-compute[72586]:   </seclabel>
Aug 01 21:22:23 user nova-compute[72586]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 01 21:22:23 user nova-compute[72586]:     <label>+64055:+108</label>
Aug 01 21:22:23 user nova-compute[72586]:     <imagelabel>+64055:+108</imagelabel>
Aug 01 21:22:23 user nova-compute[72586]:   </seclabel>
Aug 01 21:22:23 user nova-compute[72586]: </domain>
Aug 01 21:22:23 user nova-compute[72586]:  {{(pid=72586) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [req-70505756-b653-4bc3-87ae-4711adecd551 req-69229a8a-7880-4638-b3e5-3dcfef317cd4 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:eb:a0:ea"/><model type="virtio"/><mtu size="1442"/><target dev="tap03e03a20-d1"/></interface> {{(pid=72586) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [req-70505756-b653-4bc3-87ae-4711adecd551 req-69229a8a-7880-4638-b3e5-3dcfef317cd4 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:eb:a0:ea"/><model type="virtio"/><mtu size="1442"/><target dev="tap03e03a20-d1"/></interface>not found in domain: <domain type='kvm' id='7'>
Aug 01 21:22:23 user nova-compute[72586]:   <name>instance-00000008</name>
Aug 01 21:22:23 user nova-compute[72586]:   <uuid>34b640b7-1dec-4b31-b64b-f1dbee7f62f6</uuid>
Aug 01 21:22:23 user nova-compute[72586]:   <metadata>
Aug 01 21:22:23 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:22:23 user nova-compute[72586]:   <nova:package version="0.0.0"/>
Aug 01 21:22:23 user nova-compute[72586]:   <nova:name>tempest-device-tagging-server-1746161852</nova:name>
Aug 01 21:22:23 user nova-compute[72586]:   <nova:creationTime>2023-08-01 21:22:22</nova:creationTime>
Aug 01 21:22:23 user nova-compute[72586]:   <nova:flavor name="m1.tiny">
Aug 01 21:22:23 user nova-compute[72586]:     <nova:memory>512</nova:memory>
Aug 01 21:22:23 user nova-compute[72586]:     <nova:disk>1</nova:disk>
Aug 01 21:22:23 user nova-compute[72586]:     <nova:swap>0</nova:swap>
Aug 01 21:22:23 user nova-compute[72586]:     <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:22:23 user nova-compute[72586]:     <nova:vcpus>1</nova:vcpus>
Aug 01 21:22:23 user nova-compute[72586]:   </nova:flavor>
Aug 01 21:22:23 user nova-compute[72586]:   <nova:owner>
Aug 01 21:22:23 user nova-compute[72586]:     <nova:user uuid="25edfd4907cf4d6c816799babd01e662">tempest-TaggedAttachmentsTest-2000096306-project-member</nova:user>
Aug 01 21:22:23 user nova-compute[72586]:     <nova:project uuid="fbe1daeb21ad4628841cbf8406131a88">tempest-TaggedAttachmentsTest-2000096306</nova:project>
Aug 01 21:22:23 user nova-compute[72586]:   </nova:owner>
Aug 01 21:22:23 user nova-compute[72586]:   <nova:root type="image" uuid="0243d46b-6819-42a5-926f-42b71f0c97ad"/>
Aug 01 21:22:23 user nova-compute[72586]:   <nova:ports>
Aug 01 21:22:23 user nova-compute[72586]:     <nova:port uuid="1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a">
Aug 01 21:22:23 user nova-compute[72586]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 01 21:22:23 user nova-compute[72586]:     </nova:port>
Aug 01 21:22:23 user nova-compute[72586]:   </nova:ports>
Aug 01 21:22:23 user nova-compute[72586]: </nova:instance>
Aug 01 21:22:23 user nova-compute[72586]:   </metadata>
Aug 01 21:22:23 user nova-compute[72586]:   <memory unit='KiB'>524288</memory>
Aug 01 21:22:23 user nova-compute[72586]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 01 21:22:23 user nova-compute[72586]:   <vcpu placement='static'>1</vcpu>
Aug 01 21:22:23 user nova-compute[72586]:   <resource>
Aug 01 21:22:23 user nova-compute[72586]:     <partition>/machine</partition>
Aug 01 21:22:23 user nova-compute[72586]:   </resource>
Aug 01 21:22:23 user nova-compute[72586]:   <sysinfo type='smbios'>
Aug 01 21:22:23 user nova-compute[72586]:     <system>
Aug 01 21:22:23 user nova-compute[72586]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 01 21:22:23 user nova-compute[72586]:       <entry name='product'>OpenStack Nova</entry>
Aug 01 21:22:23 user nova-compute[72586]:       <entry name='version'>0.0.0</entry>
Aug 01 21:22:23 user nova-compute[72586]:       <entry name='serial'>34b640b7-1dec-4b31-b64b-f1dbee7f62f6</entry>
Aug 01 21:22:23 user nova-compute[72586]:       <entry name='uuid'>34b640b7-1dec-4b31-b64b-f1dbee7f62f6</entry>
Aug 01 21:22:23 user nova-compute[72586]:       <entry name='family'>Virtual Machine</entry>
Aug 01 21:22:23 user nova-compute[72586]:     </system>
Aug 01 21:22:23 user nova-compute[72586]:   </sysinfo>
Aug 01 21:22:23 user nova-compute[72586]:   <os>
Aug 01 21:22:23 user nova-compute[72586]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 01 21:22:23 user nova-compute[72586]:     <boot dev='hd'/>
Aug 01 21:22:23 user nova-compute[72586]:     <smbios mode='sysinfo'/>
Aug 01 21:22:23 user nova-compute[72586]:   </os>
Aug 01 21:22:23 user nova-compute[72586]:   <features>
Aug 01 21:22:23 user nova-compute[72586]:     <acpi/>
Aug 01 21:22:23 user nova-compute[72586]:     <apic/>
Aug 01 21:22:23 user nova-compute[72586]:     <vmcoreinfo state='on'/>
Aug 01 21:22:23 user nova-compute[72586]:   </features>
Aug 01 21:22:23 user nova-compute[72586]:   <cpu mode='custom' match='exact' check='full'>
Aug 01 21:22:23 user nova-compute[72586]:     <model fallback='forbid'>Nehalem</model>
Aug 01 21:22:23 user nova-compute[72586]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 01 21:22:23 user nova-compute[72586]:     <feature policy='require' name='vme'/>
Aug 01 21:22:23 user nova-compute[72586]:     <feature policy='require' name='x2apic'/>
Aug 01 21:22:23 user nova-compute[72586]:     <feature policy='require' name='hypervisor'/>
Aug 01 21:22:23 user nova-compute[72586]:   </cpu>
Aug 01 21:22:23 user nova-compute[72586]:   <clock offset='utc'>
Aug 01 21:22:23 user nova-compute[72586]:     <timer name='pit' tickpolicy='delay'/>
Aug 01 21:22:23 user nova-compute[72586]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 01 21:22:23 user nova-compute[72586]:     <timer name='hpet' present='no'/>
Aug 01 21:22:23 user nova-compute[72586]:   </clock>
Aug 01 21:22:23 user nova-compute[72586]:   <on_poweroff>destroy</on_poweroff>
Aug 01 21:22:23 user nova-compute[72586]:   <on_reboot>restart</on_reboot>
Aug 01 21:22:23 user nova-compute[72586]:   <on_crash>destroy</on_crash>
Aug 01 21:22:23 user nova-compute[72586]:   <devices>
Aug 01 21:22:23 user nova-compute[72586]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 01 21:22:23 user nova-compute[72586]:     <disk type='file' device='disk'>
Aug 01 21:22:23 user nova-compute[72586]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 01 21:22:23 user nova-compute[72586]:       <source file='/opt/stack/data/nova/instances/34b640b7-1dec-4b31-b64b-f1dbee7f62f6/disk' index='2'/>
Aug 01 21:22:23 user nova-compute[72586]:       <backingStore type='file' index='3'>
Aug 01 21:22:23 user nova-compute[72586]:         <format type='raw'/>
Aug 01 21:22:23 user nova-compute[72586]:         <source file='/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08'/>
Aug 01 21:22:23 user nova-compute[72586]:         <backingStore/>
Aug 01 21:22:23 user nova-compute[72586]:       </backingStore>
Aug 01 21:22:23 user nova-compute[72586]:       <target dev='vda' bus='virtio'/>
Aug 01 21:22:23 user nova-compute[72586]:       <alias name='virtio-disk0'/>
Aug 01 21:22:23 user nova-compute[72586]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 01 21:22:23 user nova-compute[72586]:     </disk>
Aug 01 21:22:23 user nova-compute[72586]:     <disk type='file' device='cdrom'>
Aug 01 21:22:23 user nova-compute[72586]:       <driver name='qemu' type='raw' cache='none'/>
Aug 01 21:22:23 user nova-compute[72586]:       <source file='/opt/stack/data/nova/instances/34b640b7-1dec-4b31-b64b-f1dbee7f62f6/disk.config' index='1'/>
Aug 01 21:22:23 user nova-compute[72586]:       <backingStore/>
Aug 01 21:22:23 user nova-compute[72586]:       <target dev='hda' bus='ide'/>
Aug 01 21:22:23 user nova-compute[72586]:       <readonly/>
Aug 01 21:22:23 user nova-compute[72586]:       <alias name='ide0-0-0'/>
Aug 01 21:22:23 user nova-compute[72586]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 01 21:22:23 user nova-compute[72586]:     </disk>
Aug 01 21:22:23 user nova-compute[72586]:     <controller type='usb' index='0' model='none'>
Aug 01 21:22:23 user nova-compute[72586]:       <alias name='usb'/>
Aug 01 21:22:23 user nova-compute[72586]:     </controller>
Aug 01 21:22:23 user nova-compute[72586]:     <controller type='pci' index='0' model='pci-root'>
Aug 01 21:22:23 user nova-compute[72586]:       <alias name='pci.0'/>
Aug 01 21:22:23 user nova-compute[72586]:     </controller>
Aug 01 21:22:23 user nova-compute[72586]:     <controller type='ide' index='0'>
Aug 01 21:22:23 user nova-compute[72586]:       <alias name='ide'/>
Aug 01 21:22:23 user nova-compute[72586]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 01 21:22:23 user nova-compute[72586]:     </controller>
Aug 01 21:22:23 user nova-compute[72586]:     <interface type='ethernet'>
Aug 01 21:22:23 user nova-compute[72586]:       <mac address='fa:16:3e:1b:58:f6'/>
Aug 01 21:22:23 user nova-compute[72586]:       <target dev='tap1c85a8b5-9e'/>
Aug 01 21:22:23 user nova-compute[72586]:       <model type='virtio'/>
Aug 01 21:22:23 user nova-compute[72586]:       <mtu size='1442'/>
Aug 01 21:22:23 user nova-compute[72586]:       <alias name='net0'/>
Aug 01 21:22:23 user nova-compute[72586]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 01 21:22:23 user nova-compute[72586]:     </interface>
Aug 01 21:22:23 user nova-compute[72586]:     <serial type='pty'>
Aug 01 21:22:23 user nova-compute[72586]:       <source path='/dev/pts/5'/>
Aug 01 21:22:23 user nova-compute[72586]:       <log file='/opt/stack/data/nova/instances/34b640b7-1dec-4b31-b64b-f1dbee7f62f6/console.log' append='off'/>
Aug 01 21:22:23 user nova-compute[72586]:       <target type='isa-serial' port='0'>
Aug 01 21:22:23 user nova-compute[72586]:         <model name='isa-serial'/>
Aug 01 21:22:23 user nova-compute[72586]:       </target>
Aug 01 21:22:23 user nova-compute[72586]:       <alias name='serial0'/>
Aug 01 21:22:23 user nova-compute[72586]:     </serial>
Aug 01 21:22:23 user nova-compute[72586]:     <console type='pty' tty='/dev/pts/5'>
Aug 01 21:22:23 user nova-compute[72586]:       <source path='/dev/pts/5'/>
Aug 01 21:22:23 user nova-compute[72586]:       <log file='/opt/stack/data/nova/instances/34b640b7-1dec-4b31-b64b-f1dbee7f62f6/console.log' append='off'/>
Aug 01 21:22:23 user nova-compute[72586]:       <target type='serial' port='0'/>
Aug 01 21:22:23 user nova-compute[72586]:       <alias name='serial0'/>
Aug 01 21:22:23 user nova-compute[72586]:     </console>
Aug 01 21:22:23 user nova-compute[72586]:     <input type='mouse' bus='ps2'>
Aug 01 21:22:23 user nova-compute[72586]:       <alias name='input0'/>
Aug 01 21:22:23 user nova-compute[72586]:     </input>
Aug 01 21:22:23 user nova-compute[72586]:     <input type='keyboard' bus='ps2'>
Aug 01 21:22:23 user nova-compute[72586]:       <alias name='input1'/>
Aug 01 21:22:23 user nova-compute[72586]:     </input>
Aug 01 21:22:23 user nova-compute[72586]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Aug 01 21:22:23 user nova-compute[72586]:       <listen type='address' address='0.0.0.0'/>
Aug 01 21:22:23 user nova-compute[72586]:     </graphics>
Aug 01 21:22:23 user nova-compute[72586]:     <audio id='1' type='none'/>
Aug 01 21:22:23 user nova-compute[72586]:     <video>
Aug 01 21:22:23 user nova-compute[72586]:       <model type='virtio' heads='1' primary='yes'/>
Aug 01 21:22:23 user nova-compute[72586]:       <alias name='video0'/>
Aug 01 21:22:23 user nova-compute[72586]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 01 21:22:23 user nova-compute[72586]:     </video>
Aug 01 21:22:23 user nova-compute[72586]:     <memballoon model='virtio'>
Aug 01 21:22:23 user nova-compute[72586]:       <stats period='10'/>
Aug 01 21:22:23 user nova-compute[72586]:       <alias name='balloon0'/>
Aug 01 21:22:23 user nova-compute[72586]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 01 21:22:23 user nova-compute[72586]:     </memballoon>
Aug 01 21:22:23 user nova-compute[72586]:     <rng model='virtio'>
Aug 01 21:22:23 user nova-compute[72586]:       <backend model='random'>/dev/urandom</backend>
Aug 01 21:22:23 user nova-compute[72586]:       <alias name='rng0'/>
Aug 01 21:22:23 user nova-compute[72586]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 01 21:22:23 user nova-compute[72586]:     </rng>
Aug 01 21:22:23 user nova-compute[72586]:   </devices>
Aug 01 21:22:23 user nova-compute[72586]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 01 21:22:23 user nova-compute[72586]:     <label>libvirt-34b640b7-1dec-4b31-b64b-f1dbee7f62f6</label>
Aug 01 21:22:23 user nova-compute[72586]:     <imagelabel>libvirt-34b640b7-1dec-4b31-b64b-f1dbee7f62f6</imagelabel>
Aug 01 21:22:23 user nova-compute[72586]:   </seclabel>
Aug 01 21:22:23 user nova-compute[72586]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 01 21:22:23 user nova-compute[72586]:     <label>+64055:+108</label>
Aug 01 21:22:23 user nova-compute[72586]:     <imagelabel>+64055:+108</imagelabel>
Aug 01 21:22:23 user nova-compute[72586]:   </seclabel>
Aug 01 21:22:23 user nova-compute[72586]: </domain>
Aug 01 21:22:23 user nova-compute[72586]:  {{(pid=72586) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 01 21:22:23 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [req-70505756-b653-4bc3-87ae-4711adecd551 req-69229a8a-7880-4638-b3e5-3dcfef317cd4 service nova] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Detaching interface fa:16:3e:eb:a0:ea failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap03e03a20-d1' not found.
Aug 01 21:22:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [req-70505756-b653-4bc3-87ae-4711adecd551 req-69229a8a-7880-4638-b3e5-3dcfef317cd4 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T21:20:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1746161852',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1746161852',id=8,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPKzYl7JBQVoZJNm+4i5JYdGUIIrqn01ZBx9Dxn59EM/3bkIAv2U6qz+jMD9EtD+pH0t0lwSsBe6DmGDRqmtPx9+g58b8uj/ol6c7hfvBYUh2jxk2AjOzIXFtbR5OZW2WA==',key_name='tempest-keypair-1235433569',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:20:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fbe1daeb21ad4628841cbf8406131a88',ramdisk_id='',reservation_id='r-5lrvjzh8',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2000096306',owner_user_name='tempest-TaggedAttachmentsTest-2000096306-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:20:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25edfd4907cf4d6c816799babd01e662',uuid=34b640b7-1dec-4b31-b64b-f1dbee7f62f6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "03e03a20-d14a-4605-ad03-adb3411a1d85", "address": "fa:16:3e:eb:a0:ea", "network": {"id": "8714a7f9-0535-4183-a3b0-5c85f6bdbd21", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-704681534", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fbe1daeb21ad4628841cbf8406131a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03e03a20-d1", "ovs_interfaceid": "03e03a20-d14a-4605-ad03-adb3411a1d85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG nova.network.os_vif_util [req-70505756-b653-4bc3-87ae-4711adecd551 req-69229a8a-7880-4638-b3e5-3dcfef317cd4 service nova] Converting VIF {"id": "03e03a20-d14a-4605-ad03-adb3411a1d85", "address": "fa:16:3e:eb:a0:ea", "network": {"id": "8714a7f9-0535-4183-a3b0-5c85f6bdbd21", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-704681534", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fbe1daeb21ad4628841cbf8406131a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03e03a20-d1", "ovs_interfaceid": "03e03a20-d14a-4605-ad03-adb3411a1d85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG nova.network.os_vif_util [req-70505756-b653-4bc3-87ae-4711adecd551 req-69229a8a-7880-4638-b3e5-3dcfef317cd4 service nova] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:a0:ea,bridge_name='br-int',has_traffic_filtering=True,id=03e03a20-d14a-4605-ad03-adb3411a1d85,network=Network(8714a7f9-0535-4183-a3b0-5c85f6bdbd21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03e03a20-d1') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG os_vif [req-70505756-b653-4bc3-87ae-4711adecd551 req-69229a8a-7880-4638-b3e5-3dcfef317cd4 service nova] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:a0:ea,bridge_name='br-int',has_traffic_filtering=True,id=03e03a20-d14a-4605-ad03-adb3411a1d85,network=Network(8714a7f9-0535-4183-a3b0-5c85f6bdbd21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03e03a20-d1') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap03e03a20-d1, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:22:23 user nova-compute[72586]: INFO os_vif [req-70505756-b653-4bc3-87ae-4711adecd551 req-69229a8a-7880-4638-b3e5-3dcfef317cd4 service nova] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:a0:ea,bridge_name='br-int',has_traffic_filtering=True,id=03e03a20-d14a-4605-ad03-adb3411a1d85,network=Network(8714a7f9-0535-4183-a3b0-5c85f6bdbd21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03e03a20-d1')
Aug 01 21:22:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [req-70505756-b653-4bc3-87ae-4711adecd551 req-69229a8a-7880-4638-b3e5-3dcfef317cd4 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:22:23 user nova-compute[72586]:   <nova:package version="0.0.0"/>
Aug 01 21:22:23 user nova-compute[72586]:   <nova:name>tempest-device-tagging-server-1746161852</nova:name>
Aug 01 21:22:23 user nova-compute[72586]:   <nova:creationTime>2023-08-01 21:22:23</nova:creationTime>
Aug 01 21:22:23 user nova-compute[72586]:   <nova:flavor name="m1.tiny">
Aug 01 21:22:23 user nova-compute[72586]:     <nova:memory>512</nova:memory>
Aug 01 21:22:23 user nova-compute[72586]:     <nova:disk>1</nova:disk>
Aug 01 21:22:23 user nova-compute[72586]:     <nova:swap>0</nova:swap>
Aug 01 21:22:23 user nova-compute[72586]:     <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:22:23 user nova-compute[72586]:     <nova:vcpus>1</nova:vcpus>
Aug 01 21:22:23 user nova-compute[72586]:   </nova:flavor>
Aug 01 21:22:23 user nova-compute[72586]:   <nova:owner>
Aug 01 21:22:23 user nova-compute[72586]:     <nova:user uuid="25edfd4907cf4d6c816799babd01e662">tempest-TaggedAttachmentsTest-2000096306-project-member</nova:user>
Aug 01 21:22:23 user nova-compute[72586]:     <nova:project uuid="fbe1daeb21ad4628841cbf8406131a88">tempest-TaggedAttachmentsTest-2000096306</nova:project>
Aug 01 21:22:23 user nova-compute[72586]:   </nova:owner>
Aug 01 21:22:23 user nova-compute[72586]:   <nova:root type="image" uuid="0243d46b-6819-42a5-926f-42b71f0c97ad"/>
Aug 01 21:22:23 user nova-compute[72586]:   <nova:ports>
Aug 01 21:22:23 user nova-compute[72586]:     <nova:port uuid="1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a">
Aug 01 21:22:23 user nova-compute[72586]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 01 21:22:23 user nova-compute[72586]:     </nova:port>
Aug 01 21:22:23 user nova-compute[72586]:   </nova:ports>
Aug 01 21:22:23 user nova-compute[72586]: </nova:instance>
Aug 01 21:22:23 user nova-compute[72586]:  {{(pid=72586) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG nova.network.neutron [None req-8c55d20c-aaa8-4db2-a2af-e499e43bd18c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Updating instance_info_cache with network_info: [{"id": "1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a", "address": "fa:16:3e:1b:58:f6", "network": {"id": "869076ac-07a1-49eb-9912-83f396d5b66d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2019500958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbe1daeb21ad4628841cbf8406131a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c85a8b5-9e", "ovs_interfaceid": "1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-8c55d20c-aaa8-4db2-a2af-e499e43bd18c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Releasing lock "refresh_cache-34b640b7-1dec-4b31-b64b-f1dbee7f62f6" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-8c55d20c-aaa8-4db2-a2af-e499e43bd18c tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Lock "interface-34b640b7-1dec-4b31-b64b-f1dbee7f62f6-03e03a20-d14a-4605-ad03-adb3411a1d85" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 2.077s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:22:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:24 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-1bb880c4-a665-47a2-834d-264c834e8133 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.395s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:22:24 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb880c4-a665-47a2-834d-264c834e8133 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] <== connect_volume: return (1397ms) {'type': 'block', 'scsi_wwn': '23132313864623961', 'path': '/dev/sdi'} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:22:24 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bb880c4-a665-47a2-834d-264c834e8133 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23132313864623961', 'path': '/dev/sdi'} {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 21:22:24 user nova-compute[72586]: DEBUG nova.objects.instance [None req-1bb880c4-a665-47a2-834d-264c834e8133 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Lazy-loading 'flavor' on Instance uuid 25fb970a-0caf-41e8-8d58-259dbd9cf291 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:22:24 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-1bb880c4-a665-47a2-834d-264c834e8133 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 21:22:24 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:22:24 user nova-compute[72586]:   <source dev="/dev/sdi"/>
Aug 01 21:22:24 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:22:24 user nova-compute[72586]:   <serial>e83d4aa1-7fe5-415e-96fc-4e413114e225</serial>
Aug 01 21:22:24 user nova-compute[72586]: </disk>
Aug 01 21:22:24 user nova-compute[72586]:  {{(pid=72586) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 21:22:24 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:22:24 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:22:24 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Starting heal instance info cache {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 21:22:24 user nova-compute[72586]: DEBUG nova.compute.manager [req-c19ea4f4-357d-4772-b3c8-c4495ee4c86b req-9e0562fe-cd2d-4853-b467-29cf10744893 service nova] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Received event network-vif-plugged-03e03a20-d14a-4605-ad03-adb3411a1d85 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:22:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-c19ea4f4-357d-4772-b3c8-c4495ee4c86b req-9e0562fe-cd2d-4853-b467-29cf10744893 service nova] Acquiring lock "34b640b7-1dec-4b31-b64b-f1dbee7f62f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:22:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-c19ea4f4-357d-4772-b3c8-c4495ee4c86b req-9e0562fe-cd2d-4853-b467-29cf10744893 service nova] Lock "34b640b7-1dec-4b31-b64b-f1dbee7f62f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:22:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-c19ea4f4-357d-4772-b3c8-c4495ee4c86b req-9e0562fe-cd2d-4853-b467-29cf10744893 service nova] Lock "34b640b7-1dec-4b31-b64b-f1dbee7f62f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:22:24 user nova-compute[72586]: DEBUG nova.compute.manager [req-c19ea4f4-357d-4772-b3c8-c4495ee4c86b req-9e0562fe-cd2d-4853-b467-29cf10744893 service nova] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] No waiting events found dispatching network-vif-plugged-03e03a20-d14a-4605-ad03-adb3411a1d85 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:22:24 user nova-compute[72586]: WARNING nova.compute.manager [req-c19ea4f4-357d-4772-b3c8-c4495ee4c86b req-9e0562fe-cd2d-4853-b467-29cf10744893 service nova] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Received unexpected event network-vif-plugged-03e03a20-d14a-4605-ad03-adb3411a1d85 for instance with vm_state active and task_state None.
Aug 01 21:22:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "refresh_cache-413c3426-18ad-4a5c-af04-e0e7fc90f050" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:22:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquired lock "refresh_cache-413c3426-18ad-4a5c-af04-e0e7fc90f050" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:22:24 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Forcefully refreshing network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 21:22:24 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-1bb880c4-a665-47a2-834d-264c834e8133 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:22:24 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-1bb880c4-a665-47a2-834d-264c834e8133 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:22:24 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-1bb880c4-a665-47a2-834d-264c834e8133 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] No VIF found with MAC fa:16:3e:a0:ef:27, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:22:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1bb880c4-a665-47a2-834d-264c834e8133 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Lock "25fb970a-0caf-41e8-8d58-259dbd9cf291" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.839s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:22:24 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Updating instance_info_cache with network_info: [{"id": "38381409-a508-45f7-ad5c-53e84d2d5adb", "address": "fa:16:3e:73:a7:41", "network": {"id": "d229a8de-7a2b-4dcd-a9ac-44a40349676e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-67691992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b1a1d82f39347119a9fb49fb8e8893f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38381409-a5", "ovs_interfaceid": "38381409-a508-45f7-ad5c-53e84d2d5adb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:22:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Releasing lock "refresh_cache-413c3426-18ad-4a5c-af04-e0e7fc90f050" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:22:24 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Updated the network info_cache for instance {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 21:22:24 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:22:24 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:22:24 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:22:24 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72586) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 21:22:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] Acquiring lock "25fb970a-0caf-41e8-8d58-259dbd9cf291" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:22:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] Lock "25fb970a-0caf-41e8-8d58-259dbd9cf291" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:22:25 user nova-compute[72586]: DEBUG os_brick.utils [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:22:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:25 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dfcec8d-7073-473d-823b-df4f1390e7ef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4bc202fb9cb\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:25 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[440f7a81-9b22-49f4-9d23-77add092b9f1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:25 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd6dafb-89d0-4045-8b37-a44f4e57d6fa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:25 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[2165402e-af7c-4bbf-b7fd-4e3d0c09d6d8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] Running cmd (subprocess): nvme version {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:22:25 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] nvme not present on system {{(pid=72586) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 21:22:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:22:25 user nova-compute[72586]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 21:22:25 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec92915-9452-4f9a-bab7-c26877eff7cb]: (4, '') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:25 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72586) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 21:22:25 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 21:22:25 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] LIGHTOS: no hostnqn found. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 21:22:25 user nova-compute[72586]: DEBUG os_brick.utils [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4bc202fb9cb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:22:25 user nova-compute[72586]: INFO nova.compute.manager [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Swapping volume e83d4aa1-7fe5-415e-96fc-4e413114e225 for 7d8e7763-931d-4d10-a968-38b7b52437be
Aug 01 21:22:27 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:28 user nova-compute[72586]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690924933.5005944, 9197638d-0c03-4b4e-876a-003bd8db3c35 => Stopped> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:22:28 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] VM Stopped (Lifecycle Event)
Aug 01 21:22:28 user nova-compute[72586]: DEBUG nova.compute.manager [None req-136c93b5-a92d-48f2-8121-4ce6b4aa29eb None None] [instance: 9197638d-0c03-4b4e-876a-003bd8db3c35] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:22:28 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:32 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:33 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:36 user nova-compute[72586]: DEBUG nova.compute.manager [req-964697c6-ba45-4628-aa86-010acfc980a9 req-a84c62ac-c83c-41ee-aacb-543443bdc617 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received event network-changed-28d77550-badf-4c92-9b3d-2335ad88267a {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:22:36 user nova-compute[72586]: DEBUG nova.compute.manager [req-964697c6-ba45-4628-aa86-010acfc980a9 req-a84c62ac-c83c-41ee-aacb-543443bdc617 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Refreshing instance network info cache due to event network-changed-28d77550-badf-4c92-9b3d-2335ad88267a. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:22:36 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-964697c6-ba45-4628-aa86-010acfc980a9 req-a84c62ac-c83c-41ee-aacb-543443bdc617 service nova] Acquiring lock "refresh_cache-4d8fb5ee-2b96-4824-bf5c-a5ebe507606e" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:22:36 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-964697c6-ba45-4628-aa86-010acfc980a9 req-a84c62ac-c83c-41ee-aacb-543443bdc617 service nova] Acquired lock "refresh_cache-4d8fb5ee-2b96-4824-bf5c-a5ebe507606e" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:22:36 user nova-compute[72586]: DEBUG nova.network.neutron [req-964697c6-ba45-4628-aa86-010acfc980a9 req-a84c62ac-c83c-41ee-aacb-543443bdc617 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Refreshing network info cache for port 28d77550-badf-4c92-9b3d-2335ad88267a {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:22:37 user nova-compute[72586]: DEBUG nova.network.neutron [req-964697c6-ba45-4628-aa86-010acfc980a9 req-a84c62ac-c83c-41ee-aacb-543443bdc617 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Updated VIF entry in instance network info cache for port 28d77550-badf-4c92-9b3d-2335ad88267a. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:22:37 user nova-compute[72586]: DEBUG nova.network.neutron [req-964697c6-ba45-4628-aa86-010acfc980a9 req-a84c62ac-c83c-41ee-aacb-543443bdc617 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Updating instance_info_cache with network_info: [{"id": "28d77550-badf-4c92-9b3d-2335ad88267a", "address": "fa:16:3e:a9:7c:cd", "network": {"id": "7a484128-086b-466a-a4f1-7ee335a489ac", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1177849467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28d77550-ba", "ovs_interfaceid": "28d77550-badf-4c92-9b3d-2335ad88267a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0630d545-5545-4e43-96e7-1a0aed01ba9b", "address": "fa:16:3e:6b:2e:9d", "network": {"id": "e4f2e657-3943-4157-85f2-95d34eebda68", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137166827", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0630d545-55", "ovs_interfaceid": "0630d545-5545-4e43-96e7-1a0aed01ba9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e986409e-ff38-4dad-ba15-4338156ff5f7", "address": "fa:16:3e:ac:26:34", "network": {"id": "e4f2e657-3943-4157-85f2-95d34eebda68", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137166827", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape986409e-ff", "ovs_interfaceid": "e986409e-ff38-4dad-ba15-4338156ff5f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9420c293-c443-4003-a54a-d6edbd12ddbc", "address": "fa:16:3e:f5:5b:b1", "network": {"id": "e4f2e657-3943-4157-85f2-95d34eebda68", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137166827", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9420c293-c4", "ovs_interfaceid": "9420c293-c443-4003-a54a-d6edbd12ddbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a842fd3a-0b86-4008-8ae9-96ecbd5cb7e2", "address": "fa:16:3e:e2:04:9a", "network": {"id": "e4f2e657-3943-4157-85f2-95d34eebda68", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137166827", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa842fd3a-0b", "ovs_interfaceid": "a842fd3a-0b86-4008-8ae9-96ecbd5cb7e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c71bda65-c16d-48f8-b66f-60d78a569ca3", "address": "fa:16:3e:45:96:2a", "network": {"id": "9c8aece4-aa0f-4431-9376-d0069c7e1003", "bridge": "br-int", "label": "tempest-device-tagging-net2-1263991370", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc71bda65-c1", "ovs_interfaceid": "c71bda65-c16d-48f8-b66f-60d78a569ca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "07f02376-9705-48a3-8434-f7ac557f7d5b", "address": "fa:16:3e:29:34:47", "network": {"id": "9c8aece4-aa0f-4431-9376-d0069c7e1003", "bridge": "br-int", "label": "tempest-device-tagging-net2-1263991370", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07f02376-97", "ovs_interfaceid": "07f02376-9705-48a3-8434-f7ac557f7d5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:22:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-964697c6-ba45-4628-aa86-010acfc980a9 req-a84c62ac-c83c-41ee-aacb-543443bdc617 service nova] Releasing lock "refresh_cache-4d8fb5ee-2b96-4824-bf5c-a5ebe507606e" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:22:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:38 user nova-compute[72586]: DEBUG nova.compute.manager [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VKNUcazg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '25fb970a-0caf-41e8-8d58-259dbd9cf291', 'attached_at': '', 'detached_at': '', 'volume_id': '7d8e7763-931d-4d10-a968-38b7b52437be', 'serial': '7d8e7763-931d-4d10-a968-38b7b52437be'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QhPHJSjs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': '25fb970a-0caf-41e8-8d58-259dbd9cf291', 'attached_at': '', 'detached_at': '', 'volume_id': 'e83d4aa1-7fe5-415e-96fc-4e413114e225', 'serial'} {{(pid=72586) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 01 21:22:38 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Calling os-brick to attach iSCSI Volume {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 21:22:38 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VKNUcazg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:22:38 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:22:38 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:22:38 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:22:38 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:22:38 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:22:38 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:22:38 user nova-compute[72586]: INFO os_brick.initiator.connectors.iscsi [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 21:22:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Acquiring lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:22:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:22:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Acquiring lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:22:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:22:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:22:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be -p 172.16.0.220:3260 {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:38 user nova-compute[72586]: INFO nova.compute.manager [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Terminating instance
Aug 01 21:22:38 user nova-compute[72586]: DEBUG nova.compute.manager [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Start destroying the instance on the hypervisor. {{(pid=72586) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 21:22:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:38 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23b1c2e-e808-464e-bd8f-578b4472787a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:38 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 21:22:38 user nova-compute[72586]:  {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be -p 172.16.0.220:3260 --interface default --op new {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:38 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[8304f03e-e677-48fe-b3e0-8ffd5d6cca47]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be] added\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:38 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be] added
Aug 01 21:22:38 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:38 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe3df85-7e9f-41e1-8b58-c58568ef6155]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:38 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:38 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[267b1261-47a7-4e3f-bac0-3a94b46cb92e]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:38 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VKNUcazg {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:38 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VKNUcazg" returned: 0 in 0.024s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:38 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7957fa7-c19b-41a7-b4c6-945c43791ec7]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:38 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VKNUcazg'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:38 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:38 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:38 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[12893a49-711b-4701-92ff-e0833573ac9e]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:38 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:39 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[8077c366-c1c7-4db1-89e8-a5ec7cd493c9]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 (non-flash)
Aug 01 21:22:39 user nova-compute[72586]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)
Aug 01 21:22:39 user nova-compute[72586]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)
Aug 01 21:22:39 user nova-compute[72586]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)
Aug 01 21:22:39 user nova-compute[72586]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)
Aug 01 21:22:39 user nova-compute[72586]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)
Aug 01 21:22:39 user nova-compute[72586]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)
Aug 01 21:22:39 user nova-compute[72586]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)
Aug 01 21:22:39 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:22:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 (non-flash)
Aug 01 21:22:39 user nova-compute[72586]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)
Aug 01 21:22:39 user nova-compute[72586]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)
Aug 01 21:22:39 user nova-compute[72586]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)
Aug 01 21:22:39 user nova-compute[72586]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)
Aug 01 21:22:39 user nova-compute[72586]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)
Aug 01 21:22:39 user nova-compute[72586]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)
Aug 01 21:22:39 user nova-compute[72586]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)
Aug 01 21:22:39 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:22:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be -p 172.16.0.220:3260 --login {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:39 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4295da-68df-4ea7-a311-1f3df470c614]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be, portal: 172.16.0.220,3260]
Aug 01 21:22:39 user nova-compute[72586]: Login to [iface: default, target: iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be, portal: 172.16.0.220,3260] successful.
Aug 01 21:22:39 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:39 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[6652158a-0bd3-43c0-90ef-64e8f3f9c62e]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:39 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[428a9c19-04ef-413f-a0f7-0cbb6cf32c09]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 (non-flash)
Aug 01 21:22:39 user nova-compute[72586]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be (non-flash)
Aug 01 21:22:39 user nova-compute[72586]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)
Aug 01 21:22:39 user nova-compute[72586]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)
Aug 01 21:22:39 user nova-compute[72586]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)
Aug 01 21:22:39 user nova-compute[72586]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)
Aug 01 21:22:39 user nova-compute[72586]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)
Aug 01 21:22:39 user nova-compute[72586]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)
Aug 01 21:22:39 user nova-compute[72586]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)
Aug 01 21:22:39 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:22:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 (non-flash)
Aug 01 21:22:39 user nova-compute[72586]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be (non-flash)
Aug 01 21:22:39 user nova-compute[72586]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)
Aug 01 21:22:39 user nova-compute[72586]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)
Aug 01 21:22:39 user nova-compute[72586]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)
Aug 01 21:22:39 user nova-compute[72586]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)
Aug 01 21:22:39 user nova-compute[72586]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)
Aug 01 21:22:39 user nova-compute[72586]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)
Aug 01 21:22:39 user nova-compute[72586]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)
Aug 01 21:22:39 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:22:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.358s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:22:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] Connected to 172.16.0.220:3260 {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 21:22:39 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] HCTL ('41', '-', '-', 0) found on session 14 with lun 0 {{(pid=72586) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 21:22:39 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] Scanning host 41 c: -, t: -, l: 0) {{(pid=72586) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 21:22:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.030s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:39 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[72cf677c-b9cb-4ad6-a976-b37281bba417]: (4, ('- - 0', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:39 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] Searching for a device in session 14 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:22:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VKNUcazg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 21:22:39 user nova-compute[72586]: DEBUG nova.compute.manager [req-eff93f62-1d19-4216-97aa-1a942fdd5f7f req-d041c4e4-1ff8-415e-8e90-c776a50457b6 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received event network-vif-unplugged-28d77550-badf-4c92-9b3d-2335ad88267a {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:22:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-eff93f62-1d19-4216-97aa-1a942fdd5f7f req-d041c4e4-1ff8-415e-8e90-c776a50457b6 service nova] Acquiring lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:22:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-eff93f62-1d19-4216-97aa-1a942fdd5f7f req-d041c4e4-1ff8-415e-8e90-c776a50457b6 service nova] Lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:22:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-eff93f62-1d19-4216-97aa-1a942fdd5f7f req-d041c4e4-1ff8-415e-8e90-c776a50457b6 service nova] Lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:22:39 user nova-compute[72586]: DEBUG nova.compute.manager [req-eff93f62-1d19-4216-97aa-1a942fdd5f7f req-d041c4e4-1ff8-415e-8e90-c776a50457b6 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] No waiting events found dispatching network-vif-unplugged-28d77550-badf-4c92-9b3d-2335ad88267a {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:22:39 user nova-compute[72586]: DEBUG nova.compute.manager [req-eff93f62-1d19-4216-97aa-1a942fdd5f7f req-d041c4e4-1ff8-415e-8e90-c776a50457b6 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received event network-vif-unplugged-28d77550-badf-4c92-9b3d-2335ad88267a for instance with task_state deleting. {{(pid=72586) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 21:22:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:39 user nova-compute[72586]: DEBUG nova.compute.manager [req-607222c8-7283-4ca7-b4c5-bfa3c1571c36 req-c5a9335e-e4c5-4adb-a073-053e764e9730 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received event network-vif-unplugged-0630d545-5545-4e43-96e7-1a0aed01ba9b {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:22:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-607222c8-7283-4ca7-b4c5-bfa3c1571c36 req-c5a9335e-e4c5-4adb-a073-053e764e9730 service nova] Acquiring lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:22:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-607222c8-7283-4ca7-b4c5-bfa3c1571c36 req-c5a9335e-e4c5-4adb-a073-053e764e9730 service nova] Lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:22:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-607222c8-7283-4ca7-b4c5-bfa3c1571c36 req-c5a9335e-e4c5-4adb-a073-053e764e9730 service nova] Lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:22:39 user nova-compute[72586]: DEBUG nova.compute.manager [req-607222c8-7283-4ca7-b4c5-bfa3c1571c36 req-c5a9335e-e4c5-4adb-a073-053e764e9730 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] No waiting events found dispatching network-vif-unplugged-0630d545-5545-4e43-96e7-1a0aed01ba9b {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:22:39 user nova-compute[72586]: DEBUG nova.compute.manager [req-607222c8-7283-4ca7-b4c5-bfa3c1571c36 req-c5a9335e-e4c5-4adb-a073-053e764e9730 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received event network-vif-unplugged-0630d545-5545-4e43-96e7-1a0aed01ba9b for instance with task_state deleting. {{(pid=72586) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 21:22:39 user nova-compute[72586]: DEBUG nova.compute.manager [req-49b32954-06d0-4de5-9481-a177380a75c0 req-7b286c06-92a2-4f98-b7a3-02b8ea0fbf94 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received event network-vif-unplugged-e986409e-ff38-4dad-ba15-4338156ff5f7 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:22:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-49b32954-06d0-4de5-9481-a177380a75c0 req-7b286c06-92a2-4f98-b7a3-02b8ea0fbf94 service nova] Acquiring lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:22:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-49b32954-06d0-4de5-9481-a177380a75c0 req-7b286c06-92a2-4f98-b7a3-02b8ea0fbf94 service nova] Lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:22:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-49b32954-06d0-4de5-9481-a177380a75c0 req-7b286c06-92a2-4f98-b7a3-02b8ea0fbf94 service nova] Lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:22:39 user nova-compute[72586]: DEBUG nova.compute.manager [req-49b32954-06d0-4de5-9481-a177380a75c0 req-7b286c06-92a2-4f98-b7a3-02b8ea0fbf94 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] No waiting events found dispatching network-vif-unplugged-e986409e-ff38-4dad-ba15-4338156ff5f7 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:22:39 user nova-compute[72586]: DEBUG nova.compute.manager [req-49b32954-06d0-4de5-9481-a177380a75c0 req-7b286c06-92a2-4f98-b7a3-02b8ea0fbf94 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received event network-vif-unplugged-e986409e-ff38-4dad-ba15-4338156ff5f7 for instance with task_state deleting. {{(pid=72586) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 21:22:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:40 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:40 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:40 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.416s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:22:40 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] <== connect_volume: return (1418ms) {'type': 'block', 'scsi_wwn': '23566666430643535', 'path': '/dev/sdj'} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:22:40 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23566666430643535', 'path': '/dev/sdj'} {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 21:22:40 user nova-compute[72586]: DEBUG nova.objects.instance [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] Lazy-loading 'flavor' on Instance uuid 25fb970a-0caf-41e8-8d58-259dbd9cf291 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:22:40 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Instance destroyed successfully.
Aug 01 21:22:40 user nova-compute[72586]: DEBUG nova.objects.instance [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Lazy-loading 'resources' on Instance uuid 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:22:40 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T21:20:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-173590662',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-173590662',id=10,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZmmWaf4o2+vepoSlCSvdhQnW0Ip8s2V4mKR4aDQ5fLtO6MyouBGx7OzU53scmj6G3TpyQRTILBn5stq45p5fvY9X/n+AtzlawrI2mVsOfI/+KhRVPQhj4yVIanSKzsXQ==',key_name='tempest-keypair-718734038',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:21:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='420db45538ce406abe9e8186c4e3b447',ramdisk_id='',reservation_id='r-6nkwelxb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1489054380',owner_user_name='tempest-TaggedBootDevicesTest-1489054380-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:21:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8cc90afc26ca4b69b61b8c3c47aa2eaa',uuid=4d8fb5ee-2b96-4824-bf5c-a5ebe507606e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "28d77550-badf-4c92-9b3d-2335ad88267a", "address": "fa:16:3e:a9:7c:cd", "network": {"id": "7a484128-086b-466a-a4f1-7ee335a489ac", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1177849467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28d77550-ba", "ovs_interfaceid": "28d77550-badf-4c92-9b3d-2335ad88267a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:22:40 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Converting VIF {"id": "28d77550-badf-4c92-9b3d-2335ad88267a", "address": "fa:16:3e:a9:7c:cd", "network": {"id": "7a484128-086b-466a-a4f1-7ee335a489ac", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1177849467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28d77550-ba", "ovs_interfaceid": "28d77550-badf-4c92-9b3d-2335ad88267a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:22:40 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a9:7c:cd,bridge_name='br-int',has_traffic_filtering=True,id=28d77550-badf-4c92-9b3d-2335ad88267a,network=Network(7a484128-086b-466a-a4f1-7ee335a489ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28d77550-ba') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:22:40 user nova-compute[72586]: DEBUG os_vif [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:7c:cd,bridge_name='br-int',has_traffic_filtering=True,id=28d77550-badf-4c92-9b3d-2335ad88267a,network=Network(7a484128-086b-466a-a4f1-7ee335a489ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28d77550-ba') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:22:40 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:40 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap28d77550-ba, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:22:40 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:40 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] COPY block job progress, current cursor: 6291456 final cursor: 1073741824 {{(pid=72586) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 21:22:40 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:22:40 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:40 user nova-compute[72586]: INFO os_vif [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:7c:cd,bridge_name='br-int',has_traffic_filtering=True,id=28d77550-badf-4c92-9b3d-2335ad88267a,network=Network(7a484128-086b-466a-a4f1-7ee335a489ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28d77550-ba')
Aug 01 21:22:40 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T21:20:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-173590662',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-173590662',id=10,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZmmWaf4o2+vepoSlCSvdhQnW0Ip8s2V4mKR4aDQ5fLtO6MyouBGx7OzU53scmj6G3TpyQRTILBn5stq45p5fvY9X/n+AtzlawrI2mVsOfI/+KhRVPQhj4yVIanSKzsXQ==',key_name='tempest-keypair-718734038',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:21:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='420db45538ce406abe9e8186c4e3b447',ramdisk_id='',reservation_id='r-6nkwelxb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1489054380',owner_user_name='tempest-TaggedBootDevicesTest-1489054380-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:21:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8cc90afc26ca4b69b61b8c3c47aa2eaa',uuid=4d8fb5ee-2b96-4824-bf5c-a5ebe507606e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0630d545-5545-4e43-96e7-1a0aed01ba9b", "address": "fa:16:3e:6b:2e:9d", "network": {"id": "e4f2e657-3943-4157-85f2-95d34eebda68", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137166827", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0630d545-55", "ovs_interfaceid": "0630d545-5545-4e43-96e7-1a0aed01ba9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:22:40 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Converting VIF {"id": "0630d545-5545-4e43-96e7-1a0aed01ba9b", "address": "fa:16:3e:6b:2e:9d", "network": {"id": "e4f2e657-3943-4157-85f2-95d34eebda68", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137166827", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0630d545-55", "ovs_interfaceid": "0630d545-5545-4e43-96e7-1a0aed01ba9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:22:40 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:2e:9d,bridge_name='br-int',has_traffic_filtering=True,id=0630d545-5545-4e43-96e7-1a0aed01ba9b,network=Network(e4f2e657-3943-4157-85f2-95d34eebda68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0630d545-55') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:22:40 user nova-compute[72586]: DEBUG os_vif [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:2e:9d,bridge_name='br-int',has_traffic_filtering=True,id=0630d545-5545-4e43-96e7-1a0aed01ba9b,network=Network(e4f2e657-3943-4157-85f2-95d34eebda68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0630d545-55') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:22:40 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:40 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0630d545-55, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:22:40 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:40 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:22:40 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:40 user nova-compute[72586]: INFO os_vif [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:2e:9d,bridge_name='br-int',has_traffic_filtering=True,id=0630d545-5545-4e43-96e7-1a0aed01ba9b,network=Network(e4f2e657-3943-4157-85f2-95d34eebda68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0630d545-55')
Aug 01 21:22:40 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T21:20:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-173590662',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-173590662',id=10,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZmmWaf4o2+vepoSlCSvdhQnW0Ip8s2V4mKR4aDQ5fLtO6MyouBGx7OzU53scmj6G3TpyQRTILBn5stq45p5fvY9X/n+AtzlawrI2mVsOfI/+KhRVPQhj4yVIanSKzsXQ==',key_name='tempest-keypair-718734038',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:21:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='420db45538ce406abe9e8186c4e3b447',ramdisk_id='',reservation_id='r-6nkwelxb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1489054380',owner_user_name='tempest-TaggedBootDevicesTest-1489054380-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:21:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8cc90afc26ca4b69b61b8c3c47aa2eaa',uuid=4d8fb5ee-2b96-4824-bf5c-a5ebe507606e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e986409e-ff38-4dad-ba15-4338156ff5f7", "address": "fa:16:3e:ac:26:34", "network": {"id": "e4f2e657-3943-4157-85f2-95d34eebda68", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137166827", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape986409e-ff", "ovs_interfaceid": "e986409e-ff38-4dad-ba15-4338156ff5f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:22:40 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Converting VIF {"id": "e986409e-ff38-4dad-ba15-4338156ff5f7", "address": "fa:16:3e:ac:26:34", "network": {"id": "e4f2e657-3943-4157-85f2-95d34eebda68", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137166827", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape986409e-ff", "ovs_interfaceid": "e986409e-ff38-4dad-ba15-4338156ff5f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:22:40 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:26:34,bridge_name='br-int',has_traffic_filtering=True,id=e986409e-ff38-4dad-ba15-4338156ff5f7,network=Network(e4f2e657-3943-4157-85f2-95d34eebda68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape986409e-ff') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:22:40 user nova-compute[72586]: DEBUG os_vif [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:26:34,bridge_name='br-int',has_traffic_filtering=True,id=e986409e-ff38-4dad-ba15-4338156ff5f7,network=Network(e4f2e657-3943-4157-85f2-95d34eebda68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape986409e-ff') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:22:40 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:40 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape986409e-ff, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:22:40 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:40 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:41 user nova-compute[72586]: INFO os_vif [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:26:34,bridge_name='br-int',has_traffic_filtering=True,id=e986409e-ff38-4dad-ba15-4338156ff5f7,network=Network(e4f2e657-3943-4157-85f2-95d34eebda68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape986409e-ff')
Aug 01 21:22:41 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T21:20:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-173590662',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-173590662',id=10,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZmmWaf4o2+vepoSlCSvdhQnW0Ip8s2V4mKR4aDQ5fLtO6MyouBGx7OzU53scmj6G3TpyQRTILBn5stq45p5fvY9X/n+AtzlawrI2mVsOfI/+KhRVPQhj4yVIanSKzsXQ==',key_name='tempest-keypair-718734038',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:21:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='420db45538ce406abe9e8186c4e3b447',ramdisk_id='',reservation_id='r-6nkwelxb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1489054380',owner_user_name='tempest-TaggedBootDevicesTest-1489054380-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:21:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8cc90afc26ca4b69b61b8c3c47aa2eaa',uuid=4d8fb5ee-2b96-4824-bf5c-a5ebe507606e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9420c293-c443-4003-a54a-d6edbd12ddbc", "address": "fa:16:3e:f5:5b:b1", "network": {"id": "e4f2e657-3943-4157-85f2-95d34eebda68", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137166827", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9420c293-c4", "ovs_interfaceid": "9420c293-c443-4003-a54a-d6edbd12ddbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Converting VIF {"id": "9420c293-c443-4003-a54a-d6edbd12ddbc", "address": "fa:16:3e:f5:5b:b1", "network": {"id": "e4f2e657-3943-4157-85f2-95d34eebda68", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137166827", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9420c293-c4", "ovs_interfaceid": "9420c293-c443-4003-a54a-d6edbd12ddbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:5b:b1,bridge_name='br-int',has_traffic_filtering=True,id=9420c293-c443-4003-a54a-d6edbd12ddbc,network=Network(e4f2e657-3943-4157-85f2-95d34eebda68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9420c293-c4') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG os_vif [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:5b:b1,bridge_name='br-int',has_traffic_filtering=True,id=9420c293-c443-4003-a54a-d6edbd12ddbc,network=Network(e4f2e657-3943-4157-85f2-95d34eebda68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9420c293-c4') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9420c293-c4, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:41 user nova-compute[72586]: INFO os_vif [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:5b:b1,bridge_name='br-int',has_traffic_filtering=True,id=9420c293-c443-4003-a54a-d6edbd12ddbc,network=Network(e4f2e657-3943-4157-85f2-95d34eebda68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9420c293-c4')
Aug 01 21:22:41 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T21:20:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-173590662',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-173590662',id=10,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZmmWaf4o2+vepoSlCSvdhQnW0Ip8s2V4mKR4aDQ5fLtO6MyouBGx7OzU53scmj6G3TpyQRTILBn5stq45p5fvY9X/n+AtzlawrI2mVsOfI/+KhRVPQhj4yVIanSKzsXQ==',key_name='tempest-keypair-718734038',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:21:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='420db45538ce406abe9e8186c4e3b447',ramdisk_id='',reservation_id='r-6nkwelxb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1489054380',owner_user_name='tempest-TaggedBootDevicesTest-1489054380-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:21:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8cc90afc26ca4b69b61b8c3c47aa2eaa',uuid=4d8fb5ee-2b96-4824-bf5c-a5ebe507606e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a842fd3a-0b86-4008-8ae9-96ecbd5cb7e2", "address": "fa:16:3e:e2:04:9a", "network": {"id": "e4f2e657-3943-4157-85f2-95d34eebda68", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137166827", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa842fd3a-0b", "ovs_interfaceid": "a842fd3a-0b86-4008-8ae9-96ecbd5cb7e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Converting VIF {"id": "a842fd3a-0b86-4008-8ae9-96ecbd5cb7e2", "address": "fa:16:3e:e2:04:9a", "network": {"id": "e4f2e657-3943-4157-85f2-95d34eebda68", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137166827", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa842fd3a-0b", "ovs_interfaceid": "a842fd3a-0b86-4008-8ae9-96ecbd5cb7e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:04:9a,bridge_name='br-int',has_traffic_filtering=True,id=a842fd3a-0b86-4008-8ae9-96ecbd5cb7e2,network=Network(e4f2e657-3943-4157-85f2-95d34eebda68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa842fd3a-0b') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG os_vif [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:04:9a,bridge_name='br-int',has_traffic_filtering=True,id=a842fd3a-0b86-4008-8ae9-96ecbd5cb7e2,network=Network(e4f2e657-3943-4157-85f2-95d34eebda68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa842fd3a-0b') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa842fd3a-0b, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:41 user nova-compute[72586]: INFO os_vif [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:04:9a,bridge_name='br-int',has_traffic_filtering=True,id=a842fd3a-0b86-4008-8ae9-96ecbd5cb7e2,network=Network(e4f2e657-3943-4157-85f2-95d34eebda68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa842fd3a-0b')
Aug 01 21:22:41 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T21:20:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-173590662',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-173590662',id=10,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZmmWaf4o2+vepoSlCSvdhQnW0Ip8s2V4mKR4aDQ5fLtO6MyouBGx7OzU53scmj6G3TpyQRTILBn5stq45p5fvY9X/n+AtzlawrI2mVsOfI/+KhRVPQhj4yVIanSKzsXQ==',key_name='tempest-keypair-718734038',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:21:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='420db45538ce406abe9e8186c4e3b447',ramdisk_id='',reservation_id='r-6nkwelxb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1489054380',owner_user_name='tempest-TaggedBootDevicesTest-1489054380-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:21:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8cc90afc26ca4b69b61b8c3c47aa2eaa',uuid=4d8fb5ee-2b96-4824-bf5c-a5ebe507606e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c71bda65-c16d-48f8-b66f-60d78a569ca3", "address": "fa:16:3e:45:96:2a", "network": {"id": "9c8aece4-aa0f-4431-9376-d0069c7e1003", "bridge": "br-int", "label": "tempest-device-tagging-net2-1263991370", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc71bda65-c1", "ovs_interfaceid": "c71bda65-c16d-48f8-b66f-60d78a569ca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Converting VIF {"id": "c71bda65-c16d-48f8-b66f-60d78a569ca3", "address": "fa:16:3e:45:96:2a", "network": {"id": "9c8aece4-aa0f-4431-9376-d0069c7e1003", "bridge": "br-int", "label": "tempest-device-tagging-net2-1263991370", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc71bda65-c1", "ovs_interfaceid": "c71bda65-c16d-48f8-b66f-60d78a569ca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:96:2a,bridge_name='br-int',has_traffic_filtering=True,id=c71bda65-c16d-48f8-b66f-60d78a569ca3,network=Network(9c8aece4-aa0f-4431-9376-d0069c7e1003),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc71bda65-c1') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG os_vif [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:96:2a,bridge_name='br-int',has_traffic_filtering=True,id=c71bda65-c16d-48f8-b66f-60d78a569ca3,network=Network(9c8aece4-aa0f-4431-9376-d0069c7e1003),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc71bda65-c1') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc71bda65-c1, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:41 user nova-compute[72586]: INFO os_vif [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:96:2a,bridge_name='br-int',has_traffic_filtering=True,id=c71bda65-c16d-48f8-b66f-60d78a569ca3,network=Network(9c8aece4-aa0f-4431-9376-d0069c7e1003),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc71bda65-c1')
Aug 01 21:22:41 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T21:20:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-173590662',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-173590662',id=10,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZmmWaf4o2+vepoSlCSvdhQnW0Ip8s2V4mKR4aDQ5fLtO6MyouBGx7OzU53scmj6G3TpyQRTILBn5stq45p5fvY9X/n+AtzlawrI2mVsOfI/+KhRVPQhj4yVIanSKzsXQ==',key_name='tempest-keypair-718734038',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:21:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='420db45538ce406abe9e8186c4e3b447',ramdisk_id='',reservation_id='r-6nkwelxb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1489054380',owner_user_name='tempest-TaggedBootDevicesTest-1489054380-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:21:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8cc90afc26ca4b69b61b8c3c47aa2eaa',uuid=4d8fb5ee-2b96-4824-bf5c-a5ebe507606e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "07f02376-9705-48a3-8434-f7ac557f7d5b", "address": "fa:16:3e:29:34:47", "network": {"id": "9c8aece4-aa0f-4431-9376-d0069c7e1003", "bridge": "br-int", "label": "tempest-device-tagging-net2-1263991370", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07f02376-97", "ovs_interfaceid": "07f02376-9705-48a3-8434-f7ac557f7d5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Converting VIF {"id": "07f02376-9705-48a3-8434-f7ac557f7d5b", "address": "fa:16:3e:29:34:47", "network": {"id": "9c8aece4-aa0f-4431-9376-d0069c7e1003", "bridge": "br-int", "label": "tempest-device-tagging-net2-1263991370", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07f02376-97", "ovs_interfaceid": "07f02376-9705-48a3-8434-f7ac557f7d5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:34:47,bridge_name='br-int',has_traffic_filtering=True,id=07f02376-9705-48a3-8434-f7ac557f7d5b,network=Network(9c8aece4-aa0f-4431-9376-d0069c7e1003),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07f02376-97') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG os_vif [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:34:47,bridge_name='br-int',has_traffic_filtering=True,id=07f02376-9705-48a3-8434-f7ac557f7d5b,network=Network(9c8aece4-aa0f-4431-9376-d0069c7e1003),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07f02376-97') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap07f02376-97, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:22:41 user nova-compute[72586]: INFO os_vif [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:34:47,bridge_name='br-int',has_traffic_filtering=True,id=07f02376-9705-48a3-8434-f7ac557f7d5b,network=Network(9c8aece4-aa0f-4431-9376-d0069c7e1003),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07f02376-97')
Aug 01 21:22:41 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] calling os-brick to detach iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, {'target_iqns': ['iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZKvSOuDI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:22:41 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:22:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce', 0)] {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba66d80-fe5c-43dd-83fe-73fdd36cb288]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e981b22-fa8e-47c2-953b-46139463ca01]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 (non-flash)
Aug 01 21:22:41 user nova-compute[72586]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be (non-flash)
Aug 01 21:22:41 user nova-compute[72586]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)
Aug 01 21:22:41 user nova-compute[72586]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)
Aug 01 21:22:41 user nova-compute[72586]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)
Aug 01 21:22:41 user nova-compute[72586]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)
Aug 01 21:22:41 user nova-compute[72586]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)
Aug 01 21:22:41 user nova-compute[72586]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)
Aug 01 21:22:41 user nova-compute[72586]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)
Aug 01 21:22:41 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 (non-flash)
Aug 01 21:22:41 user nova-compute[72586]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be (non-flash)
Aug 01 21:22:41 user nova-compute[72586]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce (non-flash)
Aug 01 21:22:41 user nova-compute[72586]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)
Aug 01 21:22:41 user nova-compute[72586]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)
Aug 01 21:22:41 user nova-compute[72586]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)
Aug 01 21:22:41 user nova-compute[72586]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)
Aug 01 21:22:41 user nova-compute[72586]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)
Aug 01 21:22:41 user nova-compute[72586]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)
Aug 01 21:22:41 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ed0787f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce'): ({'sdb'}, set())}) {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Removing single pathed devices sdb {{(pid=72586) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.033s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c851de-9468-4f0e-854b-25bc92670634]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] COPY block job progress, current cursor: 136314880 final cursor: 1073741824 {{(pid=72586) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG nova.compute.manager [req-f7086ae2-5fbe-4450-aa80-df6112ba789d req-06df2284-f51d-4953-be56-3fef68677fbc service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received event network-vif-plugged-28d77550-badf-4c92-9b3d-2335ad88267a {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-f7086ae2-5fbe-4450-aa80-df6112ba789d req-06df2284-f51d-4953-be56-3fef68677fbc service nova] Acquiring lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-f7086ae2-5fbe-4450-aa80-df6112ba789d req-06df2284-f51d-4953-be56-3fef68677fbc service nova] Lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-f7086ae2-5fbe-4450-aa80-df6112ba789d req-06df2284-f51d-4953-be56-3fef68677fbc service nova] Lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG nova.compute.manager [req-f7086ae2-5fbe-4450-aa80-df6112ba789d req-06df2284-f51d-4953-be56-3fef68677fbc service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] No waiting events found dispatching network-vif-plugged-28d77550-badf-4c92-9b3d-2335ad88267a {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:22:41 user nova-compute[72586]: WARNING nova.compute.manager [req-f7086ae2-5fbe-4450-aa80-df6112ba789d req-06df2284-f51d-4953-be56-3fef68677fbc service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received unexpected event network-vif-plugged-28d77550-badf-4c92-9b3d-2335ad88267a for instance with vm_state active and task_state deleting.
Aug 01 21:22:41 user nova-compute[72586]: DEBUG nova.compute.manager [req-f7086ae2-5fbe-4450-aa80-df6112ba789d req-06df2284-f51d-4953-be56-3fef68677fbc service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received event network-vif-unplugged-07f02376-9705-48a3-8434-f7ac557f7d5b {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-f7086ae2-5fbe-4450-aa80-df6112ba789d req-06df2284-f51d-4953-be56-3fef68677fbc service nova] Acquiring lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-f7086ae2-5fbe-4450-aa80-df6112ba789d req-06df2284-f51d-4953-be56-3fef68677fbc service nova] Lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-f7086ae2-5fbe-4450-aa80-df6112ba789d req-06df2284-f51d-4953-be56-3fef68677fbc service nova] Lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG nova.compute.manager [req-f7086ae2-5fbe-4450-aa80-df6112ba789d req-06df2284-f51d-4953-be56-3fef68677fbc service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] No waiting events found dispatching network-vif-unplugged-07f02376-9705-48a3-8434-f7ac557f7d5b {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG nova.compute.manager [req-f7086ae2-5fbe-4450-aa80-df6112ba789d req-06df2284-f51d-4953-be56-3fef68677fbc service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received event network-vif-unplugged-07f02376-9705-48a3-8434-f7ac557f7d5b for instance with task_state deleting. {{(pid=72586) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG nova.compute.manager [req-f7086ae2-5fbe-4450-aa80-df6112ba789d req-06df2284-f51d-4953-be56-3fef68677fbc service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received event network-vif-plugged-07f02376-9705-48a3-8434-f7ac557f7d5b {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-f7086ae2-5fbe-4450-aa80-df6112ba789d req-06df2284-f51d-4953-be56-3fef68677fbc service nova] Acquiring lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-f7086ae2-5fbe-4450-aa80-df6112ba789d req-06df2284-f51d-4953-be56-3fef68677fbc service nova] Lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-f7086ae2-5fbe-4450-aa80-df6112ba789d req-06df2284-f51d-4953-be56-3fef68677fbc service nova] Lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG nova.compute.manager [req-f7086ae2-5fbe-4450-aa80-df6112ba789d req-06df2284-f51d-4953-be56-3fef68677fbc service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] No waiting events found dispatching network-vif-plugged-07f02376-9705-48a3-8434-f7ac557f7d5b {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:22:41 user nova-compute[72586]: WARNING nova.compute.manager [req-f7086ae2-5fbe-4450-aa80-df6112ba789d req-06df2284-f51d-4953-be56-3fef68677fbc service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received unexpected event network-vif-plugged-07f02376-9705-48a3-8434-f7ac557f7d5b for instance with vm_state active and task_state deleting.
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.029s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e41c2d2-8ae1-40b6-8b58-04d3c6c2559f]: (4, ('ok\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Flushing IO for device /dev/sdb {{(pid=72586) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a82313-b619-4db6-81bf-b23095feb0e9]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72586) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[be111362-d206-44d2-b341-fcb33a4e279b]: (4, ('1', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] SCSI volumes sdb have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce')] {{(pid=72586) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG nova.compute.manager [req-d036056f-f633-4391-a10c-07bac0ef634a req-d9a4bf55-9b19-4f0c-8296-354e71734811 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received event network-vif-plugged-0630d545-5545-4e43-96e7-1a0aed01ba9b {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d036056f-f633-4391-a10c-07bac0ef634a req-d9a4bf55-9b19-4f0c-8296-354e71734811 service nova] Acquiring lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d036056f-f633-4391-a10c-07bac0ef634a req-d9a4bf55-9b19-4f0c-8296-354e71734811 service nova] Lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d036056f-f633-4391-a10c-07bac0ef634a req-d9a4bf55-9b19-4f0c-8296-354e71734811 service nova] Lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG nova.compute.manager [req-d036056f-f633-4391-a10c-07bac0ef634a req-d9a4bf55-9b19-4f0c-8296-354e71734811 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] No waiting events found dispatching network-vif-plugged-0630d545-5545-4e43-96e7-1a0aed01ba9b {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:22:41 user nova-compute[72586]: WARNING nova.compute.manager [req-d036056f-f633-4391-a10c-07bac0ef634a req-d9a4bf55-9b19-4f0c-8296-354e71734811 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received unexpected event network-vif-plugged-0630d545-5545-4e43-96e7-1a0aed01ba9b for instance with vm_state active and task_state deleting.
Aug 01 21:22:41 user nova-compute[72586]: DEBUG nova.compute.manager [req-d036056f-f633-4391-a10c-07bac0ef634a req-d9a4bf55-9b19-4f0c-8296-354e71734811 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received event network-vif-unplugged-9420c293-c443-4003-a54a-d6edbd12ddbc {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d036056f-f633-4391-a10c-07bac0ef634a req-d9a4bf55-9b19-4f0c-8296-354e71734811 service nova] Acquiring lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d036056f-f633-4391-a10c-07bac0ef634a req-d9a4bf55-9b19-4f0c-8296-354e71734811 service nova] Lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d036056f-f633-4391-a10c-07bac0ef634a req-d9a4bf55-9b19-4f0c-8296-354e71734811 service nova] Lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG nova.compute.manager [req-d036056f-f633-4391-a10c-07bac0ef634a req-d9a4bf55-9b19-4f0c-8296-354e71734811 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] No waiting events found dispatching network-vif-unplugged-9420c293-c443-4003-a54a-d6edbd12ddbc {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG nova.compute.manager [req-d036056f-f633-4391-a10c-07bac0ef634a req-d9a4bf55-9b19-4f0c-8296-354e71734811 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received event network-vif-unplugged-9420c293-c443-4003-a54a-d6edbd12ddbc for instance with task_state deleting. {{(pid=72586) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG nova.compute.manager [req-d036056f-f633-4391-a10c-07bac0ef634a req-d9a4bf55-9b19-4f0c-8296-354e71734811 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received event network-vif-plugged-9420c293-c443-4003-a54a-d6edbd12ddbc {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d036056f-f633-4391-a10c-07bac0ef634a req-d9a4bf55-9b19-4f0c-8296-354e71734811 service nova] Acquiring lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d036056f-f633-4391-a10c-07bac0ef634a req-d9a4bf55-9b19-4f0c-8296-354e71734811 service nova] Lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d036056f-f633-4391-a10c-07bac0ef634a req-d9a4bf55-9b19-4f0c-8296-354e71734811 service nova] Lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG nova.compute.manager [req-d036056f-f633-4391-a10c-07bac0ef634a req-d9a4bf55-9b19-4f0c-8296-354e71734811 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] No waiting events found dispatching network-vif-plugged-9420c293-c443-4003-a54a-d6edbd12ddbc {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:22:41 user nova-compute[72586]: WARNING nova.compute.manager [req-d036056f-f633-4391-a10c-07bac0ef634a req-d9a4bf55-9b19-4f0c-8296-354e71734811 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received unexpected event network-vif-plugged-9420c293-c443-4003-a54a-d6edbd12ddbc for instance with vm_state active and task_state deleting.
Aug 01 21:22:41 user nova-compute[72586]: DEBUG nova.compute.manager [req-d036056f-f633-4391-a10c-07bac0ef634a req-d9a4bf55-9b19-4f0c-8296-354e71734811 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received event network-vif-unplugged-a842fd3a-0b86-4008-8ae9-96ecbd5cb7e2 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d036056f-f633-4391-a10c-07bac0ef634a req-d9a4bf55-9b19-4f0c-8296-354e71734811 service nova] Acquiring lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d036056f-f633-4391-a10c-07bac0ef634a req-d9a4bf55-9b19-4f0c-8296-354e71734811 service nova] Lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d036056f-f633-4391-a10c-07bac0ef634a req-d9a4bf55-9b19-4f0c-8296-354e71734811 service nova] Lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG nova.compute.manager [req-d036056f-f633-4391-a10c-07bac0ef634a req-d9a4bf55-9b19-4f0c-8296-354e71734811 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] No waiting events found dispatching network-vif-unplugged-a842fd3a-0b86-4008-8ae9-96ecbd5cb7e2 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG nova.compute.manager [req-d036056f-f633-4391-a10c-07bac0ef634a req-d9a4bf55-9b19-4f0c-8296-354e71734811 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received event network-vif-unplugged-a842fd3a-0b86-4008-8ae9-96ecbd5cb7e2 for instance with task_state deleting. {{(pid=72586) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG nova.compute.manager [req-d036056f-f633-4391-a10c-07bac0ef634a req-d9a4bf55-9b19-4f0c-8296-354e71734811 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received event network-vif-plugged-a842fd3a-0b86-4008-8ae9-96ecbd5cb7e2 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d036056f-f633-4391-a10c-07bac0ef634a req-d9a4bf55-9b19-4f0c-8296-354e71734811 service nova] Acquiring lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d036056f-f633-4391-a10c-07bac0ef634a req-d9a4bf55-9b19-4f0c-8296-354e71734811 service nova] Lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d036056f-f633-4391-a10c-07bac0ef634a req-d9a4bf55-9b19-4f0c-8296-354e71734811 service nova] Lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG nova.compute.manager [req-d036056f-f633-4391-a10c-07bac0ef634a req-d9a4bf55-9b19-4f0c-8296-354e71734811 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] No waiting events found dispatching network-vif-plugged-a842fd3a-0b86-4008-8ae9-96ecbd5cb7e2 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:22:41 user nova-compute[72586]: WARNING nova.compute.manager [req-d036056f-f633-4391-a10c-07bac0ef634a req-d9a4bf55-9b19-4f0c-8296-354e71734811 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received unexpected event network-vif-plugged-a842fd3a-0b86-4008-8ae9-96ecbd5cb7e2 for instance with vm_state active and task_state deleting.
Aug 01 21:22:41 user nova-compute[72586]: DEBUG nova.compute.manager [req-d036056f-f633-4391-a10c-07bac0ef634a req-d9a4bf55-9b19-4f0c-8296-354e71734811 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received event network-vif-unplugged-c71bda65-c16d-48f8-b66f-60d78a569ca3 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d036056f-f633-4391-a10c-07bac0ef634a req-d9a4bf55-9b19-4f0c-8296-354e71734811 service nova] Acquiring lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d036056f-f633-4391-a10c-07bac0ef634a req-d9a4bf55-9b19-4f0c-8296-354e71734811 service nova] Lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d036056f-f633-4391-a10c-07bac0ef634a req-d9a4bf55-9b19-4f0c-8296-354e71734811 service nova] Lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG nova.compute.manager [req-d036056f-f633-4391-a10c-07bac0ef634a req-d9a4bf55-9b19-4f0c-8296-354e71734811 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] No waiting events found dispatching network-vif-unplugged-c71bda65-c16d-48f8-b66f-60d78a569ca3 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG nova.compute.manager [req-d036056f-f633-4391-a10c-07bac0ef634a req-d9a4bf55-9b19-4f0c-8296-354e71734811 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received event network-vif-unplugged-c71bda65-c16d-48f8-b66f-60d78a569ca3 for instance with task_state deleting. {{(pid=72586) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG nova.compute.manager [req-d036056f-f633-4391-a10c-07bac0ef634a req-d9a4bf55-9b19-4f0c-8296-354e71734811 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received event network-vif-plugged-c71bda65-c16d-48f8-b66f-60d78a569ca3 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d036056f-f633-4391-a10c-07bac0ef634a req-d9a4bf55-9b19-4f0c-8296-354e71734811 service nova] Acquiring lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d036056f-f633-4391-a10c-07bac0ef634a req-d9a4bf55-9b19-4f0c-8296-354e71734811 service nova] Lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d036056f-f633-4391-a10c-07bac0ef634a req-d9a4bf55-9b19-4f0c-8296-354e71734811 service nova] Lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG nova.compute.manager [req-d036056f-f633-4391-a10c-07bac0ef634a req-d9a4bf55-9b19-4f0c-8296-354e71734811 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] No waiting events found dispatching network-vif-plugged-c71bda65-c16d-48f8-b66f-60d78a569ca3 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:22:41 user nova-compute[72586]: WARNING nova.compute.manager [req-d036056f-f633-4391-a10c-07bac0ef634a req-d9a4bf55-9b19-4f0c-8296-354e71734811 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received unexpected event network-vif-plugged-c71bda65-c16d-48f8-b66f-60d78a569ca3 for instance with vm_state active and task_state deleting.
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[5148f72a-4d4b-44a8-afc3-8208bedcfcc5]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce -p 172.16.0.220:3260 --logout {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG nova.compute.manager [req-f6f83422-dbc7-4865-bd89-0dcf5de33b27 req-54d8977b-7127-4055-a008-f89bbb47be63 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received event network-vif-plugged-e986409e-ff38-4dad-ba15-4338156ff5f7 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-f6f83422-dbc7-4865-bd89-0dcf5de33b27 req-54d8977b-7127-4055-a008-f89bbb47be63 service nova] Acquiring lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-f6f83422-dbc7-4865-bd89-0dcf5de33b27 req-54d8977b-7127-4055-a008-f89bbb47be63 service nova] Lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-f6f83422-dbc7-4865-bd89-0dcf5de33b27 req-54d8977b-7127-4055-a008-f89bbb47be63 service nova] Lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG nova.compute.manager [req-f6f83422-dbc7-4865-bd89-0dcf5de33b27 req-54d8977b-7127-4055-a008-f89bbb47be63 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] No waiting events found dispatching network-vif-plugged-e986409e-ff38-4dad-ba15-4338156ff5f7 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:22:41 user nova-compute[72586]: WARNING nova.compute.manager [req-f6f83422-dbc7-4865-bd89-0dcf5de33b27 req-54d8977b-7127-4055-a008-f89bbb47be63 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received unexpected event network-vif-plugged-e986409e-ff38-4dad-ba15-4338156ff5f7 for instance with vm_state active and task_state deleting.
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[504463b8-5d65-4ae0-8798-3e6d5430d258]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce, portal: 172.16.0.220,3260]
Aug 01 21:22:41 user nova-compute[72586]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce, portal: 172.16.0.220,3260] successful.
Aug 01 21:22:41 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce -p 172.16.0.220:3260 --op delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4ecbe90-4aec-4946-8ae3-84a870533fce -p 172.16.0.220:3260 --op delete" returned: 0 in 0.048s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[57fe7288-745b-4bf9-a50d-9d967e415ab4]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.432s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] <== disconnect_volume: return (433ms) None {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Disconnected iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] calling os-brick to detach iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, {'target_iqns': ['iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jKuEmDJe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:22:41 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:22:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d', 0)] {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e60f728-f771-4cd5-b0e0-862ccdd7ab45]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[990334f2-9596-4c44-ac0d-d3d9b286cc87]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 (non-flash)
Aug 01 21:22:41 user nova-compute[72586]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be (non-flash)
Aug 01 21:22:41 user nova-compute[72586]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)
Aug 01 21:22:41 user nova-compute[72586]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)
Aug 01 21:22:41 user nova-compute[72586]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)
Aug 01 21:22:41 user nova-compute[72586]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)
Aug 01 21:22:41 user nova-compute[72586]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)
Aug 01 21:22:41 user nova-compute[72586]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)
Aug 01 21:22:41 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 (non-flash)
Aug 01 21:22:41 user nova-compute[72586]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be (non-flash)
Aug 01 21:22:41 user nova-compute[72586]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d (non-flash)
Aug 01 21:22:41 user nova-compute[72586]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)
Aug 01 21:22:41 user nova-compute[72586]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)
Aug 01 21:22:41 user nova-compute[72586]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)
Aug 01 21:22:41 user nova-compute[72586]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)
Aug 01 21:22:41 user nova-compute[72586]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)
Aug 01 21:22:41 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ed0787f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d'): ({'sdc'}, set())}) {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Removing single pathed devices sdc {{(pid=72586) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1291ffa4-dab4-4d96-bdcc-68ecc65d75d7]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8351a4-7a2d-4238-9a3b-a99c50bbad5c]: (4, ('ok\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Flushing IO for device /dev/sdc {{(pid=72586) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[495aa972-1205-4d31-b9c0-a7b3da64b859]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72586) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] COPY block job progress, current cursor: 298844160 final cursor: 1073741824 {{(pid=72586) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0e0dcd-780e-43d3-8f08-c1d05750c6a0]: (4, ('1', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] SCSI volumes sdc have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d')] {{(pid=72586) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4e02ce-d6ac-4f95-8e8a-3187785047e8]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d -p 172.16.0.220:3260 --logout {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[33658080-afc3-4a73-9bef-6be7b9aed226]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d, portal: 172.16.0.220,3260]
Aug 01 21:22:41 user nova-compute[72586]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d, portal: 172.16.0.220,3260] successful.
Aug 01 21:22:41 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d -p 172.16.0.220:3260 --op delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4c35416-07f0-4c10-86da-a4645d35ea7d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.046s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa9cacb-2fac-426f-ab8c-446464eac8b4]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] <== disconnect_volume: return (375ms) None {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Disconnected iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] calling os-brick to detach iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, {'target_iqns': ['iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XphWnVaz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:22:41 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:22:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb', 0)] {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 21:22:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:42 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[421e5a7d-2904-4135-846c-20c8d2103222]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:42 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[92128838-fe29-4dbd-b139-8a36cece921d]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:42 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 (non-flash)
Aug 01 21:22:42 user nova-compute[72586]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be (non-flash)
Aug 01 21:22:42 user nova-compute[72586]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)
Aug 01 21:22:42 user nova-compute[72586]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)
Aug 01 21:22:42 user nova-compute[72586]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)
Aug 01 21:22:42 user nova-compute[72586]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)
Aug 01 21:22:42 user nova-compute[72586]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)
Aug 01 21:22:42 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:22:42 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 (non-flash)
Aug 01 21:22:42 user nova-compute[72586]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be (non-flash)
Aug 01 21:22:42 user nova-compute[72586]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb (non-flash)
Aug 01 21:22:42 user nova-compute[72586]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)
Aug 01 21:22:42 user nova-compute[72586]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)
Aug 01 21:22:42 user nova-compute[72586]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)
Aug 01 21:22:42 user nova-compute[72586]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)
Aug 01 21:22:42 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:22:42 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ee821f250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb'): ({'sdd'}, set())}) {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 21:22:42 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Removing single pathed devices sdd {{(pid=72586) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 21:22:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:42 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[331dd5f6-ed65-4180-a2e7-f2e7893eb428]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:42 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0f2dfd-bbd9-463f-a40c-0de28448a66d]: (4, ('ok\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:42 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Flushing IO for device /dev/sdd {{(pid=72586) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 21:22:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:42 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f8b34d-5d21-4823-9d99-709328560fd8]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:42 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72586) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 21:22:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:42 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b87160e-e4a0-4622-9850-608fd01f038d]: (4, ('1', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:42 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 21:22:42 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] SCSI volumes sdd have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 21:22:42 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb')] {{(pid=72586) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 21:22:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:42 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0649b366-592c-41c7-9563-ff678695face]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:42 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb -p 172.16.0.220:3260 --logout {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:42 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9f4ef1-8103-4ebd-ac40-31db59f0b835]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:42 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb, portal: 172.16.0.220,3260]
Aug 01 21:22:42 user nova-compute[72586]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb, portal: 172.16.0.220,3260] successful.
Aug 01 21:22:42 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb -p 172.16.0.220:3260 --op delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:42 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] COPY block job progress, current cursor: 416284672 final cursor: 1073741824 {{(pid=72586) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 21:22:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:531ff415-8aca-4d11-869c-5d5617b265eb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:42 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d81e849-6889-4654-8633-7cbdde7b6b3f]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:42 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:42 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:22:42 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] <== disconnect_volume: return (343ms) None {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:22:42 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Disconnected iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 21:22:42 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Deleting instance files /opt/stack/data/nova/instances/4d8fb5ee-2b96-4824-bf5c-a5ebe507606e_del
Aug 01 21:22:42 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Deletion of /opt/stack/data/nova/instances/4d8fb5ee-2b96-4824-bf5c-a5ebe507606e_del complete
Aug 01 21:22:42 user nova-compute[72586]: INFO nova.compute.manager [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Took 3.60 seconds to destroy the instance on the hypervisor.
Aug 01 21:22:42 user nova-compute[72586]: DEBUG oslo.service.loopingcall [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72586) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 21:22:42 user nova-compute[72586]: DEBUG nova.compute.manager [-] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Deallocating network for instance {{(pid=72586) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 21:22:42 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] deallocate_for_instance() {{(pid=72586) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 21:22:42 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] COPY block job progress, current cursor: 603979776 final cursor: 1073741824 {{(pid=72586) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 21:22:43 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] COPY block job progress, current cursor: 781189120 final cursor: 1073741824 {{(pid=72586) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 21:22:43 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] COPY block job progress, current cursor: 844103680 final cursor: 1073741824 {{(pid=72586) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 21:22:43 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:44 user nova-compute[72586]: DEBUG nova.compute.manager [req-47feb523-9c1f-4b2b-9b10-a22d93cd04a2 req-a3ff9950-e35f-461e-89c0-bcffc4f1dbad service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received event network-changed-cdf2815f-96ba-4cb9-a025-1436804117e7 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:22:44 user nova-compute[72586]: DEBUG nova.compute.manager [req-47feb523-9c1f-4b2b-9b10-a22d93cd04a2 req-a3ff9950-e35f-461e-89c0-bcffc4f1dbad service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Refreshing instance network info cache due to event network-changed-cdf2815f-96ba-4cb9-a025-1436804117e7. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:22:44 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-47feb523-9c1f-4b2b-9b10-a22d93cd04a2 req-a3ff9950-e35f-461e-89c0-bcffc4f1dbad service nova] Acquiring lock "refresh_cache-420cd648-f3bb-49b0-a731-d2e4337367f6" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:22:44 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-47feb523-9c1f-4b2b-9b10-a22d93cd04a2 req-a3ff9950-e35f-461e-89c0-bcffc4f1dbad service nova] Acquired lock "refresh_cache-420cd648-f3bb-49b0-a731-d2e4337367f6" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:22:44 user nova-compute[72586]: DEBUG nova.network.neutron [req-47feb523-9c1f-4b2b-9b10-a22d93cd04a2 req-a3ff9950-e35f-461e-89c0-bcffc4f1dbad service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Refreshing network info cache for port cdf2815f-96ba-4cb9-a025-1436804117e7 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:22:44 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] COPY block job progress, current cursor: 1027604480 final cursor: 1073741824 {{(pid=72586) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 21:22:44 user nova-compute[72586]: DEBUG nova.network.neutron [req-47feb523-9c1f-4b2b-9b10-a22d93cd04a2 req-a3ff9950-e35f-461e-89c0-bcffc4f1dbad service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Updated VIF entry in instance network info cache for port cdf2815f-96ba-4cb9-a025-1436804117e7. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:22:44 user nova-compute[72586]: DEBUG nova.network.neutron [req-47feb523-9c1f-4b2b-9b10-a22d93cd04a2 req-a3ff9950-e35f-461e-89c0-bcffc4f1dbad service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Updating instance_info_cache with network_info: [{"id": "cdf2815f-96ba-4cb9-a025-1436804117e7", "address": "fa:16:3e:ae:ba:f8", "network": {"id": "871f534e-89b7-4186-a803-3bc9953b3b9c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-910794372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdf2815f-96", "ovs_interfaceid": "cdf2815f-96ba-4cb9-a025-1436804117e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bdfc5e91-52c4-4071-8252-a7caa7b53d24", "address": "fa:16:3e:2e:72:04", "network": {"id": "f744beb1-7d5f-4163-a4c7-807309ebcfec", "bridge": "br-int", "label": "tempest-device-tagging-net1-329951819", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdfc5e91-52", "ovs_interfaceid": "bdfc5e91-52c4-4071-8252-a7caa7b53d24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5ba1ef1d-6876-4756-86b2-0425ba5dfb39", "address": "fa:16:3e:7c:c9:b7", "network": {"id": "f744beb1-7d5f-4163-a4c7-807309ebcfec", "bridge": "br-int", "label": "tempest-device-tagging-net1-329951819", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ba1ef1d-68", "ovs_interfaceid": "5ba1ef1d-6876-4756-86b2-0425ba5dfb39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "65302d59-bf47-478e-be2e-37920bc76542", "address": "fa:16:3e:a4:c8:14", "network": {"id": "f744beb1-7d5f-4163-a4c7-807309ebcfec", "bridge": "br-int", "label": "tempest-device-tagging-net1-329951819", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65302d59-bf", "ovs_interfaceid": "65302d59-bf47-478e-be2e-37920bc76542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d823d714-835e-418a-85f2-e99504cc3f94", "address": "fa:16:3e:17:cd:33", "network": {"id": "f744beb1-7d5f-4163-a4c7-807309ebcfec", "bridge": "br-int", "label": "tempest-device-tagging-net1-329951819", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd823d714-83", "ovs_interfaceid": "d823d714-835e-418a-85f2-e99504cc3f94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "abf0b845-110a-447f-b130-b1eeed139b29", "address": "fa:16:3e:43:2b:85", "network": {"id": "3ae43cbc-2d22-465e-ba01-b2422e24134b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1150402374", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabf0b845-11", "ovs_interfaceid": "abf0b845-110a-447f-b130-b1eeed139b29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3095c6ca-2bce-4216-9290-e1fc3fe17e03", "address": "fa:16:3e:78:4c:6e", "network": {"id": "3ae43cbc-2d22-465e-ba01-b2422e24134b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1150402374", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3095c6ca-2b", "ovs_interfaceid": "3095c6ca-2bce-4216-9290-e1fc3fe17e03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:22:44 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-47feb523-9c1f-4b2b-9b10-a22d93cd04a2 req-a3ff9950-e35f-461e-89c0-bcffc4f1dbad service nova] Releasing lock "refresh_cache-420cd648-f3bb-49b0-a731-d2e4337367f6" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:22:44 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72586) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 21:22:44 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] calling os-brick to detach iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 21:22:44 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, {'target_iqns': ['iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QhPHJSjs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:22:44 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:22:44 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:22:44 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:22:44 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225', 0)] {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 21:22:44 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:44 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:44 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5dc5eb4-bb4a-415f-b851-1a063ae43b03]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:44 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:45 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:45 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3df72a2-83a7-42cb-a9f0-5e3efb18ea20]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:45 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 (non-flash)
Aug 01 21:22:45 user nova-compute[72586]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be (non-flash)
Aug 01 21:22:45 user nova-compute[72586]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)
Aug 01 21:22:45 user nova-compute[72586]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)
Aug 01 21:22:45 user nova-compute[72586]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)
Aug 01 21:22:45 user nova-compute[72586]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)
Aug 01 21:22:45 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:22:45 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 (non-flash)
Aug 01 21:22:45 user nova-compute[72586]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be (non-flash)
Aug 01 21:22:45 user nova-compute[72586]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)
Aug 01 21:22:45 user nova-compute[72586]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)
Aug 01 21:22:45 user nova-compute[72586]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)
Aug 01 21:22:45 user nova-compute[72586]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)
Aug 01 21:22:45 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:22:45 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ee837ab00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225'): ({'sdi'}, set())}) {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 21:22:45 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] Removing single pathed devices sdi {{(pid=72586) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 21:22:45 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:45 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:45 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b579f7c3-e1c2-4eb3-9074-d0a76b96e74b]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:45 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:45 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:45 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c69df8-960b-4b0a-a855-b6614cb98907]: (4, ('ok\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:45 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] Flushing IO for device /dev/sdi {{(pid=72586) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 21:22:45 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:45 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:45 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64dedb9-78b7-4ea2-852b-8d39e5574254]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:45 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=72586) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 21:22:45 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:45 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.053s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:45 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a0f56d-f76d-4b9c-8fd2-7a20a2c6f6be]: (4, ('1', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:45 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 21:22:45 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] SCSI volumes sdi have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 21:22:45 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225')] {{(pid=72586) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 21:22:45 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:45 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:45 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[654e73e0-3261-4fd2-b2f3-3fc7af754e39]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:45 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:45 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 -p 172.16.0.220:3260 --logout {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:45 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:45 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c3316e-d459-4cea-a28a-9d946af30929]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:45 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225, portal: 172.16.0.220,3260]
Aug 01 21:22:45 user nova-compute[72586]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225, portal: 172.16.0.220,3260] successful.
Aug 01 21:22:45 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:45 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 -p 172.16.0.220:3260 --op delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:45 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:45 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[76126754-652c-487e-ba80-4501d194cc2c]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:45 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:45 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:22:45 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] <== disconnect_volume: return (334ms) None {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:22:45 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Disconnected iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 21:22:45 user nova-compute[72586]: DEBUG nova.compute.manager [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VKNUcazg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': '25fb970a-0caf-41e8-8d58-259dbd9cf291', 'attached_at': '', 'detached_at': '', 'volume_id': '7d8e7763-931d-4d10-a968-38b7b52437be', 'serial'} {{(pid=72586) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 01 21:22:45 user nova-compute[72586]: DEBUG nova.compute.manager [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] swap_volume: removing Cinder connection for volume e83d4aa1-7fe5-415e-96fc-4e413114e225 {{(pid=72586) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 01 21:22:46 user nova-compute[72586]: DEBUG nova.compute.manager [req-ada3fddc-b04e-49ef-9c17-78542c112987 req-b402c87f-9927-447c-b744-02a4bfa78399 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received event network-vif-deleted-9420c293-c443-4003-a54a-d6edbd12ddbc {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:22:46 user nova-compute[72586]: INFO nova.compute.manager [req-ada3fddc-b04e-49ef-9c17-78542c112987 req-b402c87f-9927-447c-b744-02a4bfa78399 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Neutron deleted interface 9420c293-c443-4003-a54a-d6edbd12ddbc; detaching it from the instance and deleting it from the info cache
Aug 01 21:22:46 user nova-compute[72586]: DEBUG nova.network.neutron [req-ada3fddc-b04e-49ef-9c17-78542c112987 req-b402c87f-9927-447c-b744-02a4bfa78399 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Updating instance_info_cache with network_info: [{"id": "28d77550-badf-4c92-9b3d-2335ad88267a", "address": "fa:16:3e:a9:7c:cd", "network": {"id": "7a484128-086b-466a-a4f1-7ee335a489ac", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1177849467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28d77550-ba", "ovs_interfaceid": "28d77550-badf-4c92-9b3d-2335ad88267a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0630d545-5545-4e43-96e7-1a0aed01ba9b", "address": "fa:16:3e:6b:2e:9d", "network": {"id": "e4f2e657-3943-4157-85f2-95d34eebda68", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137166827", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0630d545-55", "ovs_interfaceid": "0630d545-5545-4e43-96e7-1a0aed01ba9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e986409e-ff38-4dad-ba15-4338156ff5f7", "address": "fa:16:3e:ac:26:34", "network": {"id": "e4f2e657-3943-4157-85f2-95d34eebda68", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137166827", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape986409e-ff", "ovs_interfaceid": "e986409e-ff38-4dad-ba15-4338156ff5f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a842fd3a-0b86-4008-8ae9-96ecbd5cb7e2", "address": "fa:16:3e:e2:04:9a", "network": {"id": "e4f2e657-3943-4157-85f2-95d34eebda68", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137166827", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa842fd3a-0b", "ovs_interfaceid": "a842fd3a-0b86-4008-8ae9-96ecbd5cb7e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c71bda65-c16d-48f8-b66f-60d78a569ca3", "address": "fa:16:3e:45:96:2a", "network": {"id": "9c8aece4-aa0f-4431-9376-d0069c7e1003", "bridge": "br-int", "label": "tempest-device-tagging-net2-1263991370", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc71bda65-c1", "ovs_interfaceid": "c71bda65-c16d-48f8-b66f-60d78a569ca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "07f02376-9705-48a3-8434-f7ac557f7d5b", "address": "fa:16:3e:29:34:47", "network": {"id": "9c8aece4-aa0f-4431-9376-d0069c7e1003", "bridge": "br-int", "label": "tempest-device-tagging-net2-1263991370", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07f02376-97", "ovs_interfaceid": "07f02376-9705-48a3-8434-f7ac557f7d5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:22:46 user nova-compute[72586]: DEBUG nova.compute.manager [req-ada3fddc-b04e-49ef-9c17-78542c112987 req-b402c87f-9927-447c-b744-02a4bfa78399 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Detach interface failed, port_id=9420c293-c443-4003-a54a-d6edbd12ddbc, reason: Instance 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e could not be found. {{(pid=72586) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 21:22:46 user nova-compute[72586]: DEBUG nova.compute.manager [req-ada3fddc-b04e-49ef-9c17-78542c112987 req-b402c87f-9927-447c-b744-02a4bfa78399 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received event network-vif-deleted-a842fd3a-0b86-4008-8ae9-96ecbd5cb7e2 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:22:46 user nova-compute[72586]: INFO nova.compute.manager [req-ada3fddc-b04e-49ef-9c17-78542c112987 req-b402c87f-9927-447c-b744-02a4bfa78399 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Neutron deleted interface a842fd3a-0b86-4008-8ae9-96ecbd5cb7e2; detaching it from the instance and deleting it from the info cache
Aug 01 21:22:46 user nova-compute[72586]: DEBUG nova.network.neutron [req-ada3fddc-b04e-49ef-9c17-78542c112987 req-b402c87f-9927-447c-b744-02a4bfa78399 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Updating instance_info_cache with network_info: [{"id": "28d77550-badf-4c92-9b3d-2335ad88267a", "address": "fa:16:3e:a9:7c:cd", "network": {"id": "7a484128-086b-466a-a4f1-7ee335a489ac", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1177849467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28d77550-ba", "ovs_interfaceid": "28d77550-badf-4c92-9b3d-2335ad88267a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0630d545-5545-4e43-96e7-1a0aed01ba9b", "address": "fa:16:3e:6b:2e:9d", "network": {"id": "e4f2e657-3943-4157-85f2-95d34eebda68", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137166827", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0630d545-55", "ovs_interfaceid": "0630d545-5545-4e43-96e7-1a0aed01ba9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e986409e-ff38-4dad-ba15-4338156ff5f7", "address": "fa:16:3e:ac:26:34", "network": {"id": "e4f2e657-3943-4157-85f2-95d34eebda68", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137166827", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape986409e-ff", "ovs_interfaceid": "e986409e-ff38-4dad-ba15-4338156ff5f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c71bda65-c16d-48f8-b66f-60d78a569ca3", "address": "fa:16:3e:45:96:2a", "network": {"id": "9c8aece4-aa0f-4431-9376-d0069c7e1003", "bridge": "br-int", "label": "tempest-device-tagging-net2-1263991370", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc71bda65-c1", "ovs_interfaceid": "c71bda65-c16d-48f8-b66f-60d78a569ca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "07f02376-9705-48a3-8434-f7ac557f7d5b", "address": "fa:16:3e:29:34:47", "network": {"id": "9c8aece4-aa0f-4431-9376-d0069c7e1003", "bridge": "br-int", "label": "tempest-device-tagging-net2-1263991370", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "420db45538ce406abe9e8186c4e3b447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07f02376-97", "ovs_interfaceid": "07f02376-9705-48a3-8434-f7ac557f7d5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:22:46 user nova-compute[72586]: DEBUG nova.compute.manager [req-ada3fddc-b04e-49ef-9c17-78542c112987 req-b402c87f-9927-447c-b744-02a4bfa78399 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Detach interface failed, port_id=a842fd3a-0b86-4008-8ae9-96ecbd5cb7e2, reason: Instance 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e could not be found. {{(pid=72586) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 21:22:46 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:46 user nova-compute[72586]: DEBUG nova.compute.manager [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] swap_volume: Updating volume e83d4aa1-7fe5-415e-96fc-4e413114e225 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "VKNUcazg", "auth_password": "9RDcIXAaOiQC18", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdj", "volume_id": "7d8e7763-931d-4d10-a968-38b7b52437be"}, "status": "reserved", "instance": "25fb970a-0caf-41e8-8d58-259dbd9cf291", "attached_at": "", "detached_at": "", "volume_id": "7d8e7763-931d-4d10-a968-38b7b52437be", "serial": "7d8e7763-931d-4d10-a968-38b7b52437be"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '7d8e7763-931d-4d10-a968-38b7b52437be', 'no_device': None, 'attachment_id': 'c3203f10-f34f-490a-b404-d398c8d04dba'} {{(pid=72586) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 01 21:22:46 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1fcfc4e1-8e70-4d51-985c-418e1c34ad9e tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] Lock "25fb970a-0caf-41e8-8d58-259dbd9cf291" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 20.620s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:22:46 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Acquiring lock "420cd648-f3bb-49b0-a731-d2e4337367f6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:22:46 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Lock "420cd648-f3bb-49b0-a731-d2e4337367f6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:22:46 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Acquiring lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:22:46 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:22:46 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:22:46 user nova-compute[72586]: INFO nova.compute.manager [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Terminating instance
Aug 01 21:22:46 user nova-compute[72586]: DEBUG nova.compute.manager [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Start destroying the instance on the hypervisor. {{(pid=72586) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 21:22:46 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:46 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:46 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:46 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:46 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:46 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:46 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:46 user nova-compute[72586]: DEBUG nova.compute.manager [req-f6e6d568-400e-48af-a55d-62d42f96a2e4 req-1bb36d29-35ba-4b72-9d83-8f1f211abbd1 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received event network-vif-unplugged-cdf2815f-96ba-4cb9-a025-1436804117e7 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:22:46 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-f6e6d568-400e-48af-a55d-62d42f96a2e4 req-1bb36d29-35ba-4b72-9d83-8f1f211abbd1 service nova] Acquiring lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:22:46 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-f6e6d568-400e-48af-a55d-62d42f96a2e4 req-1bb36d29-35ba-4b72-9d83-8f1f211abbd1 service nova] Lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:22:46 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-f6e6d568-400e-48af-a55d-62d42f96a2e4 req-1bb36d29-35ba-4b72-9d83-8f1f211abbd1 service nova] Lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:22:46 user nova-compute[72586]: DEBUG nova.compute.manager [req-f6e6d568-400e-48af-a55d-62d42f96a2e4 req-1bb36d29-35ba-4b72-9d83-8f1f211abbd1 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] No waiting events found dispatching network-vif-unplugged-cdf2815f-96ba-4cb9-a025-1436804117e7 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:22:46 user nova-compute[72586]: DEBUG nova.compute.manager [req-f6e6d568-400e-48af-a55d-62d42f96a2e4 req-1bb36d29-35ba-4b72-9d83-8f1f211abbd1 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received event network-vif-unplugged-cdf2815f-96ba-4cb9-a025-1436804117e7 for instance with task_state deleting. {{(pid=72586) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 21:22:46 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:46 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:47 user nova-compute[72586]: DEBUG nova.compute.manager [req-7240d5c5-f996-4bde-81eb-4e7a85a9aace req-745bde65-ab08-45dc-9280-9df4f14526c1 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received event network-vif-unplugged-5ba1ef1d-6876-4756-86b2-0425ba5dfb39 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:22:47 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-7240d5c5-f996-4bde-81eb-4e7a85a9aace req-745bde65-ab08-45dc-9280-9df4f14526c1 service nova] Acquiring lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:22:47 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-7240d5c5-f996-4bde-81eb-4e7a85a9aace req-745bde65-ab08-45dc-9280-9df4f14526c1 service nova] Lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:22:47 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-7240d5c5-f996-4bde-81eb-4e7a85a9aace req-745bde65-ab08-45dc-9280-9df4f14526c1 service nova] Lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:22:47 user nova-compute[72586]: DEBUG nova.compute.manager [req-7240d5c5-f996-4bde-81eb-4e7a85a9aace req-745bde65-ab08-45dc-9280-9df4f14526c1 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] No waiting events found dispatching network-vif-unplugged-5ba1ef1d-6876-4756-86b2-0425ba5dfb39 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:22:47 user nova-compute[72586]: DEBUG nova.compute.manager [req-7240d5c5-f996-4bde-81eb-4e7a85a9aace req-745bde65-ab08-45dc-9280-9df4f14526c1 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received event network-vif-unplugged-5ba1ef1d-6876-4756-86b2-0425ba5dfb39 for instance with task_state deleting. {{(pid=72586) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 21:22:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:47 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:22:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:47 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Took 5.23 seconds to deallocate network for instance.
Aug 01 21:22:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:48 user nova-compute[72586]: DEBUG nova.compute.manager [req-9f436c50-a92c-4192-8267-0195147d5c45 req-dabd0b1f-b6bf-48b1-a507-c766c4076455 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received event network-vif-deleted-28d77550-badf-4c92-9b3d-2335ad88267a {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:22:48 user nova-compute[72586]: DEBUG nova.compute.manager [req-9f436c50-a92c-4192-8267-0195147d5c45 req-dabd0b1f-b6bf-48b1-a507-c766c4076455 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received event network-vif-deleted-07f02376-9705-48a3-8434-f7ac557f7d5b {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:22:48 user nova-compute[72586]: DEBUG nova.compute.manager [req-9f436c50-a92c-4192-8267-0195147d5c45 req-dabd0b1f-b6bf-48b1-a507-c766c4076455 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received event network-vif-unplugged-abf0b845-110a-447f-b130-b1eeed139b29 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:22:48 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-9f436c50-a92c-4192-8267-0195147d5c45 req-dabd0b1f-b6bf-48b1-a507-c766c4076455 service nova] Acquiring lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:22:48 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-9f436c50-a92c-4192-8267-0195147d5c45 req-dabd0b1f-b6bf-48b1-a507-c766c4076455 service nova] Lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:22:48 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-9f436c50-a92c-4192-8267-0195147d5c45 req-dabd0b1f-b6bf-48b1-a507-c766c4076455 service nova] Lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:22:48 user nova-compute[72586]: DEBUG nova.compute.manager [req-9f436c50-a92c-4192-8267-0195147d5c45 req-dabd0b1f-b6bf-48b1-a507-c766c4076455 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] No waiting events found dispatching network-vif-unplugged-abf0b845-110a-447f-b130-b1eeed139b29 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:22:48 user nova-compute[72586]: DEBUG nova.compute.manager [req-9f436c50-a92c-4192-8267-0195147d5c45 req-dabd0b1f-b6bf-48b1-a507-c766c4076455 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received event network-vif-unplugged-abf0b845-110a-447f-b130-b1eeed139b29 for instance with task_state deleting. {{(pid=72586) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 21:22:48 user nova-compute[72586]: DEBUG nova.compute.manager [req-9f436c50-a92c-4192-8267-0195147d5c45 req-dabd0b1f-b6bf-48b1-a507-c766c4076455 service nova] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Received event network-vif-deleted-c71bda65-c16d-48f8-b66f-60d78a569ca3 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:22:48 user nova-compute[72586]: DEBUG nova.compute.manager [req-9f436c50-a92c-4192-8267-0195147d5c45 req-dabd0b1f-b6bf-48b1-a507-c766c4076455 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received event network-vif-plugged-abf0b845-110a-447f-b130-b1eeed139b29 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:22:48 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-9f436c50-a92c-4192-8267-0195147d5c45 req-dabd0b1f-b6bf-48b1-a507-c766c4076455 service nova] Acquiring lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:22:48 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-9f436c50-a92c-4192-8267-0195147d5c45 req-dabd0b1f-b6bf-48b1-a507-c766c4076455 service nova] Lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:22:48 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-9f436c50-a92c-4192-8267-0195147d5c45 req-dabd0b1f-b6bf-48b1-a507-c766c4076455 service nova] Lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:22:48 user nova-compute[72586]: DEBUG nova.compute.manager [req-9f436c50-a92c-4192-8267-0195147d5c45 req-dabd0b1f-b6bf-48b1-a507-c766c4076455 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] No waiting events found dispatching network-vif-plugged-abf0b845-110a-447f-b130-b1eeed139b29 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:22:48 user nova-compute[72586]: WARNING nova.compute.manager [req-9f436c50-a92c-4192-8267-0195147d5c45 req-dabd0b1f-b6bf-48b1-a507-c766c4076455 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received unexpected event network-vif-plugged-abf0b845-110a-447f-b130-b1eeed139b29 for instance with vm_state active and task_state deleting.
Aug 01 21:22:48 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] Acquiring lock "25fb970a-0caf-41e8-8d58-259dbd9cf291" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:22:48 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] Lock "25fb970a-0caf-41e8-8d58-259dbd9cf291" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:22:48 user nova-compute[72586]: DEBUG os_brick.utils [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:22:48 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:48 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:48 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[26de161e-d8a2-4ceb-9dda-b8b9211d206e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4bc202fb9cb\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:48 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:48 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:48 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[822e5b01-95f5-4b60-a554-8b8f4d32996c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:48 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:48 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:48 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad7c900-e560-45c2-97f2-fb27b594b7c5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:48 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[44afa200-3d0a-4e3e-9db3-732cd74dde13]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:48 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] Running cmd (subprocess): nvme version {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:48 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:22:48 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] nvme not present on system {{(pid=72586) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 21:22:48 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:48 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:22:48 user nova-compute[72586]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 21:22:48 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d90eea-eecc-4a51-bfc7-2924163e0566]: (4, '') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:48 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72586) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 21:22:48 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 21:22:48 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] LIGHTOS: no hostnqn found. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 21:22:48 user nova-compute[72586]: DEBUG os_brick.utils [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4bc202fb9cb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:22:48 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Instance destroyed successfully.
Aug 01 21:22:48 user nova-compute[72586]: DEBUG nova.objects.instance [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Lazy-loading 'resources' on Instance uuid 420cd648-f3bb-49b0-a731-d2e4337367f6 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:22:48 user nova-compute[72586]: INFO nova.compute.manager [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Swapping volume 7d8e7763-931d-4d10-a968-38b7b52437be for e83d4aa1-7fe5-415e-96fc-4e413114e225
Aug 01 21:22:48 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T21:20:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-217867043',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-217867043',id=11,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO76uCuhkjrWPkyXk6qmYQwxhaVjlKA+ce6UfOilBS2ShINaqd2kTHhw6N+tWxLYcCs1mxp+f1Hh10jwhbHka3cfTUcwK8jtYq/GKdIX+pjyujzcReByfdCEuUmQ8BfXbA==',key_name='tempest-keypair-1207086275',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:21:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46642f001d8644259eea283abaff6383',ramdisk_id='',reservation_id='r-ukz2hx41',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2021813946',owner_user_name='tempest-TaggedBootDevicesTest_v242-2021813946-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:21:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e476921eeb9b4212a088e864a0b85117',uuid=420cd648-f3bb-49b0-a731-d2e4337367f6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cdf2815f-96ba-4cb9-a025-1436804117e7", "address": "fa:16:3e:ae:ba:f8", "network": {"id": "871f534e-89b7-4186-a803-3bc9953b3b9c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-910794372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdf2815f-96", "ovs_interfaceid": "cdf2815f-96ba-4cb9-a025-1436804117e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:22:48 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Converting VIF {"id": "cdf2815f-96ba-4cb9-a025-1436804117e7", "address": "fa:16:3e:ae:ba:f8", "network": {"id": "871f534e-89b7-4186-a803-3bc9953b3b9c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-910794372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdf2815f-96", "ovs_interfaceid": "cdf2815f-96ba-4cb9-a025-1436804117e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:22:48 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:ba:f8,bridge_name='br-int',has_traffic_filtering=True,id=cdf2815f-96ba-4cb9-a025-1436804117e7,network=Network(871f534e-89b7-4186-a803-3bc9953b3b9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdf2815f-96') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:22:48 user nova-compute[72586]: DEBUG os_vif [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:ba:f8,bridge_name='br-int',has_traffic_filtering=True,id=cdf2815f-96ba-4cb9-a025-1436804117e7,network=Network(871f534e-89b7-4186-a803-3bc9953b3b9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdf2815f-96') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:22:48 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:48 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcdf2815f-96, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:22:48 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:48 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:22:48 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:48 user nova-compute[72586]: INFO os_vif [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:ba:f8,bridge_name='br-int',has_traffic_filtering=True,id=cdf2815f-96ba-4cb9-a025-1436804117e7,network=Network(871f534e-89b7-4186-a803-3bc9953b3b9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdf2815f-96')
Aug 01 21:22:48 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T21:20:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-217867043',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-217867043',id=11,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO76uCuhkjrWPkyXk6qmYQwxhaVjlKA+ce6UfOilBS2ShINaqd2kTHhw6N+tWxLYcCs1mxp+f1Hh10jwhbHka3cfTUcwK8jtYq/GKdIX+pjyujzcReByfdCEuUmQ8BfXbA==',key_name='tempest-keypair-1207086275',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:21:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46642f001d8644259eea283abaff6383',ramdisk_id='',reservation_id='r-ukz2hx41',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2021813946',owner_user_name='tempest-TaggedBootDevicesTest_v242-2021813946-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:21:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e476921eeb9b4212a088e864a0b85117',uuid=420cd648-f3bb-49b0-a731-d2e4337367f6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bdfc5e91-52c4-4071-8252-a7caa7b53d24", "address": "fa:16:3e:2e:72:04", "network": {"id": "f744beb1-7d5f-4163-a4c7-807309ebcfec", "bridge": "br-int", "label": "tempest-device-tagging-net1-329951819", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdfc5e91-52", "ovs_interfaceid": "bdfc5e91-52c4-4071-8252-a7caa7b53d24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:22:48 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Converting VIF {"id": "bdfc5e91-52c4-4071-8252-a7caa7b53d24", "address": "fa:16:3e:2e:72:04", "network": {"id": "f744beb1-7d5f-4163-a4c7-807309ebcfec", "bridge": "br-int", "label": "tempest-device-tagging-net1-329951819", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdfc5e91-52", "ovs_interfaceid": "bdfc5e91-52c4-4071-8252-a7caa7b53d24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:22:48 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:72:04,bridge_name='br-int',has_traffic_filtering=True,id=bdfc5e91-52c4-4071-8252-a7caa7b53d24,network=Network(f744beb1-7d5f-4163-a4c7-807309ebcfec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbdfc5e91-52') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:22:48 user nova-compute[72586]: DEBUG os_vif [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:72:04,bridge_name='br-int',has_traffic_filtering=True,id=bdfc5e91-52c4-4071-8252-a7caa7b53d24,network=Network(f744beb1-7d5f-4163-a4c7-807309ebcfec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbdfc5e91-52') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:22:48 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:48 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbdfc5e91-52, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:22:48 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:48 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:22:48 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:48 user nova-compute[72586]: INFO os_vif [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:72:04,bridge_name='br-int',has_traffic_filtering=True,id=bdfc5e91-52c4-4071-8252-a7caa7b53d24,network=Network(f744beb1-7d5f-4163-a4c7-807309ebcfec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbdfc5e91-52')
Aug 01 21:22:48 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T21:20:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-217867043',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-217867043',id=11,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO76uCuhkjrWPkyXk6qmYQwxhaVjlKA+ce6UfOilBS2ShINaqd2kTHhw6N+tWxLYcCs1mxp+f1Hh10jwhbHka3cfTUcwK8jtYq/GKdIX+pjyujzcReByfdCEuUmQ8BfXbA==',key_name='tempest-keypair-1207086275',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:21:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46642f001d8644259eea283abaff6383',ramdisk_id='',reservation_id='r-ukz2hx41',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2021813946',owner_user_name='tempest-TaggedBootDevicesTest_v242-2021813946-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:21:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e476921eeb9b4212a088e864a0b85117',uuid=420cd648-f3bb-49b0-a731-d2e4337367f6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ba1ef1d-6876-4756-86b2-0425ba5dfb39", "address": "fa:16:3e:7c:c9:b7", "network": {"id": "f744beb1-7d5f-4163-a4c7-807309ebcfec", "bridge": "br-int", "label": "tempest-device-tagging-net1-329951819", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ba1ef1d-68", "ovs_interfaceid": "5ba1ef1d-6876-4756-86b2-0425ba5dfb39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:22:48 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Converting VIF {"id": "5ba1ef1d-6876-4756-86b2-0425ba5dfb39", "address": "fa:16:3e:7c:c9:b7", "network": {"id": "f744beb1-7d5f-4163-a4c7-807309ebcfec", "bridge": "br-int", "label": "tempest-device-tagging-net1-329951819", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ba1ef1d-68", "ovs_interfaceid": "5ba1ef1d-6876-4756-86b2-0425ba5dfb39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:22:48 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:c9:b7,bridge_name='br-int',has_traffic_filtering=True,id=5ba1ef1d-6876-4756-86b2-0425ba5dfb39,network=Network(f744beb1-7d5f-4163-a4c7-807309ebcfec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5ba1ef1d-68') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:22:48 user nova-compute[72586]: DEBUG os_vif [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:c9:b7,bridge_name='br-int',has_traffic_filtering=True,id=5ba1ef1d-6876-4756-86b2-0425ba5dfb39,network=Network(f744beb1-7d5f-4163-a4c7-807309ebcfec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5ba1ef1d-68') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:22:48 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:48 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ba1ef1d-68, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:22:48 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:49 user nova-compute[72586]: INFO os_vif [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:c9:b7,bridge_name='br-int',has_traffic_filtering=True,id=5ba1ef1d-6876-4756-86b2-0425ba5dfb39,network=Network(f744beb1-7d5f-4163-a4c7-807309ebcfec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5ba1ef1d-68')
Aug 01 21:22:49 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T21:20:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-217867043',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-217867043',id=11,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO76uCuhkjrWPkyXk6qmYQwxhaVjlKA+ce6UfOilBS2ShINaqd2kTHhw6N+tWxLYcCs1mxp+f1Hh10jwhbHka3cfTUcwK8jtYq/GKdIX+pjyujzcReByfdCEuUmQ8BfXbA==',key_name='tempest-keypair-1207086275',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:21:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46642f001d8644259eea283abaff6383',ramdisk_id='',reservation_id='r-ukz2hx41',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2021813946',owner_user_name='tempest-TaggedBootDevicesTest_v242-2021813946-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:21:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e476921eeb9b4212a088e864a0b85117',uuid=420cd648-f3bb-49b0-a731-d2e4337367f6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "65302d59-bf47-478e-be2e-37920bc76542", "address": "fa:16:3e:a4:c8:14", "network": {"id": "f744beb1-7d5f-4163-a4c7-807309ebcfec", "bridge": "br-int", "label": "tempest-device-tagging-net1-329951819", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65302d59-bf", "ovs_interfaceid": "65302d59-bf47-478e-be2e-37920bc76542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Converting VIF {"id": "65302d59-bf47-478e-be2e-37920bc76542", "address": "fa:16:3e:a4:c8:14", "network": {"id": "f744beb1-7d5f-4163-a4c7-807309ebcfec", "bridge": "br-int", "label": "tempest-device-tagging-net1-329951819", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65302d59-bf", "ovs_interfaceid": "65302d59-bf47-478e-be2e-37920bc76542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:c8:14,bridge_name='br-int',has_traffic_filtering=True,id=65302d59-bf47-478e-be2e-37920bc76542,network=Network(f744beb1-7d5f-4163-a4c7-807309ebcfec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65302d59-bf') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG os_vif [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:c8:14,bridge_name='br-int',has_traffic_filtering=True,id=65302d59-bf47-478e-be2e-37920bc76542,network=Network(f744beb1-7d5f-4163-a4c7-807309ebcfec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65302d59-bf') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap65302d59-bf, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG nova.compute.manager [req-d66d7c18-a043-4f9f-af34-3f9b01213751 req-0cebd463-9a22-4855-9653-735924f0baee service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received event network-vif-plugged-cdf2815f-96ba-4cb9-a025-1436804117e7 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d66d7c18-a043-4f9f-af34-3f9b01213751 req-0cebd463-9a22-4855-9653-735924f0baee service nova] Acquiring lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d66d7c18-a043-4f9f-af34-3f9b01213751 req-0cebd463-9a22-4855-9653-735924f0baee service nova] Lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d66d7c18-a043-4f9f-af34-3f9b01213751 req-0cebd463-9a22-4855-9653-735924f0baee service nova] Lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG nova.compute.manager [req-d66d7c18-a043-4f9f-af34-3f9b01213751 req-0cebd463-9a22-4855-9653-735924f0baee service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] No waiting events found dispatching network-vif-plugged-cdf2815f-96ba-4cb9-a025-1436804117e7 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:22:49 user nova-compute[72586]: WARNING nova.compute.manager [req-d66d7c18-a043-4f9f-af34-3f9b01213751 req-0cebd463-9a22-4855-9653-735924f0baee service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received unexpected event network-vif-plugged-cdf2815f-96ba-4cb9-a025-1436804117e7 for instance with vm_state active and task_state deleting.
Aug 01 21:22:49 user nova-compute[72586]: DEBUG nova.compute.manager [req-d66d7c18-a043-4f9f-af34-3f9b01213751 req-0cebd463-9a22-4855-9653-735924f0baee service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received event network-vif-unplugged-bdfc5e91-52c4-4071-8252-a7caa7b53d24 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d66d7c18-a043-4f9f-af34-3f9b01213751 req-0cebd463-9a22-4855-9653-735924f0baee service nova] Acquiring lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d66d7c18-a043-4f9f-af34-3f9b01213751 req-0cebd463-9a22-4855-9653-735924f0baee service nova] Lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d66d7c18-a043-4f9f-af34-3f9b01213751 req-0cebd463-9a22-4855-9653-735924f0baee service nova] Lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG nova.compute.manager [req-d66d7c18-a043-4f9f-af34-3f9b01213751 req-0cebd463-9a22-4855-9653-735924f0baee service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] No waiting events found dispatching network-vif-unplugged-bdfc5e91-52c4-4071-8252-a7caa7b53d24 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG nova.compute.manager [req-d66d7c18-a043-4f9f-af34-3f9b01213751 req-0cebd463-9a22-4855-9653-735924f0baee service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received event network-vif-unplugged-bdfc5e91-52c4-4071-8252-a7caa7b53d24 for instance with task_state deleting. {{(pid=72586) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG nova.compute.manager [req-d66d7c18-a043-4f9f-af34-3f9b01213751 req-0cebd463-9a22-4855-9653-735924f0baee service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received event network-vif-plugged-bdfc5e91-52c4-4071-8252-a7caa7b53d24 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d66d7c18-a043-4f9f-af34-3f9b01213751 req-0cebd463-9a22-4855-9653-735924f0baee service nova] Acquiring lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d66d7c18-a043-4f9f-af34-3f9b01213751 req-0cebd463-9a22-4855-9653-735924f0baee service nova] Lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d66d7c18-a043-4f9f-af34-3f9b01213751 req-0cebd463-9a22-4855-9653-735924f0baee service nova] Lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG nova.compute.manager [req-d66d7c18-a043-4f9f-af34-3f9b01213751 req-0cebd463-9a22-4855-9653-735924f0baee service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] No waiting events found dispatching network-vif-plugged-bdfc5e91-52c4-4071-8252-a7caa7b53d24 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:22:49 user nova-compute[72586]: WARNING nova.compute.manager [req-d66d7c18-a043-4f9f-af34-3f9b01213751 req-0cebd463-9a22-4855-9653-735924f0baee service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received unexpected event network-vif-plugged-bdfc5e91-52c4-4071-8252-a7caa7b53d24 for instance with vm_state active and task_state deleting.
Aug 01 21:22:49 user nova-compute[72586]: DEBUG nova.compute.manager [req-d66d7c18-a043-4f9f-af34-3f9b01213751 req-0cebd463-9a22-4855-9653-735924f0baee service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received event network-vif-unplugged-3095c6ca-2bce-4216-9290-e1fc3fe17e03 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d66d7c18-a043-4f9f-af34-3f9b01213751 req-0cebd463-9a22-4855-9653-735924f0baee service nova] Acquiring lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d66d7c18-a043-4f9f-af34-3f9b01213751 req-0cebd463-9a22-4855-9653-735924f0baee service nova] Lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d66d7c18-a043-4f9f-af34-3f9b01213751 req-0cebd463-9a22-4855-9653-735924f0baee service nova] Lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG nova.compute.manager [req-d66d7c18-a043-4f9f-af34-3f9b01213751 req-0cebd463-9a22-4855-9653-735924f0baee service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] No waiting events found dispatching network-vif-unplugged-3095c6ca-2bce-4216-9290-e1fc3fe17e03 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG nova.compute.manager [req-d66d7c18-a043-4f9f-af34-3f9b01213751 req-0cebd463-9a22-4855-9653-735924f0baee service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received event network-vif-unplugged-3095c6ca-2bce-4216-9290-e1fc3fe17e03 for instance with task_state deleting. {{(pid=72586) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG nova.compute.manager [req-d66d7c18-a043-4f9f-af34-3f9b01213751 req-0cebd463-9a22-4855-9653-735924f0baee service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received event network-vif-plugged-3095c6ca-2bce-4216-9290-e1fc3fe17e03 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d66d7c18-a043-4f9f-af34-3f9b01213751 req-0cebd463-9a22-4855-9653-735924f0baee service nova] Acquiring lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d66d7c18-a043-4f9f-af34-3f9b01213751 req-0cebd463-9a22-4855-9653-735924f0baee service nova] Lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d66d7c18-a043-4f9f-af34-3f9b01213751 req-0cebd463-9a22-4855-9653-735924f0baee service nova] Lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG nova.compute.manager [req-d66d7c18-a043-4f9f-af34-3f9b01213751 req-0cebd463-9a22-4855-9653-735924f0baee service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] No waiting events found dispatching network-vif-plugged-3095c6ca-2bce-4216-9290-e1fc3fe17e03 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:22:49 user nova-compute[72586]: WARNING nova.compute.manager [req-d66d7c18-a043-4f9f-af34-3f9b01213751 req-0cebd463-9a22-4855-9653-735924f0baee service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received unexpected event network-vif-plugged-3095c6ca-2bce-4216-9290-e1fc3fe17e03 for instance with vm_state active and task_state deleting.
Aug 01 21:22:49 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:49 user nova-compute[72586]: INFO os_vif [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:c8:14,bridge_name='br-int',has_traffic_filtering=True,id=65302d59-bf47-478e-be2e-37920bc76542,network=Network(f744beb1-7d5f-4163-a4c7-807309ebcfec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65302d59-bf')
Aug 01 21:22:49 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T21:20:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-217867043',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-217867043',id=11,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO76uCuhkjrWPkyXk6qmYQwxhaVjlKA+ce6UfOilBS2ShINaqd2kTHhw6N+tWxLYcCs1mxp+f1Hh10jwhbHka3cfTUcwK8jtYq/GKdIX+pjyujzcReByfdCEuUmQ8BfXbA==',key_name='tempest-keypair-1207086275',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:21:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46642f001d8644259eea283abaff6383',ramdisk_id='',reservation_id='r-ukz2hx41',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2021813946',owner_user_name='tempest-TaggedBootDevicesTest_v242-2021813946-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:21:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e476921eeb9b4212a088e864a0b85117',uuid=420cd648-f3bb-49b0-a731-d2e4337367f6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d823d714-835e-418a-85f2-e99504cc3f94", "address": "fa:16:3e:17:cd:33", "network": {"id": "f744beb1-7d5f-4163-a4c7-807309ebcfec", "bridge": "br-int", "label": "tempest-device-tagging-net1-329951819", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd823d714-83", "ovs_interfaceid": "d823d714-835e-418a-85f2-e99504cc3f94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Converting VIF {"id": "d823d714-835e-418a-85f2-e99504cc3f94", "address": "fa:16:3e:17:cd:33", "network": {"id": "f744beb1-7d5f-4163-a4c7-807309ebcfec", "bridge": "br-int", "label": "tempest-device-tagging-net1-329951819", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd823d714-83", "ovs_interfaceid": "d823d714-835e-418a-85f2-e99504cc3f94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:cd:33,bridge_name='br-int',has_traffic_filtering=True,id=d823d714-835e-418a-85f2-e99504cc3f94,network=Network(f744beb1-7d5f-4163-a4c7-807309ebcfec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd823d714-83') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG os_vif [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:cd:33,bridge_name='br-int',has_traffic_filtering=True,id=d823d714-835e-418a-85f2-e99504cc3f94,network=Network(f744beb1-7d5f-4163-a4c7-807309ebcfec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd823d714-83') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd823d714-83, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:49 user nova-compute[72586]: INFO os_vif [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:cd:33,bridge_name='br-int',has_traffic_filtering=True,id=d823d714-835e-418a-85f2-e99504cc3f94,network=Network(f744beb1-7d5f-4163-a4c7-807309ebcfec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd823d714-83')
Aug 01 21:22:49 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T21:20:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-217867043',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-217867043',id=11,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO76uCuhkjrWPkyXk6qmYQwxhaVjlKA+ce6UfOilBS2ShINaqd2kTHhw6N+tWxLYcCs1mxp+f1Hh10jwhbHka3cfTUcwK8jtYq/GKdIX+pjyujzcReByfdCEuUmQ8BfXbA==',key_name='tempest-keypair-1207086275',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:21:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46642f001d8644259eea283abaff6383',ramdisk_id='',reservation_id='r-ukz2hx41',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2021813946',owner_user_name='tempest-TaggedBootDevicesTest_v242-2021813946-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:21:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e476921eeb9b4212a088e864a0b85117',uuid=420cd648-f3bb-49b0-a731-d2e4337367f6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "abf0b845-110a-447f-b130-b1eeed139b29", "address": "fa:16:3e:43:2b:85", "network": {"id": "3ae43cbc-2d22-465e-ba01-b2422e24134b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1150402374", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabf0b845-11", "ovs_interfaceid": "abf0b845-110a-447f-b130-b1eeed139b29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Converting VIF {"id": "abf0b845-110a-447f-b130-b1eeed139b29", "address": "fa:16:3e:43:2b:85", "network": {"id": "3ae43cbc-2d22-465e-ba01-b2422e24134b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1150402374", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabf0b845-11", "ovs_interfaceid": "abf0b845-110a-447f-b130-b1eeed139b29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:2b:85,bridge_name='br-int',has_traffic_filtering=True,id=abf0b845-110a-447f-b130-b1eeed139b29,network=Network(3ae43cbc-2d22-465e-ba01-b2422e24134b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabf0b845-11') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG os_vif [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:2b:85,bridge_name='br-int',has_traffic_filtering=True,id=abf0b845-110a-447f-b130-b1eeed139b29,network=Network(3ae43cbc-2d22-465e-ba01-b2422e24134b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabf0b845-11') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapabf0b845-11, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:49 user nova-compute[72586]: INFO os_vif [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:2b:85,bridge_name='br-int',has_traffic_filtering=True,id=abf0b845-110a-447f-b130-b1eeed139b29,network=Network(3ae43cbc-2d22-465e-ba01-b2422e24134b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabf0b845-11')
Aug 01 21:22:49 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T21:20:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-217867043',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-217867043',id=11,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO76uCuhkjrWPkyXk6qmYQwxhaVjlKA+ce6UfOilBS2ShINaqd2kTHhw6N+tWxLYcCs1mxp+f1Hh10jwhbHka3cfTUcwK8jtYq/GKdIX+pjyujzcReByfdCEuUmQ8BfXbA==',key_name='tempest-keypair-1207086275',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:21:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46642f001d8644259eea283abaff6383',ramdisk_id='',reservation_id='r-ukz2hx41',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2021813946',owner_user_name='tempest-TaggedBootDevicesTest_v242-2021813946-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:21:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e476921eeb9b4212a088e864a0b85117',uuid=420cd648-f3bb-49b0-a731-d2e4337367f6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3095c6ca-2bce-4216-9290-e1fc3fe17e03", "address": "fa:16:3e:78:4c:6e", "network": {"id": "3ae43cbc-2d22-465e-ba01-b2422e24134b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1150402374", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3095c6ca-2b", "ovs_interfaceid": "3095c6ca-2bce-4216-9290-e1fc3fe17e03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Converting VIF {"id": "3095c6ca-2bce-4216-9290-e1fc3fe17e03", "address": "fa:16:3e:78:4c:6e", "network": {"id": "3ae43cbc-2d22-465e-ba01-b2422e24134b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1150402374", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3095c6ca-2b", "ovs_interfaceid": "3095c6ca-2bce-4216-9290-e1fc3fe17e03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:4c:6e,bridge_name='br-int',has_traffic_filtering=True,id=3095c6ca-2bce-4216-9290-e1fc3fe17e03,network=Network(3ae43cbc-2d22-465e-ba01-b2422e24134b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3095c6ca-2b') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG os_vif [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:4c:6e,bridge_name='br-int',has_traffic_filtering=True,id=3095c6ca-2bce-4216-9290-e1fc3fe17e03,network=Network(3ae43cbc-2d22-465e-ba01-b2422e24134b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3095c6ca-2b') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3095c6ca-2b, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:22:49 user nova-compute[72586]: INFO os_vif [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:4c:6e,bridge_name='br-int',has_traffic_filtering=True,id=3095c6ca-2bce-4216-9290-e1fc3fe17e03,network=Network(3ae43cbc-2d22-465e-ba01-b2422e24134b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3095c6ca-2b')
Aug 01 21:22:49 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] calling os-brick to detach iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, {'target_iqns': ['iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CsqEQfdn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:22:49 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:22:49 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13', 0)] {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG nova.compute.manager [req-580ab63c-5b71-4ddc-acd4-80c1f55045b7 req-35384b72-6902-4430-999e-bd62677e6cca service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received event network-vif-plugged-5ba1ef1d-6876-4756-86b2-0425ba5dfb39 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-580ab63c-5b71-4ddc-acd4-80c1f55045b7 req-35384b72-6902-4430-999e-bd62677e6cca service nova] Acquiring lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-580ab63c-5b71-4ddc-acd4-80c1f55045b7 req-35384b72-6902-4430-999e-bd62677e6cca service nova] Lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-580ab63c-5b71-4ddc-acd4-80c1f55045b7 req-35384b72-6902-4430-999e-bd62677e6cca service nova] Lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG nova.compute.manager [req-580ab63c-5b71-4ddc-acd4-80c1f55045b7 req-35384b72-6902-4430-999e-bd62677e6cca service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] No waiting events found dispatching network-vif-plugged-5ba1ef1d-6876-4756-86b2-0425ba5dfb39 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:22:49 user nova-compute[72586]: WARNING nova.compute.manager [req-580ab63c-5b71-4ddc-acd4-80c1f55045b7 req-35384b72-6902-4430-999e-bd62677e6cca service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received unexpected event network-vif-plugged-5ba1ef1d-6876-4756-86b2-0425ba5dfb39 for instance with vm_state active and task_state deleting.
Aug 01 21:22:49 user nova-compute[72586]: DEBUG nova.compute.manager [req-580ab63c-5b71-4ddc-acd4-80c1f55045b7 req-35384b72-6902-4430-999e-bd62677e6cca service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received event network-vif-unplugged-65302d59-bf47-478e-be2e-37920bc76542 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-580ab63c-5b71-4ddc-acd4-80c1f55045b7 req-35384b72-6902-4430-999e-bd62677e6cca service nova] Acquiring lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-580ab63c-5b71-4ddc-acd4-80c1f55045b7 req-35384b72-6902-4430-999e-bd62677e6cca service nova] Lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-580ab63c-5b71-4ddc-acd4-80c1f55045b7 req-35384b72-6902-4430-999e-bd62677e6cca service nova] Lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG nova.compute.manager [req-580ab63c-5b71-4ddc-acd4-80c1f55045b7 req-35384b72-6902-4430-999e-bd62677e6cca service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] No waiting events found dispatching network-vif-unplugged-65302d59-bf47-478e-be2e-37920bc76542 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG nova.compute.manager [req-580ab63c-5b71-4ddc-acd4-80c1f55045b7 req-35384b72-6902-4430-999e-bd62677e6cca service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received event network-vif-unplugged-65302d59-bf47-478e-be2e-37920bc76542 for instance with task_state deleting. {{(pid=72586) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG nova.compute.manager [req-580ab63c-5b71-4ddc-acd4-80c1f55045b7 req-35384b72-6902-4430-999e-bd62677e6cca service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received event network-vif-plugged-65302d59-bf47-478e-be2e-37920bc76542 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-580ab63c-5b71-4ddc-acd4-80c1f55045b7 req-35384b72-6902-4430-999e-bd62677e6cca service nova] Acquiring lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-580ab63c-5b71-4ddc-acd4-80c1f55045b7 req-35384b72-6902-4430-999e-bd62677e6cca service nova] Lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-580ab63c-5b71-4ddc-acd4-80c1f55045b7 req-35384b72-6902-4430-999e-bd62677e6cca service nova] Lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG nova.compute.manager [req-580ab63c-5b71-4ddc-acd4-80c1f55045b7 req-35384b72-6902-4430-999e-bd62677e6cca service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] No waiting events found dispatching network-vif-plugged-65302d59-bf47-478e-be2e-37920bc76542 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:22:49 user nova-compute[72586]: WARNING nova.compute.manager [req-580ab63c-5b71-4ddc-acd4-80c1f55045b7 req-35384b72-6902-4430-999e-bd62677e6cca service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received unexpected event network-vif-plugged-65302d59-bf47-478e-be2e-37920bc76542 for instance with vm_state active and task_state deleting.
Aug 01 21:22:49 user nova-compute[72586]: DEBUG nova.compute.manager [req-580ab63c-5b71-4ddc-acd4-80c1f55045b7 req-35384b72-6902-4430-999e-bd62677e6cca service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received event network-vif-unplugged-d823d714-835e-418a-85f2-e99504cc3f94 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-580ab63c-5b71-4ddc-acd4-80c1f55045b7 req-35384b72-6902-4430-999e-bd62677e6cca service nova] Acquiring lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-580ab63c-5b71-4ddc-acd4-80c1f55045b7 req-35384b72-6902-4430-999e-bd62677e6cca service nova] Lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-580ab63c-5b71-4ddc-acd4-80c1f55045b7 req-35384b72-6902-4430-999e-bd62677e6cca service nova] Lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG nova.compute.manager [req-580ab63c-5b71-4ddc-acd4-80c1f55045b7 req-35384b72-6902-4430-999e-bd62677e6cca service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] No waiting events found dispatching network-vif-unplugged-d823d714-835e-418a-85f2-e99504cc3f94 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG nova.compute.manager [req-580ab63c-5b71-4ddc-acd4-80c1f55045b7 req-35384b72-6902-4430-999e-bd62677e6cca service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received event network-vif-unplugged-d823d714-835e-418a-85f2-e99504cc3f94 for instance with task_state deleting. {{(pid=72586) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG nova.compute.manager [req-580ab63c-5b71-4ddc-acd4-80c1f55045b7 req-35384b72-6902-4430-999e-bd62677e6cca service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received event network-vif-plugged-d823d714-835e-418a-85f2-e99504cc3f94 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-580ab63c-5b71-4ddc-acd4-80c1f55045b7 req-35384b72-6902-4430-999e-bd62677e6cca service nova] Acquiring lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-580ab63c-5b71-4ddc-acd4-80c1f55045b7 req-35384b72-6902-4430-999e-bd62677e6cca service nova] Lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-580ab63c-5b71-4ddc-acd4-80c1f55045b7 req-35384b72-6902-4430-999e-bd62677e6cca service nova] Lock "420cd648-f3bb-49b0-a731-d2e4337367f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG nova.compute.manager [req-580ab63c-5b71-4ddc-acd4-80c1f55045b7 req-35384b72-6902-4430-999e-bd62677e6cca service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] No waiting events found dispatching network-vif-plugged-d823d714-835e-418a-85f2-e99504cc3f94 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:22:49 user nova-compute[72586]: WARNING nova.compute.manager [req-580ab63c-5b71-4ddc-acd4-80c1f55045b7 req-35384b72-6902-4430-999e-bd62677e6cca service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received unexpected event network-vif-plugged-d823d714-835e-418a-85f2-e99504cc3f94 for instance with vm_state active and task_state deleting.
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[107ab39f-da04-4824-bdd9-3f5100c6ae30]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[907767fd-1cef-45f7-b4c8-a535827b5d3b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be (non-flash)
Aug 01 21:22:49 user nova-compute[72586]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)
Aug 01 21:22:49 user nova-compute[72586]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)
Aug 01 21:22:49 user nova-compute[72586]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)
Aug 01 21:22:49 user nova-compute[72586]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)
Aug 01 21:22:49 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be (non-flash)
Aug 01 21:22:49 user nova-compute[72586]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 (non-flash)
Aug 01 21:22:49 user nova-compute[72586]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)
Aug 01 21:22:49 user nova-compute[72586]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)
Aug 01 21:22:49 user nova-compute[72586]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)
Aug 01 21:22:49 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ee81c4c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13'): ({'sde'}, set())}) {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Removing single pathed devices sde {{(pid=72586) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b296115-f3a2-466a-8dea-e71b84d81734]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[6784da93-7986-4f10-b5a1-39a4e022a78b]: (4, ('ok\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Flushing IO for device /dev/sde {{(pid=72586) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2ba902-b881-4e95-927f-1000278bcf3e]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72586) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[72714765-a507-42bd-a005-916b0ea70170]: (4, ('1', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] SCSI volumes sde have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13')] {{(pid=72586) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.176s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3a92f2-09d6-48b4-8e1c-3cca86378326]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 -p 172.16.0.220:3260 --logout {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[673866d5-99c6-4b1a-a3ae-5abc7cefe269]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13, portal: 172.16.0.220,3260]
Aug 01 21:22:49 user nova-compute[72586]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13, portal: 172.16.0.220,3260] successful.
Aug 01 21:22:49 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 -p 172.16.0.220:3260 --op delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dca4146-b838-4652-af2d-aa2dcdd95e13 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b63f9f1-2452-4525-a3f0-b49f0fd85845]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.482s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] <== disconnect_volume: return (484ms) None {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Disconnected iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] calling os-brick to detach iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, {'target_iqns': ['iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lXUgimYK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:22:49 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:22:49 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3', 0)] {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a636d4-13bf-4a49-a8ef-babd006a39fe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e6d675-e7eb-42c2-b3fb-dca19e9dec2e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be (non-flash)
Aug 01 21:22:49 user nova-compute[72586]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)
Aug 01 21:22:49 user nova-compute[72586]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)
Aug 01 21:22:49 user nova-compute[72586]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)
Aug 01 21:22:49 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be (non-flash)
Aug 01 21:22:49 user nova-compute[72586]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 (non-flash)
Aug 01 21:22:49 user nova-compute[72586]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)
Aug 01 21:22:49 user nova-compute[72586]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)
Aug 01 21:22:49 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ee81c41f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3'): ({'sdf'}, set())}) {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Removing single pathed devices sdf {{(pid=72586) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[73724917-ad20-46cb-91c2-9e1f47fff8f8]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[2005e702-aeec-44f7-ac30-5c7c8200ce77]: (4, ('ok\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Flushing IO for device /dev/sdf {{(pid=72586) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3781fd9-5913-4f68-961e-4d67d9da3a8b]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72586) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.044s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[896cba68-b3c1-4b08-966a-ae1155939b6c]: (4, ('1', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] SCSI volumes sdf have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3')] {{(pid=72586) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd26116f-fbe7-4fde-ada9-47cc7f6c7243]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 -p 172.16.0.220:3260 --logout {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82b51f7-cd17-4134-8f36-ec1a6100c063]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3, portal: 172.16.0.220,3260]
Aug 01 21:22:49 user nova-compute[72586]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3, portal: 172.16.0.220,3260] successful.
Aug 01 21:22:49 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 -p 172.16.0.220:3260 --op delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bf0c46e-827e-44eb-986e-53dec3bf35e3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55563ee-7564-43d9-93fd-443402c265b7]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] <== disconnect_volume: return (314ms) None {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Disconnected iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] calling os-brick to detach iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, {'target_iqns': ['iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mCzBfics', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:22:49 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:22:49 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e', 0)] {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4992e33-a82b-4127-8337-106beb9e46b9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[27dcceb6-1c7f-450a-92e5-658eadeb276a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be (non-flash)
Aug 01 21:22:49 user nova-compute[72586]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)
Aug 01 21:22:49 user nova-compute[72586]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)
Aug 01 21:22:49 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be (non-flash)
Aug 01 21:22:49 user nova-compute[72586]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e (non-flash)
Aug 01 21:22:49 user nova-compute[72586]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)
Aug 01 21:22:49 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:22:49 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ee81c41f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e'): ({'sdg'}, set())}) {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 21:22:50 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Removing single pathed devices sdg {{(pid=72586) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 21:22:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:50 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc157b4-4b5a-4ae2-a276-70f1f690b90a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:50 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffdb6973-42cc-4779-9bcf-de883d3eae2a]: (4, ('ok\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:50 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Flushing IO for device /dev/sdg {{(pid=72586) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 21:22:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:50 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c3a982e-1b94-47c5-acd9-9845483734ba]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:50 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72586) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 21:22:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.052s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:50 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d797cf2-85f7-4f16-b334-eaa8bb79c0fe]: (4, ('1', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:50 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 21:22:50 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] SCSI volumes sdg have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 21:22:50 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e')] {{(pid=72586) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 21:22:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:50 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c69963-3055-43f4-9479-34816c36c941]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:50 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e -p 172.16.0.220:3260 --logout {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:50 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47dfec2-a2e1-49e4-bf24-c93ae2a1fee7]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:50 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e, portal: 172.16.0.220,3260]
Aug 01 21:22:50 user nova-compute[72586]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e, portal: 172.16.0.220,3260] successful.
Aug 01 21:22:50 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e -p 172.16.0.220:3260 --op delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bed2346a-fc3e-4a91-b4cb-f3f1b1b7e27e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:50 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e97847a-3dcc-402b-88ad-31b41caead22]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:50 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:50 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:22:50 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] <== disconnect_volume: return (278ms) None {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:22:50 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Disconnected iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 21:22:50 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Deleting instance files /opt/stack/data/nova/instances/420cd648-f3bb-49b0-a731-d2e4337367f6_del
Aug 01 21:22:50 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Deletion of /opt/stack/data/nova/instances/420cd648-f3bb-49b0-a731-d2e4337367f6_del complete
Aug 01 21:22:50 user nova-compute[72586]: INFO nova.compute.manager [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Took 3.75 seconds to destroy the instance on the hypervisor.
Aug 01 21:22:50 user nova-compute[72586]: DEBUG oslo.service.loopingcall [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72586) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 21:22:50 user nova-compute[72586]: DEBUG nova.compute.manager [-] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Deallocating network for instance {{(pid=72586) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 21:22:50 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] deallocate_for_instance() {{(pid=72586) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 21:22:50 user nova-compute[72586]: INFO nova.compute.manager [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Took 2.96 seconds to detach 3 volumes for instance.
Aug 01 21:22:50 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:22:50 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:22:51 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:22:51 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:22:51 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.360s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:22:51 user nova-compute[72586]: INFO nova.scheduler.client.report [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Deleted allocations for instance 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e
Aug 01 21:22:51 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-08bbea76-f930-499f-9c1b-358f8f9714c5 tempest-TaggedBootDevicesTest-1489054380 tempest-TaggedBootDevicesTest-1489054380-project-member] Lock "4d8fb5ee-2b96-4824-bf5c-a5ebe507606e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.368s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:22:52 user nova-compute[72586]: DEBUG nova.compute.manager [req-f79ab2e5-4b1f-4d20-938e-6d855231d522 req-7937b04c-42e2-4683-9395-771854f7b1c2 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received event network-vif-deleted-65302d59-bf47-478e-be2e-37920bc76542 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:22:52 user nova-compute[72586]: INFO nova.compute.manager [req-f79ab2e5-4b1f-4d20-938e-6d855231d522 req-7937b04c-42e2-4683-9395-771854f7b1c2 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Neutron deleted interface 65302d59-bf47-478e-be2e-37920bc76542; detaching it from the instance and deleting it from the info cache
Aug 01 21:22:52 user nova-compute[72586]: DEBUG nova.network.neutron [req-f79ab2e5-4b1f-4d20-938e-6d855231d522 req-7937b04c-42e2-4683-9395-771854f7b1c2 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Updating instance_info_cache with network_info: [{"id": "cdf2815f-96ba-4cb9-a025-1436804117e7", "address": "fa:16:3e:ae:ba:f8", "network": {"id": "871f534e-89b7-4186-a803-3bc9953b3b9c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-910794372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdf2815f-96", "ovs_interfaceid": "cdf2815f-96ba-4cb9-a025-1436804117e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bdfc5e91-52c4-4071-8252-a7caa7b53d24", "address": "fa:16:3e:2e:72:04", "network": {"id": "f744beb1-7d5f-4163-a4c7-807309ebcfec", "bridge": "br-int", "label": "tempest-device-tagging-net1-329951819", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdfc5e91-52", "ovs_interfaceid": "bdfc5e91-52c4-4071-8252-a7caa7b53d24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5ba1ef1d-6876-4756-86b2-0425ba5dfb39", "address": "fa:16:3e:7c:c9:b7", "network": {"id": "f744beb1-7d5f-4163-a4c7-807309ebcfec", "bridge": "br-int", "label": "tempest-device-tagging-net1-329951819", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ba1ef1d-68", "ovs_interfaceid": "5ba1ef1d-6876-4756-86b2-0425ba5dfb39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d823d714-835e-418a-85f2-e99504cc3f94", "address": "fa:16:3e:17:cd:33", "network": {"id": "f744beb1-7d5f-4163-a4c7-807309ebcfec", "bridge": "br-int", "label": "tempest-device-tagging-net1-329951819", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd823d714-83", "ovs_interfaceid": "d823d714-835e-418a-85f2-e99504cc3f94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "abf0b845-110a-447f-b130-b1eeed139b29", "address": "fa:16:3e:43:2b:85", "network": {"id": "3ae43cbc-2d22-465e-ba01-b2422e24134b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1150402374", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabf0b845-11", "ovs_interfaceid": "abf0b845-110a-447f-b130-b1eeed139b29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3095c6ca-2bce-4216-9290-e1fc3fe17e03", "address": "fa:16:3e:78:4c:6e", "network": {"id": "3ae43cbc-2d22-465e-ba01-b2422e24134b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1150402374", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46642f001d8644259eea283abaff6383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3095c6ca-2b", "ovs_interfaceid": "3095c6ca-2bce-4216-9290-e1fc3fe17e03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:22:52 user nova-compute[72586]: DEBUG nova.compute.manager [req-f79ab2e5-4b1f-4d20-938e-6d855231d522 req-7937b04c-42e2-4683-9395-771854f7b1c2 service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Detach interface failed, port_id=65302d59-bf47-478e-be2e-37920bc76542, reason: Instance 420cd648-f3bb-49b0-a731-d2e4337367f6 could not be found. {{(pid=72586) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 21:22:53 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:54 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:54 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:22:54 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Took 4.02 seconds to deallocate network for instance.
Aug 01 21:22:54 user nova-compute[72586]: DEBUG nova.compute.manager [req-1ea9a393-08a8-4dfe-bae0-31bbcd7e7d8b req-1e56c476-3d3d-48a6-b5e8-9077182ddfec service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received event network-vif-deleted-3095c6ca-2bce-4216-9290-e1fc3fe17e03 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:22:54 user nova-compute[72586]: DEBUG nova.compute.manager [req-1ea9a393-08a8-4dfe-bae0-31bbcd7e7d8b req-1e56c476-3d3d-48a6-b5e8-9077182ddfec service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received event network-vif-deleted-d823d714-835e-418a-85f2-e99504cc3f94 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:22:54 user nova-compute[72586]: DEBUG nova.compute.manager [req-1ea9a393-08a8-4dfe-bae0-31bbcd7e7d8b req-1e56c476-3d3d-48a6-b5e8-9077182ddfec service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received event network-vif-deleted-cdf2815f-96ba-4cb9-a025-1436804117e7 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:22:54 user nova-compute[72586]: DEBUG nova.compute.manager [req-1ea9a393-08a8-4dfe-bae0-31bbcd7e7d8b req-1e56c476-3d3d-48a6-b5e8-9077182ddfec service nova] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Received event network-vif-deleted-abf0b845-110a-447f-b130-b1eeed139b29 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:22:55 user nova-compute[72586]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690924960.7332711, 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e => Stopped> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:22:55 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] VM Stopped (Lifecycle Event)
Aug 01 21:22:55 user nova-compute[72586]: DEBUG nova.compute.manager [None req-7e556fad-07c2-4810-9f2d-5f17874c2b42 None None] [instance: 4d8fb5ee-2b96-4824-bf5c-a5ebe507606e] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:22:56 user nova-compute[72586]: INFO nova.compute.manager [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Took 2.32 seconds to detach 3 volumes for instance.
Aug 01 21:22:56 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:22:56 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:22:56 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:22:56 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:22:57 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.314s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:22:57 user nova-compute[72586]: INFO nova.scheduler.client.report [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Deleted allocations for instance 420cd648-f3bb-49b0-a731-d2e4337367f6
Aug 01 21:22:57 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b5b0f761-c4ff-4821-835c-48418f3315f1 tempest-TaggedBootDevicesTest_v242-2021813946 tempest-TaggedBootDevicesTest_v242-2021813946-project-member] Lock "420cd648-f3bb-49b0-a731-d2e4337367f6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.604s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:22:57 user nova-compute[72586]: DEBUG nova.compute.manager [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QhPHJSjs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '25fb970a-0caf-41e8-8d58-259dbd9cf291', 'attached_at': '', 'detached_at': '', 'volume_id': 'e83d4aa1-7fe5-415e-96fc-4e413114e225', 'serial': 'e83d4aa1-7fe5-415e-96fc-4e413114e225'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VKNUcazg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': '7d8e7763-931d-4d10-a968-38b7b52437be'}, 'status': 'reserved', 'instance': '25fb970a-0caf-41e8-8d58-259dbd9cf291', 'attached_at': '', 'detached_at': '', 'volume_id': '7d8e7763-931d-4d10-a968-38b7b52437be', 'serial'} {{(pid=72586) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 01 21:22:57 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Calling os-brick to attach iSCSI Volume {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 21:22:57 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QhPHJSjs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:22:57 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:22:57 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:22:57 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:22:57 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:22:57 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:22:57 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:22:57 user nova-compute[72586]: INFO os_brick.initiator.connectors.iscsi [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 21:22:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 -p 172.16.0.220:3260 {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:57 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[c672f6b4-6678-435d-a7ea-a708899a6389]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:57 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 21:22:57 user nova-compute[72586]:  {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 -p 172.16.0.220:3260 --interface default --op new {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:57 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8965f2-e655-400c-bcae-7cd331383f1c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225] added\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:57 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225] added
Aug 01 21:22:57 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:57 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[921cec36-db60-4517-98bf-71b3df8104bf]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:57 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:57 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad69df1a-5b33-4907-a1fd-269b7e34d1b8]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:57 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QhPHJSjs {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QhPHJSjs" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:57 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b123532e-1a9d-4794-9085-ebb3d213238e]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:57 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QhPHJSjs'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:57 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[48fa0cf8-5e6b-4332-aa51-7b64ddd703f0]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:57 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:57 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f618707-31c8-4a1b-8f36-25c34b5558d2]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:57 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be (non-flash)
Aug 01 21:22:57 user nova-compute[72586]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)
Aug 01 21:22:57 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:22:57 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be (non-flash)
Aug 01 21:22:57 user nova-compute[72586]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)
Aug 01 21:22:57 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:22:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 -p 172.16.0.220:3260 --login {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:57 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac545b9c-4f2f-4e0e-afdf-166ac9d12dca]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:57 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225, portal: 172.16.0.220,3260]
Aug 01 21:22:57 user nova-compute[72586]: Login to [iface: default, target: iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225, portal: 172.16.0.220,3260] successful.
Aug 01 21:22:57 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:57 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8bf6deb-188b-4fa6-8c31-6e35ffe915cc]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:57 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:22:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:57 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad9721a-ce3d-4884-b69b-1519f76eb6e3]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:57 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be (non-flash)
Aug 01 21:22:57 user nova-compute[72586]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 (non-flash)
Aug 01 21:22:57 user nova-compute[72586]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)
Aug 01 21:22:57 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:22:57 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be (non-flash)
Aug 01 21:22:57 user nova-compute[72586]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 (non-flash)
Aug 01 21:22:57 user nova-compute[72586]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)
Aug 01 21:22:57 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:22:57 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:22:57 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] Connected to 172.16.0.220:3260 {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 21:22:57 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=72586) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 21:22:57 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=72586) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 21:22:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:22:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:22:57 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ae2758-116f-48f0-a066-bc1be5eca37d]: (4, ('- - 0', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:22:57 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: None {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:22:58 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:22:58 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QhPHJSjs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 21:22:58 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:22:58 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23132313864623961', 'path': '/dev/sdb'} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:22:58 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23132313864623961', 'path': '/dev/sdb'} {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 21:22:58 user nova-compute[72586]: DEBUG nova.objects.instance [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] Lazy-loading 'flavor' on Instance uuid 25fb970a-0caf-41e8-8d58-259dbd9cf291 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:22:58 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=72586) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 21:22:59 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:22:59 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:22:59 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72586) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 21:22:59 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72586) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 21:22:59 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72586) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 21:22:59 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:22:59 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] COPY block job progress, current cursor: 138412032 final cursor: 1073741824 {{(pid=72586) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 21:23:00 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] COPY block job progress, current cursor: 320864256 final cursor: 1073741824 {{(pid=72586) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 21:23:00 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] COPY block job progress, current cursor: 499122176 final cursor: 1073741824 {{(pid=72586) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 21:23:01 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] COPY block job progress, current cursor: 673185792 final cursor: 1073741824 {{(pid=72586) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 21:23:01 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] COPY block job progress, current cursor: 840957952 final cursor: 1073741824 {{(pid=72586) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 21:23:02 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] COPY block job progress, current cursor: 988807168 final cursor: 1073741824 {{(pid=72586) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 21:23:02 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72586) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 21:23:02 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] calling os-brick to detach iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 21:23:02 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, {'target_iqns': ['iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VKNUcazg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': '7d8e7763-931d-4d10-a968-38b7b52437be'}, None), 'kwargs': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:23:02 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:23:02 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:23:02 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:23:02 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be', 0)] {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 21:23:02 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:02 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:02 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c5e6f5-c208-4b81-8763-e729a34baa26]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:23:02 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:02 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:02 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[43546b72-7d1e-4281-aece-4cd2b21a4e10]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:23:02 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be (non-flash)
Aug 01 21:23:02 user nova-compute[72586]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 (non-flash)
Aug 01 21:23:02 user nova-compute[72586]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)
Aug 01 21:23:02 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:23:02 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be (non-flash)
Aug 01 21:23:02 user nova-compute[72586]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 (non-flash)
Aug 01 21:23:02 user nova-compute[72586]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)
Aug 01 21:23:02 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:23:02 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ed065d510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be'): ({'sdj'}, set())}) {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 21:23:02 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] Removing single pathed devices sdj {{(pid=72586) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 21:23:02 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:02 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:02 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b885a4a0-3be8-4be0-8f44-a174c598f76c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:23:02 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:02 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:02 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[834e59a5-c9a9-480e-9ace-910e2a97d23b]: (4, ('ok\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:23:02 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] Flushing IO for device /dev/sdj {{(pid=72586) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 21:23:02 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:02 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:02 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[05652dd9-0ca0-4132-ac27-156722c81369]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:23:02 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=72586) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 21:23:02 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:02 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.039s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:02 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ce08f2-6688-44da-b8da-7924261e33e6]: (4, ('1', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:23:02 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 21:23:02 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] SCSI volumes sdj have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 21:23:02 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be')] {{(pid=72586) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 21:23:02 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:02 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:02 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[53554b91-415a-4c74-9bc1-a448d38385e3]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:23:02 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:23:02 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be -p 172.16.0.220:3260 --logout {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:02 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:02 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db10fc7-3ba7-47b7-b4fe-862574a1630c]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:23:02 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be, portal: 172.16.0.220,3260]
Aug 01 21:23:02 user nova-compute[72586]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be, portal: 172.16.0.220,3260] successful.
Aug 01 21:23:02 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:23:02 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be -p 172.16.0.220:3260 --op delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:03 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d8e7763-931d-4d10-a968-38b7b52437be -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:03 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2765855-d3ab-44d3-b223-00a90c98569d]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:23:03 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:23:03 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:23:03 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] <== disconnect_volume: return (314ms) None {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:23:03 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Disconnected iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 21:23:03 user nova-compute[72586]: DEBUG nova.compute.manager [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QhPHJSjs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '25fb970a-0caf-41e8-8d58-259dbd9cf291', 'attached_at': '', 'detached_at': '', 'volume_id': 'e83d4aa1-7fe5-415e-96fc-4e413114e225', 'serial'} {{(pid=72586) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 01 21:23:03 user nova-compute[72586]: DEBUG nova.compute.manager [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] swap_volume: removing Cinder connection for volume 7d8e7763-931d-4d10-a968-38b7b52437be {{(pid=72586) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 01 21:23:03 user nova-compute[72586]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690924968.7435539, 420cd648-f3bb-49b0-a731-d2e4337367f6 => Stopped> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:23:03 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] VM Stopped (Lifecycle Event)
Aug 01 21:23:03 user nova-compute[72586]: DEBUG nova.compute.manager [None req-b3ef23fc-3eb9-464a-a39e-a6b600fec0de None None] [instance: 420cd648-f3bb-49b0-a731-d2e4337367f6] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:23:03 user nova-compute[72586]: DEBUG nova.compute.manager [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] swap_volume: Updating volume 7d8e7763-931d-4d10-a968-38b7b52437be BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "QhPHJSjs", "auth_password": "abFHgqM0v1JPRz", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "e83d4aa1-7fe5-415e-96fc-4e413114e225"}, "status": "reserved", "instance": "25fb970a-0caf-41e8-8d58-259dbd9cf291", "attached_at": "", "detached_at": "", "volume_id": "e83d4aa1-7fe5-415e-96fc-4e413114e225", "serial": "e83d4aa1-7fe5-415e-96fc-4e413114e225"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'e83d4aa1-7fe5-415e-96fc-4e413114e225', 'no_device': None, 'attachment_id': 'e6b4359e-d82c-4af5-bdcb-70833595cf44'} {{(pid=72586) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 01 21:23:03 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-e7b54aa3-4bc2-4f78-a45c-1dde59aa999c tempest-TestVolumeSwap-531086868 tempest-TestVolumeSwap-531086868-project-admin] Lock "25fb970a-0caf-41e8-8d58-259dbd9cf291" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 15.539s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:23:04 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:23:04 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Acquiring lock "8fe2afa2-730a-4c17-adb6-f6b875aba3b6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:23:04 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Lock "8fe2afa2-730a-4c17-adb6-f6b875aba3b6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:23:04 user nova-compute[72586]: DEBUG nova.compute.manager [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] Starting instance... {{(pid=72586) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 21:23:04 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:23:04 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:23:04 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72586) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 21:23:04 user nova-compute[72586]: INFO nova.compute.claims [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] Claim successful on node user
Aug 01 21:23:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-df85665b-a78b-4bf6-9e0b-28177fa2ce03 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Acquiring lock "25fb970a-0caf-41e8-8d58-259dbd9cf291" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-df85665b-a78b-4bf6-9e0b-28177fa2ce03 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Lock "25fb970a-0caf-41e8-8d58-259dbd9cf291" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:23:05 user nova-compute[72586]: INFO nova.compute.manager [None req-df85665b-a78b-4bf6-9e0b-28177fa2ce03 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Detaching volume e83d4aa1-7fe5-415e-96fc-4e413114e225
Aug 01 21:23:05 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.375s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG nova.compute.manager [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] Start building networks asynchronously for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 21:23:05 user nova-compute[72586]: INFO nova.virt.block_device [None req-df85665b-a78b-4bf6-9e0b-28177fa2ce03 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Attempting to driver detach volume e83d4aa1-7fe5-415e-96fc-4e413114e225 from mountpoint /dev/vdb
Aug 01 21:23:05 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-df85665b-a78b-4bf6-9e0b-28177fa2ce03 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Attempting to detach device vdb from instance 25fb970a-0caf-41e8-8d58-259dbd9cf291 from the persistent domain config. {{(pid=72586) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-df85665b-a78b-4bf6-9e0b-28177fa2ce03 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 21:23:05 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:23:05 user nova-compute[72586]:   <source dev="/dev/sdb"/>
Aug 01 21:23:05 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:23:05 user nova-compute[72586]:   <serial>e83d4aa1-7fe5-415e-96fc-4e413114e225</serial>
Aug 01 21:23:05 user nova-compute[72586]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 21:23:05 user nova-compute[72586]: </disk>
Aug 01 21:23:05 user nova-compute[72586]:  {{(pid=72586) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 21:23:05 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-df85665b-a78b-4bf6-9e0b-28177fa2ce03 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Successfully detached device vdb from instance 25fb970a-0caf-41e8-8d58-259dbd9cf291 from the persistent domain config.
Aug 01 21:23:05 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-df85665b-a78b-4bf6-9e0b-28177fa2ce03 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 25fb970a-0caf-41e8-8d58-259dbd9cf291 from the live domain config. {{(pid=72586) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-df85665b-a78b-4bf6-9e0b-28177fa2ce03 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 21:23:05 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:23:05 user nova-compute[72586]:   <source dev="/dev/sdb"/>
Aug 01 21:23:05 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:23:05 user nova-compute[72586]:   <serial>e83d4aa1-7fe5-415e-96fc-4e413114e225</serial>
Aug 01 21:23:05 user nova-compute[72586]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 21:23:05 user nova-compute[72586]: </disk>
Aug 01 21:23:05 user nova-compute[72586]:  {{(pid=72586) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG nova.compute.manager [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] Allocating IP information in the background. {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG nova.network.neutron [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] allocate_for_instance() {{(pid=72586) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 21:23:05 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 21:23:05 user nova-compute[72586]: DEBUG nova.compute.manager [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] Start building block device mappings for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG nova.policy [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '06a57074fd8148679aec2090afa47ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e128138ba483401895a8d8257d2a2600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72586) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG nova.compute.manager [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] Start spawning the instance on the hypervisor. {{(pid=72586) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] Creating instance directory {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 21:23:05 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] Creating image(s)
Aug 01 21:23:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Acquiring lock "/opt/stack/data/nova/instances/8fe2afa2-730a-4c17-adb6-f6b875aba3b6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Lock "/opt/stack/data/nova/instances/8fe2afa2-730a-4c17-adb6-f6b875aba3b6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Lock "/opt/stack/data/nova/instances/8fe2afa2-730a-4c17-adb6-f6b875aba3b6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.128s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Acquiring lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Received event <DeviceRemovedEvent: 1690924985.5550776, 25fb970a-0caf-41e8-8d58-259dbd9cf291 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72586) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-df85665b-a78b-4bf6-9e0b-28177fa2ce03 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 25fb970a-0caf-41e8-8d58-259dbd9cf291 {{(pid=72586) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 21:23:05 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-df85665b-a78b-4bf6-9e0b-28177fa2ce03 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Successfully detached device vdb from instance 25fb970a-0caf-41e8-8d58-259dbd9cf291 from the live domain config.
Aug 01 21:23:05 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df85665b-a78b-4bf6-9e0b-28177fa2ce03 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] calling os-brick to detach iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-df85665b-a78b-4bf6-9e0b-28177fa2ce03 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, {'target_iqns': ['iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QhPHJSjs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': 'e83d4aa1-7fe5-415e-96fc-4e413114e225'}, None), 'kwargs': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:23:05 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-df85665b-a78b-4bf6-9e0b-28177fa2ce03 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:23:05 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-df85665b-a78b-4bf6-9e0b-28177fa2ce03 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-df85665b-a78b-4bf6-9e0b-28177fa2ce03 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-df85665b-a78b-4bf6-9e0b-28177fa2ce03 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225', 0)] {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[946c366e-93c6-4c75-9dd2-cda9c1156631]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.132s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/8fe2afa2-730a-4c17-adb6-f6b875aba3b6/disk 1073741824 {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1be5dd-10e7-4bc1-adfe-749603d9192b]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-df85665b-a78b-4bf6-9e0b-28177fa2ce03 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 (non-flash)
Aug 01 21:23:05 user nova-compute[72586]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)
Aug 01 21:23:05 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-df85665b-a78b-4bf6-9e0b-28177fa2ce03 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 (non-flash)
Aug 01 21:23:05 user nova-compute[72586]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)
Aug 01 21:23:05 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-df85665b-a78b-4bf6-9e0b-28177fa2ce03 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ee823f7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225'): ({'sdb'}, set())}) {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-df85665b-a78b-4bf6-9e0b-28177fa2ce03 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Removing single pathed devices sdb {{(pid=72586) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/8fe2afa2-730a-4c17-adb6-f6b875aba3b6/disk 1073741824" returned: 0 in 0.060s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[319aac80-f952-4119-b131-73fb2b0a0b02]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed294fae-1e2b-483a-bbf0-2d393aa701a9]: (4, ('ok\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-df85665b-a78b-4bf6-9e0b-28177fa2ce03 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Flushing IO for device /dev/sdb {{(pid=72586) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb15f41-d542-4fd7-9f1f-3e3704a7cce7]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-df85665b-a78b-4bf6-9e0b-28177fa2ce03 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72586) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f86eb0f-a85b-4427-9f13-c1f15459fe0f]: (4, ('1', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-df85665b-a78b-4bf6-9e0b-28177fa2ce03 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-df85665b-a78b-4bf6-9e0b-28177fa2ce03 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] SCSI volumes sdb have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-df85665b-a78b-4bf6-9e0b-28177fa2ce03 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225')] {{(pid=72586) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.135s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8fe2afa2-730a-4c17-adb6-f6b875aba3b6/disk. size=1073741824 {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe2afa2-730a-4c17-adb6-f6b875aba3b6/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[24866510-d256-4334-afbe-53ef582381ab]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-df85665b-a78b-4bf6-9e0b-28177fa2ce03 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 -p 172.16.0.220:3260 --logout {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[016c5e88-f936-4cb5-823f-8979551284f1]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-df85665b-a78b-4bf6-9e0b-28177fa2ce03 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225, portal: 172.16.0.220,3260]
Aug 01 21:23:05 user nova-compute[72586]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225, portal: 172.16.0.220,3260] successful.
Aug 01 21:23:05 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 -p 172.16.0.220:3260 --op delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e83d4aa1-7fe5-415e-96fc-4e413114e225 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[09aa6e72-8455-4684-b369-d41850e90d3b]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-df85665b-a78b-4bf6-9e0b-28177fa2ce03 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-df85665b-a78b-4bf6-9e0b-28177fa2ce03 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.377s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-df85665b-a78b-4bf6-9e0b-28177fa2ce03 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] <== disconnect_volume: return (379ms) None {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df85665b-a78b-4bf6-9e0b-28177fa2ce03 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Disconnected iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG nova.network.neutron [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] Successfully created port: ef700174-bf23-4263-8272-084d9d62b2bf {{(pid=72586) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe2afa2-730a-4c17-adb6-f6b875aba3b6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Cannot resize image /opt/stack/data/nova/instances/8fe2afa2-730a-4c17-adb6-f6b875aba3b6/disk to a smaller size. {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 21:23:05 user nova-compute[72586]: DEBUG nova.objects.instance [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Lazy-loading 'migration_context' on Instance uuid 8fe2afa2-730a-4c17-adb6-f6b875aba3b6 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:23:06 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] Created local disks {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 21:23:06 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] Ensure instance console log exists: /opt/stack/data/nova/instances/8fe2afa2-730a-4c17-adb6-f6b875aba3b6/console.log {{(pid=72586) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 21:23:06 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:23:06 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:23:06 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:23:06 user nova-compute[72586]: DEBUG nova.objects.instance [None req-df85665b-a78b-4bf6-9e0b-28177fa2ce03 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Lazy-loading 'flavor' on Instance uuid 25fb970a-0caf-41e8-8d58-259dbd9cf291 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:23:06 user nova-compute[72586]: DEBUG nova.network.neutron [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] Successfully updated port: ef700174-bf23-4263-8272-084d9d62b2bf {{(pid=72586) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 21:23:06 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Acquiring lock "refresh_cache-8fe2afa2-730a-4c17-adb6-f6b875aba3b6" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:23:06 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Acquired lock "refresh_cache-8fe2afa2-730a-4c17-adb6-f6b875aba3b6" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:23:06 user nova-compute[72586]: DEBUG nova.network.neutron [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:23:06 user nova-compute[72586]: DEBUG nova.compute.manager [req-a5f08c62-cce4-44e5-9164-4033212ac104 req-45a771d5-6787-4e80-bb05-3a707c488656 service nova] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] Received event network-changed-ef700174-bf23-4263-8272-084d9d62b2bf {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:23:06 user nova-compute[72586]: DEBUG nova.compute.manager [req-a5f08c62-cce4-44e5-9164-4033212ac104 req-45a771d5-6787-4e80-bb05-3a707c488656 service nova] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] Refreshing instance network info cache due to event network-changed-ef700174-bf23-4263-8272-084d9d62b2bf. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:23:06 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-a5f08c62-cce4-44e5-9164-4033212ac104 req-45a771d5-6787-4e80-bb05-3a707c488656 service nova] Acquiring lock "refresh_cache-8fe2afa2-730a-4c17-adb6-f6b875aba3b6" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:23:06 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-df85665b-a78b-4bf6-9e0b-28177fa2ce03 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Lock "25fb970a-0caf-41e8-8d58-259dbd9cf291" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.709s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:23:06 user nova-compute[72586]: DEBUG nova.network.neutron [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] Instance cache missing network info. {{(pid=72586) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 21:23:07 user nova-compute[72586]: DEBUG nova.network.neutron [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] Updating instance_info_cache with network_info: [{"id": "ef700174-bf23-4263-8272-084d9d62b2bf", "address": "fa:16:3e:ff:13:2f", "network": {"id": "198d348c-3661-477f-9e09-f9592f57c588", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1890713425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e128138ba483401895a8d8257d2a2600", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef700174-bf", "ovs_interfaceid": "ef700174-bf23-4263-8272-084d9d62b2bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:23:07 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Releasing lock "refresh_cache-8fe2afa2-730a-4c17-adb6-f6b875aba3b6" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:23:07 user nova-compute[72586]: DEBUG nova.compute.manager [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] Instance network_info: |[{"id": "ef700174-bf23-4263-8272-084d9d62b2bf", "address": "fa:16:3e:ff:13:2f", "network": {"id": "198d348c-3661-477f-9e09-f9592f57c588", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1890713425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e128138ba483401895a8d8257d2a2600", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef700174-bf", "ovs_interfaceid": "ef700174-bf23-4263-8272-084d9d62b2bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 21:23:07 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-a5f08c62-cce4-44e5-9164-4033212ac104 req-45a771d5-6787-4e80-bb05-3a707c488656 service nova] Acquired lock "refresh_cache-8fe2afa2-730a-4c17-adb6-f6b875aba3b6" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:23:07 user nova-compute[72586]: DEBUG nova.network.neutron [req-a5f08c62-cce4-44e5-9164-4033212ac104 req-45a771d5-6787-4e80-bb05-3a707c488656 service nova] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] Refreshing network info cache for port ef700174-bf23-4263-8272-084d9d62b2bf {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:23:07 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] Start _get_guest_xml network_info=[{"id": "ef700174-bf23-4263-8272-084d9d62b2bf", "address": "fa:16:3e:ff:13:2f", "network": {"id": "198d348c-3661-477f-9e09-f9592f57c588", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1890713425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e128138ba483401895a8d8257d2a2600", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef700174-bf", "ovs_interfaceid": "ef700174-bf23-4263-8272-084d9d62b2bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '0243d46b-6819-42a5-926f-42b71f0c97ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:23:07 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:23:07 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:23:07 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:23:07 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:23:07 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:23:07 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:23:07 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:23:07 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:23:07 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:23:07 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:23:07 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:23:07 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:23:07 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:23:07 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:23:07 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:23:07 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:23:07 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:23:07 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:23:07 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:23:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1333011832',display_name='tempest-VolumesAdminNegativeTest-server-1333011832',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1333011832',id=13,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e128138ba483401895a8d8257d2a2600',ramdisk_id='',reservation_id='r-x85aak8n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1961775269',owner_user_name='tempest-VolumesAdminNegativeTest-1961775269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:23:05Z,user_data=None,user_id='06a57074fd8148679aec2090afa47ff5',uuid=8fe2afa2-730a-4c17-adb6-f6b875aba3b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef700174-bf23-4263-8272-084d9d62b2bf", "address": "fa:16:3e:ff:13:2f", "network": {"id": "198d348c-3661-477f-9e09-f9592f57c588", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1890713425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e128138ba483401895a8d8257d2a2600", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef700174-bf", "ovs_interfaceid": "ef700174-bf23-4263-8272-084d9d62b2bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:23:07 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Converting VIF {"id": "ef700174-bf23-4263-8272-084d9d62b2bf", "address": "fa:16:3e:ff:13:2f", "network": {"id": "198d348c-3661-477f-9e09-f9592f57c588", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1890713425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e128138ba483401895a8d8257d2a2600", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef700174-bf", "ovs_interfaceid": "ef700174-bf23-4263-8272-084d9d62b2bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:23:07 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:13:2f,bridge_name='br-int',has_traffic_filtering=True,id=ef700174-bf23-4263-8272-084d9d62b2bf,network=Network(198d348c-3661-477f-9e09-f9592f57c588),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef700174-bf') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:23:07 user nova-compute[72586]: DEBUG nova.objects.instance [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Lazy-loading 'pci_devices' on Instance uuid 8fe2afa2-730a-4c17-adb6-f6b875aba3b6 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:23:07 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:23:07 user nova-compute[72586]:   <uuid>8fe2afa2-730a-4c17-adb6-f6b875aba3b6</uuid>
Aug 01 21:23:07 user nova-compute[72586]:   <name>instance-0000000d</name>
Aug 01 21:23:07 user nova-compute[72586]:   <memory>524288</memory>
Aug 01 21:23:07 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:23:07 user nova-compute[72586]:   <metadata>
Aug 01 21:23:07 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:23:07 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:23:07 user nova-compute[72586]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1333011832</nova:name>
Aug 01 21:23:07 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:23:07</nova:creationTime>
Aug 01 21:23:07 user nova-compute[72586]:       <nova:flavor name="m1.tiny">
Aug 01 21:23:07 user nova-compute[72586]:         <nova:memory>512</nova:memory>
Aug 01 21:23:07 user nova-compute[72586]:         <nova:disk>1</nova:disk>
Aug 01 21:23:07 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:23:07 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:23:07 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:23:07 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:23:07 user nova-compute[72586]:       <nova:owner>
Aug 01 21:23:07 user nova-compute[72586]:         <nova:user uuid="06a57074fd8148679aec2090afa47ff5">tempest-VolumesAdminNegativeTest-1961775269-project-member</nova:user>
Aug 01 21:23:07 user nova-compute[72586]:         <nova:project uuid="e128138ba483401895a8d8257d2a2600">tempest-VolumesAdminNegativeTest-1961775269</nova:project>
Aug 01 21:23:07 user nova-compute[72586]:       </nova:owner>
Aug 01 21:23:07 user nova-compute[72586]:       <nova:root type="image" uuid="0243d46b-6819-42a5-926f-42b71f0c97ad"/>
Aug 01 21:23:07 user nova-compute[72586]:       <nova:ports>
Aug 01 21:23:07 user nova-compute[72586]:         <nova:port uuid="ef700174-bf23-4263-8272-084d9d62b2bf">
Aug 01 21:23:07 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 01 21:23:07 user nova-compute[72586]:         </nova:port>
Aug 01 21:23:07 user nova-compute[72586]:       </nova:ports>
Aug 01 21:23:07 user nova-compute[72586]:     </nova:instance>
Aug 01 21:23:07 user nova-compute[72586]:   </metadata>
Aug 01 21:23:07 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:23:07 user nova-compute[72586]:     <system>
Aug 01 21:23:07 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:23:07 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:23:07 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:23:07 user nova-compute[72586]:       <entry name="serial">8fe2afa2-730a-4c17-adb6-f6b875aba3b6</entry>
Aug 01 21:23:07 user nova-compute[72586]:       <entry name="uuid">8fe2afa2-730a-4c17-adb6-f6b875aba3b6</entry>
Aug 01 21:23:07 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:23:07 user nova-compute[72586]:     </system>
Aug 01 21:23:07 user nova-compute[72586]:   </sysinfo>
Aug 01 21:23:07 user nova-compute[72586]:   <os>
Aug 01 21:23:07 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:23:07 user nova-compute[72586]:     <boot dev="hd"/>
Aug 01 21:23:07 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:23:07 user nova-compute[72586]:   </os>
Aug 01 21:23:07 user nova-compute[72586]:   <features>
Aug 01 21:23:07 user nova-compute[72586]:     <acpi/>
Aug 01 21:23:07 user nova-compute[72586]:     <apic/>
Aug 01 21:23:07 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:23:07 user nova-compute[72586]:   </features>
Aug 01 21:23:07 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:23:07 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:23:07 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:23:07 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:23:07 user nova-compute[72586]:   </clock>
Aug 01 21:23:07 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:23:07 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:23:07 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:23:07 user nova-compute[72586]:   </cpu>
Aug 01 21:23:07 user nova-compute[72586]:   <devices>
Aug 01 21:23:07 user nova-compute[72586]:     <disk type="file" device="disk">
Aug 01 21:23:07 user nova-compute[72586]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 21:23:07 user nova-compute[72586]:       <source file="/opt/stack/data/nova/instances/8fe2afa2-730a-4c17-adb6-f6b875aba3b6/disk"/>
Aug 01 21:23:07 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:23:07 user nova-compute[72586]:     </disk>
Aug 01 21:23:07 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:23:07 user nova-compute[72586]:       <mac address="fa:16:3e:ff:13:2f"/>
Aug 01 21:23:07 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:23:07 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:23:07 user nova-compute[72586]:       <target dev="tapef700174-bf"/>
Aug 01 21:23:07 user nova-compute[72586]:     </interface>
Aug 01 21:23:07 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:23:07 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/8fe2afa2-730a-4c17-adb6-f6b875aba3b6/console.log" append="off"/>
Aug 01 21:23:07 user nova-compute[72586]:     </serial>
Aug 01 21:23:07 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:23:07 user nova-compute[72586]:     <video>
Aug 01 21:23:07 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:23:07 user nova-compute[72586]:     </video>
Aug 01 21:23:07 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:23:07 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:23:07 user nova-compute[72586]:     </rng>
Aug 01 21:23:07 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:23:07 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:23:07 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:23:07 user nova-compute[72586]:     </memballoon>
Aug 01 21:23:07 user nova-compute[72586]:   </devices>
Aug 01 21:23:07 user nova-compute[72586]: </domain>
Aug 01 21:23:07 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:23:07 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:23:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1333011832',display_name='tempest-VolumesAdminNegativeTest-server-1333011832',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1333011832',id=13,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e128138ba483401895a8d8257d2a2600',ramdisk_id='',reservation_id='r-x85aak8n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1961775269',owner_user_name='tempest-VolumesAdminNegativeTest-1961775269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:23:05Z,user_data=None,user_id='06a57074fd8148679aec2090afa47ff5',uuid=8fe2afa2-730a-4c17-adb6-f6b875aba3b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef700174-bf23-4263-8272-084d9d62b2bf", "address": "fa:16:3e:ff:13:2f", "network": {"id": "198d348c-3661-477f-9e09-f9592f57c588", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1890713425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e128138ba483401895a8d8257d2a2600", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef700174-bf", "ovs_interfaceid": "ef700174-bf23-4263-8272-084d9d62b2bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:23:07 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Converting VIF {"id": "ef700174-bf23-4263-8272-084d9d62b2bf", "address": "fa:16:3e:ff:13:2f", "network": {"id": "198d348c-3661-477f-9e09-f9592f57c588", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1890713425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e128138ba483401895a8d8257d2a2600", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef700174-bf", "ovs_interfaceid": "ef700174-bf23-4263-8272-084d9d62b2bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:23:07 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:13:2f,bridge_name='br-int',has_traffic_filtering=True,id=ef700174-bf23-4263-8272-084d9d62b2bf,network=Network(198d348c-3661-477f-9e09-f9592f57c588),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef700174-bf') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:23:07 user nova-compute[72586]: DEBUG os_vif [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:13:2f,bridge_name='br-int',has_traffic_filtering=True,id=ef700174-bf23-4263-8272-084d9d62b2bf,network=Network(198d348c-3661-477f-9e09-f9592f57c588),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef700174-bf') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:23:07 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:07 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:23:07 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:23:07 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:07 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapef700174-bf, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:23:07 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapef700174-bf, col_values=(('external_ids', {'iface-id': 'ef700174-bf23-4263-8272-084d9d62b2bf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:13:2f', 'vm-uuid': '8fe2afa2-730a-4c17-adb6-f6b875aba3b6'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:23:07 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:07 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:23:07 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:07 user nova-compute[72586]: INFO os_vif [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:13:2f,bridge_name='br-int',has_traffic_filtering=True,id=ef700174-bf23-4263-8272-084d9d62b2bf,network=Network(198d348c-3661-477f-9e09-f9592f57c588),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef700174-bf')
Aug 01 21:23:07 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:23:07 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] No VIF found with MAC fa:16:3e:ff:13:2f, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:23:07 user nova-compute[72586]: DEBUG nova.network.neutron [req-a5f08c62-cce4-44e5-9164-4033212ac104 req-45a771d5-6787-4e80-bb05-3a707c488656 service nova] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] Updated VIF entry in instance network info cache for port ef700174-bf23-4263-8272-084d9d62b2bf. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:23:07 user nova-compute[72586]: DEBUG nova.network.neutron [req-a5f08c62-cce4-44e5-9164-4033212ac104 req-45a771d5-6787-4e80-bb05-3a707c488656 service nova] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] Updating instance_info_cache with network_info: [{"id": "ef700174-bf23-4263-8272-084d9d62b2bf", "address": "fa:16:3e:ff:13:2f", "network": {"id": "198d348c-3661-477f-9e09-f9592f57c588", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1890713425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e128138ba483401895a8d8257d2a2600", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef700174-bf", "ovs_interfaceid": "ef700174-bf23-4263-8272-084d9d62b2bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:23:07 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-a5f08c62-cce4-44e5-9164-4033212ac104 req-45a771d5-6787-4e80-bb05-3a707c488656 service nova] Releasing lock "refresh_cache-8fe2afa2-730a-4c17-adb6-f6b875aba3b6" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:23:08 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:08 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:08 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:08 user nova-compute[72586]: DEBUG nova.compute.manager [req-09cfae4c-0d8f-4b9d-945f-87cb7dae8bc1 req-4eac346d-0128-4591-9e71-3847a7f295a1 service nova] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] Received event network-vif-plugged-ef700174-bf23-4263-8272-084d9d62b2bf {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:23:08 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-09cfae4c-0d8f-4b9d-945f-87cb7dae8bc1 req-4eac346d-0128-4591-9e71-3847a7f295a1 service nova] Acquiring lock "8fe2afa2-730a-4c17-adb6-f6b875aba3b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:23:08 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-09cfae4c-0d8f-4b9d-945f-87cb7dae8bc1 req-4eac346d-0128-4591-9e71-3847a7f295a1 service nova] Lock "8fe2afa2-730a-4c17-adb6-f6b875aba3b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:23:08 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-09cfae4c-0d8f-4b9d-945f-87cb7dae8bc1 req-4eac346d-0128-4591-9e71-3847a7f295a1 service nova] Lock "8fe2afa2-730a-4c17-adb6-f6b875aba3b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:23:08 user nova-compute[72586]: DEBUG nova.compute.manager [req-09cfae4c-0d8f-4b9d-945f-87cb7dae8bc1 req-4eac346d-0128-4591-9e71-3847a7f295a1 service nova] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] No waiting events found dispatching network-vif-plugged-ef700174-bf23-4263-8272-084d9d62b2bf {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:23:08 user nova-compute[72586]: WARNING nova.compute.manager [req-09cfae4c-0d8f-4b9d-945f-87cb7dae8bc1 req-4eac346d-0128-4591-9e71-3847a7f295a1 service nova] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] Received unexpected event network-vif-plugged-ef700174-bf23-4263-8272-084d9d62b2bf for instance with vm_state building and task_state spawning.
Aug 01 21:23:08 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:10 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690924990.769136, 8fe2afa2-730a-4c17-adb6-f6b875aba3b6 => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:23:10 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] VM Resumed (Lifecycle Event)
Aug 01 21:23:10 user nova-compute[72586]: DEBUG nova.compute.manager [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] Instance event wait completed in 0 seconds for  {{(pid=72586) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 21:23:10 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] Guest created on hypervisor {{(pid=72586) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 21:23:10 user nova-compute[72586]: DEBUG nova.compute.manager [req-bd4a4597-ad2c-465b-9b38-08f444f41f2c req-517ba53f-fa19-4b7e-b422-dca17863a4dc service nova] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] Received event network-vif-plugged-ef700174-bf23-4263-8272-084d9d62b2bf {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:23:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-bd4a4597-ad2c-465b-9b38-08f444f41f2c req-517ba53f-fa19-4b7e-b422-dca17863a4dc service nova] Acquiring lock "8fe2afa2-730a-4c17-adb6-f6b875aba3b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:23:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-bd4a4597-ad2c-465b-9b38-08f444f41f2c req-517ba53f-fa19-4b7e-b422-dca17863a4dc service nova] Lock "8fe2afa2-730a-4c17-adb6-f6b875aba3b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:23:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-bd4a4597-ad2c-465b-9b38-08f444f41f2c req-517ba53f-fa19-4b7e-b422-dca17863a4dc service nova] Lock "8fe2afa2-730a-4c17-adb6-f6b875aba3b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:23:10 user nova-compute[72586]: DEBUG nova.compute.manager [req-bd4a4597-ad2c-465b-9b38-08f444f41f2c req-517ba53f-fa19-4b7e-b422-dca17863a4dc service nova] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] No waiting events found dispatching network-vif-plugged-ef700174-bf23-4263-8272-084d9d62b2bf {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:23:10 user nova-compute[72586]: WARNING nova.compute.manager [req-bd4a4597-ad2c-465b-9b38-08f444f41f2c req-517ba53f-fa19-4b7e-b422-dca17863a4dc service nova] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] Received unexpected event network-vif-plugged-ef700174-bf23-4263-8272-084d9d62b2bf for instance with vm_state building and task_state spawning.
Aug 01 21:23:10 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] Instance spawned successfully.
Aug 01 21:23:10 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 21:23:10 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:23:10 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:23:10 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] Found default for hw_cdrom_bus of ide {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:23:10 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] Found default for hw_disk_bus of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:23:10 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] Found default for hw_input_bus of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:23:10 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] Found default for hw_pointer_model of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:23:10 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] Found default for hw_video_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:23:10 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] Found default for hw_vif_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:23:10 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:23:10 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690924990.7706082, 8fe2afa2-730a-4c17-adb6-f6b875aba3b6 => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:23:10 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] VM Started (Lifecycle Event)
Aug 01 21:23:10 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:23:10 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:23:10 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:23:10 user nova-compute[72586]: INFO nova.compute.manager [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] Took 5.55 seconds to spawn the instance on the hypervisor.
Aug 01 21:23:10 user nova-compute[72586]: DEBUG nova.compute.manager [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:23:11 user nova-compute[72586]: INFO nova.compute.manager [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] Took 6.26 seconds to build instance.
Aug 01 21:23:11 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9771f992-b7d5-4dda-9ae7-db346cf8514d tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Lock "8fe2afa2-730a-4c17-adb6-f6b875aba3b6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.361s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:23:11 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-7c076984-93a0-4444-9acb-0f20a71ed4e8 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Acquiring lock "34b640b7-1dec-4b31-b64b-f1dbee7f62f6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:23:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-7c076984-93a0-4444-9acb-0f20a71ed4e8 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Lock "34b640b7-1dec-4b31-b64b-f1dbee7f62f6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:23:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-7c076984-93a0-4444-9acb-0f20a71ed4e8 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Acquiring lock "34b640b7-1dec-4b31-b64b-f1dbee7f62f6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:23:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-7c076984-93a0-4444-9acb-0f20a71ed4e8 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Lock "34b640b7-1dec-4b31-b64b-f1dbee7f62f6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:23:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-7c076984-93a0-4444-9acb-0f20a71ed4e8 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Lock "34b640b7-1dec-4b31-b64b-f1dbee7f62f6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:23:12 user nova-compute[72586]: INFO nova.compute.manager [None req-7c076984-93a0-4444-9acb-0f20a71ed4e8 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Terminating instance
Aug 01 21:23:12 user nova-compute[72586]: DEBUG nova.compute.manager [None req-7c076984-93a0-4444-9acb-0f20a71ed4e8 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Start destroying the instance on the hypervisor. {{(pid=72586) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 21:23:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:12 user nova-compute[72586]: DEBUG nova.compute.manager [req-2c7b1eca-898f-4762-8916-bdd0132e132d req-bf15fa5d-1966-441e-bb79-496decf2e467 service nova] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Received event network-vif-unplugged-1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:23:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-2c7b1eca-898f-4762-8916-bdd0132e132d req-bf15fa5d-1966-441e-bb79-496decf2e467 service nova] Acquiring lock "34b640b7-1dec-4b31-b64b-f1dbee7f62f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:23:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-2c7b1eca-898f-4762-8916-bdd0132e132d req-bf15fa5d-1966-441e-bb79-496decf2e467 service nova] Lock "34b640b7-1dec-4b31-b64b-f1dbee7f62f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:23:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-2c7b1eca-898f-4762-8916-bdd0132e132d req-bf15fa5d-1966-441e-bb79-496decf2e467 service nova] Lock "34b640b7-1dec-4b31-b64b-f1dbee7f62f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:23:12 user nova-compute[72586]: DEBUG nova.compute.manager [req-2c7b1eca-898f-4762-8916-bdd0132e132d req-bf15fa5d-1966-441e-bb79-496decf2e467 service nova] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] No waiting events found dispatching network-vif-unplugged-1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:23:12 user nova-compute[72586]: DEBUG nova.compute.manager [req-2c7b1eca-898f-4762-8916-bdd0132e132d req-bf15fa5d-1966-441e-bb79-496decf2e467 service nova] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Received event network-vif-unplugged-1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a for instance with task_state deleting. {{(pid=72586) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 21:23:13 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Instance destroyed successfully.
Aug 01 21:23:13 user nova-compute[72586]: DEBUG nova.objects.instance [None req-7c076984-93a0-4444-9acb-0f20a71ed4e8 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Lazy-loading 'resources' on Instance uuid 34b640b7-1dec-4b31-b64b-f1dbee7f62f6 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:23:13 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-7c076984-93a0-4444-9acb-0f20a71ed4e8 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T21:20:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1746161852',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1746161852',id=8,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPKzYl7JBQVoZJNm+4i5JYdGUIIrqn01ZBx9Dxn59EM/3bkIAv2U6qz+jMD9EtD+pH0t0lwSsBe6DmGDRqmtPx9+g58b8uj/ol6c7hfvBYUh2jxk2AjOzIXFtbR5OZW2WA==',key_name='tempest-keypair-1235433569',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:20:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fbe1daeb21ad4628841cbf8406131a88',ramdisk_id='',reservation_id='r-5lrvjzh8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2000096306',owner_user_name='tempest-TaggedAttachmentsTest-2000096306-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:20:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25edfd4907cf4d6c816799babd01e662',uuid=34b640b7-1dec-4b31-b64b-f1dbee7f62f6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a", "address": "fa:16:3e:1b:58:f6", "network": {"id": "869076ac-07a1-49eb-9912-83f396d5b66d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2019500958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbe1daeb21ad4628841cbf8406131a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c85a8b5-9e", "ovs_interfaceid": "1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:23:13 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-7c076984-93a0-4444-9acb-0f20a71ed4e8 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Converting VIF {"id": "1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a", "address": "fa:16:3e:1b:58:f6", "network": {"id": "869076ac-07a1-49eb-9912-83f396d5b66d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2019500958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbe1daeb21ad4628841cbf8406131a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c85a8b5-9e", "ovs_interfaceid": "1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:23:13 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-7c076984-93a0-4444-9acb-0f20a71ed4e8 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:58:f6,bridge_name='br-int',has_traffic_filtering=True,id=1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a,network=Network(869076ac-07a1-49eb-9912-83f396d5b66d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c85a8b5-9e') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:23:13 user nova-compute[72586]: DEBUG os_vif [None req-7c076984-93a0-4444-9acb-0f20a71ed4e8 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:58:f6,bridge_name='br-int',has_traffic_filtering=True,id=1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a,network=Network(869076ac-07a1-49eb-9912-83f396d5b66d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c85a8b5-9e') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:23:13 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:13 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1c85a8b5-9e, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:23:13 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:13 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:23:13 user nova-compute[72586]: INFO os_vif [None req-7c076984-93a0-4444-9acb-0f20a71ed4e8 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:58:f6,bridge_name='br-int',has_traffic_filtering=True,id=1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a,network=Network(869076ac-07a1-49eb-9912-83f396d5b66d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c85a8b5-9e')
Aug 01 21:23:13 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-7c076984-93a0-4444-9acb-0f20a71ed4e8 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Deleting instance files /opt/stack/data/nova/instances/34b640b7-1dec-4b31-b64b-f1dbee7f62f6_del
Aug 01 21:23:13 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-7c076984-93a0-4444-9acb-0f20a71ed4e8 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Deletion of /opt/stack/data/nova/instances/34b640b7-1dec-4b31-b64b-f1dbee7f62f6_del complete
Aug 01 21:23:13 user nova-compute[72586]: INFO nova.compute.manager [None req-7c076984-93a0-4444-9acb-0f20a71ed4e8 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 01 21:23:13 user nova-compute[72586]: DEBUG oslo.service.loopingcall [None req-7c076984-93a0-4444-9acb-0f20a71ed4e8 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72586) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 21:23:13 user nova-compute[72586]: DEBUG nova.compute.manager [-] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Deallocating network for instance {{(pid=72586) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 21:23:13 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] deallocate_for_instance() {{(pid=72586) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 21:23:14 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:14 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:23:14 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Took 1.09 seconds to deallocate network for instance.
Aug 01 21:23:14 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-7c076984-93a0-4444-9acb-0f20a71ed4e8 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:23:14 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-7c076984-93a0-4444-9acb-0f20a71ed4e8 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:23:14 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-7c076984-93a0-4444-9acb-0f20a71ed4e8 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:23:14 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-7c076984-93a0-4444-9acb-0f20a71ed4e8 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:23:15 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-7c076984-93a0-4444-9acb-0f20a71ed4e8 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.298s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:23:15 user nova-compute[72586]: DEBUG nova.compute.manager [req-62ffc506-5af1-46ad-9998-7973f840ce1d req-7e8d69c3-c10a-4031-a04e-957faf97c526 service nova] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Received event network-vif-plugged-1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:23:15 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-62ffc506-5af1-46ad-9998-7973f840ce1d req-7e8d69c3-c10a-4031-a04e-957faf97c526 service nova] Acquiring lock "34b640b7-1dec-4b31-b64b-f1dbee7f62f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:23:15 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-62ffc506-5af1-46ad-9998-7973f840ce1d req-7e8d69c3-c10a-4031-a04e-957faf97c526 service nova] Lock "34b640b7-1dec-4b31-b64b-f1dbee7f62f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:23:15 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-62ffc506-5af1-46ad-9998-7973f840ce1d req-7e8d69c3-c10a-4031-a04e-957faf97c526 service nova] Lock "34b640b7-1dec-4b31-b64b-f1dbee7f62f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:23:15 user nova-compute[72586]: DEBUG nova.compute.manager [req-62ffc506-5af1-46ad-9998-7973f840ce1d req-7e8d69c3-c10a-4031-a04e-957faf97c526 service nova] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] No waiting events found dispatching network-vif-plugged-1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:23:15 user nova-compute[72586]: WARNING nova.compute.manager [req-62ffc506-5af1-46ad-9998-7973f840ce1d req-7e8d69c3-c10a-4031-a04e-957faf97c526 service nova] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Received unexpected event network-vif-plugged-1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a for instance with vm_state deleted and task_state None.
Aug 01 21:23:15 user nova-compute[72586]: DEBUG nova.compute.manager [req-62ffc506-5af1-46ad-9998-7973f840ce1d req-7e8d69c3-c10a-4031-a04e-957faf97c526 service nova] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Received event network-vif-deleted-1c85a8b5-9e5e-4d14-8fe0-ee28fbafe73a {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:23:15 user nova-compute[72586]: INFO nova.scheduler.client.report [None req-7c076984-93a0-4444-9acb-0f20a71ed4e8 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Deleted allocations for instance 34b640b7-1dec-4b31-b64b-f1dbee7f62f6
Aug 01 21:23:15 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:15 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-7c076984-93a0-4444-9acb-0f20a71ed4e8 tempest-TaggedAttachmentsTest-2000096306 tempest-TaggedAttachmentsTest-2000096306-project-member] Lock "34b640b7-1dec-4b31-b64b-f1dbee7f62f6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.564s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:23:17 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:23:17 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:23:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:20 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:23:20 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:23:20 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72586) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 21:23:21 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:21 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:23:21 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Starting heal instance info cache {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 21:23:21 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Skipping network cache update for instance because it has been migrated to another host. {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9886}}
Aug 01 21:23:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "refresh_cache-0fde640d-b731-405d-af91-fb4ef85fe90a" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:23:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquired lock "refresh_cache-0fde640d-b731-405d-af91-fb4ef85fe90a" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:23:22 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Forcefully refreshing network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 21:23:22 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Updating instance_info_cache with network_info: [{"id": "4a722ba3-a6e6-4e2f-963d-f4938bc14926", "address": "fa:16:3e:f7:58:6a", "network": {"id": "d8cf5f10-6a59-4aa2-b8e8-b53932d3734e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1728024316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc531307652485c99598d21cacc2f93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a722ba3-a6", "ovs_interfaceid": "4a722ba3-a6e6-4e2f-963d-f4938bc14926", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:23:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Releasing lock "refresh_cache-0fde640d-b731-405d-af91-fb4ef85fe90a" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:23:22 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Updated the network info_cache for instance {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 21:23:22 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:23:22 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:23:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:23:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:23:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:23:22 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Auditing locally available compute resources for user (node: user) {{(pid=72586) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 21:23:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe2afa2-730a-4c17-adb6-f6b875aba3b6/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Acquiring lock "29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:23:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Lock "29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:23:23 user nova-compute[72586]: DEBUG nova.compute.manager [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] Starting instance... {{(pid=72586) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 21:23:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe2afa2-730a-4c17-adb6-f6b875aba3b6/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe2afa2-730a-4c17-adb6-f6b875aba3b6/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:23:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:23:23 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72586) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 21:23:23 user nova-compute[72586]: INFO nova.compute.claims [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] Claim successful on node user
Aug 01 21:23:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe2afa2-730a-4c17-adb6-f6b875aba3b6/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:23:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3830c8b3-27b8-45f3-bbdb-8a081dfcadc4/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3830c8b3-27b8-45f3-bbdb-8a081dfcadc4/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3830c8b3-27b8-45f3-bbdb-8a081dfcadc4/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3830c8b3-27b8-45f3-bbdb-8a081dfcadc4/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25fb970a-0caf-41e8-8d58-259dbd9cf291/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:23 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:23:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25fb970a-0caf-41e8-8d58-259dbd9cf291/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25fb970a-0caf-41e8-8d58-259dbd9cf291/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:24 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:24 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:23:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.645s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:23:24 user nova-compute[72586]: DEBUG nova.compute.manager [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] Start building networks asynchronously for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 21:23:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25fb970a-0caf-41e8-8d58-259dbd9cf291/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:24 user nova-compute[72586]: DEBUG nova.compute.manager [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] Allocating IP information in the background. {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 21:23:24 user nova-compute[72586]: DEBUG nova.network.neutron [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] allocate_for_instance() {{(pid=72586) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 21:23:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fde640d-b731-405d-af91-fb4ef85fe90a/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:24 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 21:23:24 user nova-compute[72586]: DEBUG nova.compute.manager [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] Start building block device mappings for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 21:23:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fde640d-b731-405d-af91-fb4ef85fe90a/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fde640d-b731-405d-af91-fb4ef85fe90a/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:24 user nova-compute[72586]: DEBUG nova.compute.manager [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] Start spawning the instance on the hypervisor. {{(pid=72586) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 21:23:24 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] Creating instance directory {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 21:23:24 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] Creating image(s)
Aug 01 21:23:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Acquiring lock "/opt/stack/data/nova/instances/29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:23:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Lock "/opt/stack/data/nova/instances/29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:23:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Lock "/opt/stack/data/nova/instances/29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:23:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fde640d-b731-405d-af91-fb4ef85fe90a/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.rescue --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.145s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Acquiring lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:23:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:23:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.rescue --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.162s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a/disk 1073741824 {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:24 user nova-compute[72586]: DEBUG nova.policy [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b60f16a82439448e9c83bad255217265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889ddc1d6f0a4f14b6c0467841227785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72586) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 21:23:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a/disk 1073741824" returned: 0 in 0.059s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:23:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.144s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:24 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Checking if we can resize image /opt/stack/data/nova/instances/29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a/disk. size=1073741824 {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 21:23:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:25 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Cannot resize image /opt/stack/data/nova/instances/29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a/disk to a smaller size. {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 21:23:25 user nova-compute[72586]: DEBUG nova.objects.instance [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Lazy-loading 'migration_context' on Instance uuid 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:23:25 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] Created local disks {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 21:23:25 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] Ensure instance console log exists: /opt/stack/data/nova/instances/29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a/console.log {{(pid=72586) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 21:23:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:23:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:23:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:23:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:25 user nova-compute[72586]: DEBUG nova.network.neutron [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] Successfully created port: e94821de-3c0a-43a0-ba20-b7d22e0311a4 {{(pid=72586) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 21:23:25 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:23:25 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:23:25 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Hypervisor/Node resource view: name=user free_ram=7848MB free_disk=25.71129608154297GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72586) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 21:23:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:23:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:23:25 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 042f0031-1e4d-41d0-8bfa-36001675cfe3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:23:25 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 413c3426-18ad-4a5c-af04-e0e7fc90f050 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:23:25 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 0fde640d-b731-405d-af91-fb4ef85fe90a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:23:25 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:23:25 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 25fb970a-0caf-41e8-8d58-259dbd9cf291 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:23:25 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 644c949c-3ac3-46ec-a62f-b38224f0a85c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:23:25 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 8fe2afa2-730a-4c17-adb6-f6b875aba3b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:23:25 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:23:25 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 21:23:25 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 21:23:25 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:23:25 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:23:25 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Compute_service record updated for user:user {{(pid=72586) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 21:23:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.388s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:23:26 user nova-compute[72586]: DEBUG nova.network.neutron [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] Successfully updated port: e94821de-3c0a-43a0-ba20-b7d22e0311a4 {{(pid=72586) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 21:23:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Acquiring lock "49c24c77-f102-4aed-8314-b04aad5f6b3a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:23:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "49c24c77-f102-4aed-8314-b04aad5f6b3a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:23:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Acquiring lock "refresh_cache-29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:23:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Acquired lock "refresh_cache-29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:23:26 user nova-compute[72586]: DEBUG nova.network.neutron [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:23:26 user nova-compute[72586]: DEBUG nova.compute.manager [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Starting instance... {{(pid=72586) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 21:23:26 user nova-compute[72586]: DEBUG nova.compute.manager [req-36b690c2-767b-44a4-8283-034a9cd6e4a8 req-680f988d-fdb8-42f0-a366-87f20e301f74 service nova] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] Received event network-changed-e94821de-3c0a-43a0-ba20-b7d22e0311a4 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:23:26 user nova-compute[72586]: DEBUG nova.compute.manager [req-36b690c2-767b-44a4-8283-034a9cd6e4a8 req-680f988d-fdb8-42f0-a366-87f20e301f74 service nova] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] Refreshing instance network info cache due to event network-changed-e94821de-3c0a-43a0-ba20-b7d22e0311a4. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:23:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-36b690c2-767b-44a4-8283-034a9cd6e4a8 req-680f988d-fdb8-42f0-a366-87f20e301f74 service nova] Acquiring lock "refresh_cache-29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:23:26 user nova-compute[72586]: DEBUG nova.network.neutron [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] Instance cache missing network info. {{(pid=72586) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 21:23:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:23:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:23:26 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72586) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 21:23:26 user nova-compute[72586]: INFO nova.compute.claims [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Claim successful on node user
Aug 01 21:23:26 user nova-compute[72586]: DEBUG nova.network.neutron [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] Updating instance_info_cache with network_info: [{"id": "e94821de-3c0a-43a0-ba20-b7d22e0311a4", "address": "fa:16:3e:ef:19:b8", "network": {"id": "4efef1cc-73df-4525-b4fd-b7211e04068b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1d9dd3f41aa143a5832ea7aa47fa192a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape94821de-3c", "ovs_interfaceid": "e94821de-3c0a-43a0-ba20-b7d22e0311a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:23:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Releasing lock "refresh_cache-29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:23:26 user nova-compute[72586]: DEBUG nova.compute.manager [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] Instance network_info: |[{"id": "e94821de-3c0a-43a0-ba20-b7d22e0311a4", "address": "fa:16:3e:ef:19:b8", "network": {"id": "4efef1cc-73df-4525-b4fd-b7211e04068b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1d9dd3f41aa143a5832ea7aa47fa192a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape94821de-3c", "ovs_interfaceid": "e94821de-3c0a-43a0-ba20-b7d22e0311a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 21:23:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-36b690c2-767b-44a4-8283-034a9cd6e4a8 req-680f988d-fdb8-42f0-a366-87f20e301f74 service nova] Acquired lock "refresh_cache-29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:23:26 user nova-compute[72586]: DEBUG nova.network.neutron [req-36b690c2-767b-44a4-8283-034a9cd6e4a8 req-680f988d-fdb8-42f0-a366-87f20e301f74 service nova] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] Refreshing network info cache for port e94821de-3c0a-43a0-ba20-b7d22e0311a4 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:23:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] Start _get_guest_xml network_info=[{"id": "e94821de-3c0a-43a0-ba20-b7d22e0311a4", "address": "fa:16:3e:ef:19:b8", "network": {"id": "4efef1cc-73df-4525-b4fd-b7211e04068b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1d9dd3f41aa143a5832ea7aa47fa192a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape94821de-3c", "ovs_interfaceid": "e94821de-3c0a-43a0-ba20-b7d22e0311a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '0243d46b-6819-42a5-926f-42b71f0c97ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:23:26 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:23:26 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:23:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:23:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:23:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:23:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:23:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:23:26 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:23:26 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:23:26 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:23:26 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:23:26 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:23:26 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:23:26 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:23:26 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:23:26 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:23:26 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:23:26 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:23:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:23:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-64591421',display_name='tempest-VolumesNegativeTest-instance-64591421',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-64591421',id=14,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='889ddc1d6f0a4f14b6c0467841227785',ramdisk_id='',reservation_id='r-icwj2sub',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1478076533',owner_user_name='tempest-VolumesNegativeTest-1478076533-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:23:24Z,user_data=None,user_id='b60f16a82439448e9c83bad255217265',uuid=29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e94821de-3c0a-43a0-ba20-b7d22e0311a4", "address": "fa:16:3e:ef:19:b8", "network": {"id": "4efef1cc-73df-4525-b4fd-b7211e04068b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1d9dd3f41aa143a5832ea7aa47fa192a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape94821de-3c", "ovs_interfaceid": "e94821de-3c0a-43a0-ba20-b7d22e0311a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:23:26 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Converting VIF {"id": "e94821de-3c0a-43a0-ba20-b7d22e0311a4", "address": "fa:16:3e:ef:19:b8", "network": {"id": "4efef1cc-73df-4525-b4fd-b7211e04068b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1d9dd3f41aa143a5832ea7aa47fa192a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape94821de-3c", "ovs_interfaceid": "e94821de-3c0a-43a0-ba20-b7d22e0311a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:23:26 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:19:b8,bridge_name='br-int',has_traffic_filtering=True,id=e94821de-3c0a-43a0-ba20-b7d22e0311a4,network=Network(4efef1cc-73df-4525-b4fd-b7211e04068b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape94821de-3c') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:23:26 user nova-compute[72586]: DEBUG nova.objects.instance [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Lazy-loading 'pci_devices' on Instance uuid 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:23:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:23:26 user nova-compute[72586]:   <uuid>29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a</uuid>
Aug 01 21:23:26 user nova-compute[72586]:   <name>instance-0000000e</name>
Aug 01 21:23:26 user nova-compute[72586]:   <memory>524288</memory>
Aug 01 21:23:26 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:23:26 user nova-compute[72586]:   <metadata>
Aug 01 21:23:26 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:23:26 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:23:26 user nova-compute[72586]:       <nova:name>tempest-VolumesNegativeTest-instance-64591421</nova:name>
Aug 01 21:23:26 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:23:26</nova:creationTime>
Aug 01 21:23:26 user nova-compute[72586]:       <nova:flavor name="m1.tiny">
Aug 01 21:23:26 user nova-compute[72586]:         <nova:memory>512</nova:memory>
Aug 01 21:23:26 user nova-compute[72586]:         <nova:disk>1</nova:disk>
Aug 01 21:23:26 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:23:26 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:23:26 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:23:26 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:23:26 user nova-compute[72586]:       <nova:owner>
Aug 01 21:23:26 user nova-compute[72586]:         <nova:user uuid="b60f16a82439448e9c83bad255217265">tempest-VolumesNegativeTest-1478076533-project-member</nova:user>
Aug 01 21:23:26 user nova-compute[72586]:         <nova:project uuid="889ddc1d6f0a4f14b6c0467841227785">tempest-VolumesNegativeTest-1478076533</nova:project>
Aug 01 21:23:26 user nova-compute[72586]:       </nova:owner>
Aug 01 21:23:26 user nova-compute[72586]:       <nova:root type="image" uuid="0243d46b-6819-42a5-926f-42b71f0c97ad"/>
Aug 01 21:23:26 user nova-compute[72586]:       <nova:ports>
Aug 01 21:23:26 user nova-compute[72586]:         <nova:port uuid="e94821de-3c0a-43a0-ba20-b7d22e0311a4">
Aug 01 21:23:26 user nova-compute[72586]:           <nova:ip type="fixed" address="192.168.233.166" ipVersion="4"/>
Aug 01 21:23:26 user nova-compute[72586]:         </nova:port>
Aug 01 21:23:26 user nova-compute[72586]:       </nova:ports>
Aug 01 21:23:26 user nova-compute[72586]:     </nova:instance>
Aug 01 21:23:26 user nova-compute[72586]:   </metadata>
Aug 01 21:23:26 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:23:26 user nova-compute[72586]:     <system>
Aug 01 21:23:26 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:23:26 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:23:26 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:23:26 user nova-compute[72586]:       <entry name="serial">29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a</entry>
Aug 01 21:23:26 user nova-compute[72586]:       <entry name="uuid">29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a</entry>
Aug 01 21:23:26 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:23:26 user nova-compute[72586]:     </system>
Aug 01 21:23:26 user nova-compute[72586]:   </sysinfo>
Aug 01 21:23:26 user nova-compute[72586]:   <os>
Aug 01 21:23:26 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:23:26 user nova-compute[72586]:     <boot dev="hd"/>
Aug 01 21:23:26 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:23:26 user nova-compute[72586]:   </os>
Aug 01 21:23:26 user nova-compute[72586]:   <features>
Aug 01 21:23:26 user nova-compute[72586]:     <acpi/>
Aug 01 21:23:26 user nova-compute[72586]:     <apic/>
Aug 01 21:23:26 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:23:26 user nova-compute[72586]:   </features>
Aug 01 21:23:26 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:23:26 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:23:26 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:23:26 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:23:26 user nova-compute[72586]:   </clock>
Aug 01 21:23:26 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:23:26 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:23:26 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:23:26 user nova-compute[72586]:   </cpu>
Aug 01 21:23:26 user nova-compute[72586]:   <devices>
Aug 01 21:23:26 user nova-compute[72586]:     <disk type="file" device="disk">
Aug 01 21:23:26 user nova-compute[72586]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 21:23:26 user nova-compute[72586]:       <source file="/opt/stack/data/nova/instances/29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a/disk"/>
Aug 01 21:23:26 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:23:26 user nova-compute[72586]:     </disk>
Aug 01 21:23:26 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:23:26 user nova-compute[72586]:       <mac address="fa:16:3e:ef:19:b8"/>
Aug 01 21:23:26 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:23:26 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:23:26 user nova-compute[72586]:       <target dev="tape94821de-3c"/>
Aug 01 21:23:26 user nova-compute[72586]:     </interface>
Aug 01 21:23:26 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:23:26 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a/console.log" append="off"/>
Aug 01 21:23:26 user nova-compute[72586]:     </serial>
Aug 01 21:23:26 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:23:26 user nova-compute[72586]:     <video>
Aug 01 21:23:26 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:23:26 user nova-compute[72586]:     </video>
Aug 01 21:23:26 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:23:26 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:23:26 user nova-compute[72586]:     </rng>
Aug 01 21:23:26 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:23:26 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:23:26 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:23:26 user nova-compute[72586]:     </memballoon>
Aug 01 21:23:26 user nova-compute[72586]:   </devices>
Aug 01 21:23:26 user nova-compute[72586]: </domain>
Aug 01 21:23:26 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:23:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:23:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-64591421',display_name='tempest-VolumesNegativeTest-instance-64591421',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-64591421',id=14,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='889ddc1d6f0a4f14b6c0467841227785',ramdisk_id='',reservation_id='r-icwj2sub',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1478076533',owner_user_name='tempest-VolumesNegativeTest-1478076533-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:23:24Z,user_data=None,user_id='b60f16a82439448e9c83bad255217265',uuid=29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e94821de-3c0a-43a0-ba20-b7d22e0311a4", "address": "fa:16:3e:ef:19:b8", "network": {"id": "4efef1cc-73df-4525-b4fd-b7211e04068b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1d9dd3f41aa143a5832ea7aa47fa192a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape94821de-3c", "ovs_interfaceid": "e94821de-3c0a-43a0-ba20-b7d22e0311a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:23:26 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Converting VIF {"id": "e94821de-3c0a-43a0-ba20-b7d22e0311a4", "address": "fa:16:3e:ef:19:b8", "network": {"id": "4efef1cc-73df-4525-b4fd-b7211e04068b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1d9dd3f41aa143a5832ea7aa47fa192a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape94821de-3c", "ovs_interfaceid": "e94821de-3c0a-43a0-ba20-b7d22e0311a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:23:26 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:19:b8,bridge_name='br-int',has_traffic_filtering=True,id=e94821de-3c0a-43a0-ba20-b7d22e0311a4,network=Network(4efef1cc-73df-4525-b4fd-b7211e04068b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape94821de-3c') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:23:26 user nova-compute[72586]: DEBUG os_vif [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:19:b8,bridge_name='br-int',has_traffic_filtering=True,id=e94821de-3c0a-43a0-ba20-b7d22e0311a4,network=Network(4efef1cc-73df-4525-b4fd-b7211e04068b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape94821de-3c') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:23:26 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:26 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:23:26 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:23:26 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:26 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape94821de-3c, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:23:26 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape94821de-3c, col_values=(('external_ids', {'iface-id': 'e94821de-3c0a-43a0-ba20-b7d22e0311a4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:19:b8', 'vm-uuid': '29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:23:26 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:26 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:23:26 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:26 user nova-compute[72586]: INFO os_vif [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:19:b8,bridge_name='br-int',has_traffic_filtering=True,id=e94821de-3c0a-43a0-ba20-b7d22e0311a4,network=Network(4efef1cc-73df-4525-b4fd-b7211e04068b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape94821de-3c')
Aug 01 21:23:26 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:23:26 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:23:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:23:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] No VIF found with MAC fa:16:3e:ef:19:b8, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:23:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.432s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:23:26 user nova-compute[72586]: DEBUG nova.compute.manager [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Start building networks asynchronously for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 21:23:26 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:23:26 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:23:27 user nova-compute[72586]: DEBUG nova.compute.manager [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Allocating IP information in the background. {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 21:23:27 user nova-compute[72586]: DEBUG nova.network.neutron [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] allocate_for_instance() {{(pid=72586) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 21:23:27 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 21:23:27 user nova-compute[72586]: DEBUG nova.compute.manager [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Start building block device mappings for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 21:23:27 user nova-compute[72586]: DEBUG nova.policy [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '88d01b1101164c859b19d41e251447a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19af48ffce7e4703b6d978bc3563680e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72586) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 21:23:27 user nova-compute[72586]: DEBUG nova.compute.manager [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Start spawning the instance on the hypervisor. {{(pid=72586) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 21:23:27 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Creating instance directory {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 21:23:27 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Creating image(s)
Aug 01 21:23:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Acquiring lock "/opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:23:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "/opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:23:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "/opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:23:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:27 user nova-compute[72586]: DEBUG nova.network.neutron [req-36b690c2-767b-44a4-8283-034a9cd6e4a8 req-680f988d-fdb8-42f0-a366-87f20e301f74 service nova] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] Updated VIF entry in instance network info cache for port e94821de-3c0a-43a0-ba20-b7d22e0311a4. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:23:27 user nova-compute[72586]: DEBUG nova.network.neutron [req-36b690c2-767b-44a4-8283-034a9cd6e4a8 req-680f988d-fdb8-42f0-a366-87f20e301f74 service nova] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] Updating instance_info_cache with network_info: [{"id": "e94821de-3c0a-43a0-ba20-b7d22e0311a4", "address": "fa:16:3e:ef:19:b8", "network": {"id": "4efef1cc-73df-4525-b4fd-b7211e04068b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1d9dd3f41aa143a5832ea7aa47fa192a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape94821de-3c", "ovs_interfaceid": "e94821de-3c0a-43a0-ba20-b7d22e0311a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:23:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-36b690c2-767b-44a4-8283-034a9cd6e4a8 req-680f988d-fdb8-42f0-a366-87f20e301f74 service nova] Releasing lock "refresh_cache-29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:23:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.150s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Acquiring lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:23:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:23:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.142s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk 1073741824 {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk 1073741824" returned: 0 in 0.049s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.201s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:23:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.156s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:27 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Checking if we can resize image /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk. size=1073741824 {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 21:23:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:27 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Cannot resize image /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk to a smaller size. {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 21:23:27 user nova-compute[72586]: DEBUG nova.objects.instance [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lazy-loading 'migration_context' on Instance uuid 49c24c77-f102-4aed-8314-b04aad5f6b3a {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:23:27 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Created local disks {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 21:23:27 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Ensure instance console log exists: /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/console.log {{(pid=72586) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 21:23:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:23:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:23:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:23:27 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:23:27 user nova-compute[72586]: DEBUG nova.network.neutron [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Successfully created port: 99688c7a-3e71-49d8-9002-0075560858c9 {{(pid=72586) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 21:23:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Acquiring lock "eccf50b0-9acc-49b6-8044-601e47d18c38" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:23:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "eccf50b0-9acc-49b6-8044-601e47d18c38" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:23:28 user nova-compute[72586]: INFO nova.compute.manager [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Unshelving
Aug 01 21:23:28 user nova-compute[72586]: INFO nova.virt.block_device [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Booting with volume eb131549-cfa4-4f5f-bfd4-e34009dc6686 at /dev/vdc
Aug 01 21:23:28 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:28 user nova-compute[72586]: DEBUG os_brick.utils [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:23:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:28 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[450a001f-3748-44d6-ac52-892555ba3c06]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4bc202fb9cb\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:23:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:28 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:28 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:28 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cde31fb-294a-4832-a7c1-fcbb634ae9d0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:23:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:28 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7b0e64-0eb7-46d7-9255-40b18d1bf06a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:23:28 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc8953e-cb8b-4511-b6a8-044eed653042]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:23:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Running cmd (subprocess): nvme version {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] 'nvme version' failed. Not Retrying. {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:23:28 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.nvmeof [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] nvme not present on system {{(pid=72586) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 21:23:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:23:28 user nova-compute[72586]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 21:23:28 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a16d9c-fc09-42b7-8c0f-eafadb6b3208]: (4, '') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:23:28 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72586) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 21:23:28 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 21:23:28 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] LIGHTOS: no hostnqn found. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 21:23:28 user nova-compute[72586]: DEBUG os_brick.utils [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4bc202fb9cb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:23:28 user nova-compute[72586]: DEBUG nova.virt.block_device [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Updating existing volume attachment record: dc9f6587-f978-4d17-915a-ba31631480fa {{(pid=72586) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 21:23:28 user nova-compute[72586]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690924993.4085693, 34b640b7-1dec-4b31-b64b-f1dbee7f62f6 => Stopped> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:23:28 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] VM Stopped (Lifecycle Event)
Aug 01 21:23:28 user nova-compute[72586]: DEBUG nova.compute.manager [None req-a419759e-0571-4c0c-8441-20a1b5e80135 None None] [instance: 34b640b7-1dec-4b31-b64b-f1dbee7f62f6] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:23:28 user nova-compute[72586]: DEBUG nova.compute.manager [req-6dc0eb64-875d-409d-b176-94527fbc1f98 req-92c4867b-7531-4ad8-9af5-8312ca032930 service nova] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] Received event network-vif-plugged-e94821de-3c0a-43a0-ba20-b7d22e0311a4 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:23:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-6dc0eb64-875d-409d-b176-94527fbc1f98 req-92c4867b-7531-4ad8-9af5-8312ca032930 service nova] Acquiring lock "29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:23:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-6dc0eb64-875d-409d-b176-94527fbc1f98 req-92c4867b-7531-4ad8-9af5-8312ca032930 service nova] Lock "29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:23:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-6dc0eb64-875d-409d-b176-94527fbc1f98 req-92c4867b-7531-4ad8-9af5-8312ca032930 service nova] Lock "29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:23:28 user nova-compute[72586]: DEBUG nova.compute.manager [req-6dc0eb64-875d-409d-b176-94527fbc1f98 req-92c4867b-7531-4ad8-9af5-8312ca032930 service nova] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] No waiting events found dispatching network-vif-plugged-e94821de-3c0a-43a0-ba20-b7d22e0311a4 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:23:28 user nova-compute[72586]: WARNING nova.compute.manager [req-6dc0eb64-875d-409d-b176-94527fbc1f98 req-92c4867b-7531-4ad8-9af5-8312ca032930 service nova] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] Received unexpected event network-vif-plugged-e94821de-3c0a-43a0-ba20-b7d22e0311a4 for instance with vm_state building and task_state spawning.
Aug 01 21:23:28 user nova-compute[72586]: DEBUG nova.network.neutron [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Successfully updated port: 99688c7a-3e71-49d8-9002-0075560858c9 {{(pid=72586) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 21:23:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Acquiring lock "refresh_cache-49c24c77-f102-4aed-8314-b04aad5f6b3a" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:23:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Acquired lock "refresh_cache-49c24c77-f102-4aed-8314-b04aad5f6b3a" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:23:28 user nova-compute[72586]: DEBUG nova.network.neutron [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:23:28 user nova-compute[72586]: DEBUG nova.compute.manager [req-577554a5-d5d5-4ea2-abcd-8ea3bb55596d req-47f998c4-d46d-4d89-8be8-4f001eadbccf service nova] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Received event network-changed-99688c7a-3e71-49d8-9002-0075560858c9 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:23:28 user nova-compute[72586]: DEBUG nova.compute.manager [req-577554a5-d5d5-4ea2-abcd-8ea3bb55596d req-47f998c4-d46d-4d89-8be8-4f001eadbccf service nova] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Refreshing instance network info cache due to event network-changed-99688c7a-3e71-49d8-9002-0075560858c9. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:23:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-577554a5-d5d5-4ea2-abcd-8ea3bb55596d req-47f998c4-d46d-4d89-8be8-4f001eadbccf service nova] Acquiring lock "refresh_cache-49c24c77-f102-4aed-8314-b04aad5f6b3a" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:23:28 user nova-compute[72586]: DEBUG nova.network.neutron [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Instance cache missing network info. {{(pid=72586) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 21:23:28 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:28 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:29 user nova-compute[72586]: DEBUG nova.network.neutron [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Updating instance_info_cache with network_info: [{"id": "99688c7a-3e71-49d8-9002-0075560858c9", "address": "fa:16:3e:8a:03:a7", "network": {"id": "aab9a541-2149-4c65-b60e-80a1daca6632", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1355256264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19af48ffce7e4703b6d978bc3563680e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99688c7a-3e", "ovs_interfaceid": "99688c7a-3e71-49d8-9002-0075560858c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:23:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Releasing lock "refresh_cache-49c24c77-f102-4aed-8314-b04aad5f6b3a" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:23:29 user nova-compute[72586]: DEBUG nova.compute.manager [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Instance network_info: |[{"id": "99688c7a-3e71-49d8-9002-0075560858c9", "address": "fa:16:3e:8a:03:a7", "network": {"id": "aab9a541-2149-4c65-b60e-80a1daca6632", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1355256264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19af48ffce7e4703b6d978bc3563680e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99688c7a-3e", "ovs_interfaceid": "99688c7a-3e71-49d8-9002-0075560858c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 21:23:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-577554a5-d5d5-4ea2-abcd-8ea3bb55596d req-47f998c4-d46d-4d89-8be8-4f001eadbccf service nova] Acquired lock "refresh_cache-49c24c77-f102-4aed-8314-b04aad5f6b3a" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:23:29 user nova-compute[72586]: DEBUG nova.network.neutron [req-577554a5-d5d5-4ea2-abcd-8ea3bb55596d req-47f998c4-d46d-4d89-8be8-4f001eadbccf service nova] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Refreshing network info cache for port 99688c7a-3e71-49d8-9002-0075560858c9 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:23:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Start _get_guest_xml network_info=[{"id": "99688c7a-3e71-49d8-9002-0075560858c9", "address": "fa:16:3e:8a:03:a7", "network": {"id": "aab9a541-2149-4c65-b60e-80a1daca6632", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1355256264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19af48ffce7e4703b6d978bc3563680e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99688c7a-3e", "ovs_interfaceid": "99688c7a-3e71-49d8-9002-0075560858c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '0243d46b-6819-42a5-926f-42b71f0c97ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:23:29 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:23:29 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:23:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:23:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:23:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:23:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:23:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:23:29 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:23:29 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:23:29 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:23:29 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:23:29 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:23:29 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:23:29 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:23:29 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:23:29 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:23:29 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:23:29 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:23:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:23:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-117058961',display_name='tempest-ServerActionsTestOtherA-server-117058961',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-117058961',id=15,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPk4vuGAtPXP/Itqq7TbQ+6Sv+k5bpNQFeCgGdApIPBaVaeUmQBoiJZa5I5091aDIuYBB7Uba3sQDG1YP/kTFSXvqkIW2yu6s2YyWP+iKPKZLzdQkqmU2IfIy2EEsidssA==',key_name='tempest-keypair-400537691',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='19af48ffce7e4703b6d978bc3563680e',ramdisk_id='',reservation_id='r-xq54880a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-825165282',owner_user_name='tempest-ServerActionsTestOtherA-825165282-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:23:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88d01b1101164c859b19d41e251447a5',uuid=49c24c77-f102-4aed-8314-b04aad5f6b3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99688c7a-3e71-49d8-9002-0075560858c9", "address": "fa:16:3e:8a:03:a7", "network": {"id": "aab9a541-2149-4c65-b60e-80a1daca6632", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1355256264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19af48ffce7e4703b6d978bc3563680e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99688c7a-3e", "ovs_interfaceid": "99688c7a-3e71-49d8-9002-0075560858c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:23:29 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Converting VIF {"id": "99688c7a-3e71-49d8-9002-0075560858c9", "address": "fa:16:3e:8a:03:a7", "network": {"id": "aab9a541-2149-4c65-b60e-80a1daca6632", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1355256264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19af48ffce7e4703b6d978bc3563680e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99688c7a-3e", "ovs_interfaceid": "99688c7a-3e71-49d8-9002-0075560858c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:23:29 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:03:a7,bridge_name='br-int',has_traffic_filtering=True,id=99688c7a-3e71-49d8-9002-0075560858c9,network=Network(aab9a541-2149-4c65-b60e-80a1daca6632),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99688c7a-3e') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:23:29 user nova-compute[72586]: DEBUG nova.objects.instance [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lazy-loading 'pci_devices' on Instance uuid 49c24c77-f102-4aed-8314-b04aad5f6b3a {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:23:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:23:29 user nova-compute[72586]:   <uuid>49c24c77-f102-4aed-8314-b04aad5f6b3a</uuid>
Aug 01 21:23:29 user nova-compute[72586]:   <name>instance-0000000f</name>
Aug 01 21:23:29 user nova-compute[72586]:   <memory>524288</memory>
Aug 01 21:23:29 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:23:29 user nova-compute[72586]:   <metadata>
Aug 01 21:23:29 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:23:29 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:23:29 user nova-compute[72586]:       <nova:name>tempest-ServerActionsTestOtherA-server-117058961</nova:name>
Aug 01 21:23:29 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:23:29</nova:creationTime>
Aug 01 21:23:29 user nova-compute[72586]:       <nova:flavor name="m1.tiny">
Aug 01 21:23:29 user nova-compute[72586]:         <nova:memory>512</nova:memory>
Aug 01 21:23:29 user nova-compute[72586]:         <nova:disk>1</nova:disk>
Aug 01 21:23:29 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:23:29 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:23:29 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:23:29 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:23:29 user nova-compute[72586]:       <nova:owner>
Aug 01 21:23:29 user nova-compute[72586]:         <nova:user uuid="88d01b1101164c859b19d41e251447a5">tempest-ServerActionsTestOtherA-825165282-project-member</nova:user>
Aug 01 21:23:29 user nova-compute[72586]:         <nova:project uuid="19af48ffce7e4703b6d978bc3563680e">tempest-ServerActionsTestOtherA-825165282</nova:project>
Aug 01 21:23:29 user nova-compute[72586]:       </nova:owner>
Aug 01 21:23:29 user nova-compute[72586]:       <nova:root type="image" uuid="0243d46b-6819-42a5-926f-42b71f0c97ad"/>
Aug 01 21:23:29 user nova-compute[72586]:       <nova:ports>
Aug 01 21:23:29 user nova-compute[72586]:         <nova:port uuid="99688c7a-3e71-49d8-9002-0075560858c9">
Aug 01 21:23:29 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 01 21:23:29 user nova-compute[72586]:         </nova:port>
Aug 01 21:23:29 user nova-compute[72586]:       </nova:ports>
Aug 01 21:23:29 user nova-compute[72586]:     </nova:instance>
Aug 01 21:23:29 user nova-compute[72586]:   </metadata>
Aug 01 21:23:29 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:23:29 user nova-compute[72586]:     <system>
Aug 01 21:23:29 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:23:29 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:23:29 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:23:29 user nova-compute[72586]:       <entry name="serial">49c24c77-f102-4aed-8314-b04aad5f6b3a</entry>
Aug 01 21:23:29 user nova-compute[72586]:       <entry name="uuid">49c24c77-f102-4aed-8314-b04aad5f6b3a</entry>
Aug 01 21:23:29 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:23:29 user nova-compute[72586]:     </system>
Aug 01 21:23:29 user nova-compute[72586]:   </sysinfo>
Aug 01 21:23:29 user nova-compute[72586]:   <os>
Aug 01 21:23:29 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:23:29 user nova-compute[72586]:     <boot dev="hd"/>
Aug 01 21:23:29 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:23:29 user nova-compute[72586]:   </os>
Aug 01 21:23:29 user nova-compute[72586]:   <features>
Aug 01 21:23:29 user nova-compute[72586]:     <acpi/>
Aug 01 21:23:29 user nova-compute[72586]:     <apic/>
Aug 01 21:23:29 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:23:29 user nova-compute[72586]:   </features>
Aug 01 21:23:29 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:23:29 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:23:29 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:23:29 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:23:29 user nova-compute[72586]:   </clock>
Aug 01 21:23:29 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:23:29 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:23:29 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:23:29 user nova-compute[72586]:   </cpu>
Aug 01 21:23:29 user nova-compute[72586]:   <devices>
Aug 01 21:23:29 user nova-compute[72586]:     <disk type="file" device="disk">
Aug 01 21:23:29 user nova-compute[72586]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 21:23:29 user nova-compute[72586]:       <source file="/opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk"/>
Aug 01 21:23:29 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:23:29 user nova-compute[72586]:     </disk>
Aug 01 21:23:29 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:23:29 user nova-compute[72586]:       <mac address="fa:16:3e:8a:03:a7"/>
Aug 01 21:23:29 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:23:29 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:23:29 user nova-compute[72586]:       <target dev="tap99688c7a-3e"/>
Aug 01 21:23:29 user nova-compute[72586]:     </interface>
Aug 01 21:23:29 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:23:29 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/console.log" append="off"/>
Aug 01 21:23:29 user nova-compute[72586]:     </serial>
Aug 01 21:23:29 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:23:29 user nova-compute[72586]:     <video>
Aug 01 21:23:29 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:23:29 user nova-compute[72586]:     </video>
Aug 01 21:23:29 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:23:29 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:23:29 user nova-compute[72586]:     </rng>
Aug 01 21:23:29 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:23:29 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:23:29 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:23:29 user nova-compute[72586]:     </memballoon>
Aug 01 21:23:29 user nova-compute[72586]:   </devices>
Aug 01 21:23:29 user nova-compute[72586]: </domain>
Aug 01 21:23:29 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:23:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:23:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-117058961',display_name='tempest-ServerActionsTestOtherA-server-117058961',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-117058961',id=15,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPk4vuGAtPXP/Itqq7TbQ+6Sv+k5bpNQFeCgGdApIPBaVaeUmQBoiJZa5I5091aDIuYBB7Uba3sQDG1YP/kTFSXvqkIW2yu6s2YyWP+iKPKZLzdQkqmU2IfIy2EEsidssA==',key_name='tempest-keypair-400537691',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='19af48ffce7e4703b6d978bc3563680e',ramdisk_id='',reservation_id='r-xq54880a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-825165282',owner_user_name='tempest-ServerActionsTestOtherA-825165282-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:23:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88d01b1101164c859b19d41e251447a5',uuid=49c24c77-f102-4aed-8314-b04aad5f6b3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99688c7a-3e71-49d8-9002-0075560858c9", "address": "fa:16:3e:8a:03:a7", "network": {"id": "aab9a541-2149-4c65-b60e-80a1daca6632", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1355256264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19af48ffce7e4703b6d978bc3563680e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99688c7a-3e", "ovs_interfaceid": "99688c7a-3e71-49d8-9002-0075560858c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:23:29 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Converting VIF {"id": "99688c7a-3e71-49d8-9002-0075560858c9", "address": "fa:16:3e:8a:03:a7", "network": {"id": "aab9a541-2149-4c65-b60e-80a1daca6632", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1355256264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19af48ffce7e4703b6d978bc3563680e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99688c7a-3e", "ovs_interfaceid": "99688c7a-3e71-49d8-9002-0075560858c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:23:29 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:03:a7,bridge_name='br-int',has_traffic_filtering=True,id=99688c7a-3e71-49d8-9002-0075560858c9,network=Network(aab9a541-2149-4c65-b60e-80a1daca6632),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99688c7a-3e') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:23:29 user nova-compute[72586]: DEBUG os_vif [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:03:a7,bridge_name='br-int',has_traffic_filtering=True,id=99688c7a-3e71-49d8-9002-0075560858c9,network=Network(aab9a541-2149-4c65-b60e-80a1daca6632),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99688c7a-3e') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:23:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:23:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:23:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap99688c7a-3e, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:23:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap99688c7a-3e, col_values=(('external_ids', {'iface-id': '99688c7a-3e71-49d8-9002-0075560858c9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:03:a7', 'vm-uuid': '49c24c77-f102-4aed-8314-b04aad5f6b3a'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:23:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:23:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:29 user nova-compute[72586]: INFO os_vif [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:03:a7,bridge_name='br-int',has_traffic_filtering=True,id=99688c7a-3e71-49d8-9002-0075560858c9,network=Network(aab9a541-2149-4c65-b60e-80a1daca6632),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99688c7a-3e')
Aug 01 21:23:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:23:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] No VIF found with MAC fa:16:3e:8a:03:a7, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:23:29 user nova-compute[72586]: DEBUG nova.network.neutron [req-577554a5-d5d5-4ea2-abcd-8ea3bb55596d req-47f998c4-d46d-4d89-8be8-4f001eadbccf service nova] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Updated VIF entry in instance network info cache for port 99688c7a-3e71-49d8-9002-0075560858c9. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:23:29 user nova-compute[72586]: DEBUG nova.network.neutron [req-577554a5-d5d5-4ea2-abcd-8ea3bb55596d req-47f998c4-d46d-4d89-8be8-4f001eadbccf service nova] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Updating instance_info_cache with network_info: [{"id": "99688c7a-3e71-49d8-9002-0075560858c9", "address": "fa:16:3e:8a:03:a7", "network": {"id": "aab9a541-2149-4c65-b60e-80a1daca6632", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1355256264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19af48ffce7e4703b6d978bc3563680e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99688c7a-3e", "ovs_interfaceid": "99688c7a-3e71-49d8-9002-0075560858c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:23:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-577554a5-d5d5-4ea2-abcd-8ea3bb55596d req-47f998c4-d46d-4d89-8be8-4f001eadbccf service nova] Releasing lock "refresh_cache-49c24c77-f102-4aed-8314-b04aad5f6b3a" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:23:30 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925010.412784, 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:23:30 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] VM Resumed (Lifecycle Event)
Aug 01 21:23:30 user nova-compute[72586]: DEBUG nova.compute.manager [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] Instance event wait completed in 0 seconds for  {{(pid=72586) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 21:23:30 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] Guest created on hypervisor {{(pid=72586) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 21:23:30 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] Instance spawned successfully.
Aug 01 21:23:30 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 21:23:30 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:23:30 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:23:30 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] Found default for hw_cdrom_bus of ide {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:23:30 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] Found default for hw_disk_bus of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:23:30 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] Found default for hw_input_bus of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:23:30 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] Found default for hw_pointer_model of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:23:30 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] Found default for hw_video_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:23:30 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] Found default for hw_vif_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:23:30 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:23:30 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925010.4164557, 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:23:30 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] VM Started (Lifecycle Event)
Aug 01 21:23:30 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:23:30 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:23:30 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:23:30 user nova-compute[72586]: INFO nova.compute.manager [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] Took 6.15 seconds to spawn the instance on the hypervisor.
Aug 01 21:23:30 user nova-compute[72586]: DEBUG nova.compute.manager [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:23:30 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:30 user nova-compute[72586]: DEBUG nova.compute.manager [req-1e4c9785-2f0c-4c9f-9143-342e34e80992 req-6cf33950-d71f-467c-ac1b-79f32d0a5b12 service nova] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] Received event network-vif-plugged-e94821de-3c0a-43a0-ba20-b7d22e0311a4 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:23:30 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-1e4c9785-2f0c-4c9f-9143-342e34e80992 req-6cf33950-d71f-467c-ac1b-79f32d0a5b12 service nova] Acquiring lock "29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:23:30 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-1e4c9785-2f0c-4c9f-9143-342e34e80992 req-6cf33950-d71f-467c-ac1b-79f32d0a5b12 service nova] Lock "29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:23:30 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-1e4c9785-2f0c-4c9f-9143-342e34e80992 req-6cf33950-d71f-467c-ac1b-79f32d0a5b12 service nova] Lock "29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:23:30 user nova-compute[72586]: DEBUG nova.compute.manager [req-1e4c9785-2f0c-4c9f-9143-342e34e80992 req-6cf33950-d71f-467c-ac1b-79f32d0a5b12 service nova] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] No waiting events found dispatching network-vif-plugged-e94821de-3c0a-43a0-ba20-b7d22e0311a4 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:23:30 user nova-compute[72586]: WARNING nova.compute.manager [req-1e4c9785-2f0c-4c9f-9143-342e34e80992 req-6cf33950-d71f-467c-ac1b-79f32d0a5b12 service nova] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] Received unexpected event network-vif-plugged-e94821de-3c0a-43a0-ba20-b7d22e0311a4 for instance with vm_state building and task_state spawning.
Aug 01 21:23:30 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:30 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:30 user nova-compute[72586]: INFO nova.compute.manager [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] Took 7.27 seconds to build instance.
Aug 01 21:23:30 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-4e07a07d-7ab4-483a-9cc5-d481bb0d6650 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Lock "29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.423s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:23:30 user nova-compute[72586]: DEBUG nova.compute.manager [req-9c2fc9d5-b998-484e-9b5c-bfe34a687909 req-5af90cf9-b7b5-4fdb-bd11-0e921e4f8c8a service nova] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Received event network-vif-plugged-99688c7a-3e71-49d8-9002-0075560858c9 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:23:30 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-9c2fc9d5-b998-484e-9b5c-bfe34a687909 req-5af90cf9-b7b5-4fdb-bd11-0e921e4f8c8a service nova] Acquiring lock "49c24c77-f102-4aed-8314-b04aad5f6b3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:23:30 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-9c2fc9d5-b998-484e-9b5c-bfe34a687909 req-5af90cf9-b7b5-4fdb-bd11-0e921e4f8c8a service nova] Lock "49c24c77-f102-4aed-8314-b04aad5f6b3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:23:30 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-9c2fc9d5-b998-484e-9b5c-bfe34a687909 req-5af90cf9-b7b5-4fdb-bd11-0e921e4f8c8a service nova] Lock "49c24c77-f102-4aed-8314-b04aad5f6b3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:23:30 user nova-compute[72586]: DEBUG nova.compute.manager [req-9c2fc9d5-b998-484e-9b5c-bfe34a687909 req-5af90cf9-b7b5-4fdb-bd11-0e921e4f8c8a service nova] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] No waiting events found dispatching network-vif-plugged-99688c7a-3e71-49d8-9002-0075560858c9 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:23:30 user nova-compute[72586]: WARNING nova.compute.manager [req-9c2fc9d5-b998-484e-9b5c-bfe34a687909 req-5af90cf9-b7b5-4fdb-bd11-0e921e4f8c8a service nova] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Received unexpected event network-vif-plugged-99688c7a-3e71-49d8-9002-0075560858c9 for instance with vm_state building and task_state spawning.
Aug 01 21:23:31 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:31 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:31 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:32 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925012.8934145, 49c24c77-f102-4aed-8314-b04aad5f6b3a => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:23:32 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] VM Resumed (Lifecycle Event)
Aug 01 21:23:32 user nova-compute[72586]: DEBUG nova.compute.manager [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Instance event wait completed in 0 seconds for  {{(pid=72586) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 21:23:32 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Guest created on hypervisor {{(pid=72586) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 21:23:32 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Instance spawned successfully.
Aug 01 21:23:32 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 21:23:32 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:23:32 user nova-compute[72586]: DEBUG nova.compute.manager [req-c69684e8-9329-4a41-afb2-07f49a923218 req-0562aadb-4786-47ac-8108-18f36d0764c1 service nova] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Received event network-vif-plugged-99688c7a-3e71-49d8-9002-0075560858c9 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:23:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-c69684e8-9329-4a41-afb2-07f49a923218 req-0562aadb-4786-47ac-8108-18f36d0764c1 service nova] Acquiring lock "49c24c77-f102-4aed-8314-b04aad5f6b3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:23:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-c69684e8-9329-4a41-afb2-07f49a923218 req-0562aadb-4786-47ac-8108-18f36d0764c1 service nova] Lock "49c24c77-f102-4aed-8314-b04aad5f6b3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:23:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-c69684e8-9329-4a41-afb2-07f49a923218 req-0562aadb-4786-47ac-8108-18f36d0764c1 service nova] Lock "49c24c77-f102-4aed-8314-b04aad5f6b3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:23:32 user nova-compute[72586]: DEBUG nova.compute.manager [req-c69684e8-9329-4a41-afb2-07f49a923218 req-0562aadb-4786-47ac-8108-18f36d0764c1 service nova] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] No waiting events found dispatching network-vif-plugged-99688c7a-3e71-49d8-9002-0075560858c9 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:23:32 user nova-compute[72586]: WARNING nova.compute.manager [req-c69684e8-9329-4a41-afb2-07f49a923218 req-0562aadb-4786-47ac-8108-18f36d0764c1 service nova] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Received unexpected event network-vif-plugged-99688c7a-3e71-49d8-9002-0075560858c9 for instance with vm_state building and task_state spawning.
Aug 01 21:23:32 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:23:32 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Found default for hw_cdrom_bus of ide {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:23:32 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Found default for hw_disk_bus of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:23:32 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Found default for hw_input_bus of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:23:32 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Found default for hw_pointer_model of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:23:32 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Found default for hw_video_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:23:32 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Found default for hw_vif_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:23:32 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:23:32 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925012.8984928, 49c24c77-f102-4aed-8314-b04aad5f6b3a => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:23:32 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] VM Started (Lifecycle Event)
Aug 01 21:23:33 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:23:33 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:23:33 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:23:33 user nova-compute[72586]: INFO nova.compute.manager [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Took 5.86 seconds to spawn the instance on the hypervisor.
Aug 01 21:23:33 user nova-compute[72586]: DEBUG nova.compute.manager [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:23:33 user nova-compute[72586]: INFO nova.compute.manager [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Took 6.62 seconds to build instance.
Aug 01 21:23:33 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-00f8dc4d-ce3a-4ccb-926e-f9f43aba84eb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "49c24c77-f102-4aed-8314-b04aad5f6b3a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.727s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:23:34 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:34 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:36 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:23:36 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:23:36 user nova-compute[72586]: DEBUG nova.objects.instance [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lazy-loading 'pci_requests' on Instance uuid eccf50b0-9acc-49b6-8044-601e47d18c38 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:23:36 user nova-compute[72586]: DEBUG nova.objects.instance [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lazy-loading 'numa_topology' on Instance uuid eccf50b0-9acc-49b6-8044-601e47d18c38 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:23:36 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72586) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 21:23:36 user nova-compute[72586]: INFO nova.compute.claims [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Claim successful on node user
Aug 01 21:23:36 user nova-compute[72586]: DEBUG nova.compute.manager [req-bb1e845f-f843-4e35-8a69-9bc344b86ef1 req-d85738be-c394-434f-87fb-0f49ce80872c service nova] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Received event network-changed-8994785a-c6c5-4bb6-9709-4c1f802e47d6 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:23:36 user nova-compute[72586]: DEBUG nova.compute.manager [req-bb1e845f-f843-4e35-8a69-9bc344b86ef1 req-d85738be-c394-434f-87fb-0f49ce80872c service nova] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Refreshing instance network info cache due to event network-changed-8994785a-c6c5-4bb6-9709-4c1f802e47d6. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:23:36 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-bb1e845f-f843-4e35-8a69-9bc344b86ef1 req-d85738be-c394-434f-87fb-0f49ce80872c service nova] Acquiring lock "refresh_cache-644c949c-3ac3-46ec-a62f-b38224f0a85c" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:23:36 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-bb1e845f-f843-4e35-8a69-9bc344b86ef1 req-d85738be-c394-434f-87fb-0f49ce80872c service nova] Acquired lock "refresh_cache-644c949c-3ac3-46ec-a62f-b38224f0a85c" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:23:36 user nova-compute[72586]: DEBUG nova.network.neutron [req-bb1e845f-f843-4e35-8a69-9bc344b86ef1 req-d85738be-c394-434f-87fb-0f49ce80872c service nova] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Refreshing network info cache for port 8994785a-c6c5-4bb6-9709-4c1f802e47d6 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:23:37 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:23:37 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:23:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.571s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:23:37 user nova-compute[72586]: INFO nova.network.neutron [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Updating port a766e2fb-84bd-40c0-a6d7-cdd68b728cd9 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 01 21:23:37 user nova-compute[72586]: DEBUG nova.network.neutron [req-bb1e845f-f843-4e35-8a69-9bc344b86ef1 req-d85738be-c394-434f-87fb-0f49ce80872c service nova] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Updated VIF entry in instance network info cache for port 8994785a-c6c5-4bb6-9709-4c1f802e47d6. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:23:37 user nova-compute[72586]: DEBUG nova.network.neutron [req-bb1e845f-f843-4e35-8a69-9bc344b86ef1 req-d85738be-c394-434f-87fb-0f49ce80872c service nova] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Updating instance_info_cache with network_info: [{"id": "8994785a-c6c5-4bb6-9709-4c1f802e47d6", "address": "fa:16:3e:b6:f1:83", "network": {"id": "d8cf5f10-6a59-4aa2-b8e8-b53932d3734e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1728024316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc531307652485c99598d21cacc2f93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8994785a-c6", "ovs_interfaceid": "8994785a-c6c5-4bb6-9709-4c1f802e47d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:23:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-bb1e845f-f843-4e35-8a69-9bc344b86ef1 req-d85738be-c394-434f-87fb-0f49ce80872c service nova] Releasing lock "refresh_cache-644c949c-3ac3-46ec-a62f-b38224f0a85c" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:23:37 user nova-compute[72586]: INFO nova.compute.manager [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Rebuilding instance
Aug 01 21:23:38 user nova-compute[72586]: DEBUG nova.objects.instance [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Lazy-loading 'trusted_certs' on Instance uuid 644c949c-3ac3-46ec-a62f-b38224f0a85c {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:23:38 user nova-compute[72586]: DEBUG nova.compute.manager [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:23:38 user nova-compute[72586]: DEBUG nova.objects.instance [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Lazy-loading 'pci_requests' on Instance uuid 644c949c-3ac3-46ec-a62f-b38224f0a85c {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:23:38 user nova-compute[72586]: DEBUG nova.objects.instance [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Lazy-loading 'pci_devices' on Instance uuid 644c949c-3ac3-46ec-a62f-b38224f0a85c {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:23:38 user nova-compute[72586]: DEBUG nova.objects.instance [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Lazy-loading 'resources' on Instance uuid 644c949c-3ac3-46ec-a62f-b38224f0a85c {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:23:38 user nova-compute[72586]: DEBUG nova.objects.instance [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Lazy-loading 'migration_context' on Instance uuid 644c949c-3ac3-46ec-a62f-b38224f0a85c {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:23:38 user nova-compute[72586]: DEBUG nova.objects.instance [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72586) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Aug 01 21:23:38 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:38 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Acquiring lock "refresh_cache-eccf50b0-9acc-49b6-8044-601e47d18c38" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:23:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Acquired lock "refresh_cache-eccf50b0-9acc-49b6-8044-601e47d18c38" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:23:38 user nova-compute[72586]: DEBUG nova.network.neutron [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:23:38 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:38 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:38 user nova-compute[72586]: DEBUG nova.compute.manager [req-45bc1487-6389-4cb1-9b39-b722bf8a2196 req-b01453ba-7699-4030-89e0-5aa347a0901f service nova] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Received event network-changed-a766e2fb-84bd-40c0-a6d7-cdd68b728cd9 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:23:38 user nova-compute[72586]: DEBUG nova.compute.manager [req-45bc1487-6389-4cb1-9b39-b722bf8a2196 req-b01453ba-7699-4030-89e0-5aa347a0901f service nova] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Refreshing instance network info cache due to event network-changed-a766e2fb-84bd-40c0-a6d7-cdd68b728cd9. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:23:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-45bc1487-6389-4cb1-9b39-b722bf8a2196 req-b01453ba-7699-4030-89e0-5aa347a0901f service nova] Acquiring lock "refresh_cache-eccf50b0-9acc-49b6-8044-601e47d18c38" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:23:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:39 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Instance destroyed successfully.
Aug 01 21:23:39 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Instance destroyed successfully.
Aug 01 21:23:39 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:21:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-898739020',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1632168252',id=12,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFN1pax4r2Rtmt0MkJzmJ/B3FoEGAYCOmWATKfk3X9qByC/jEbHy6mIDIfw7u2k/a61UypCjORkPhSH3mzITgt2N1Y/szofLIQYe2HUTFUXje2O0sR9hELC20XHTZIMgbQ==',key_name='tempest-keypair-16295814',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:22:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2fc531307652485c99598d21cacc2f93',ramdisk_id='',reservation_id='r-7sq1d2d0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-390719395',owner_user_name='tempest-ServerActionsV293TestJSON-390719395-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:23:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89385b6c1686413db06c1c08a7c2e442',uuid=644c949c-3ac3-46ec-a62f-b38224f0a85c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8994785a-c6c5-4bb6-9709-4c1f802e47d6", "address": "fa:16:3e:b6:f1:83", "network": {"id": "d8cf5f10-6a59-4aa2-b8e8-b53932d3734e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1728024316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc531307652485c99598d21cacc2f93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8994785a-c6", "ovs_interfaceid": "8994785a-c6c5-4bb6-9709-4c1f802e47d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:23:39 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Converting VIF {"id": "8994785a-c6c5-4bb6-9709-4c1f802e47d6", "address": "fa:16:3e:b6:f1:83", "network": {"id": "d8cf5f10-6a59-4aa2-b8e8-b53932d3734e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1728024316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc531307652485c99598d21cacc2f93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8994785a-c6", "ovs_interfaceid": "8994785a-c6c5-4bb6-9709-4c1f802e47d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:23:39 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:f1:83,bridge_name='br-int',has_traffic_filtering=True,id=8994785a-c6c5-4bb6-9709-4c1f802e47d6,network=Network(d8cf5f10-6a59-4aa2-b8e8-b53932d3734e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8994785a-c6') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:23:39 user nova-compute[72586]: DEBUG os_vif [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:f1:83,bridge_name='br-int',has_traffic_filtering=True,id=8994785a-c6c5-4bb6-9709-4c1f802e47d6,network=Network(d8cf5f10-6a59-4aa2-b8e8-b53932d3734e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8994785a-c6') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:23:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8994785a-c6, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:23:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:23:39 user nova-compute[72586]: INFO os_vif [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:f1:83,bridge_name='br-int',has_traffic_filtering=True,id=8994785a-c6c5-4bb6-9709-4c1f802e47d6,network=Network(d8cf5f10-6a59-4aa2-b8e8-b53932d3734e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8994785a-c6')
Aug 01 21:23:39 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] calling os-brick to detach iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 21:23:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, {'target_iqns': ['iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NiSdhavK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:23:39 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 01 21:23:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:23:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:23:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf', 0)] {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 21:23:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:39 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e8af243-1b26-4f42-b569-5c4324ddf2e8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:23:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:39 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dae0f1c-8e04-4e5f-9fc7-4109b03ae87d]: (4, ('tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:23:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)
Aug 01 21:23:39 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:23:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] iscsi session list stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)
Aug 01 21:23:39 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:23:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ed061d630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf'): ({'sdh'}, set())}) {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 21:23:39 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Removing single pathed devices sdh {{(pid=72586) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 21:23:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:39 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e57721-589f-425f-930d-93c16593ab8a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:23:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:39 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ab2efe-267b-4ce5-9c40-2d1f939409d8]: (4, ('ok\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:23:39 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Flushing IO for device /dev/sdh {{(pid=72586) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 21:23:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:39 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a9813f-d8c3-4cf7-b246-edb657a5087e]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:23:39 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72586) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 21:23:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:39 user nova-compute[72586]: DEBUG nova.network.neutron [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Updating instance_info_cache with network_info: [{"id": "a766e2fb-84bd-40c0-a6d7-cdd68b728cd9", "address": "fa:16:3e:fe:82:a2", "network": {"id": "a5da07bc-2f5d-461e-b31f-df624d9c6557", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948878141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae659e4ad43c44e2a8f6d48818bb796a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa766e2fb-84", "ovs_interfaceid": "a766e2fb-84bd-40c0-a6d7-cdd68b728cd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:23:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.078s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:39 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[123f0e28-c17e-4634-bde3-d14864ac273b]: (4, ('1', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:23:39 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 21:23:39 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] SCSI volumes sdh have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 21:23:39 user nova-compute[72586]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26236303839666638', '/dev/disk/by-id/scsi-1SCST_BIOcb7f55f-b6089ff8e5cb0f66', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_cb7f55f') {{(pid=83581) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 01 21:23:39 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ed3e0e-a067-47be-bbaa-cde663dcedfd]: (4, None) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:23:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf')] {{(pid=72586) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 21:23:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:39 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1074e1ca-c26f-411d-aa75-ad1e68262fb5]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:23:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:23:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf -p 172.16.0.220:3260 --logout {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:39 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa8f362-e3cc-401d-987e-164d2d64ddd2]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:23:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf, portal: 172.16.0.220,3260]
Aug 01 21:23:39 user nova-compute[72586]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf, portal: 172.16.0.220,3260] successful.
Aug 01 21:23:39 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:23:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf -p 172.16.0.220:3260 --op delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Releasing lock "refresh_cache-eccf50b0-9acc-49b6-8044-601e47d18c38" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:23:39 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Creating instance directory {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 21:23:39 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Creating image(s)
Aug 01 21:23:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Acquiring lock "/opt/stack/data/nova/instances/eccf50b0-9acc-49b6-8044-601e47d18c38/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:23:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "/opt/stack/data/nova/instances/eccf50b0-9acc-49b6-8044-601e47d18c38/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:23:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "/opt/stack/data/nova/instances/eccf50b0-9acc-49b6-8044-601e47d18c38/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:23:39 user nova-compute[72586]: DEBUG nova.objects.instance [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lazy-loading 'trusted_certs' on Instance uuid eccf50b0-9acc-49b6-8044-601e47d18c38 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:23:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:39 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6771945-6872-4a8e-96f5-564179f7f368]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:23:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-45bc1487-6389-4cb1-9b39-b722bf8a2196 req-b01453ba-7699-4030-89e0-5aa347a0901f service nova] Acquired lock "refresh_cache-eccf50b0-9acc-49b6-8044-601e47d18c38" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:23:39 user nova-compute[72586]: DEBUG nova.network.neutron [req-45bc1487-6389-4cb1-9b39-b722bf8a2196 req-b01453ba-7699-4030-89e0-5aa347a0901f service nova] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Refreshing network info cache for port a766e2fb-84bd-40c0-a6d7-cdd68b728cd9 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:23:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:23:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.391s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:23:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] <== disconnect_volume: return (393ms) None {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:23:39 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Disconnected iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 21:23:39 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Deleting instance files /opt/stack/data/nova/instances/644c949c-3ac3-46ec-a62f-b38224f0a85c_del
Aug 01 21:23:39 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Deletion of /opt/stack/data/nova/instances/644c949c-3ac3-46ec-a62f-b38224f0a85c_del complete
Aug 01 21:23:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Acquiring lock "7d80961d96ee6d713f11e481bbede074b74a3258" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:23:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "7d80961d96ee6d713f11e481bbede074b74a3258" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:23:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d80961d96ee6d713f11e481bbede074b74a3258.part --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d80961d96ee6d713f11e481bbede074b74a3258.part --force-share --output=json" returned: 0 in 0.236s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:40 user nova-compute[72586]: DEBUG nova.virt.images [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] b50f781a-5044-4423-8931-0cf905973972 was qcow2, converting to raw {{(pid=72586) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 21:23:40 user nova-compute[72586]: DEBUG nova.privsep.utils [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72586) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 21:23:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7d80961d96ee6d713f11e481bbede074b74a3258.part /opt/stack/data/nova/instances/_base/7d80961d96ee6d713f11e481bbede074b74a3258.converted {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:41 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 644c949c-3ac3-46ec-a62f-b38224f0a85c could not be found.
Aug 01 21:23:41 user nova-compute[72586]: DEBUG nova.compute.manager [req-6cb92605-8183-4204-80a2-828c2539ff39 req-8dff074e-db2a-470e-a08b-235f85262ab2 service nova] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Received event network-vif-plugged-8994785a-c6c5-4bb6-9709-4c1f802e47d6 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:23:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-6cb92605-8183-4204-80a2-828c2539ff39 req-8dff074e-db2a-470e-a08b-235f85262ab2 service nova] Acquiring lock "644c949c-3ac3-46ec-a62f-b38224f0a85c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:23:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-6cb92605-8183-4204-80a2-828c2539ff39 req-8dff074e-db2a-470e-a08b-235f85262ab2 service nova] Lock "644c949c-3ac3-46ec-a62f-b38224f0a85c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:23:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-6cb92605-8183-4204-80a2-828c2539ff39 req-8dff074e-db2a-470e-a08b-235f85262ab2 service nova] Lock "644c949c-3ac3-46ec-a62f-b38224f0a85c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:23:41 user nova-compute[72586]: DEBUG nova.compute.manager [req-6cb92605-8183-4204-80a2-828c2539ff39 req-8dff074e-db2a-470e-a08b-235f85262ab2 service nova] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] No waiting events found dispatching network-vif-plugged-8994785a-c6c5-4bb6-9709-4c1f802e47d6 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:23:41 user nova-compute[72586]: WARNING nova.compute.manager [req-6cb92605-8183-4204-80a2-828c2539ff39 req-8dff074e-db2a-470e-a08b-235f85262ab2 service nova] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Received unexpected event network-vif-plugged-8994785a-c6c5-4bb6-9709-4c1f802e47d6 for instance with vm_state active and task_state rebuilding.
Aug 01 21:23:41 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] calling os-brick to detach iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 21:23:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, {'target_iqns': ['iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NiSdhavK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:23:41 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 01 21:23:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:23:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:23:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf', 0)] {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 21:23:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 21 in 0.028s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:41 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[67457c04-e645-4fb2-a2b1-19cb904f7167]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:23:41 user nova-compute[72586]: WARNING os_brick.initiator.connectors.iscsi [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Couldn't find iSCSI nodes because iscsiadm err: iscsiadm: No records found
Aug 01 21:23:41 user nova-compute[72586]: : NotImplementedError
Aug 01 21:23:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.026s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:41 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[2655b375-179f-4b84-bbc4-9929d29d4fa8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:23:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 21:23:41 user nova-compute[72586]:  {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:23:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 21:23:41 user nova-compute[72586]:  {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:23:41 user nova-compute[72586]: WARNING os_brick.initiator.connectors.iscsi [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 21:23:41 user nova-compute[72586]: : NotImplementedError
Aug 01 21:23:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ed07b23b0>, {}) {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 21:23:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Disconnecting from: [] {{(pid=72586) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 21:23:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.073s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:23:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] <== disconnect_volume: return (75ms) None {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:23:41 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Disconnected iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 21:23:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7d80961d96ee6d713f11e481bbede074b74a3258.part /opt/stack/data/nova/instances/_base/7d80961d96ee6d713f11e481bbede074b74a3258.converted" returned: 0 in 0.751s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d80961d96ee6d713f11e481bbede074b74a3258.converted --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d80961d96ee6d713f11e481bbede074b74a3258.converted --force-share --output=json" returned: 0 in 0.147s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "7d80961d96ee6d713f11e481bbede074b74a3258" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.248s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:23:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d80961d96ee6d713f11e481bbede074b74a3258 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:41 user nova-compute[72586]: DEBUG nova.network.neutron [req-45bc1487-6389-4cb1-9b39-b722bf8a2196 req-b01453ba-7699-4030-89e0-5aa347a0901f service nova] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Updated VIF entry in instance network info cache for port a766e2fb-84bd-40c0-a6d7-cdd68b728cd9. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:23:41 user nova-compute[72586]: DEBUG nova.network.neutron [req-45bc1487-6389-4cb1-9b39-b722bf8a2196 req-b01453ba-7699-4030-89e0-5aa347a0901f service nova] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Updating instance_info_cache with network_info: [{"id": "a766e2fb-84bd-40c0-a6d7-cdd68b728cd9", "address": "fa:16:3e:fe:82:a2", "network": {"id": "a5da07bc-2f5d-461e-b31f-df624d9c6557", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948878141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae659e4ad43c44e2a8f6d48818bb796a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa766e2fb-84", "ovs_interfaceid": "a766e2fb-84bd-40c0-a6d7-cdd68b728cd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:23:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-45bc1487-6389-4cb1-9b39-b722bf8a2196 req-b01453ba-7699-4030-89e0-5aa347a0901f service nova] Releasing lock "refresh_cache-eccf50b0-9acc-49b6-8044-601e47d18c38" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:23:41 user nova-compute[72586]: DEBUG nova.compute.manager [req-45bc1487-6389-4cb1-9b39-b722bf8a2196 req-b01453ba-7699-4030-89e0-5aa347a0901f service nova] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Received event network-vif-unplugged-8994785a-c6c5-4bb6-9709-4c1f802e47d6 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:23:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-45bc1487-6389-4cb1-9b39-b722bf8a2196 req-b01453ba-7699-4030-89e0-5aa347a0901f service nova] Acquiring lock "644c949c-3ac3-46ec-a62f-b38224f0a85c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:23:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-45bc1487-6389-4cb1-9b39-b722bf8a2196 req-b01453ba-7699-4030-89e0-5aa347a0901f service nova] Lock "644c949c-3ac3-46ec-a62f-b38224f0a85c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:23:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-45bc1487-6389-4cb1-9b39-b722bf8a2196 req-b01453ba-7699-4030-89e0-5aa347a0901f service nova] Lock "644c949c-3ac3-46ec-a62f-b38224f0a85c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:23:41 user nova-compute[72586]: DEBUG nova.compute.manager [req-45bc1487-6389-4cb1-9b39-b722bf8a2196 req-b01453ba-7699-4030-89e0-5aa347a0901f service nova] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] No waiting events found dispatching network-vif-unplugged-8994785a-c6c5-4bb6-9709-4c1f802e47d6 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:23:41 user nova-compute[72586]: WARNING nova.compute.manager [req-45bc1487-6389-4cb1-9b39-b722bf8a2196 req-b01453ba-7699-4030-89e0-5aa347a0901f service nova] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Received unexpected event network-vif-unplugged-8994785a-c6c5-4bb6-9709-4c1f802e47d6 for instance with vm_state active and task_state rebuilding.
Aug 01 21:23:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d80961d96ee6d713f11e481bbede074b74a3258 --force-share --output=json" returned: 0 in 0.150s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Acquiring lock "7d80961d96ee6d713f11e481bbede074b74a3258" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:23:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "7d80961d96ee6d713f11e481bbede074b74a3258" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:23:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d80961d96ee6d713f11e481bbede074b74a3258 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d80961d96ee6d713f11e481bbede074b74a3258 --force-share --output=json" returned: 0 in 0.143s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d80961d96ee6d713f11e481bbede074b74a3258,backing_fmt=raw /opt/stack/data/nova/instances/eccf50b0-9acc-49b6-8044-601e47d18c38/disk 1073741824 {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d80961d96ee6d713f11e481bbede074b74a3258,backing_fmt=raw /opt/stack/data/nova/instances/eccf50b0-9acc-49b6-8044-601e47d18c38/disk 1073741824" returned: 0 in 0.060s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:42 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "7d80961d96ee6d713f11e481bbede074b74a3258" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.213s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:23:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d80961d96ee6d713f11e481bbede074b74a3258 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d80961d96ee6d713f11e481bbede074b74a3258 --force-share --output=json" returned: 0 in 0.145s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:42 user nova-compute[72586]: DEBUG nova.objects.instance [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lazy-loading 'migration_context' on Instance uuid eccf50b0-9acc-49b6-8044-601e47d18c38 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:23:42 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Rebasing disk image.
Aug 01 21:23:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:42 user nova-compute[72586]: DEBUG nova.compute.manager [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Preparing to wait for external event volume-reimaged-4a04f408-4471-4c55-8ba3-ac6f023f49bf {{(pid=72586) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 01 21:23:42 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Acquiring lock "644c949c-3ac3-46ec-a62f-b38224f0a85c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:23:42 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Lock "644c949c-3ac3-46ec-a62f-b38224f0a85c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:23:42 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Lock "644c949c-3ac3-46ec-a62f-b38224f0a85c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:23:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.153s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 -F raw /opt/stack/data/nova/instances/eccf50b0-9acc-49b6-8044-601e47d18c38/disk {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:44 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:44 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:44 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 -F raw /opt/stack/data/nova/instances/eccf50b0-9acc-49b6-8044-601e47d18c38/disk" returned: 0 in 2.072s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:44 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Created local disks {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 21:23:44 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Ensure instance console log exists: /opt/stack/data/nova/instances/eccf50b0-9acc-49b6-8044-601e47d18c38/console.log {{(pid=72586) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 21:23:44 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:23:44 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:23:44 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:23:44 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Start _get_guest_xml network_info=[{"id": "a766e2fb-84bd-40c0-a6d7-cdd68b728cd9", "address": "fa:16:3e:fe:82:a2", "network": {"id": "a5da07bc-2f5d-461e-b31f-df624d9c6557", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948878141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae659e4ad43c44e2a8f6d48818bb796a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa766e2fb-84", "ovs_interfaceid": "a766e2fb-84bd-40c0-a6d7-cdd68b728cd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c4269643f21a85820484556b59369d42',container_format='bare',created_at=2023-08-01T21:21:35Z,direct_url=<?>,disk_format='qcow2',id=b50f781a-5044-4423-8931-0cf905973972,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1431613257-shelved',owner='ae659e4ad43c44e2a8f6d48818bb796a',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-01T21:21:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '0243d46b-6819-42a5-926f-42b71f0c97ad'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'mount_device': '/dev/vdc', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:eb131549-cfa4-4f5f-bfd4-e34009dc6686'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iJAPkuyl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'eccf50b0-9acc-49b6-8044-601e47d18c38', 'attached_at': '', 'detached_at': '', 'volume_id': 'eb131549-cfa4-4f5f-bfd4-e34009dc6686', 'serial': 'eb131549-cfa4-4f5f-bfd4-e34009dc6686'}, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'dc9f6587-f978-4d17-915a-ba31631480fa', 'delete_on_termination': False, 'volume_type': None} {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:23:44 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:23:44 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:23:44 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:23:44 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:23:44 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:23:44 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:23:44 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:23:44 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c4269643f21a85820484556b59369d42',container_format='bare',created_at=2023-08-01T21:21:35Z,direct_url=<?>,disk_format='qcow2',id=b50f781a-5044-4423-8931-0cf905973972,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1431613257-shelved',owner='ae659e4ad43c44e2a8f6d48818bb796a',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-01T21:21:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:23:44 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:23:44 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:23:44 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:23:44 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:23:44 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:23:44 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:23:44 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:23:44 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:23:44 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:23:44 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:23:44 user nova-compute[72586]: DEBUG nova.objects.instance [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lazy-loading 'vcpu_model' on Instance uuid eccf50b0-9acc-49b6-8044-601e47d18c38 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:23:44 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Calling os-brick to attach iSCSI Volume {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 21:23:44 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:eb131549-cfa4-4f5f-bfd4-e34009dc6686'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iJAPkuyl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:23:44 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:23:44 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:23:44 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:23:44 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:23:44 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb131549-cfa4-4f5f-bfd4-e34009dc6686" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:23:44 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb131549-cfa4-4f5f-bfd4-e34009dc6686" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:23:44 user nova-compute[72586]: INFO os_brick.initiator.connectors.iscsi [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 21:23:44 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb131549-cfa4-4f5f-bfd4-e34009dc6686 -p 172.16.0.220:3260 {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:44 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb131549-cfa4-4f5f-bfd4-e34009dc6686 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:44 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[691da21f-8460-40ae-a461-7197ef78e08e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:23:44 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 21:23:44 user nova-compute[72586]:  {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:23:44 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb131549-cfa4-4f5f-bfd4-e34009dc6686 -p 172.16.0.220:3260 --interface default --op new {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:44 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb131549-cfa4-4f5f-bfd4-e34009dc6686 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:44 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7134c0-e958-48eb-88ca-e2eb11008de4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb131549-cfa4-4f5f-bfd4-e34009dc6686] added\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:23:44 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb131549-cfa4-4f5f-bfd4-e34009dc6686] added
Aug 01 21:23:44 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:23:44 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb131549-cfa4-4f5f-bfd4-e34009dc6686 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:44 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb131549-cfa4-4f5f-bfd4-e34009dc6686 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:44 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ae0ffb-67e7-4d5b-8179-1a35fac57ff9]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:23:44 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:23:44 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb131549-cfa4-4f5f-bfd4-e34009dc6686 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:44 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb131549-cfa4-4f5f-bfd4-e34009dc6686 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:44 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3e3eb7-ef34-4cf9-9a1f-158bb08e7148]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:23:44 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:23:44 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb131549-cfa4-4f5f-bfd4-e34009dc6686 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iJAPkuyl {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:44 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb131549-cfa4-4f5f-bfd4-e34009dc6686 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iJAPkuyl" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:44 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1207dce3-dc5f-403b-ae0e-5e7bc4177bc5]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:23:44 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iJAPkuyl'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:23:44 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb131549-cfa4-4f5f-bfd4-e34009dc6686 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:44 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb131549-cfa4-4f5f-bfd4-e34009dc6686 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:44 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3440694-9b77-4b68-9874-bdcfcb3a88c7]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:23:44 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:23:44 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:44 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:44 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c56733e-79dd-4488-862d-e31234f1ee0d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:23:44 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 21:23:44 user nova-compute[72586]:  {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:23:44 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 21:23:44 user nova-compute[72586]:  {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:23:44 user nova-compute[72586]: WARNING os_brick.initiator.connectors.iscsi [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 21:23:44 user nova-compute[72586]: 
Aug 01 21:23:44 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb131549-cfa4-4f5f-bfd4-e34009dc6686 -p 172.16.0.220:3260 --login {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:44 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb131549-cfa4-4f5f-bfd4-e34009dc6686 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:44 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[125d9a71-2e8d-41dc-8ade-799301e98141]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb131549-cfa4-4f5f-bfd4-e34009dc6686, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eb131549-cfa4-4f5f-bfd4-e34009dc6686, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:23:44 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb131549-cfa4-4f5f-bfd4-e34009dc6686, portal: 172.16.0.220,3260]
Aug 01 21:23:44 user nova-compute[72586]: Login to [iface: default, target: iqn.2010-10.org.openstack:eb131549-cfa4-4f5f-bfd4-e34009dc6686, portal: 172.16.0.220,3260] successful.
Aug 01 21:23:44 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:23:44 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb131549-cfa4-4f5f-bfd4-e34009dc6686 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:45 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb131549-cfa4-4f5f-bfd4-e34009dc6686 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.155s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:45 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c5e2dc-07b0-4b68-bb02-de7a1730e922]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:23:45 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:23:45 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:45 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:45 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa2cf69-6427-427c-88d6-928c1c59bafa]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb131549-cfa4-4f5f-bfd4-e34009dc6686 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:23:45 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb131549-cfa4-4f5f-bfd4-e34009dc6686 (non-flash)
Aug 01 21:23:45 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:23:45 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb131549-cfa4-4f5f-bfd4-e34009dc6686 (non-flash)
Aug 01 21:23:45 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:23:45 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb131549-cfa4-4f5f-bfd4-e34009dc6686" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.419s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:23:45 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Connected to 172.16.0.220:3260 {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 21:23:45 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=72586) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 21:23:45 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72586) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 21:23:45 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:45 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.045s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:45 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d71f721-09a8-4dea-83b4-cf62ea5be821]: (4, ('- - 0', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:23:45 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:23:45 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iJAPkuyl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 21:23:46 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.489s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:23:46 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] <== connect_volume: return (1490ms) {'type': 'block', 'scsi_wwn': '26566356162393232', 'path': '/dev/sdb'} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:23:46 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26566356162393232', 'path': '/dev/sdb'} {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 21:23:46 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T21:19:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1431613257',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1431613257',id=4,image_ref='b50f781a-5044-4423-8931-0cf905973972',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2087820494',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:19:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ae659e4ad43c44e2a8f6d48818bb796a',ramdisk_id='',reservation_id='r-kpiui11s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1935542868',owner_user_name='tempest-AttachVolumeShelveTestJSON-1935542868-project-member',shelved_at='2023-08-01T21:21:40.525441',shelved_host='user',shelved_image_id='b50f781a-5044-4423-8931-0cf905973972'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:23:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1a0d71c79c04216b9bf278f650aeb77',uuid=eccf50b0-9acc-49b6-8044-601e47d18c38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a766e2fb-84bd-40c0-a6d7-cdd68b728cd9", "address": "fa:16:3e:fe:82:a2", "network": {"id": "a5da07bc-2f5d-461e-b31f-df624d9c6557", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948878141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae659e4ad43c44e2a8f6d48818bb796a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa766e2fb-84", "ovs_interfaceid": "a766e2fb-84bd-40c0-a6d7-cdd68b728cd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:23:46 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Converting VIF {"id": "a766e2fb-84bd-40c0-a6d7-cdd68b728cd9", "address": "fa:16:3e:fe:82:a2", "network": {"id": "a5da07bc-2f5d-461e-b31f-df624d9c6557", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948878141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae659e4ad43c44e2a8f6d48818bb796a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa766e2fb-84", "ovs_interfaceid": "a766e2fb-84bd-40c0-a6d7-cdd68b728cd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:23:46 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:82:a2,bridge_name='br-int',has_traffic_filtering=True,id=a766e2fb-84bd-40c0-a6d7-cdd68b728cd9,network=Network(a5da07bc-2f5d-461e-b31f-df624d9c6557),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa766e2fb-84') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:23:46 user nova-compute[72586]: DEBUG nova.objects.instance [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lazy-loading 'pci_devices' on Instance uuid eccf50b0-9acc-49b6-8044-601e47d18c38 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:23:46 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:23:46 user nova-compute[72586]:   <uuid>eccf50b0-9acc-49b6-8044-601e47d18c38</uuid>
Aug 01 21:23:46 user nova-compute[72586]:   <name>instance-00000004</name>
Aug 01 21:23:46 user nova-compute[72586]:   <memory>524288</memory>
Aug 01 21:23:46 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:23:46 user nova-compute[72586]:   <metadata>
Aug 01 21:23:46 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:23:46 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:23:46 user nova-compute[72586]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1431613257</nova:name>
Aug 01 21:23:46 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:23:44</nova:creationTime>
Aug 01 21:23:46 user nova-compute[72586]:       <nova:flavor name="m1.tiny">
Aug 01 21:23:46 user nova-compute[72586]:         <nova:memory>512</nova:memory>
Aug 01 21:23:46 user nova-compute[72586]:         <nova:disk>1</nova:disk>
Aug 01 21:23:46 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:23:46 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:23:46 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:23:46 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:23:46 user nova-compute[72586]:       <nova:owner>
Aug 01 21:23:46 user nova-compute[72586]:         <nova:user uuid="e1a0d71c79c04216b9bf278f650aeb77">tempest-AttachVolumeShelveTestJSON-1935542868-project-member</nova:user>
Aug 01 21:23:46 user nova-compute[72586]:         <nova:project uuid="ae659e4ad43c44e2a8f6d48818bb796a">tempest-AttachVolumeShelveTestJSON-1935542868</nova:project>
Aug 01 21:23:46 user nova-compute[72586]:       </nova:owner>
Aug 01 21:23:46 user nova-compute[72586]:       <nova:root type="image" uuid="b50f781a-5044-4423-8931-0cf905973972"/>
Aug 01 21:23:46 user nova-compute[72586]:       <nova:ports>
Aug 01 21:23:46 user nova-compute[72586]:         <nova:port uuid="a766e2fb-84bd-40c0-a6d7-cdd68b728cd9">
Aug 01 21:23:46 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 01 21:23:46 user nova-compute[72586]:         </nova:port>
Aug 01 21:23:46 user nova-compute[72586]:       </nova:ports>
Aug 01 21:23:46 user nova-compute[72586]:     </nova:instance>
Aug 01 21:23:46 user nova-compute[72586]:   </metadata>
Aug 01 21:23:46 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:23:46 user nova-compute[72586]:     <system>
Aug 01 21:23:46 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:23:46 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:23:46 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:23:46 user nova-compute[72586]:       <entry name="serial">eccf50b0-9acc-49b6-8044-601e47d18c38</entry>
Aug 01 21:23:46 user nova-compute[72586]:       <entry name="uuid">eccf50b0-9acc-49b6-8044-601e47d18c38</entry>
Aug 01 21:23:46 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:23:46 user nova-compute[72586]:     </system>
Aug 01 21:23:46 user nova-compute[72586]:   </sysinfo>
Aug 01 21:23:46 user nova-compute[72586]:   <os>
Aug 01 21:23:46 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:23:46 user nova-compute[72586]:     <boot dev="hd"/>
Aug 01 21:23:46 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:23:46 user nova-compute[72586]:   </os>
Aug 01 21:23:46 user nova-compute[72586]:   <features>
Aug 01 21:23:46 user nova-compute[72586]:     <acpi/>
Aug 01 21:23:46 user nova-compute[72586]:     <apic/>
Aug 01 21:23:46 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:23:46 user nova-compute[72586]:   </features>
Aug 01 21:23:46 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:23:46 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:23:46 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:23:46 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:23:46 user nova-compute[72586]:   </clock>
Aug 01 21:23:46 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:23:46 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:23:46 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:23:46 user nova-compute[72586]:   </cpu>
Aug 01 21:23:46 user nova-compute[72586]:   <devices>
Aug 01 21:23:46 user nova-compute[72586]:     <disk type="file" device="disk">
Aug 01 21:23:46 user nova-compute[72586]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 21:23:46 user nova-compute[72586]:       <source file="/opt/stack/data/nova/instances/eccf50b0-9acc-49b6-8044-601e47d18c38/disk"/>
Aug 01 21:23:46 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:23:46 user nova-compute[72586]:     </disk>
Aug 01 21:23:46 user nova-compute[72586]:     <disk type="block" device="disk">
Aug 01 21:23:46 user nova-compute[72586]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:23:46 user nova-compute[72586]:       <source dev="/dev/sdb"/>
Aug 01 21:23:46 user nova-compute[72586]:       <target dev="vdc" bus="virtio"/>
Aug 01 21:23:46 user nova-compute[72586]:       <serial>eb131549-cfa4-4f5f-bfd4-e34009dc6686</serial>
Aug 01 21:23:46 user nova-compute[72586]:     </disk>
Aug 01 21:23:46 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:23:46 user nova-compute[72586]:       <mac address="fa:16:3e:fe:82:a2"/>
Aug 01 21:23:46 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:23:46 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:23:46 user nova-compute[72586]:       <target dev="tapa766e2fb-84"/>
Aug 01 21:23:46 user nova-compute[72586]:     </interface>
Aug 01 21:23:46 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:23:46 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/eccf50b0-9acc-49b6-8044-601e47d18c38/console.log" append="off"/>
Aug 01 21:23:46 user nova-compute[72586]:     </serial>
Aug 01 21:23:46 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:23:46 user nova-compute[72586]:     <video>
Aug 01 21:23:46 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:23:46 user nova-compute[72586]:     </video>
Aug 01 21:23:46 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:23:46 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:23:46 user nova-compute[72586]:     </rng>
Aug 01 21:23:46 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:23:46 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:23:46 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:23:46 user nova-compute[72586]:     </memballoon>
Aug 01 21:23:46 user nova-compute[72586]:   </devices>
Aug 01 21:23:46 user nova-compute[72586]: </domain>
Aug 01 21:23:46 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:23:46 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T21:19:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1431613257',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1431613257',id=4,image_ref='b50f781a-5044-4423-8931-0cf905973972',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2087820494',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:19:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ae659e4ad43c44e2a8f6d48818bb796a',ramdisk_id='',reservation_id='r-kpiui11s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1935542868',owner_user_name='tempest-AttachVolumeShelveTestJSON-1935542868-project-member',shelved_at='2023-08-01T21:21:40.525441',shelved_host='user',shelved_image_id='b50f781a-5044-4423-8931-0cf905973972'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:23:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1a0d71c79c04216b9bf278f650aeb77',uuid=eccf50b0-9acc-49b6-8044-601e47d18c38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a766e2fb-84bd-40c0-a6d7-cdd68b728cd9", "address": "fa:16:3e:fe:82:a2", "network": {"id": "a5da07bc-2f5d-461e-b31f-df624d9c6557", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948878141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae659e4ad43c44e2a8f6d48818bb796a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa766e2fb-84", "ovs_interfaceid": "a766e2fb-84bd-40c0-a6d7-cdd68b728cd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:23:46 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Converting VIF {"id": "a766e2fb-84bd-40c0-a6d7-cdd68b728cd9", "address": "fa:16:3e:fe:82:a2", "network": {"id": "a5da07bc-2f5d-461e-b31f-df624d9c6557", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948878141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae659e4ad43c44e2a8f6d48818bb796a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa766e2fb-84", "ovs_interfaceid": "a766e2fb-84bd-40c0-a6d7-cdd68b728cd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:23:46 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:82:a2,bridge_name='br-int',has_traffic_filtering=True,id=a766e2fb-84bd-40c0-a6d7-cdd68b728cd9,network=Network(a5da07bc-2f5d-461e-b31f-df624d9c6557),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa766e2fb-84') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:23:46 user nova-compute[72586]: DEBUG os_vif [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:82:a2,bridge_name='br-int',has_traffic_filtering=True,id=a766e2fb-84bd-40c0-a6d7-cdd68b728cd9,network=Network(a5da07bc-2f5d-461e-b31f-df624d9c6557),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa766e2fb-84') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:23:46 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:46 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:23:46 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:23:46 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:46 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa766e2fb-84, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:23:46 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa766e2fb-84, col_values=(('external_ids', {'iface-id': 'a766e2fb-84bd-40c0-a6d7-cdd68b728cd9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:82:a2', 'vm-uuid': 'eccf50b0-9acc-49b6-8044-601e47d18c38'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:23:46 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:46 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:23:46 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:46 user nova-compute[72586]: INFO os_vif [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:82:a2,bridge_name='br-int',has_traffic_filtering=True,id=a766e2fb-84bd-40c0-a6d7-cdd68b728cd9,network=Network(a5da07bc-2f5d-461e-b31f-df624d9c6557),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa766e2fb-84')
Aug 01 21:23:46 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:23:46 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:23:46 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] No VIF found with MAC fa:16:3e:fe:82:a2, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:23:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:48 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:48 user nova-compute[72586]: DEBUG nova.compute.manager [req-2cac9053-9f74-44eb-83af-91d23f6d8abb req-35c47784-7541-4279-89f5-ece1add5b005 service nova] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Received event network-vif-plugged-a766e2fb-84bd-40c0-a6d7-cdd68b728cd9 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:23:48 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-2cac9053-9f74-44eb-83af-91d23f6d8abb req-35c47784-7541-4279-89f5-ece1add5b005 service nova] Acquiring lock "eccf50b0-9acc-49b6-8044-601e47d18c38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:23:48 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-2cac9053-9f74-44eb-83af-91d23f6d8abb req-35c47784-7541-4279-89f5-ece1add5b005 service nova] Lock "eccf50b0-9acc-49b6-8044-601e47d18c38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:23:48 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-2cac9053-9f74-44eb-83af-91d23f6d8abb req-35c47784-7541-4279-89f5-ece1add5b005 service nova] Lock "eccf50b0-9acc-49b6-8044-601e47d18c38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:23:48 user nova-compute[72586]: DEBUG nova.compute.manager [req-2cac9053-9f74-44eb-83af-91d23f6d8abb req-35c47784-7541-4279-89f5-ece1add5b005 service nova] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] No waiting events found dispatching network-vif-plugged-a766e2fb-84bd-40c0-a6d7-cdd68b728cd9 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:23:48 user nova-compute[72586]: WARNING nova.compute.manager [req-2cac9053-9f74-44eb-83af-91d23f6d8abb req-35c47784-7541-4279-89f5-ece1add5b005 service nova] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Received unexpected event network-vif-plugged-a766e2fb-84bd-40c0-a6d7-cdd68b728cd9 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 01 21:23:48 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:48 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:48 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:48 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:49 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:50 user nova-compute[72586]: DEBUG nova.compute.manager [req-9eeb352b-07a5-47e4-a370-e189f4bed7c0 req-dd8a3b4a-d395-4045-a5b6-57a1126dcffc service nova] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Received event network-vif-plugged-a766e2fb-84bd-40c0-a6d7-cdd68b728cd9 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:23:50 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-9eeb352b-07a5-47e4-a370-e189f4bed7c0 req-dd8a3b4a-d395-4045-a5b6-57a1126dcffc service nova] Acquiring lock "eccf50b0-9acc-49b6-8044-601e47d18c38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:23:50 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-9eeb352b-07a5-47e4-a370-e189f4bed7c0 req-dd8a3b4a-d395-4045-a5b6-57a1126dcffc service nova] Lock "eccf50b0-9acc-49b6-8044-601e47d18c38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:23:50 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-9eeb352b-07a5-47e4-a370-e189f4bed7c0 req-dd8a3b4a-d395-4045-a5b6-57a1126dcffc service nova] Lock "eccf50b0-9acc-49b6-8044-601e47d18c38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:23:50 user nova-compute[72586]: DEBUG nova.compute.manager [req-9eeb352b-07a5-47e4-a370-e189f4bed7c0 req-dd8a3b4a-d395-4045-a5b6-57a1126dcffc service nova] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] No waiting events found dispatching network-vif-plugged-a766e2fb-84bd-40c0-a6d7-cdd68b728cd9 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:23:50 user nova-compute[72586]: WARNING nova.compute.manager [req-9eeb352b-07a5-47e4-a370-e189f4bed7c0 req-dd8a3b4a-d395-4045-a5b6-57a1126dcffc service nova] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Received unexpected event network-vif-plugged-a766e2fb-84bd-40c0-a6d7-cdd68b728cd9 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 01 21:23:50 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925030.4769855, eccf50b0-9acc-49b6-8044-601e47d18c38 => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:23:50 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] VM Resumed (Lifecycle Event)
Aug 01 21:23:50 user nova-compute[72586]: DEBUG nova.compute.manager [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Instance event wait completed in 0 seconds for  {{(pid=72586) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 21:23:50 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Guest created on hypervisor {{(pid=72586) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 21:23:50 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Instance spawned successfully.
Aug 01 21:23:50 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:23:50 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:23:50 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:23:50 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925030.4783921, eccf50b0-9acc-49b6-8044-601e47d18c38 => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:23:50 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] VM Started (Lifecycle Event)
Aug 01 21:23:50 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:23:50 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:23:50 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:23:50 user nova-compute[72586]: DEBUG nova.compute.manager [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:23:50 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-46eaee20-5cd2-4263-9c36-2b926a9fb785 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "eccf50b0-9acc-49b6-8044-601e47d18c38" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 22.806s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:23:51 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:54 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:54 user nova-compute[72586]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690925019.0779, 644c949c-3ac3-46ec-a62f-b38224f0a85c => Stopped> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:23:54 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] VM Stopped (Lifecycle Event)
Aug 01 21:23:54 user nova-compute[72586]: DEBUG nova.compute.manager [None req-7532ee0a-16b7-47a4-9f02-61a208b64e6b None None] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:23:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9c5fc470-83af-458d-82c1-4fd3eee5d8c5 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Acquiring lock "25fb970a-0caf-41e8-8d58-259dbd9cf291" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:23:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9c5fc470-83af-458d-82c1-4fd3eee5d8c5 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Lock "25fb970a-0caf-41e8-8d58-259dbd9cf291" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:23:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9c5fc470-83af-458d-82c1-4fd3eee5d8c5 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Acquiring lock "25fb970a-0caf-41e8-8d58-259dbd9cf291-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:23:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9c5fc470-83af-458d-82c1-4fd3eee5d8c5 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Lock "25fb970a-0caf-41e8-8d58-259dbd9cf291-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:23:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9c5fc470-83af-458d-82c1-4fd3eee5d8c5 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Lock "25fb970a-0caf-41e8-8d58-259dbd9cf291-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:23:55 user nova-compute[72586]: INFO nova.compute.manager [None req-9c5fc470-83af-458d-82c1-4fd3eee5d8c5 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Terminating instance
Aug 01 21:23:55 user nova-compute[72586]: DEBUG nova.compute.manager [None req-9c5fc470-83af-458d-82c1-4fd3eee5d8c5 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Start destroying the instance on the hypervisor. {{(pid=72586) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 21:23:55 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:55 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:55 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:55 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:56 user nova-compute[72586]: DEBUG nova.compute.manager [req-fe9a1577-8a84-4012-9ff8-80516b938b9b req-1bfe41ed-7183-4c58-898b-3de2ee2e6e9b service nova] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Received event network-vif-unplugged-91634168-0e3d-42db-b0f4-af85d2673762 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:23:56 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-fe9a1577-8a84-4012-9ff8-80516b938b9b req-1bfe41ed-7183-4c58-898b-3de2ee2e6e9b service nova] Acquiring lock "25fb970a-0caf-41e8-8d58-259dbd9cf291-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:23:56 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-fe9a1577-8a84-4012-9ff8-80516b938b9b req-1bfe41ed-7183-4c58-898b-3de2ee2e6e9b service nova] Lock "25fb970a-0caf-41e8-8d58-259dbd9cf291-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:23:56 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-fe9a1577-8a84-4012-9ff8-80516b938b9b req-1bfe41ed-7183-4c58-898b-3de2ee2e6e9b service nova] Lock "25fb970a-0caf-41e8-8d58-259dbd9cf291-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:23:56 user nova-compute[72586]: DEBUG nova.compute.manager [req-fe9a1577-8a84-4012-9ff8-80516b938b9b req-1bfe41ed-7183-4c58-898b-3de2ee2e6e9b service nova] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] No waiting events found dispatching network-vif-unplugged-91634168-0e3d-42db-b0f4-af85d2673762 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:23:56 user nova-compute[72586]: DEBUG nova.compute.manager [req-fe9a1577-8a84-4012-9ff8-80516b938b9b req-1bfe41ed-7183-4c58-898b-3de2ee2e6e9b service nova] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Received event network-vif-unplugged-91634168-0e3d-42db-b0f4-af85d2673762 for instance with task_state deleting. {{(pid=72586) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 21:23:56 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:56 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Instance destroyed successfully.
Aug 01 21:23:56 user nova-compute[72586]: DEBUG nova.objects.instance [None req-9c5fc470-83af-458d-82c1-4fd3eee5d8c5 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Lazy-loading 'resources' on Instance uuid 25fb970a-0caf-41e8-8d58-259dbd9cf291 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:23:56 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-9c5fc470-83af-458d-82c1-4fd3eee5d8c5 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:20:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1502478417',display_name='tempest-TestVolumeSwap-server-1502478417',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1502478417',id=9,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCvk8l1Q8znUNmNO4t7uyUpIE+79wm96jJPMppGTBwsTiLJw7JILuwEIvh8PYggsnkpF8Uwk+qd9ucf1SkNhW44JfiQOrC0YWRK9Dtqqi9MhswF9CZL+dBNyIytFV7Y/Ow==',key_name='tempest-keypair-537422444',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:20:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='80dd67d749d04409923cd9b64691b638',ramdisk_id='',reservation_id='r-k089wnn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-345897363',owner_user_name='tempest-TestVolumeSwap-345897363-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:20:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d121f9e2de24379af2bccb61a3b81ce',uuid=25fb970a-0caf-41e8-8d58-259dbd9cf291,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "91634168-0e3d-42db-b0f4-af85d2673762", "address": "fa:16:3e:a0:ef:27", "network": {"id": "3df6057c-0dba-4e06-bfe5-4df929c74a85", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2011731775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80dd67d749d04409923cd9b64691b638", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91634168-0e", "ovs_interfaceid": "91634168-0e3d-42db-b0f4-af85d2673762", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:23:56 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-9c5fc470-83af-458d-82c1-4fd3eee5d8c5 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Converting VIF {"id": "91634168-0e3d-42db-b0f4-af85d2673762", "address": "fa:16:3e:a0:ef:27", "network": {"id": "3df6057c-0dba-4e06-bfe5-4df929c74a85", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2011731775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80dd67d749d04409923cd9b64691b638", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91634168-0e", "ovs_interfaceid": "91634168-0e3d-42db-b0f4-af85d2673762", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:23:56 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-9c5fc470-83af-458d-82c1-4fd3eee5d8c5 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a0:ef:27,bridge_name='br-int',has_traffic_filtering=True,id=91634168-0e3d-42db-b0f4-af85d2673762,network=Network(3df6057c-0dba-4e06-bfe5-4df929c74a85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91634168-0e') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:23:56 user nova-compute[72586]: DEBUG os_vif [None req-9c5fc470-83af-458d-82c1-4fd3eee5d8c5 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:ef:27,bridge_name='br-int',has_traffic_filtering=True,id=91634168-0e3d-42db-b0f4-af85d2673762,network=Network(3df6057c-0dba-4e06-bfe5-4df929c74a85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91634168-0e') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:23:56 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:56 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap91634168-0e, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:23:56 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:56 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:23:56 user nova-compute[72586]: INFO os_vif [None req-9c5fc470-83af-458d-82c1-4fd3eee5d8c5 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:ef:27,bridge_name='br-int',has_traffic_filtering=True,id=91634168-0e3d-42db-b0f4-af85d2673762,network=Network(3df6057c-0dba-4e06-bfe5-4df929c74a85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91634168-0e')
Aug 01 21:23:56 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-9c5fc470-83af-458d-82c1-4fd3eee5d8c5 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Deleting instance files /opt/stack/data/nova/instances/25fb970a-0caf-41e8-8d58-259dbd9cf291_del
Aug 01 21:23:56 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-9c5fc470-83af-458d-82c1-4fd3eee5d8c5 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Deletion of /opt/stack/data/nova/instances/25fb970a-0caf-41e8-8d58-259dbd9cf291_del complete
Aug 01 21:23:56 user nova-compute[72586]: INFO nova.compute.manager [None req-9c5fc470-83af-458d-82c1-4fd3eee5d8c5 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Took 1.12 seconds to destroy the instance on the hypervisor.
Aug 01 21:23:56 user nova-compute[72586]: DEBUG oslo.service.loopingcall [None req-9c5fc470-83af-458d-82c1-4fd3eee5d8c5 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72586) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 21:23:56 user nova-compute[72586]: DEBUG nova.compute.manager [-] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Deallocating network for instance {{(pid=72586) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 21:23:56 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] deallocate_for_instance() {{(pid=72586) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 21:23:57 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:23:57 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Took 1.27 seconds to deallocate network for instance.
Aug 01 21:23:58 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9c5fc470-83af-458d-82c1-4fd3eee5d8c5 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:23:58 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9c5fc470-83af-458d-82c1-4fd3eee5d8c5 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:23:58 user nova-compute[72586]: DEBUG nova.compute.manager [req-6d24d7b5-54df-4ed8-a906-59c0bd4b72f2 req-eb796907-90b5-4fc0-8e36-9f6d47913db8 service nova] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Received event network-vif-plugged-91634168-0e3d-42db-b0f4-af85d2673762 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:23:58 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-6d24d7b5-54df-4ed8-a906-59c0bd4b72f2 req-eb796907-90b5-4fc0-8e36-9f6d47913db8 service nova] Acquiring lock "25fb970a-0caf-41e8-8d58-259dbd9cf291-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:23:58 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-6d24d7b5-54df-4ed8-a906-59c0bd4b72f2 req-eb796907-90b5-4fc0-8e36-9f6d47913db8 service nova] Lock "25fb970a-0caf-41e8-8d58-259dbd9cf291-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:23:58 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-6d24d7b5-54df-4ed8-a906-59c0bd4b72f2 req-eb796907-90b5-4fc0-8e36-9f6d47913db8 service nova] Lock "25fb970a-0caf-41e8-8d58-259dbd9cf291-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:23:58 user nova-compute[72586]: DEBUG nova.compute.manager [req-6d24d7b5-54df-4ed8-a906-59c0bd4b72f2 req-eb796907-90b5-4fc0-8e36-9f6d47913db8 service nova] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] No waiting events found dispatching network-vif-plugged-91634168-0e3d-42db-b0f4-af85d2673762 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:23:58 user nova-compute[72586]: WARNING nova.compute.manager [req-6d24d7b5-54df-4ed8-a906-59c0bd4b72f2 req-eb796907-90b5-4fc0-8e36-9f6d47913db8 service nova] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Received unexpected event network-vif-plugged-91634168-0e3d-42db-b0f4-af85d2673762 for instance with vm_state deleted and task_state None.
Aug 01 21:23:58 user nova-compute[72586]: DEBUG nova.compute.manager [req-6d24d7b5-54df-4ed8-a906-59c0bd4b72f2 req-eb796907-90b5-4fc0-8e36-9f6d47913db8 service nova] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Received event network-vif-deleted-91634168-0e3d-42db-b0f4-af85d2673762 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:23:58 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-9c5fc470-83af-458d-82c1-4fd3eee5d8c5 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:23:58 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-9c5fc470-83af-458d-82c1-4fd3eee5d8c5 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:23:58 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9c5fc470-83af-458d-82c1-4fd3eee5d8c5 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.403s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:23:58 user nova-compute[72586]: INFO nova.scheduler.client.report [None req-9c5fc470-83af-458d-82c1-4fd3eee5d8c5 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Deleted allocations for instance 25fb970a-0caf-41e8-8d58-259dbd9cf291
Aug 01 21:23:58 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9c5fc470-83af-458d-82c1-4fd3eee5d8c5 tempest-TestVolumeSwap-345897363 tempest-TestVolumeSwap-345897363-project-member] Lock "25fb970a-0caf-41e8-8d58-259dbd9cf291" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.048s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:23:59 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:23:59 user nova-compute[72586]: DEBUG nova.compute.manager [req-c46e68fb-181b-4f20-8755-6f2c8b15a45b req-348f420e-ce6b-4794-9358-6b03b0471b3a service nova] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Received event volume-reimaged-4a04f408-4471-4c55-8ba3-ac6f023f49bf {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:23:59 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-c46e68fb-181b-4f20-8755-6f2c8b15a45b req-348f420e-ce6b-4794-9358-6b03b0471b3a service nova] Acquiring lock "644c949c-3ac3-46ec-a62f-b38224f0a85c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:23:59 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-c46e68fb-181b-4f20-8755-6f2c8b15a45b req-348f420e-ce6b-4794-9358-6b03b0471b3a service nova] Lock "644c949c-3ac3-46ec-a62f-b38224f0a85c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:23:59 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-c46e68fb-181b-4f20-8755-6f2c8b15a45b req-348f420e-ce6b-4794-9358-6b03b0471b3a service nova] Lock "644c949c-3ac3-46ec-a62f-b38224f0a85c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:23:59 user nova-compute[72586]: DEBUG nova.compute.manager [req-c46e68fb-181b-4f20-8755-6f2c8b15a45b req-348f420e-ce6b-4794-9358-6b03b0471b3a service nova] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Processing event volume-reimaged-4a04f408-4471-4c55-8ba3-ac6f023f49bf {{(pid=72586) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 01 21:23:59 user nova-compute[72586]: DEBUG nova.compute.manager [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Instance event wait completed in 17 seconds for volume-reimaged {{(pid=72586) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 21:23:59 user nova-compute[72586]: INFO nova.virt.block_device [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Booting with volume 4a04f408-4471-4c55-8ba3-ac6f023f49bf at /dev/vda
Aug 01 21:23:59 user nova-compute[72586]: DEBUG os_brick.utils [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:23:59 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:59 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:59 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b49004e3-84ac-4b11-ad1a-f5e5d80475c2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4bc202fb9cb\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:23:59 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:59 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:59 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b03966b-bd6b-4022-b026-6e1890940e63]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:23:59 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:59 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:23:59 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75277f8-33e0-449c-8b47-bf9a4b4680f8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:23:59 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e731d7-9e31-4883-a27c-1389bfdce313]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:23:59 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Running cmd (subprocess): nvme version {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:59 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] 'nvme version' failed. Not Retrying. {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:23:59 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] nvme not present on system {{(pid=72586) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 21:23:59 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:23:59 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:23:59 user nova-compute[72586]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 21:23:59 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e2feda-8768-45ba-85d8-e9d0da548ddb]: (4, '') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:23:59 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72586) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 21:23:59 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 21:23:59 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] LIGHTOS: no hostnqn found. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 21:23:59 user nova-compute[72586]: DEBUG os_brick.utils [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4bc202fb9cb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:23:59 user nova-compute[72586]: DEBUG nova.virt.block_device [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Updating existing volume attachment record: 6033b98f-9a81-4b00-aa52-00f2dbe367b6 {{(pid=72586) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 21:24:01 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:03 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:04 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:04 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:06 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:07 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:08 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Creating instance directory {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 21:24:08 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Creating image(s)
Aug 01 21:24:08 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Did not create local disks {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 21:24:08 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Ensure instance console log exists: /opt/stack/data/nova/instances/644c949c-3ac3-46ec-a62f-b38224f0a85c/console.log {{(pid=72586) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 21:24:08 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:24:08 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:24:08 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:24:08 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Start _get_guest_xml network_info=[{"id": "8994785a-c6c5-4bb6-9709-4c1f802e47d6", "address": "fa:16:3e:b6:f1:83", "network": {"id": "d8cf5f10-6a59-4aa2-b8e8-b53932d3734e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1728024316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc531307652485c99598d21cacc2f93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8994785a-c6", "ovs_interfaceid": "8994785a-c6c5-4bb6-9709-4c1f802e47d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NiSdhavK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '644c949c-3ac3-46ec-a62f-b38224f0a85c', 'attached_at': '', 'detached_at': '', 'volume_id': '4a04f408-4471-4c55-8ba3-ac6f023f49bf', 'serial': '4a04f408-4471-4c55-8ba3-ac6f023f49bf'}, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '6033b98f-9a81-4b00-aa52-00f2dbe367b6', 'delete_on_termination': True, 'volume_type': None} {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:24:08 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 01 21:24:08 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 01 21:24:08 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:24:08 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:24:08 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:24:08 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:24:08 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:24:08 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:24:08 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:24:08 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:24:08 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:24:08 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:24:08 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:24:08 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:24:08 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:24:08 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:24:08 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:24:08 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:24:08 user nova-compute[72586]: DEBUG nova.objects.instance [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Lazy-loading 'vcpu_model' on Instance uuid 644c949c-3ac3-46ec-a62f-b38224f0a85c {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:24:08 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Calling os-brick to attach iSCSI Volume {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 21:24:08 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NiSdhavK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:24:08 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 01 21:24:08 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:24:08 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:24:08 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 01 21:24:08 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:24:08 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:24:08 user nova-compute[72586]: INFO os_brick.initiator.connectors.iscsi [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 21:24:08 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf -p 172.16.0.220:3260 {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:24:08 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:24:08 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7d7b5d-40d8-401f-8cda-5912c7ea4b1b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:24:08 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 21:24:08 user nova-compute[72586]:  {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:24:08 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf -p 172.16.0.220:3260 --interface default --op new {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:24:08 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:08 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:24:08 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[247e79c5-3af8-40b3-9916-25ef07f7ec87]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf] added\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:24:08 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf] added
Aug 01 21:24:08 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:24:08 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:24:08 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:24:08 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f50b7f3-1d2c-46aa-8605-ee13fe5aa08d]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:24:08 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:24:08 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:24:08 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.040s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:24:08 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[509a3ef1-2e49-4021-a47a-7fdc90caa01d]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:24:08 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:24:08 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NiSdhavK {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:24:08 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NiSdhavK" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:24:08 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[a816fd49-9dc8-422a-9daa-2972ebf8af8d]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:24:08 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NiSdhavK'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:24:08 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:24:09 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:24:09 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b702249-3b2b-4355-bbb3-45069bf83b01]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:24:09 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:24:09 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:24:09 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:24:09 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[5477bdcf-35f2-403d-ba5c-61827345ac47]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb131549-cfa4-4f5f-bfd4-e34009dc6686 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:24:09 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb131549-cfa4-4f5f-bfd4-e34009dc6686 (non-flash)
Aug 01 21:24:09 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:24:09 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb131549-cfa4-4f5f-bfd4-e34009dc6686 (non-flash)
Aug 01 21:24:09 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:24:09 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf -p 172.16.0.220:3260 --login {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:24:09 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:09 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:24:09 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[a08272b3-202f-4c32-8e5c-afff3e7920a0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:24:09 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf, portal: 172.16.0.220,3260]
Aug 01 21:24:09 user nova-compute[72586]: Login to [iface: default, target: iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf, portal: 172.16.0.220,3260] successful.
Aug 01 21:24:09 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:24:09 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:24:09 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:24:09 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b244f0af-f381-4094-8211-a1ea6ea05c19]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:24:09 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:24:09 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:24:09 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:24:09 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[752fbe83-2c10-4536-86f3-11f9b39f18ed]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb131549-cfa4-4f5f-bfd4-e34009dc6686 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:24:09 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb131549-cfa4-4f5f-bfd4-e34009dc6686 (non-flash)
Aug 01 21:24:09 user nova-compute[72586]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)
Aug 01 21:24:09 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:24:09 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb131549-cfa4-4f5f-bfd4-e34009dc6686 (non-flash)
Aug 01 21:24:09 user nova-compute[72586]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)
Aug 01 21:24:09 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:24:09 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:24:09 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Connected to 172.16.0.220:3260 {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 21:24:09 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] HCTL ('34', '-', '-', 0) found on session 18 with lun 0 {{(pid=72586) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 21:24:09 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72586) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 21:24:09 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:24:09 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:24:09 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed02471e-150e-4ba6-aef8-1f4e0cc20826]: (4, ('- - 0', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:24:09 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:24:09 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NiSdhavK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 21:24:10 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:24:10 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '26236303839666638', 'path': '/dev/sdc'} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:24:10 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236303839666638', 'path': '/dev/sdc'} {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 21:24:10 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T21:21:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-898739020',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1632168252',id=12,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFN1pax4r2Rtmt0MkJzmJ/B3FoEGAYCOmWATKfk3X9qByC/jEbHy6mIDIfw7u2k/a61UypCjORkPhSH3mzITgt2N1Y/szofLIQYe2HUTFUXje2O0sR9hELC20XHTZIMgbQ==',key_name='tempest-keypair-16295814',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:22:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2fc531307652485c99598d21cacc2f93',ramdisk_id='',reservation_id='r-7sq1d2d0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-390719395',owner_user_name='tempest-ServerActionsV293TestJSON-390719395-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:24:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89385b6c1686413db06c1c08a7c2e442',uuid=644c949c-3ac3-46ec-a62f-b38224f0a85c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8994785a-c6c5-4bb6-9709-4c1f802e47d6", "address": "fa:16:3e:b6:f1:83", "network": {"id": "d8cf5f10-6a59-4aa2-b8e8-b53932d3734e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1728024316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc531307652485c99598d21cacc2f93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8994785a-c6", "ovs_interfaceid": "8994785a-c6c5-4bb6-9709-4c1f802e47d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:24:10 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Converting VIF {"id": "8994785a-c6c5-4bb6-9709-4c1f802e47d6", "address": "fa:16:3e:b6:f1:83", "network": {"id": "d8cf5f10-6a59-4aa2-b8e8-b53932d3734e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1728024316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc531307652485c99598d21cacc2f93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8994785a-c6", "ovs_interfaceid": "8994785a-c6c5-4bb6-9709-4c1f802e47d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:24:10 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:f1:83,bridge_name='br-int',has_traffic_filtering=True,id=8994785a-c6c5-4bb6-9709-4c1f802e47d6,network=Network(d8cf5f10-6a59-4aa2-b8e8-b53932d3734e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8994785a-c6') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:24:10 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:24:10 user nova-compute[72586]:   <uuid>644c949c-3ac3-46ec-a62f-b38224f0a85c</uuid>
Aug 01 21:24:10 user nova-compute[72586]:   <name>instance-0000000c</name>
Aug 01 21:24:10 user nova-compute[72586]:   <memory>524288</memory>
Aug 01 21:24:10 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:24:10 user nova-compute[72586]:   <metadata>
Aug 01 21:24:10 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:24:10 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:24:10 user nova-compute[72586]:       <nova:name>tempest-ServerActionsV293TestJSON-server-898739020</nova:name>
Aug 01 21:24:10 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:24:08</nova:creationTime>
Aug 01 21:24:10 user nova-compute[72586]:       <nova:flavor name="m1.tiny">
Aug 01 21:24:10 user nova-compute[72586]:         <nova:memory>512</nova:memory>
Aug 01 21:24:10 user nova-compute[72586]:         <nova:disk>1</nova:disk>
Aug 01 21:24:10 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:24:10 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:24:10 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:24:10 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:24:10 user nova-compute[72586]:       <nova:owner>
Aug 01 21:24:10 user nova-compute[72586]:         <nova:user uuid="89385b6c1686413db06c1c08a7c2e442">tempest-ServerActionsV293TestJSON-390719395-project-member</nova:user>
Aug 01 21:24:10 user nova-compute[72586]:         <nova:project uuid="2fc531307652485c99598d21cacc2f93">tempest-ServerActionsV293TestJSON-390719395</nova:project>
Aug 01 21:24:10 user nova-compute[72586]:       </nova:owner>
Aug 01 21:24:10 user nova-compute[72586]:       <nova:ports>
Aug 01 21:24:10 user nova-compute[72586]:         <nova:port uuid="8994785a-c6c5-4bb6-9709-4c1f802e47d6">
Aug 01 21:24:10 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 01 21:24:10 user nova-compute[72586]:         </nova:port>
Aug 01 21:24:10 user nova-compute[72586]:       </nova:ports>
Aug 01 21:24:10 user nova-compute[72586]:     </nova:instance>
Aug 01 21:24:10 user nova-compute[72586]:   </metadata>
Aug 01 21:24:10 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:24:10 user nova-compute[72586]:     <system>
Aug 01 21:24:10 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:24:10 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:24:10 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:24:10 user nova-compute[72586]:       <entry name="serial">644c949c-3ac3-46ec-a62f-b38224f0a85c</entry>
Aug 01 21:24:10 user nova-compute[72586]:       <entry name="uuid">644c949c-3ac3-46ec-a62f-b38224f0a85c</entry>
Aug 01 21:24:10 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:24:10 user nova-compute[72586]:     </system>
Aug 01 21:24:10 user nova-compute[72586]:   </sysinfo>
Aug 01 21:24:10 user nova-compute[72586]:   <os>
Aug 01 21:24:10 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:24:10 user nova-compute[72586]:     <boot dev="hd"/>
Aug 01 21:24:10 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:24:10 user nova-compute[72586]:   </os>
Aug 01 21:24:10 user nova-compute[72586]:   <features>
Aug 01 21:24:10 user nova-compute[72586]:     <acpi/>
Aug 01 21:24:10 user nova-compute[72586]:     <apic/>
Aug 01 21:24:10 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:24:10 user nova-compute[72586]:   </features>
Aug 01 21:24:10 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:24:10 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:24:10 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:24:10 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:24:10 user nova-compute[72586]:   </clock>
Aug 01 21:24:10 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:24:10 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:24:10 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:24:10 user nova-compute[72586]:   </cpu>
Aug 01 21:24:10 user nova-compute[72586]:   <devices>
Aug 01 21:24:10 user nova-compute[72586]:     <disk type="block" device="disk">
Aug 01 21:24:10 user nova-compute[72586]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:24:10 user nova-compute[72586]:       <source dev="/dev/sdc"/>
Aug 01 21:24:10 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:24:10 user nova-compute[72586]:       <serial>4a04f408-4471-4c55-8ba3-ac6f023f49bf</serial>
Aug 01 21:24:10 user nova-compute[72586]:     </disk>
Aug 01 21:24:10 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:24:10 user nova-compute[72586]:       <mac address="fa:16:3e:b6:f1:83"/>
Aug 01 21:24:10 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:24:10 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:24:10 user nova-compute[72586]:       <target dev="tap8994785a-c6"/>
Aug 01 21:24:10 user nova-compute[72586]:     </interface>
Aug 01 21:24:10 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:24:10 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/644c949c-3ac3-46ec-a62f-b38224f0a85c/console.log" append="off"/>
Aug 01 21:24:10 user nova-compute[72586]:     </serial>
Aug 01 21:24:10 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:24:10 user nova-compute[72586]:     <video>
Aug 01 21:24:10 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:24:10 user nova-compute[72586]:     </video>
Aug 01 21:24:10 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:24:10 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:24:10 user nova-compute[72586]:     </rng>
Aug 01 21:24:10 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:24:10 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:24:10 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:24:10 user nova-compute[72586]:     </memballoon>
Aug 01 21:24:10 user nova-compute[72586]:   </devices>
Aug 01 21:24:10 user nova-compute[72586]: </domain>
Aug 01 21:24:10 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:24:10 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T21:21:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-898739020',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1632168252',id=12,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFN1pax4r2Rtmt0MkJzmJ/B3FoEGAYCOmWATKfk3X9qByC/jEbHy6mIDIfw7u2k/a61UypCjORkPhSH3mzITgt2N1Y/szofLIQYe2HUTFUXje2O0sR9hELC20XHTZIMgbQ==',key_name='tempest-keypair-16295814',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:22:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2fc531307652485c99598d21cacc2f93',ramdisk_id='',reservation_id='r-7sq1d2d0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-390719395',owner_user_name='tempest-ServerActionsV293TestJSON-390719395-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:24:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89385b6c1686413db06c1c08a7c2e442',uuid=644c949c-3ac3-46ec-a62f-b38224f0a85c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8994785a-c6c5-4bb6-9709-4c1f802e47d6", "address": "fa:16:3e:b6:f1:83", "network": {"id": "d8cf5f10-6a59-4aa2-b8e8-b53932d3734e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1728024316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc531307652485c99598d21cacc2f93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8994785a-c6", "ovs_interfaceid": "8994785a-c6c5-4bb6-9709-4c1f802e47d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:24:10 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Converting VIF {"id": "8994785a-c6c5-4bb6-9709-4c1f802e47d6", "address": "fa:16:3e:b6:f1:83", "network": {"id": "d8cf5f10-6a59-4aa2-b8e8-b53932d3734e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1728024316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc531307652485c99598d21cacc2f93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8994785a-c6", "ovs_interfaceid": "8994785a-c6c5-4bb6-9709-4c1f802e47d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:24:10 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:f1:83,bridge_name='br-int',has_traffic_filtering=True,id=8994785a-c6c5-4bb6-9709-4c1f802e47d6,network=Network(d8cf5f10-6a59-4aa2-b8e8-b53932d3734e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8994785a-c6') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:24:10 user nova-compute[72586]: DEBUG os_vif [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:f1:83,bridge_name='br-int',has_traffic_filtering=True,id=8994785a-c6c5-4bb6-9709-4c1f802e47d6,network=Network(d8cf5f10-6a59-4aa2-b8e8-b53932d3734e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8994785a-c6') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:24:10 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:10 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:24:10 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:24:10 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:10 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8994785a-c6, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:24:10 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8994785a-c6, col_values=(('external_ids', {'iface-id': '8994785a-c6c5-4bb6-9709-4c1f802e47d6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:f1:83', 'vm-uuid': '644c949c-3ac3-46ec-a62f-b38224f0a85c'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:24:10 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:10 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:24:10 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:10 user nova-compute[72586]: INFO os_vif [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:f1:83,bridge_name='br-int',has_traffic_filtering=True,id=8994785a-c6c5-4bb6-9709-4c1f802e47d6,network=Network(d8cf5f10-6a59-4aa2-b8e8-b53932d3734e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8994785a-c6')
Aug 01 21:24:10 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:24:10 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] No VIF found with MAC fa:16:3e:b6:f1:83, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:24:10 user nova-compute[72586]: INFO nova.compute.manager [None req-c7d6c03f-0d4c-4f01-9d03-4a47705cfe54 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Rescuing
Aug 01 21:24:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c7d6c03f-0d4c-4f01-9d03-4a47705cfe54 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Acquiring lock "refresh_cache-042f0031-1e4d-41d0-8bfa-36001675cfe3" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:24:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c7d6c03f-0d4c-4f01-9d03-4a47705cfe54 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Acquired lock "refresh_cache-042f0031-1e4d-41d0-8bfa-36001675cfe3" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:24:10 user nova-compute[72586]: DEBUG nova.network.neutron [None req-c7d6c03f-0d4c-4f01-9d03-4a47705cfe54 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:24:11 user nova-compute[72586]: DEBUG nova.network.neutron [None req-c7d6c03f-0d4c-4f01-9d03-4a47705cfe54 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Updating instance_info_cache with network_info: [{"id": "fb56dcd2-b1ea-4992-a896-22f65127a96c", "address": "fa:16:3e:8e:7c:d3", "network": {"id": "d229a8de-7a2b-4dcd-a9ac-44a40349676e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-67691992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b1a1d82f39347119a9fb49fb8e8893f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb56dcd2-b1", "ovs_interfaceid": "fb56dcd2-b1ea-4992-a896-22f65127a96c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:24:11 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c7d6c03f-0d4c-4f01-9d03-4a47705cfe54 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Releasing lock "refresh_cache-042f0031-1e4d-41d0-8bfa-36001675cfe3" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:24:11 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:11 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:11 user nova-compute[72586]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690925036.5330105, 25fb970a-0caf-41e8-8d58-259dbd9cf291 => Stopped> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:24:11 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] VM Stopped (Lifecycle Event)
Aug 01 21:24:11 user nova-compute[72586]: DEBUG nova.compute.manager [None req-2658ff7d-e4b1-439a-ba3c-253de5ab39aa None None] [instance: 25fb970a-0caf-41e8-8d58-259dbd9cf291] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:24:11 user nova-compute[72586]: DEBUG nova.compute.manager [req-576d6595-58d4-4979-b938-d29dd6482fa6 req-1e676376-1c39-401a-81ed-45e6feafa48f service nova] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Received event network-vif-unplugged-fb56dcd2-b1ea-4992-a896-22f65127a96c {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:24:11 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-576d6595-58d4-4979-b938-d29dd6482fa6 req-1e676376-1c39-401a-81ed-45e6feafa48f service nova] Acquiring lock "042f0031-1e4d-41d0-8bfa-36001675cfe3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:24:11 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-576d6595-58d4-4979-b938-d29dd6482fa6 req-1e676376-1c39-401a-81ed-45e6feafa48f service nova] Lock "042f0031-1e4d-41d0-8bfa-36001675cfe3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:24:11 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-576d6595-58d4-4979-b938-d29dd6482fa6 req-1e676376-1c39-401a-81ed-45e6feafa48f service nova] Lock "042f0031-1e4d-41d0-8bfa-36001675cfe3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:24:11 user nova-compute[72586]: DEBUG nova.compute.manager [req-576d6595-58d4-4979-b938-d29dd6482fa6 req-1e676376-1c39-401a-81ed-45e6feafa48f service nova] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] No waiting events found dispatching network-vif-unplugged-fb56dcd2-b1ea-4992-a896-22f65127a96c {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:24:11 user nova-compute[72586]: WARNING nova.compute.manager [req-576d6595-58d4-4979-b938-d29dd6482fa6 req-1e676376-1c39-401a-81ed-45e6feafa48f service nova] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Received unexpected event network-vif-unplugged-fb56dcd2-b1ea-4992-a896-22f65127a96c for instance with vm_state active and task_state rescuing.
Aug 01 21:24:11 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:11 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:11 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:11 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:11 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:11 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:12 user nova-compute[72586]: DEBUG nova.compute.manager [req-a28ae80a-7f14-4f75-b8c9-8cfac9571abb req-facf63e8-f5a2-429f-a09d-f0c17331eace service nova] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Received event network-vif-plugged-8994785a-c6c5-4bb6-9709-4c1f802e47d6 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:24:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-a28ae80a-7f14-4f75-b8c9-8cfac9571abb req-facf63e8-f5a2-429f-a09d-f0c17331eace service nova] Acquiring lock "644c949c-3ac3-46ec-a62f-b38224f0a85c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:24:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-a28ae80a-7f14-4f75-b8c9-8cfac9571abb req-facf63e8-f5a2-429f-a09d-f0c17331eace service nova] Lock "644c949c-3ac3-46ec-a62f-b38224f0a85c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:24:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-a28ae80a-7f14-4f75-b8c9-8cfac9571abb req-facf63e8-f5a2-429f-a09d-f0c17331eace service nova] Lock "644c949c-3ac3-46ec-a62f-b38224f0a85c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:24:12 user nova-compute[72586]: DEBUG nova.compute.manager [req-a28ae80a-7f14-4f75-b8c9-8cfac9571abb req-facf63e8-f5a2-429f-a09d-f0c17331eace service nova] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] No waiting events found dispatching network-vif-plugged-8994785a-c6c5-4bb6-9709-4c1f802e47d6 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:24:12 user nova-compute[72586]: WARNING nova.compute.manager [req-a28ae80a-7f14-4f75-b8c9-8cfac9571abb req-facf63e8-f5a2-429f-a09d-f0c17331eace service nova] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Received unexpected event network-vif-plugged-8994785a-c6c5-4bb6-9709-4c1f802e47d6 for instance with vm_state active and task_state rebuild_spawning.
Aug 01 21:24:12 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Instance destroyed successfully.
Aug 01 21:24:12 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-c7d6c03f-0d4c-4f01-9d03-4a47705cfe54 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Attempting rescue
Aug 01 21:24:12 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c7d6c03f-0d4c-4f01-9d03-4a47705cfe54 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72586) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 01 21:24:12 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c7d6c03f-0d4c-4f01-9d03-4a47705cfe54 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Instance directory exists: not creating {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 01 21:24:12 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-c7d6c03f-0d4c-4f01-9d03-4a47705cfe54 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Creating image(s)
Aug 01 21:24:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c7d6c03f-0d4c-4f01-9d03-4a47705cfe54 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Acquiring lock "/opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:24:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c7d6c03f-0d4c-4f01-9d03-4a47705cfe54 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "/opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:24:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c7d6c03f-0d4c-4f01-9d03-4a47705cfe54 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "/opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:24:12 user nova-compute[72586]: DEBUG nova.objects.instance [None req-c7d6c03f-0d4c-4f01-9d03-4a47705cfe54 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lazy-loading 'trusted_certs' on Instance uuid 042f0031-1e4d-41d0-8bfa-36001675cfe3 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:24:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c7d6c03f-0d4c-4f01-9d03-4a47705cfe54 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Acquiring lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:24:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c7d6c03f-0d4c-4f01-9d03-4a47705cfe54 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:24:12 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-c7d6c03f-0d4c-4f01-9d03-4a47705cfe54 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:24:12 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-c7d6c03f-0d4c-4f01-9d03-4a47705cfe54 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.152s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:24:12 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-c7d6c03f-0d4c-4f01-9d03-4a47705cfe54 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk.rescue {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:24:12 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-c7d6c03f-0d4c-4f01-9d03-4a47705cfe54 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk.rescue" returned: 0 in 0.068s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:24:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c7d6c03f-0d4c-4f01-9d03-4a47705cfe54 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:24:12 user nova-compute[72586]: DEBUG nova.objects.instance [None req-c7d6c03f-0d4c-4f01-9d03-4a47705cfe54 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lazy-loading 'migration_context' on Instance uuid 042f0031-1e4d-41d0-8bfa-36001675cfe3 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:24:12 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c7d6c03f-0d4c-4f01-9d03-4a47705cfe54 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Created local disks {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 21:24:12 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c7d6c03f-0d4c-4f01-9d03-4a47705cfe54 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Start _get_guest_xml network_info=[{"id": "fb56dcd2-b1ea-4992-a896-22f65127a96c", "address": "fa:16:3e:8e:7c:d3", "network": {"id": "d229a8de-7a2b-4dcd-a9ac-44a40349676e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-67691992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-67691992-network", "vif_mac": "fa:16:3e:8e:7c:d3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b1a1d82f39347119a9fb49fb8e8893f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb56dcd2-b1", "ovs_interfaceid": "fb56dcd2-b1ea-4992-a896-22f65127a96c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '0243d46b-6819-42a5-926f-42b71f0c97ad', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:24:12 user nova-compute[72586]: DEBUG nova.objects.instance [None req-c7d6c03f-0d4c-4f01-9d03-4a47705cfe54 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lazy-loading 'resources' on Instance uuid 042f0031-1e4d-41d0-8bfa-36001675cfe3 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:24:12 user nova-compute[72586]: DEBUG nova.objects.instance [None req-c7d6c03f-0d4c-4f01-9d03-4a47705cfe54 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lazy-loading 'numa_topology' on Instance uuid 042f0031-1e4d-41d0-8bfa-36001675cfe3 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:24:12 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-c7d6c03f-0d4c-4f01-9d03-4a47705cfe54 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:24:12 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-c7d6c03f-0d4c-4f01-9d03-4a47705cfe54 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:24:12 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-c7d6c03f-0d4c-4f01-9d03-4a47705cfe54 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:24:12 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-c7d6c03f-0d4c-4f01-9d03-4a47705cfe54 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:24:12 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-c7d6c03f-0d4c-4f01-9d03-4a47705cfe54 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:24:12 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-c7d6c03f-0d4c-4f01-9d03-4a47705cfe54 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:24:12 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c7d6c03f-0d4c-4f01-9d03-4a47705cfe54 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:24:12 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-c7d6c03f-0d4c-4f01-9d03-4a47705cfe54 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:24:12 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-c7d6c03f-0d4c-4f01-9d03-4a47705cfe54 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:24:12 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-c7d6c03f-0d4c-4f01-9d03-4a47705cfe54 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:24:12 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-c7d6c03f-0d4c-4f01-9d03-4a47705cfe54 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:24:12 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-c7d6c03f-0d4c-4f01-9d03-4a47705cfe54 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:24:12 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-c7d6c03f-0d4c-4f01-9d03-4a47705cfe54 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:24:12 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-c7d6c03f-0d4c-4f01-9d03-4a47705cfe54 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:24:12 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-c7d6c03f-0d4c-4f01-9d03-4a47705cfe54 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:24:12 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-c7d6c03f-0d4c-4f01-9d03-4a47705cfe54 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:24:12 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-c7d6c03f-0d4c-4f01-9d03-4a47705cfe54 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:24:12 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-c7d6c03f-0d4c-4f01-9d03-4a47705cfe54 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:24:12 user nova-compute[72586]: DEBUG nova.objects.instance [None req-c7d6c03f-0d4c-4f01-9d03-4a47705cfe54 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lazy-loading 'vcpu_model' on Instance uuid 042f0031-1e4d-41d0-8bfa-36001675cfe3 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:24:12 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-c7d6c03f-0d4c-4f01-9d03-4a47705cfe54 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:19:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1034962218',display_name='tempest-ServerRescueNegativeTestJSON-server-1034962218',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1034962218',id=1,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:19:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5b1a1d82f39347119a9fb49fb8e8893f',ramdisk_id='',reservation_id='r-9jvsak0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1258600061',owner_user_name='tempest-ServerRescueNegativeTestJSON-1258600061-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:19:44Z,user_data=None,user_id='0f678ac8999a42c4a383ee8b2976b4cc',uuid=042f0031-1e4d-41d0-8bfa-36001675cfe3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb56dcd2-b1ea-4992-a896-22f65127a96c", "address": "fa:16:3e:8e:7c:d3", "network": {"id": "d229a8de-7a2b-4dcd-a9ac-44a40349676e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-67691992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-67691992-network", "vif_mac": "fa:16:3e:8e:7c:d3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b1a1d82f39347119a9fb49fb8e8893f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb56dcd2-b1", "ovs_interfaceid": "fb56dcd2-b1ea-4992-a896-22f65127a96c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:24:12 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-c7d6c03f-0d4c-4f01-9d03-4a47705cfe54 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Converting VIF {"id": "fb56dcd2-b1ea-4992-a896-22f65127a96c", "address": "fa:16:3e:8e:7c:d3", "network": {"id": "d229a8de-7a2b-4dcd-a9ac-44a40349676e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-67691992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-67691992-network", "vif_mac": "fa:16:3e:8e:7c:d3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b1a1d82f39347119a9fb49fb8e8893f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb56dcd2-b1", "ovs_interfaceid": "fb56dcd2-b1ea-4992-a896-22f65127a96c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:24:12 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-c7d6c03f-0d4c-4f01-9d03-4a47705cfe54 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:7c:d3,bridge_name='br-int',has_traffic_filtering=True,id=fb56dcd2-b1ea-4992-a896-22f65127a96c,network=Network(d229a8de-7a2b-4dcd-a9ac-44a40349676e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb56dcd2-b1') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:24:12 user nova-compute[72586]: DEBUG nova.objects.instance [None req-c7d6c03f-0d4c-4f01-9d03-4a47705cfe54 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lazy-loading 'pci_devices' on Instance uuid 042f0031-1e4d-41d0-8bfa-36001675cfe3 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:24:12 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c7d6c03f-0d4c-4f01-9d03-4a47705cfe54 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:24:12 user nova-compute[72586]:   <uuid>042f0031-1e4d-41d0-8bfa-36001675cfe3</uuid>
Aug 01 21:24:12 user nova-compute[72586]:   <name>instance-00000001</name>
Aug 01 21:24:12 user nova-compute[72586]:   <memory>524288</memory>
Aug 01 21:24:12 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:24:12 user nova-compute[72586]:   <metadata>
Aug 01 21:24:12 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:24:12 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:24:12 user nova-compute[72586]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1034962218</nova:name>
Aug 01 21:24:12 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:24:12</nova:creationTime>
Aug 01 21:24:12 user nova-compute[72586]:       <nova:flavor name="m1.tiny">
Aug 01 21:24:12 user nova-compute[72586]:         <nova:memory>512</nova:memory>
Aug 01 21:24:12 user nova-compute[72586]:         <nova:disk>1</nova:disk>
Aug 01 21:24:12 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:24:12 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:24:12 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:24:12 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:24:12 user nova-compute[72586]:       <nova:owner>
Aug 01 21:24:12 user nova-compute[72586]:         <nova:user uuid="0f678ac8999a42c4a383ee8b2976b4cc">tempest-ServerRescueNegativeTestJSON-1258600061-project-member</nova:user>
Aug 01 21:24:12 user nova-compute[72586]:         <nova:project uuid="5b1a1d82f39347119a9fb49fb8e8893f">tempest-ServerRescueNegativeTestJSON-1258600061</nova:project>
Aug 01 21:24:12 user nova-compute[72586]:       </nova:owner>
Aug 01 21:24:12 user nova-compute[72586]:       <nova:root type="image" uuid="0243d46b-6819-42a5-926f-42b71f0c97ad"/>
Aug 01 21:24:12 user nova-compute[72586]:       <nova:ports>
Aug 01 21:24:12 user nova-compute[72586]:         <nova:port uuid="fb56dcd2-b1ea-4992-a896-22f65127a96c">
Aug 01 21:24:12 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 01 21:24:12 user nova-compute[72586]:         </nova:port>
Aug 01 21:24:12 user nova-compute[72586]:       </nova:ports>
Aug 01 21:24:12 user nova-compute[72586]:     </nova:instance>
Aug 01 21:24:12 user nova-compute[72586]:   </metadata>
Aug 01 21:24:12 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:24:12 user nova-compute[72586]:     <system>
Aug 01 21:24:12 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:24:12 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:24:12 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:24:12 user nova-compute[72586]:       <entry name="serial">042f0031-1e4d-41d0-8bfa-36001675cfe3</entry>
Aug 01 21:24:12 user nova-compute[72586]:       <entry name="uuid">042f0031-1e4d-41d0-8bfa-36001675cfe3</entry>
Aug 01 21:24:12 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:24:12 user nova-compute[72586]:     </system>
Aug 01 21:24:12 user nova-compute[72586]:   </sysinfo>
Aug 01 21:24:12 user nova-compute[72586]:   <os>
Aug 01 21:24:12 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:24:12 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:24:12 user nova-compute[72586]:   </os>
Aug 01 21:24:12 user nova-compute[72586]:   <features>
Aug 01 21:24:12 user nova-compute[72586]:     <acpi/>
Aug 01 21:24:12 user nova-compute[72586]:     <apic/>
Aug 01 21:24:12 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:24:12 user nova-compute[72586]:   </features>
Aug 01 21:24:12 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:24:12 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:24:12 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:24:12 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:24:12 user nova-compute[72586]:   </clock>
Aug 01 21:24:12 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:24:12 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:24:12 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:24:12 user nova-compute[72586]:   </cpu>
Aug 01 21:24:12 user nova-compute[72586]:   <devices>
Aug 01 21:24:12 user nova-compute[72586]:     <disk type="file" device="disk">
Aug 01 21:24:12 user nova-compute[72586]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 21:24:12 user nova-compute[72586]:       <source file="/opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk.rescue"/>
Aug 01 21:24:12 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:24:12 user nova-compute[72586]:     </disk>
Aug 01 21:24:12 user nova-compute[72586]:     <disk type="file" device="disk">
Aug 01 21:24:12 user nova-compute[72586]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 21:24:12 user nova-compute[72586]:       <source file="/opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk"/>
Aug 01 21:24:12 user nova-compute[72586]:       <target dev="vdb" bus="virtio"/>
Aug 01 21:24:12 user nova-compute[72586]:     </disk>
Aug 01 21:24:12 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:24:12 user nova-compute[72586]:       <mac address="fa:16:3e:8e:7c:d3"/>
Aug 01 21:24:12 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:24:12 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:24:12 user nova-compute[72586]:       <target dev="tapfb56dcd2-b1"/>
Aug 01 21:24:12 user nova-compute[72586]:     </interface>
Aug 01 21:24:12 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:24:12 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/console.log" append="off"/>
Aug 01 21:24:12 user nova-compute[72586]:     </serial>
Aug 01 21:24:12 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:24:12 user nova-compute[72586]:     <video>
Aug 01 21:24:12 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:24:12 user nova-compute[72586]:     </video>
Aug 01 21:24:12 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:24:12 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:24:12 user nova-compute[72586]:     </rng>
Aug 01 21:24:12 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:24:12 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:24:12 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:24:12 user nova-compute[72586]:     </memballoon>
Aug 01 21:24:12 user nova-compute[72586]:   </devices>
Aug 01 21:24:12 user nova-compute[72586]: </domain>
Aug 01 21:24:12 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:24:12 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Instance destroyed successfully.
Aug 01 21:24:12 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c7d6c03f-0d4c-4f01-9d03-4a47705cfe54 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:24:12 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c7d6c03f-0d4c-4f01-9d03-4a47705cfe54 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:24:13 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c7d6c03f-0d4c-4f01-9d03-4a47705cfe54 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] No VIF found with MAC fa:16:3e:8e:7c:d3, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:24:13 user nova-compute[72586]: DEBUG nova.compute.manager [req-31198a14-f996-4c86-ade5-b916b48f2f1f req-6c2d9be4-d8b9-4efc-acf8-d2b420c139ad service nova] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Received event network-vif-plugged-fb56dcd2-b1ea-4992-a896-22f65127a96c {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:24:13 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-31198a14-f996-4c86-ade5-b916b48f2f1f req-6c2d9be4-d8b9-4efc-acf8-d2b420c139ad service nova] Acquiring lock "042f0031-1e4d-41d0-8bfa-36001675cfe3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:24:13 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-31198a14-f996-4c86-ade5-b916b48f2f1f req-6c2d9be4-d8b9-4efc-acf8-d2b420c139ad service nova] Lock "042f0031-1e4d-41d0-8bfa-36001675cfe3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:24:13 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-31198a14-f996-4c86-ade5-b916b48f2f1f req-6c2d9be4-d8b9-4efc-acf8-d2b420c139ad service nova] Lock "042f0031-1e4d-41d0-8bfa-36001675cfe3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:24:13 user nova-compute[72586]: DEBUG nova.compute.manager [req-31198a14-f996-4c86-ade5-b916b48f2f1f req-6c2d9be4-d8b9-4efc-acf8-d2b420c139ad service nova] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] No waiting events found dispatching network-vif-plugged-fb56dcd2-b1ea-4992-a896-22f65127a96c {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:24:13 user nova-compute[72586]: WARNING nova.compute.manager [req-31198a14-f996-4c86-ade5-b916b48f2f1f req-6c2d9be4-d8b9-4efc-acf8-d2b420c139ad service nova] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Received unexpected event network-vif-plugged-fb56dcd2-b1ea-4992-a896-22f65127a96c for instance with vm_state active and task_state rescuing.
Aug 01 21:24:14 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:14 user nova-compute[72586]: DEBUG nova.compute.manager [req-d309a4d1-62e6-466a-acd1-2bb53c443c48 req-59fdcbf0-2f40-431c-a176-ed873fe3094f service nova] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Received event network-vif-plugged-8994785a-c6c5-4bb6-9709-4c1f802e47d6 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:24:14 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d309a4d1-62e6-466a-acd1-2bb53c443c48 req-59fdcbf0-2f40-431c-a176-ed873fe3094f service nova] Acquiring lock "644c949c-3ac3-46ec-a62f-b38224f0a85c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:24:14 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d309a4d1-62e6-466a-acd1-2bb53c443c48 req-59fdcbf0-2f40-431c-a176-ed873fe3094f service nova] Lock "644c949c-3ac3-46ec-a62f-b38224f0a85c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:24:14 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d309a4d1-62e6-466a-acd1-2bb53c443c48 req-59fdcbf0-2f40-431c-a176-ed873fe3094f service nova] Lock "644c949c-3ac3-46ec-a62f-b38224f0a85c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:24:14 user nova-compute[72586]: DEBUG nova.compute.manager [req-d309a4d1-62e6-466a-acd1-2bb53c443c48 req-59fdcbf0-2f40-431c-a176-ed873fe3094f service nova] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] No waiting events found dispatching network-vif-plugged-8994785a-c6c5-4bb6-9709-4c1f802e47d6 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:24:14 user nova-compute[72586]: WARNING nova.compute.manager [req-d309a4d1-62e6-466a-acd1-2bb53c443c48 req-59fdcbf0-2f40-431c-a176-ed873fe3094f service nova] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Received unexpected event network-vif-plugged-8994785a-c6c5-4bb6-9709-4c1f802e47d6 for instance with vm_state active and task_state rebuild_spawning.
Aug 01 21:24:14 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:14 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:14 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:14 user nova-compute[72586]: DEBUG nova.compute.manager [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Instance event wait completed in 0 seconds for  {{(pid=72586) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 21:24:14 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Guest created on hypervisor {{(pid=72586) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 21:24:14 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925054.5385137, 644c949c-3ac3-46ec-a62f-b38224f0a85c => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:24:14 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] VM Resumed (Lifecycle Event)
Aug 01 21:24:14 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Instance spawned successfully.
Aug 01 21:24:14 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 21:24:14 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:24:14 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:24:14 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Found default for hw_cdrom_bus of ide {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:24:14 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Found default for hw_disk_bus of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:24:14 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Found default for hw_input_bus of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:24:14 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Found default for hw_pointer_model of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:24:14 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Found default for hw_video_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:24:14 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Found default for hw_vif_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:24:14 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 01 21:24:14 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925054.5423887, 644c949c-3ac3-46ec-a62f-b38224f0a85c => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:24:14 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] VM Started (Lifecycle Event)
Aug 01 21:24:14 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:24:14 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:14 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:24:14 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 01 21:24:14 user nova-compute[72586]: DEBUG nova.compute.manager [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:24:14 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:24:14 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:24:14 user nova-compute[72586]: DEBUG nova.objects.instance [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72586) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Aug 01 21:24:15 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c46e68fb-181b-4f20-8755-6f2c8b15a45b tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.147s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:24:15 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:15 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:15 user nova-compute[72586]: DEBUG nova.compute.manager [req-ac8a0ef8-3dd6-4c06-83f6-5077386956df req-73ffb18d-5c71-402f-b93f-749cb6db4f3d service nova] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Received event network-vif-plugged-fb56dcd2-b1ea-4992-a896-22f65127a96c {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:24:15 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ac8a0ef8-3dd6-4c06-83f6-5077386956df req-73ffb18d-5c71-402f-b93f-749cb6db4f3d service nova] Acquiring lock "042f0031-1e4d-41d0-8bfa-36001675cfe3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:24:15 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ac8a0ef8-3dd6-4c06-83f6-5077386956df req-73ffb18d-5c71-402f-b93f-749cb6db4f3d service nova] Lock "042f0031-1e4d-41d0-8bfa-36001675cfe3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:24:15 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ac8a0ef8-3dd6-4c06-83f6-5077386956df req-73ffb18d-5c71-402f-b93f-749cb6db4f3d service nova] Lock "042f0031-1e4d-41d0-8bfa-36001675cfe3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:24:15 user nova-compute[72586]: DEBUG nova.compute.manager [req-ac8a0ef8-3dd6-4c06-83f6-5077386956df req-73ffb18d-5c71-402f-b93f-749cb6db4f3d service nova] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] No waiting events found dispatching network-vif-plugged-fb56dcd2-b1ea-4992-a896-22f65127a96c {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:24:15 user nova-compute[72586]: WARNING nova.compute.manager [req-ac8a0ef8-3dd6-4c06-83f6-5077386956df req-73ffb18d-5c71-402f-b93f-749cb6db4f3d service nova] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Received unexpected event network-vif-plugged-fb56dcd2-b1ea-4992-a896-22f65127a96c for instance with vm_state active and task_state rescuing.
Aug 01 21:24:15 user nova-compute[72586]: DEBUG nova.compute.manager [req-ac8a0ef8-3dd6-4c06-83f6-5077386956df req-73ffb18d-5c71-402f-b93f-749cb6db4f3d service nova] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Received event network-vif-plugged-fb56dcd2-b1ea-4992-a896-22f65127a96c {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:24:15 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ac8a0ef8-3dd6-4c06-83f6-5077386956df req-73ffb18d-5c71-402f-b93f-749cb6db4f3d service nova] Acquiring lock "042f0031-1e4d-41d0-8bfa-36001675cfe3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:24:15 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ac8a0ef8-3dd6-4c06-83f6-5077386956df req-73ffb18d-5c71-402f-b93f-749cb6db4f3d service nova] Lock "042f0031-1e4d-41d0-8bfa-36001675cfe3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:24:15 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ac8a0ef8-3dd6-4c06-83f6-5077386956df req-73ffb18d-5c71-402f-b93f-749cb6db4f3d service nova] Lock "042f0031-1e4d-41d0-8bfa-36001675cfe3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:24:15 user nova-compute[72586]: DEBUG nova.compute.manager [req-ac8a0ef8-3dd6-4c06-83f6-5077386956df req-73ffb18d-5c71-402f-b93f-749cb6db4f3d service nova] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] No waiting events found dispatching network-vif-plugged-fb56dcd2-b1ea-4992-a896-22f65127a96c {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:24:15 user nova-compute[72586]: WARNING nova.compute.manager [req-ac8a0ef8-3dd6-4c06-83f6-5077386956df req-73ffb18d-5c71-402f-b93f-749cb6db4f3d service nova] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Received unexpected event network-vif-plugged-fb56dcd2-b1ea-4992-a896-22f65127a96c for instance with vm_state active and task_state rescuing.
Aug 01 21:24:16 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Removed pending event for 042f0031-1e4d-41d0-8bfa-36001675cfe3 due to event {{(pid=72586) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 21:24:16 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925056.8995085, 042f0031-1e4d-41d0-8bfa-36001675cfe3 => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:24:16 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] VM Resumed (Lifecycle Event)
Aug 01 21:24:16 user nova-compute[72586]: DEBUG nova.compute.manager [None req-c7d6c03f-0d4c-4f01-9d03-4a47705cfe54 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:24:16 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:24:16 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:24:16 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 01 21:24:16 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925056.904019, 042f0031-1e4d-41d0-8bfa-36001675cfe3 => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:24:16 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] VM Started (Lifecycle Event)
Aug 01 21:24:17 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:24:17 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:24:17 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:18 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:24:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:19 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:24:19 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:24:20 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:21 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:21 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:21 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:24:21 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Starting heal instance info cache {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 21:24:21 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Rebuilding the list of instances to heal {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 21:24:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "refresh_cache-042f0031-1e4d-41d0-8bfa-36001675cfe3" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:24:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquired lock "refresh_cache-042f0031-1e4d-41d0-8bfa-36001675cfe3" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:24:22 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Forcefully refreshing network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 21:24:22 user nova-compute[72586]: DEBUG nova.objects.instance [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lazy-loading 'info_cache' on Instance uuid 042f0031-1e4d-41d0-8bfa-36001675cfe3 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:24:22 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Updating instance_info_cache with network_info: [{"id": "fb56dcd2-b1ea-4992-a896-22f65127a96c", "address": "fa:16:3e:8e:7c:d3", "network": {"id": "d229a8de-7a2b-4dcd-a9ac-44a40349676e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-67691992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b1a1d82f39347119a9fb49fb8e8893f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb56dcd2-b1", "ovs_interfaceid": "fb56dcd2-b1ea-4992-a896-22f65127a96c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:24:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Releasing lock "refresh_cache-042f0031-1e4d-41d0-8bfa-36001675cfe3" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:24:22 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Updated the network info_cache for instance {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 21:24:22 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:24:22 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72586) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 21:24:22 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:24:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:24:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:24:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:24:22 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Auditing locally available compute resources for user (node: user) {{(pid=72586) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 21:24:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk.rescue --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:24:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:24:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk.rescue --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:24:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk.rescue --force-share --output=json" returned: 0 in 0.158s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:24:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:24:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:24:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:24:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:24:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe2afa2-730a-4c17-adb6-f6b875aba3b6/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:24:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe2afa2-730a-4c17-adb6-f6b875aba3b6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:24:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe2afa2-730a-4c17-adb6-f6b875aba3b6/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:24:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe2afa2-730a-4c17-adb6-f6b875aba3b6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:24:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eccf50b0-9acc-49b6-8044-601e47d18c38/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:24:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eccf50b0-9acc-49b6-8044-601e47d18c38/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:24:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eccf50b0-9acc-49b6-8044-601e47d18c38/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:24:24 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eccf50b0-9acc-49b6-8044-601e47d18c38/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:24:24 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:24:24 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:24:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3830c8b3-27b8-45f3-bbdb-8a081dfcadc4/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:24:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3830c8b3-27b8-45f3-bbdb-8a081dfcadc4/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:24:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3830c8b3-27b8-45f3-bbdb-8a081dfcadc4/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:24:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3830c8b3-27b8-45f3-bbdb-8a081dfcadc4/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:24:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:24:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:24:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:24:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:24:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fde640d-b731-405d-af91-fb4ef85fe90a/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:24:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fde640d-b731-405d-af91-fb4ef85fe90a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:24:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fde640d-b731-405d-af91-fb4ef85fe90a/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:24:25 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fde640d-b731-405d-af91-fb4ef85fe90a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:24:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.rescue --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:24:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:24:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.rescue --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:24:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Acquiring lock "d51eb56c-bce2-4593-abc3-878c358c9a74" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:24:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Lock "d51eb56c-bce2-4593-abc3-878c358c9a74" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:24:25 user nova-compute[72586]: DEBUG nova.compute.manager [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Starting instance... {{(pid=72586) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 21:24:25 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:24:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:24:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:24:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:24:25 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72586) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 21:24:25 user nova-compute[72586]: INFO nova.compute.claims [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Claim successful on node user
Aug 01 21:24:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:24:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:24:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:24:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:24:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a/disk --force-share --output=json" returned: 0 in 0.362s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:24:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:24:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:24:26 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:24:26 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:24:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.277s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:24:26 user nova-compute[72586]: DEBUG nova.compute.manager [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Start building networks asynchronously for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 21:24:26 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:24:26 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:24:26 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Hypervisor/Node resource view: name=user free_ram=7556MB free_disk=25.61309814453125GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72586) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 21:24:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:24:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:24:27 user nova-compute[72586]: DEBUG nova.compute.manager [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Allocating IP information in the background. {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 21:24:27 user nova-compute[72586]: DEBUG nova.network.neutron [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] allocate_for_instance() {{(pid=72586) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 21:24:27 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 21:24:27 user nova-compute[72586]: DEBUG nova.compute.manager [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Start building block device mappings for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 21:24:27 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 042f0031-1e4d-41d0-8bfa-36001675cfe3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:24:27 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 413c3426-18ad-4a5c-af04-e0e7fc90f050 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:24:27 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 0fde640d-b731-405d-af91-fb4ef85fe90a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:24:27 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:24:27 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 644c949c-3ac3-46ec-a62f-b38224f0a85c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:24:27 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 8fe2afa2-730a-4c17-adb6-f6b875aba3b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:24:27 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:24:27 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 49c24c77-f102-4aed-8314-b04aad5f6b3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:24:27 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance eccf50b0-9acc-49b6-8044-601e47d18c38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:24:27 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance d51eb56c-bce2-4593-abc3-878c358c9a74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:24:27 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 21:24:27 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 21:24:27 user nova-compute[72586]: DEBUG nova.compute.manager [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Start spawning the instance on the hypervisor. {{(pid=72586) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 21:24:27 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Creating instance directory {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 21:24:27 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Creating image(s)
Aug 01 21:24:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Acquiring lock "/opt/stack/data/nova/instances/d51eb56c-bce2-4593-abc3-878c358c9a74/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:24:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Lock "/opt/stack/data/nova/instances/d51eb56c-bce2-4593-abc3-878c358c9a74/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:24:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Lock "/opt/stack/data/nova/instances/d51eb56c-bce2-4593-abc3-878c358c9a74/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:24:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:24:27 user nova-compute[72586]: DEBUG nova.policy [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd22bbcdb21c5414b805fadba9cd1ce70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f911c1cbc98a4d93b73090da5f655812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72586) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 21:24:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.147s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:24:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Acquiring lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:24:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:24:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:24:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.167s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:24:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/d51eb56c-bce2-4593-abc3-878c358c9a74/disk 1073741824 {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:24:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/d51eb56c-bce2-4593-abc3-878c358c9a74/disk 1073741824" returned: 0 in 0.049s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:24:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:24:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:24:27 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:24:27 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:24:27 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Compute_service record updated for user:user {{(pid=72586) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 21:24:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.770s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:24:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.162s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:24:27 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d51eb56c-bce2-4593-abc3-878c358c9a74/disk. size=1073741824 {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 21:24:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51eb56c-bce2-4593-abc3-878c358c9a74/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:24:27 user nova-compute[72586]: DEBUG nova.network.neutron [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Successfully created port: 0cdd112b-f316-4cf2-b3e5-82897e241453 {{(pid=72586) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 21:24:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51eb56c-bce2-4593-abc3-878c358c9a74/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:24:27 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Cannot resize image /opt/stack/data/nova/instances/d51eb56c-bce2-4593-abc3-878c358c9a74/disk to a smaller size. {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 21:24:27 user nova-compute[72586]: DEBUG nova.objects.instance [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Lazy-loading 'migration_context' on Instance uuid d51eb56c-bce2-4593-abc3-878c358c9a74 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:24:27 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Created local disks {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 21:24:27 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Ensure instance console log exists: /opt/stack/data/nova/instances/d51eb56c-bce2-4593-abc3-878c358c9a74/console.log {{(pid=72586) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 21:24:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:24:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:24:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:24:28 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:28 user nova-compute[72586]: DEBUG nova.network.neutron [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Successfully updated port: 0cdd112b-f316-4cf2-b3e5-82897e241453 {{(pid=72586) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 21:24:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Acquiring lock "refresh_cache-d51eb56c-bce2-4593-abc3-878c358c9a74" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:24:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Acquired lock "refresh_cache-d51eb56c-bce2-4593-abc3-878c358c9a74" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:24:28 user nova-compute[72586]: DEBUG nova.network.neutron [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:24:28 user nova-compute[72586]: DEBUG nova.compute.manager [req-36638a4c-8a80-44ec-b0aa-58078e3243a0 req-8a177e67-acc7-4579-9f0c-30eb8b6c13c2 service nova] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Received event network-changed-0cdd112b-f316-4cf2-b3e5-82897e241453 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:24:28 user nova-compute[72586]: DEBUG nova.compute.manager [req-36638a4c-8a80-44ec-b0aa-58078e3243a0 req-8a177e67-acc7-4579-9f0c-30eb8b6c13c2 service nova] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Refreshing instance network info cache due to event network-changed-0cdd112b-f316-4cf2-b3e5-82897e241453. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:24:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-36638a4c-8a80-44ec-b0aa-58078e3243a0 req-8a177e67-acc7-4579-9f0c-30eb8b6c13c2 service nova] Acquiring lock "refresh_cache-d51eb56c-bce2-4593-abc3-878c358c9a74" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:24:28 user nova-compute[72586]: DEBUG nova.network.neutron [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Instance cache missing network info. {{(pid=72586) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 21:24:28 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:24:28 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:24:28 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:24:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:29 user nova-compute[72586]: DEBUG nova.network.neutron [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Updating instance_info_cache with network_info: [{"id": "0cdd112b-f316-4cf2-b3e5-82897e241453", "address": "fa:16:3e:f2:07:05", "network": {"id": "b40254e1-7668-4ef6-b133-681304d57290", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1667586785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f911c1cbc98a4d93b73090da5f655812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cdd112b-f3", "ovs_interfaceid": "0cdd112b-f316-4cf2-b3e5-82897e241453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:24:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Releasing lock "refresh_cache-d51eb56c-bce2-4593-abc3-878c358c9a74" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:24:29 user nova-compute[72586]: DEBUG nova.compute.manager [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Instance network_info: |[{"id": "0cdd112b-f316-4cf2-b3e5-82897e241453", "address": "fa:16:3e:f2:07:05", "network": {"id": "b40254e1-7668-4ef6-b133-681304d57290", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1667586785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f911c1cbc98a4d93b73090da5f655812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cdd112b-f3", "ovs_interfaceid": "0cdd112b-f316-4cf2-b3e5-82897e241453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 21:24:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-36638a4c-8a80-44ec-b0aa-58078e3243a0 req-8a177e67-acc7-4579-9f0c-30eb8b6c13c2 service nova] Acquired lock "refresh_cache-d51eb56c-bce2-4593-abc3-878c358c9a74" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:24:29 user nova-compute[72586]: DEBUG nova.network.neutron [req-36638a4c-8a80-44ec-b0aa-58078e3243a0 req-8a177e67-acc7-4579-9f0c-30eb8b6c13c2 service nova] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Refreshing network info cache for port 0cdd112b-f316-4cf2-b3e5-82897e241453 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:24:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Start _get_guest_xml network_info=[{"id": "0cdd112b-f316-4cf2-b3e5-82897e241453", "address": "fa:16:3e:f2:07:05", "network": {"id": "b40254e1-7668-4ef6-b133-681304d57290", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1667586785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f911c1cbc98a4d93b73090da5f655812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cdd112b-f3", "ovs_interfaceid": "0cdd112b-f316-4cf2-b3e5-82897e241453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '0243d46b-6819-42a5-926f-42b71f0c97ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:24:29 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:24:29 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:24:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:24:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:24:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:24:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:24:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:24:29 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:24:29 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:24:29 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:24:29 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:24:29 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:24:29 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:24:29 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:24:29 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:24:29 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:24:29 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:24:29 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:24:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:24:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2052800267',display_name='tempest-ServerStableDeviceRescueTest-server-2052800267',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2052800267',id=16,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOAvh66e+pEUdqXK4j6Bev4qsj5Kw07j5qNS+OqbzC0rxd8JE0DAFrfEkFQTMqQTO8zjMSitipbfpifLdeH7ftdHAX9wDP0Yye10y43OrSHeNISMfjmF8SQTQ58PdQpW2A==',key_name='tempest-keypair-2114790470',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f911c1cbc98a4d93b73090da5f655812',ramdisk_id='',reservation_id='r-ls9h6vet',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1118462212',owner_user_name='tempest-ServerStableDeviceRescueTest-1118462212-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:24:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d22bbcdb21c5414b805fadba9cd1ce70',uuid=d51eb56c-bce2-4593-abc3-878c358c9a74,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0cdd112b-f316-4cf2-b3e5-82897e241453", "address": "fa:16:3e:f2:07:05", "network": {"id": "b40254e1-7668-4ef6-b133-681304d57290", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1667586785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f911c1cbc98a4d93b73090da5f655812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cdd112b-f3", "ovs_interfaceid": "0cdd112b-f316-4cf2-b3e5-82897e241453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:24:29 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Converting VIF {"id": "0cdd112b-f316-4cf2-b3e5-82897e241453", "address": "fa:16:3e:f2:07:05", "network": {"id": "b40254e1-7668-4ef6-b133-681304d57290", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1667586785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f911c1cbc98a4d93b73090da5f655812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cdd112b-f3", "ovs_interfaceid": "0cdd112b-f316-4cf2-b3e5-82897e241453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:24:29 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:07:05,bridge_name='br-int',has_traffic_filtering=True,id=0cdd112b-f316-4cf2-b3e5-82897e241453,network=Network(b40254e1-7668-4ef6-b133-681304d57290),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cdd112b-f3') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:24:29 user nova-compute[72586]: DEBUG nova.objects.instance [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Lazy-loading 'pci_devices' on Instance uuid d51eb56c-bce2-4593-abc3-878c358c9a74 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:24:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:24:29 user nova-compute[72586]:   <uuid>d51eb56c-bce2-4593-abc3-878c358c9a74</uuid>
Aug 01 21:24:29 user nova-compute[72586]:   <name>instance-00000010</name>
Aug 01 21:24:29 user nova-compute[72586]:   <memory>524288</memory>
Aug 01 21:24:29 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:24:29 user nova-compute[72586]:   <metadata>
Aug 01 21:24:29 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:24:29 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:24:29 user nova-compute[72586]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-2052800267</nova:name>
Aug 01 21:24:29 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:24:29</nova:creationTime>
Aug 01 21:24:29 user nova-compute[72586]:       <nova:flavor name="m1.tiny">
Aug 01 21:24:29 user nova-compute[72586]:         <nova:memory>512</nova:memory>
Aug 01 21:24:29 user nova-compute[72586]:         <nova:disk>1</nova:disk>
Aug 01 21:24:29 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:24:29 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:24:29 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:24:29 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:24:29 user nova-compute[72586]:       <nova:owner>
Aug 01 21:24:29 user nova-compute[72586]:         <nova:user uuid="d22bbcdb21c5414b805fadba9cd1ce70">tempest-ServerStableDeviceRescueTest-1118462212-project-member</nova:user>
Aug 01 21:24:29 user nova-compute[72586]:         <nova:project uuid="f911c1cbc98a4d93b73090da5f655812">tempest-ServerStableDeviceRescueTest-1118462212</nova:project>
Aug 01 21:24:29 user nova-compute[72586]:       </nova:owner>
Aug 01 21:24:29 user nova-compute[72586]:       <nova:root type="image" uuid="0243d46b-6819-42a5-926f-42b71f0c97ad"/>
Aug 01 21:24:29 user nova-compute[72586]:       <nova:ports>
Aug 01 21:24:29 user nova-compute[72586]:         <nova:port uuid="0cdd112b-f316-4cf2-b3e5-82897e241453">
Aug 01 21:24:29 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 01 21:24:29 user nova-compute[72586]:         </nova:port>
Aug 01 21:24:29 user nova-compute[72586]:       </nova:ports>
Aug 01 21:24:29 user nova-compute[72586]:     </nova:instance>
Aug 01 21:24:29 user nova-compute[72586]:   </metadata>
Aug 01 21:24:29 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:24:29 user nova-compute[72586]:     <system>
Aug 01 21:24:29 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:24:29 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:24:29 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:24:29 user nova-compute[72586]:       <entry name="serial">d51eb56c-bce2-4593-abc3-878c358c9a74</entry>
Aug 01 21:24:29 user nova-compute[72586]:       <entry name="uuid">d51eb56c-bce2-4593-abc3-878c358c9a74</entry>
Aug 01 21:24:29 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:24:29 user nova-compute[72586]:     </system>
Aug 01 21:24:29 user nova-compute[72586]:   </sysinfo>
Aug 01 21:24:29 user nova-compute[72586]:   <os>
Aug 01 21:24:29 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:24:29 user nova-compute[72586]:     <boot dev="hd"/>
Aug 01 21:24:29 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:24:29 user nova-compute[72586]:   </os>
Aug 01 21:24:29 user nova-compute[72586]:   <features>
Aug 01 21:24:29 user nova-compute[72586]:     <acpi/>
Aug 01 21:24:29 user nova-compute[72586]:     <apic/>
Aug 01 21:24:29 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:24:29 user nova-compute[72586]:   </features>
Aug 01 21:24:29 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:24:29 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:24:29 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:24:29 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:24:29 user nova-compute[72586]:   </clock>
Aug 01 21:24:29 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:24:29 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:24:29 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:24:29 user nova-compute[72586]:   </cpu>
Aug 01 21:24:29 user nova-compute[72586]:   <devices>
Aug 01 21:24:29 user nova-compute[72586]:     <disk type="file" device="disk">
Aug 01 21:24:29 user nova-compute[72586]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 21:24:29 user nova-compute[72586]:       <source file="/opt/stack/data/nova/instances/d51eb56c-bce2-4593-abc3-878c358c9a74/disk"/>
Aug 01 21:24:29 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:24:29 user nova-compute[72586]:     </disk>
Aug 01 21:24:29 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:24:29 user nova-compute[72586]:       <mac address="fa:16:3e:f2:07:05"/>
Aug 01 21:24:29 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:24:29 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:24:29 user nova-compute[72586]:       <target dev="tap0cdd112b-f3"/>
Aug 01 21:24:29 user nova-compute[72586]:     </interface>
Aug 01 21:24:29 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:24:29 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/d51eb56c-bce2-4593-abc3-878c358c9a74/console.log" append="off"/>
Aug 01 21:24:29 user nova-compute[72586]:     </serial>
Aug 01 21:24:29 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:24:29 user nova-compute[72586]:     <video>
Aug 01 21:24:29 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:24:29 user nova-compute[72586]:     </video>
Aug 01 21:24:29 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:24:29 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:24:29 user nova-compute[72586]:     </rng>
Aug 01 21:24:29 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:24:29 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:24:29 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:24:29 user nova-compute[72586]:     </memballoon>
Aug 01 21:24:29 user nova-compute[72586]:   </devices>
Aug 01 21:24:29 user nova-compute[72586]: </domain>
Aug 01 21:24:29 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:24:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:24:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2052800267',display_name='tempest-ServerStableDeviceRescueTest-server-2052800267',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2052800267',id=16,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOAvh66e+pEUdqXK4j6Bev4qsj5Kw07j5qNS+OqbzC0rxd8JE0DAFrfEkFQTMqQTO8zjMSitipbfpifLdeH7ftdHAX9wDP0Yye10y43OrSHeNISMfjmF8SQTQ58PdQpW2A==',key_name='tempest-keypair-2114790470',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f911c1cbc98a4d93b73090da5f655812',ramdisk_id='',reservation_id='r-ls9h6vet',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1118462212',owner_user_name='tempest-ServerStableDeviceRescueTest-1118462212-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:24:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d22bbcdb21c5414b805fadba9cd1ce70',uuid=d51eb56c-bce2-4593-abc3-878c358c9a74,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0cdd112b-f316-4cf2-b3e5-82897e241453", "address": "fa:16:3e:f2:07:05", "network": {"id": "b40254e1-7668-4ef6-b133-681304d57290", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1667586785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f911c1cbc98a4d93b73090da5f655812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cdd112b-f3", "ovs_interfaceid": "0cdd112b-f316-4cf2-b3e5-82897e241453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:24:29 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Converting VIF {"id": "0cdd112b-f316-4cf2-b3e5-82897e241453", "address": "fa:16:3e:f2:07:05", "network": {"id": "b40254e1-7668-4ef6-b133-681304d57290", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1667586785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f911c1cbc98a4d93b73090da5f655812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cdd112b-f3", "ovs_interfaceid": "0cdd112b-f316-4cf2-b3e5-82897e241453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:24:29 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:07:05,bridge_name='br-int',has_traffic_filtering=True,id=0cdd112b-f316-4cf2-b3e5-82897e241453,network=Network(b40254e1-7668-4ef6-b133-681304d57290),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cdd112b-f3') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:24:29 user nova-compute[72586]: DEBUG os_vif [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:07:05,bridge_name='br-int',has_traffic_filtering=True,id=0cdd112b-f316-4cf2-b3e5-82897e241453,network=Network(b40254e1-7668-4ef6-b133-681304d57290),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cdd112b-f3') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:24:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:24:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:24:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0cdd112b-f3, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:24:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0cdd112b-f3, col_values=(('external_ids', {'iface-id': '0cdd112b-f316-4cf2-b3e5-82897e241453', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:07:05', 'vm-uuid': 'd51eb56c-bce2-4593-abc3-878c358c9a74'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:24:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:24:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:29 user nova-compute[72586]: INFO os_vif [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:07:05,bridge_name='br-int',has_traffic_filtering=True,id=0cdd112b-f316-4cf2-b3e5-82897e241453,network=Network(b40254e1-7668-4ef6-b133-681304d57290),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cdd112b-f3')
Aug 01 21:24:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:24:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] No VIF found with MAC fa:16:3e:f2:07:05, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:24:29 user nova-compute[72586]: DEBUG nova.network.neutron [req-36638a4c-8a80-44ec-b0aa-58078e3243a0 req-8a177e67-acc7-4579-9f0c-30eb8b6c13c2 service nova] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Updated VIF entry in instance network info cache for port 0cdd112b-f316-4cf2-b3e5-82897e241453. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:24:29 user nova-compute[72586]: DEBUG nova.network.neutron [req-36638a4c-8a80-44ec-b0aa-58078e3243a0 req-8a177e67-acc7-4579-9f0c-30eb8b6c13c2 service nova] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Updating instance_info_cache with network_info: [{"id": "0cdd112b-f316-4cf2-b3e5-82897e241453", "address": "fa:16:3e:f2:07:05", "network": {"id": "b40254e1-7668-4ef6-b133-681304d57290", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1667586785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f911c1cbc98a4d93b73090da5f655812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cdd112b-f3", "ovs_interfaceid": "0cdd112b-f316-4cf2-b3e5-82897e241453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:24:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-36638a4c-8a80-44ec-b0aa-58078e3243a0 req-8a177e67-acc7-4579-9f0c-30eb8b6c13c2 service nova] Releasing lock "refresh_cache-d51eb56c-bce2-4593-abc3-878c358c9a74" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:24:30 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:30 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:30 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:30 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:31 user nova-compute[72586]: DEBUG nova.compute.manager [req-f24c3844-c09b-456c-a46b-aeefffa43ecb req-514173a2-dd8b-43c9-966f-910922f742a6 service nova] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Received event network-vif-plugged-0cdd112b-f316-4cf2-b3e5-82897e241453 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:24:31 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-f24c3844-c09b-456c-a46b-aeefffa43ecb req-514173a2-dd8b-43c9-966f-910922f742a6 service nova] Acquiring lock "d51eb56c-bce2-4593-abc3-878c358c9a74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:24:31 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-f24c3844-c09b-456c-a46b-aeefffa43ecb req-514173a2-dd8b-43c9-966f-910922f742a6 service nova] Lock "d51eb56c-bce2-4593-abc3-878c358c9a74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:24:31 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-f24c3844-c09b-456c-a46b-aeefffa43ecb req-514173a2-dd8b-43c9-966f-910922f742a6 service nova] Lock "d51eb56c-bce2-4593-abc3-878c358c9a74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:24:31 user nova-compute[72586]: DEBUG nova.compute.manager [req-f24c3844-c09b-456c-a46b-aeefffa43ecb req-514173a2-dd8b-43c9-966f-910922f742a6 service nova] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] No waiting events found dispatching network-vif-plugged-0cdd112b-f316-4cf2-b3e5-82897e241453 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:24:31 user nova-compute[72586]: WARNING nova.compute.manager [req-f24c3844-c09b-456c-a46b-aeefffa43ecb req-514173a2-dd8b-43c9-966f-910922f742a6 service nova] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Received unexpected event network-vif-plugged-0cdd112b-f316-4cf2-b3e5-82897e241453 for instance with vm_state building and task_state spawning.
Aug 01 21:24:31 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:31 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:31 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:31 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:33 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925073.4534214, d51eb56c-bce2-4593-abc3-878c358c9a74 => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:24:33 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] VM Resumed (Lifecycle Event)
Aug 01 21:24:33 user nova-compute[72586]: DEBUG nova.compute.manager [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Instance event wait completed in 0 seconds for  {{(pid=72586) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 21:24:33 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Guest created on hypervisor {{(pid=72586) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 21:24:33 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Instance spawned successfully.
Aug 01 21:24:33 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 21:24:33 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:24:33 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:24:33 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Found default for hw_cdrom_bus of ide {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:24:33 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Found default for hw_disk_bus of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:24:33 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Found default for hw_input_bus of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:24:33 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Found default for hw_pointer_model of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:24:33 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Found default for hw_video_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:24:33 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Found default for hw_vif_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:24:33 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:24:33 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925073.4536655, d51eb56c-bce2-4593-abc3-878c358c9a74 => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:24:33 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] VM Started (Lifecycle Event)
Aug 01 21:24:33 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:24:33 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:24:33 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:24:33 user nova-compute[72586]: DEBUG nova.compute.manager [req-801019d7-0101-49ed-adff-c1d5de386ba3 req-8516cd90-d410-4deb-9dd9-16efca01a2fc service nova] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Received event network-vif-plugged-0cdd112b-f316-4cf2-b3e5-82897e241453 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:24:33 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-801019d7-0101-49ed-adff-c1d5de386ba3 req-8516cd90-d410-4deb-9dd9-16efca01a2fc service nova] Acquiring lock "d51eb56c-bce2-4593-abc3-878c358c9a74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:24:33 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-801019d7-0101-49ed-adff-c1d5de386ba3 req-8516cd90-d410-4deb-9dd9-16efca01a2fc service nova] Lock "d51eb56c-bce2-4593-abc3-878c358c9a74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:24:33 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-801019d7-0101-49ed-adff-c1d5de386ba3 req-8516cd90-d410-4deb-9dd9-16efca01a2fc service nova] Lock "d51eb56c-bce2-4593-abc3-878c358c9a74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:24:33 user nova-compute[72586]: DEBUG nova.compute.manager [req-801019d7-0101-49ed-adff-c1d5de386ba3 req-8516cd90-d410-4deb-9dd9-16efca01a2fc service nova] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] No waiting events found dispatching network-vif-plugged-0cdd112b-f316-4cf2-b3e5-82897e241453 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:24:33 user nova-compute[72586]: WARNING nova.compute.manager [req-801019d7-0101-49ed-adff-c1d5de386ba3 req-8516cd90-d410-4deb-9dd9-16efca01a2fc service nova] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Received unexpected event network-vif-plugged-0cdd112b-f316-4cf2-b3e5-82897e241453 for instance with vm_state building and task_state spawning.
Aug 01 21:24:33 user nova-compute[72586]: INFO nova.compute.manager [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Took 6.50 seconds to spawn the instance on the hypervisor.
Aug 01 21:24:33 user nova-compute[72586]: DEBUG nova.compute.manager [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:24:33 user nova-compute[72586]: INFO nova.compute.manager [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Took 8.28 seconds to build instance.
Aug 01 21:24:33 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-df5b1df4-bd29-4c56-ba90-c99bb4e9b6c0 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Lock "d51eb56c-bce2-4593-abc3-878c358c9a74" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.443s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:24:34 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:34 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Acquiring lock "c3798403-855b-45e4-af48-ba6b62570dba" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:24:34 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Lock "c3798403-855b-45e4-af48-ba6b62570dba" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:24:34 user nova-compute[72586]: DEBUG nova.compute.manager [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Starting instance... {{(pid=72586) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 21:24:34 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:34 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:24:34 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:24:34 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72586) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 21:24:34 user nova-compute[72586]: INFO nova.compute.claims [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Claim successful on node user
Aug 01 21:24:34 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:24:34 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:24:34 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.553s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:24:34 user nova-compute[72586]: DEBUG nova.compute.manager [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Start building networks asynchronously for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 21:24:35 user nova-compute[72586]: DEBUG nova.compute.manager [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Allocating IP information in the background. {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 21:24:35 user nova-compute[72586]: DEBUG nova.network.neutron [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] allocate_for_instance() {{(pid=72586) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 21:24:35 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 21:24:35 user nova-compute[72586]: DEBUG nova.compute.manager [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Start building block device mappings for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 21:24:35 user nova-compute[72586]: DEBUG nova.policy [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '353f3e5b8859476b8213462a8a3d00b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c49158afdb04ea48c05f32782106197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72586) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 21:24:35 user nova-compute[72586]: DEBUG nova.compute.manager [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Start spawning the instance on the hypervisor. {{(pid=72586) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 21:24:35 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Creating instance directory {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 21:24:35 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Creating image(s)
Aug 01 21:24:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Acquiring lock "/opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:24:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Lock "/opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:24:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Lock "/opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:24:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:24:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.150s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:24:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Acquiring lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:24:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:24:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:24:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.180s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:24:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba/disk 1073741824 {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:24:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba/disk 1073741824" returned: 0 in 0.149s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:24:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.336s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:24:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:24:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.175s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:24:35 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba/disk. size=1073741824 {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 21:24:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:24:35 user nova-compute[72586]: DEBUG nova.network.neutron [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Successfully created port: 68b636e3-234f-49e5-b0fb-9f99fffab5c5 {{(pid=72586) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 21:24:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:24:36 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Cannot resize image /opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba/disk to a smaller size. {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 21:24:36 user nova-compute[72586]: DEBUG nova.objects.instance [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Lazy-loading 'migration_context' on Instance uuid c3798403-855b-45e4-af48-ba6b62570dba {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:24:36 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Created local disks {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 21:24:36 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Ensure instance console log exists: /opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba/console.log {{(pid=72586) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 21:24:36 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:24:36 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:24:36 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:24:36 user nova-compute[72586]: DEBUG nova.network.neutron [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Successfully updated port: 68b636e3-234f-49e5-b0fb-9f99fffab5c5 {{(pid=72586) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 21:24:36 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Acquiring lock "refresh_cache-c3798403-855b-45e4-af48-ba6b62570dba" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:24:36 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Acquired lock "refresh_cache-c3798403-855b-45e4-af48-ba6b62570dba" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:24:36 user nova-compute[72586]: DEBUG nova.network.neutron [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:24:36 user nova-compute[72586]: DEBUG nova.network.neutron [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Instance cache missing network info. {{(pid=72586) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 21:24:36 user nova-compute[72586]: DEBUG nova.compute.manager [req-c59edec7-66ea-484c-84c1-bc1d9697faa7 req-356b8ceb-6d00-45d6-a68f-d66c2984a9c5 service nova] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Received event network-changed-68b636e3-234f-49e5-b0fb-9f99fffab5c5 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:24:36 user nova-compute[72586]: DEBUG nova.compute.manager [req-c59edec7-66ea-484c-84c1-bc1d9697faa7 req-356b8ceb-6d00-45d6-a68f-d66c2984a9c5 service nova] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Refreshing instance network info cache due to event network-changed-68b636e3-234f-49e5-b0fb-9f99fffab5c5. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:24:36 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-c59edec7-66ea-484c-84c1-bc1d9697faa7 req-356b8ceb-6d00-45d6-a68f-d66c2984a9c5 service nova] Acquiring lock "refresh_cache-c3798403-855b-45e4-af48-ba6b62570dba" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:24:37 user nova-compute[72586]: DEBUG nova.network.neutron [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Updating instance_info_cache with network_info: [{"id": "68b636e3-234f-49e5-b0fb-9f99fffab5c5", "address": "fa:16:3e:a4:40:ed", "network": {"id": "42af123b-86fc-427d-b74a-a2e30c38720c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1787263710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c49158afdb04ea48c05f32782106197", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b636e3-23", "ovs_interfaceid": "68b636e3-234f-49e5-b0fb-9f99fffab5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:24:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Releasing lock "refresh_cache-c3798403-855b-45e4-af48-ba6b62570dba" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:24:37 user nova-compute[72586]: DEBUG nova.compute.manager [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Instance network_info: |[{"id": "68b636e3-234f-49e5-b0fb-9f99fffab5c5", "address": "fa:16:3e:a4:40:ed", "network": {"id": "42af123b-86fc-427d-b74a-a2e30c38720c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1787263710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c49158afdb04ea48c05f32782106197", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b636e3-23", "ovs_interfaceid": "68b636e3-234f-49e5-b0fb-9f99fffab5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 21:24:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-c59edec7-66ea-484c-84c1-bc1d9697faa7 req-356b8ceb-6d00-45d6-a68f-d66c2984a9c5 service nova] Acquired lock "refresh_cache-c3798403-855b-45e4-af48-ba6b62570dba" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:24:37 user nova-compute[72586]: DEBUG nova.network.neutron [req-c59edec7-66ea-484c-84c1-bc1d9697faa7 req-356b8ceb-6d00-45d6-a68f-d66c2984a9c5 service nova] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Refreshing network info cache for port 68b636e3-234f-49e5-b0fb-9f99fffab5c5 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:24:37 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Start _get_guest_xml network_info=[{"id": "68b636e3-234f-49e5-b0fb-9f99fffab5c5", "address": "fa:16:3e:a4:40:ed", "network": {"id": "42af123b-86fc-427d-b74a-a2e30c38720c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1787263710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c49158afdb04ea48c05f32782106197", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b636e3-23", "ovs_interfaceid": "68b636e3-234f-49e5-b0fb-9f99fffab5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '0243d46b-6819-42a5-926f-42b71f0c97ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:24:37 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:24:37 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:24:37 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:24:37 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:24:37 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:24:37 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:24:37 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:24:37 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:24:37 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:24:37 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:24:37 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:24:37 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:24:37 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:24:37 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:24:37 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:24:37 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:24:37 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:24:37 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:24:37 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:24:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-124717694',display_name='tempest-ServerActionsTestOtherB-server-124717694',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-124717694',id=17,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgvcOBvmaWJhEwOkJkVCtNJ+42NFJ7Wme/nrROdsaAYDVV1668xM0wdadU29PtL+UEfr1KV8jRhHGVoqdqnxjGi6czPksct12PqH1D7Zn6OKGhhWdLcIzx9a1L98V8jxQ==',key_name='tempest-keypair-177851533',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c49158afdb04ea48c05f32782106197',ramdisk_id='',reservation_id='r-6rqr0y9w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1788994838',owner_user_name='tempest-ServerActionsTestOtherB-1788994838-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:24:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='353f3e5b8859476b8213462a8a3d00b4',uuid=c3798403-855b-45e4-af48-ba6b62570dba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68b636e3-234f-49e5-b0fb-9f99fffab5c5", "address": "fa:16:3e:a4:40:ed", "network": {"id": "42af123b-86fc-427d-b74a-a2e30c38720c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1787263710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c49158afdb04ea48c05f32782106197", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b636e3-23", "ovs_interfaceid": "68b636e3-234f-49e5-b0fb-9f99fffab5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:24:37 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Converting VIF {"id": "68b636e3-234f-49e5-b0fb-9f99fffab5c5", "address": "fa:16:3e:a4:40:ed", "network": {"id": "42af123b-86fc-427d-b74a-a2e30c38720c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1787263710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c49158afdb04ea48c05f32782106197", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b636e3-23", "ovs_interfaceid": "68b636e3-234f-49e5-b0fb-9f99fffab5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:24:37 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:40:ed,bridge_name='br-int',has_traffic_filtering=True,id=68b636e3-234f-49e5-b0fb-9f99fffab5c5,network=Network(42af123b-86fc-427d-b74a-a2e30c38720c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68b636e3-23') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:24:37 user nova-compute[72586]: DEBUG nova.objects.instance [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Lazy-loading 'pci_devices' on Instance uuid c3798403-855b-45e4-af48-ba6b62570dba {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:24:37 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:24:37 user nova-compute[72586]:   <uuid>c3798403-855b-45e4-af48-ba6b62570dba</uuid>
Aug 01 21:24:37 user nova-compute[72586]:   <name>instance-00000011</name>
Aug 01 21:24:37 user nova-compute[72586]:   <memory>524288</memory>
Aug 01 21:24:37 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:24:37 user nova-compute[72586]:   <metadata>
Aug 01 21:24:37 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:24:37 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:24:37 user nova-compute[72586]:       <nova:name>tempest-ServerActionsTestOtherB-server-124717694</nova:name>
Aug 01 21:24:37 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:24:37</nova:creationTime>
Aug 01 21:24:37 user nova-compute[72586]:       <nova:flavor name="m1.tiny">
Aug 01 21:24:37 user nova-compute[72586]:         <nova:memory>512</nova:memory>
Aug 01 21:24:37 user nova-compute[72586]:         <nova:disk>1</nova:disk>
Aug 01 21:24:37 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:24:37 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:24:37 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:24:37 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:24:37 user nova-compute[72586]:       <nova:owner>
Aug 01 21:24:37 user nova-compute[72586]:         <nova:user uuid="353f3e5b8859476b8213462a8a3d00b4">tempest-ServerActionsTestOtherB-1788994838-project-member</nova:user>
Aug 01 21:24:37 user nova-compute[72586]:         <nova:project uuid="0c49158afdb04ea48c05f32782106197">tempest-ServerActionsTestOtherB-1788994838</nova:project>
Aug 01 21:24:37 user nova-compute[72586]:       </nova:owner>
Aug 01 21:24:37 user nova-compute[72586]:       <nova:root type="image" uuid="0243d46b-6819-42a5-926f-42b71f0c97ad"/>
Aug 01 21:24:37 user nova-compute[72586]:       <nova:ports>
Aug 01 21:24:37 user nova-compute[72586]:         <nova:port uuid="68b636e3-234f-49e5-b0fb-9f99fffab5c5">
Aug 01 21:24:37 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 01 21:24:37 user nova-compute[72586]:         </nova:port>
Aug 01 21:24:37 user nova-compute[72586]:       </nova:ports>
Aug 01 21:24:37 user nova-compute[72586]:     </nova:instance>
Aug 01 21:24:37 user nova-compute[72586]:   </metadata>
Aug 01 21:24:37 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:24:37 user nova-compute[72586]:     <system>
Aug 01 21:24:37 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:24:37 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:24:37 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:24:37 user nova-compute[72586]:       <entry name="serial">c3798403-855b-45e4-af48-ba6b62570dba</entry>
Aug 01 21:24:37 user nova-compute[72586]:       <entry name="uuid">c3798403-855b-45e4-af48-ba6b62570dba</entry>
Aug 01 21:24:37 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:24:37 user nova-compute[72586]:     </system>
Aug 01 21:24:37 user nova-compute[72586]:   </sysinfo>
Aug 01 21:24:37 user nova-compute[72586]:   <os>
Aug 01 21:24:37 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:24:37 user nova-compute[72586]:     <boot dev="hd"/>
Aug 01 21:24:37 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:24:37 user nova-compute[72586]:   </os>
Aug 01 21:24:37 user nova-compute[72586]:   <features>
Aug 01 21:24:37 user nova-compute[72586]:     <acpi/>
Aug 01 21:24:37 user nova-compute[72586]:     <apic/>
Aug 01 21:24:37 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:24:37 user nova-compute[72586]:   </features>
Aug 01 21:24:37 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:24:37 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:24:37 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:24:37 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:24:37 user nova-compute[72586]:   </clock>
Aug 01 21:24:37 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:24:37 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:24:37 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:24:37 user nova-compute[72586]:   </cpu>
Aug 01 21:24:37 user nova-compute[72586]:   <devices>
Aug 01 21:24:37 user nova-compute[72586]:     <disk type="file" device="disk">
Aug 01 21:24:37 user nova-compute[72586]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 21:24:37 user nova-compute[72586]:       <source file="/opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba/disk"/>
Aug 01 21:24:37 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:24:37 user nova-compute[72586]:     </disk>
Aug 01 21:24:37 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:24:37 user nova-compute[72586]:       <mac address="fa:16:3e:a4:40:ed"/>
Aug 01 21:24:37 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:24:37 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:24:37 user nova-compute[72586]:       <target dev="tap68b636e3-23"/>
Aug 01 21:24:37 user nova-compute[72586]:     </interface>
Aug 01 21:24:37 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:24:37 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba/console.log" append="off"/>
Aug 01 21:24:37 user nova-compute[72586]:     </serial>
Aug 01 21:24:37 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:24:37 user nova-compute[72586]:     <video>
Aug 01 21:24:37 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:24:37 user nova-compute[72586]:     </video>
Aug 01 21:24:37 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:24:37 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:24:37 user nova-compute[72586]:     </rng>
Aug 01 21:24:37 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:24:37 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:24:37 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:24:37 user nova-compute[72586]:     </memballoon>
Aug 01 21:24:37 user nova-compute[72586]:   </devices>
Aug 01 21:24:37 user nova-compute[72586]: </domain>
Aug 01 21:24:37 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:24:37 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:24:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-124717694',display_name='tempest-ServerActionsTestOtherB-server-124717694',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-124717694',id=17,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgvcOBvmaWJhEwOkJkVCtNJ+42NFJ7Wme/nrROdsaAYDVV1668xM0wdadU29PtL+UEfr1KV8jRhHGVoqdqnxjGi6czPksct12PqH1D7Zn6OKGhhWdLcIzx9a1L98V8jxQ==',key_name='tempest-keypair-177851533',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c49158afdb04ea48c05f32782106197',ramdisk_id='',reservation_id='r-6rqr0y9w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1788994838',owner_user_name='tempest-ServerActionsTestOtherB-1788994838-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:24:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='353f3e5b8859476b8213462a8a3d00b4',uuid=c3798403-855b-45e4-af48-ba6b62570dba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68b636e3-234f-49e5-b0fb-9f99fffab5c5", "address": "fa:16:3e:a4:40:ed", "network": {"id": "42af123b-86fc-427d-b74a-a2e30c38720c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1787263710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c49158afdb04ea48c05f32782106197", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b636e3-23", "ovs_interfaceid": "68b636e3-234f-49e5-b0fb-9f99fffab5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:24:37 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Converting VIF {"id": "68b636e3-234f-49e5-b0fb-9f99fffab5c5", "address": "fa:16:3e:a4:40:ed", "network": {"id": "42af123b-86fc-427d-b74a-a2e30c38720c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1787263710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c49158afdb04ea48c05f32782106197", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b636e3-23", "ovs_interfaceid": "68b636e3-234f-49e5-b0fb-9f99fffab5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:24:37 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:40:ed,bridge_name='br-int',has_traffic_filtering=True,id=68b636e3-234f-49e5-b0fb-9f99fffab5c5,network=Network(42af123b-86fc-427d-b74a-a2e30c38720c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68b636e3-23') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:24:37 user nova-compute[72586]: DEBUG os_vif [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:40:ed,bridge_name='br-int',has_traffic_filtering=True,id=68b636e3-234f-49e5-b0fb-9f99fffab5c5,network=Network(42af123b-86fc-427d-b74a-a2e30c38720c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68b636e3-23') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:24:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:24:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:24:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap68b636e3-23, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:24:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap68b636e3-23, col_values=(('external_ids', {'iface-id': '68b636e3-234f-49e5-b0fb-9f99fffab5c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:40:ed', 'vm-uuid': 'c3798403-855b-45e4-af48-ba6b62570dba'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:24:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:24:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:37 user nova-compute[72586]: INFO os_vif [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:40:ed,bridge_name='br-int',has_traffic_filtering=True,id=68b636e3-234f-49e5-b0fb-9f99fffab5c5,network=Network(42af123b-86fc-427d-b74a-a2e30c38720c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68b636e3-23')
Aug 01 21:24:37 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:24:37 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] No VIF found with MAC fa:16:3e:a4:40:ed, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:24:37 user nova-compute[72586]: DEBUG nova.network.neutron [req-c59edec7-66ea-484c-84c1-bc1d9697faa7 req-356b8ceb-6d00-45d6-a68f-d66c2984a9c5 service nova] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Updated VIF entry in instance network info cache for port 68b636e3-234f-49e5-b0fb-9f99fffab5c5. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:24:37 user nova-compute[72586]: DEBUG nova.network.neutron [req-c59edec7-66ea-484c-84c1-bc1d9697faa7 req-356b8ceb-6d00-45d6-a68f-d66c2984a9c5 service nova] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Updating instance_info_cache with network_info: [{"id": "68b636e3-234f-49e5-b0fb-9f99fffab5c5", "address": "fa:16:3e:a4:40:ed", "network": {"id": "42af123b-86fc-427d-b74a-a2e30c38720c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1787263710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c49158afdb04ea48c05f32782106197", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b636e3-23", "ovs_interfaceid": "68b636e3-234f-49e5-b0fb-9f99fffab5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:24:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-c59edec7-66ea-484c-84c1-bc1d9697faa7 req-356b8ceb-6d00-45d6-a68f-d66c2984a9c5 service nova] Releasing lock "refresh_cache-c3798403-855b-45e4-af48-ba6b62570dba" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:24:38 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:38 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:38 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:38 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:39 user nova-compute[72586]: DEBUG nova.compute.manager [req-307e9ade-7877-4608-8a6c-a62782c9c86c req-922e201f-8eee-43ad-bfb5-f5255ea6f16c service nova] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Received event network-vif-plugged-68b636e3-234f-49e5-b0fb-9f99fffab5c5 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:24:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-307e9ade-7877-4608-8a6c-a62782c9c86c req-922e201f-8eee-43ad-bfb5-f5255ea6f16c service nova] Acquiring lock "c3798403-855b-45e4-af48-ba6b62570dba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:24:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-307e9ade-7877-4608-8a6c-a62782c9c86c req-922e201f-8eee-43ad-bfb5-f5255ea6f16c service nova] Lock "c3798403-855b-45e4-af48-ba6b62570dba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:24:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-307e9ade-7877-4608-8a6c-a62782c9c86c req-922e201f-8eee-43ad-bfb5-f5255ea6f16c service nova] Lock "c3798403-855b-45e4-af48-ba6b62570dba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:24:39 user nova-compute[72586]: DEBUG nova.compute.manager [req-307e9ade-7877-4608-8a6c-a62782c9c86c req-922e201f-8eee-43ad-bfb5-f5255ea6f16c service nova] [instance: c3798403-855b-45e4-af48-ba6b62570dba] No waiting events found dispatching network-vif-plugged-68b636e3-234f-49e5-b0fb-9f99fffab5c5 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:24:39 user nova-compute[72586]: WARNING nova.compute.manager [req-307e9ade-7877-4608-8a6c-a62782c9c86c req-922e201f-8eee-43ad-bfb5-f5255ea6f16c service nova] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Received unexpected event network-vif-plugged-68b636e3-234f-49e5-b0fb-9f99fffab5c5 for instance with vm_state building and task_state spawning.
Aug 01 21:24:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:41 user nova-compute[72586]: DEBUG nova.compute.manager [req-5326f31d-4717-4099-9bd5-576bda90e7ef req-01d6f36c-c6d1-4e38-9025-8ea7d0fa8d59 service nova] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Received event network-vif-plugged-68b636e3-234f-49e5-b0fb-9f99fffab5c5 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:24:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-5326f31d-4717-4099-9bd5-576bda90e7ef req-01d6f36c-c6d1-4e38-9025-8ea7d0fa8d59 service nova] Acquiring lock "c3798403-855b-45e4-af48-ba6b62570dba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:24:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-5326f31d-4717-4099-9bd5-576bda90e7ef req-01d6f36c-c6d1-4e38-9025-8ea7d0fa8d59 service nova] Lock "c3798403-855b-45e4-af48-ba6b62570dba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:24:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-5326f31d-4717-4099-9bd5-576bda90e7ef req-01d6f36c-c6d1-4e38-9025-8ea7d0fa8d59 service nova] Lock "c3798403-855b-45e4-af48-ba6b62570dba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:24:41 user nova-compute[72586]: DEBUG nova.compute.manager [req-5326f31d-4717-4099-9bd5-576bda90e7ef req-01d6f36c-c6d1-4e38-9025-8ea7d0fa8d59 service nova] [instance: c3798403-855b-45e4-af48-ba6b62570dba] No waiting events found dispatching network-vif-plugged-68b636e3-234f-49e5-b0fb-9f99fffab5c5 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:24:41 user nova-compute[72586]: WARNING nova.compute.manager [req-5326f31d-4717-4099-9bd5-576bda90e7ef req-01d6f36c-c6d1-4e38-9025-8ea7d0fa8d59 service nova] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Received unexpected event network-vif-plugged-68b636e3-234f-49e5-b0fb-9f99fffab5c5 for instance with vm_state building and task_state spawning.
Aug 01 21:24:41 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925081.1638365, c3798403-855b-45e4-af48-ba6b62570dba => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:24:41 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: c3798403-855b-45e4-af48-ba6b62570dba] VM Resumed (Lifecycle Event)
Aug 01 21:24:41 user nova-compute[72586]: DEBUG nova.compute.manager [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Instance event wait completed in 0 seconds for  {{(pid=72586) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 21:24:41 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Guest created on hypervisor {{(pid=72586) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 21:24:41 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Instance spawned successfully.
Aug 01 21:24:41 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 21:24:41 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:24:41 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:24:41 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Found default for hw_cdrom_bus of ide {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:24:41 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Found default for hw_disk_bus of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:24:41 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Found default for hw_input_bus of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:24:41 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Found default for hw_pointer_model of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:24:41 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Found default for hw_video_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:24:41 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Found default for hw_vif_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:24:41 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: c3798403-855b-45e4-af48-ba6b62570dba] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:24:41 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925081.1653974, c3798403-855b-45e4-af48-ba6b62570dba => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:24:41 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: c3798403-855b-45e4-af48-ba6b62570dba] VM Started (Lifecycle Event)
Aug 01 21:24:41 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:24:41 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:24:41 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: c3798403-855b-45e4-af48-ba6b62570dba] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:24:41 user nova-compute[72586]: INFO nova.compute.manager [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Took 6.13 seconds to spawn the instance on the hypervisor.
Aug 01 21:24:41 user nova-compute[72586]: DEBUG nova.compute.manager [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:24:41 user nova-compute[72586]: INFO nova.compute.manager [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Took 7.02 seconds to build instance.
Aug 01 21:24:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-391c4a4f-ac3a-4189-9bd7-5ff87f901322 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Lock "c3798403-855b-45e4-af48-ba6b62570dba" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.117s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:24:42 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:44 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:49 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:52 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:54 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:57 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:24:59 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:25:00 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:25:02 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:25:03 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-168eac38-e8ed-4859-afe9-ade53f1798aa tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Acquiring lock "8fe2afa2-730a-4c17-adb6-f6b875aba3b6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:25:03 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-168eac38-e8ed-4859-afe9-ade53f1798aa tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Lock "8fe2afa2-730a-4c17-adb6-f6b875aba3b6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:25:03 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-168eac38-e8ed-4859-afe9-ade53f1798aa tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Acquiring lock "8fe2afa2-730a-4c17-adb6-f6b875aba3b6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:25:03 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-168eac38-e8ed-4859-afe9-ade53f1798aa tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Lock "8fe2afa2-730a-4c17-adb6-f6b875aba3b6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:25:03 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-168eac38-e8ed-4859-afe9-ade53f1798aa tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Lock "8fe2afa2-730a-4c17-adb6-f6b875aba3b6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:25:03 user nova-compute[72586]: INFO nova.compute.manager [None req-168eac38-e8ed-4859-afe9-ade53f1798aa tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] Terminating instance
Aug 01 21:25:03 user nova-compute[72586]: DEBUG nova.compute.manager [None req-168eac38-e8ed-4859-afe9-ade53f1798aa tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] Start destroying the instance on the hypervisor. {{(pid=72586) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 21:25:03 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:25:03 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:25:03 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:25:03 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:25:03 user nova-compute[72586]: DEBUG nova.compute.manager [req-6f585bb9-bf42-4d41-aec3-4d83a538006d req-50d7d478-a888-4219-8a41-b359ca51b85e service nova] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] Received event network-vif-unplugged-ef700174-bf23-4263-8272-084d9d62b2bf {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:25:03 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-6f585bb9-bf42-4d41-aec3-4d83a538006d req-50d7d478-a888-4219-8a41-b359ca51b85e service nova] Acquiring lock "8fe2afa2-730a-4c17-adb6-f6b875aba3b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:25:03 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-6f585bb9-bf42-4d41-aec3-4d83a538006d req-50d7d478-a888-4219-8a41-b359ca51b85e service nova] Lock "8fe2afa2-730a-4c17-adb6-f6b875aba3b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:25:03 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-6f585bb9-bf42-4d41-aec3-4d83a538006d req-50d7d478-a888-4219-8a41-b359ca51b85e service nova] Lock "8fe2afa2-730a-4c17-adb6-f6b875aba3b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:25:03 user nova-compute[72586]: DEBUG nova.compute.manager [req-6f585bb9-bf42-4d41-aec3-4d83a538006d req-50d7d478-a888-4219-8a41-b359ca51b85e service nova] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] No waiting events found dispatching network-vif-unplugged-ef700174-bf23-4263-8272-084d9d62b2bf {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:25:03 user nova-compute[72586]: DEBUG nova.compute.manager [req-6f585bb9-bf42-4d41-aec3-4d83a538006d req-50d7d478-a888-4219-8a41-b359ca51b85e service nova] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] Received event network-vif-unplugged-ef700174-bf23-4263-8272-084d9d62b2bf for instance with task_state deleting. {{(pid=72586) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 21:25:03 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] Instance destroyed successfully.
Aug 01 21:25:03 user nova-compute[72586]: DEBUG nova.objects.instance [None req-168eac38-e8ed-4859-afe9-ade53f1798aa tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Lazy-loading 'resources' on Instance uuid 8fe2afa2-730a-4c17-adb6-f6b875aba3b6 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:25:03 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-168eac38-e8ed-4859-afe9-ade53f1798aa tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:23:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1333011832',display_name='tempest-VolumesAdminNegativeTest-server-1333011832',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1333011832',id=13,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:23:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e128138ba483401895a8d8257d2a2600',ramdisk_id='',reservation_id='r-x85aak8n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1961775269',owner_user_name='tempest-VolumesAdminNegativeTest-1961775269-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:23:11Z,user_data=None,user_id='06a57074fd8148679aec2090afa47ff5',uuid=8fe2afa2-730a-4c17-adb6-f6b875aba3b6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef700174-bf23-4263-8272-084d9d62b2bf", "address": "fa:16:3e:ff:13:2f", "network": {"id": "198d348c-3661-477f-9e09-f9592f57c588", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1890713425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e128138ba483401895a8d8257d2a2600", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef700174-bf", "ovs_interfaceid": "ef700174-bf23-4263-8272-084d9d62b2bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:25:03 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-168eac38-e8ed-4859-afe9-ade53f1798aa tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Converting VIF {"id": "ef700174-bf23-4263-8272-084d9d62b2bf", "address": "fa:16:3e:ff:13:2f", "network": {"id": "198d348c-3661-477f-9e09-f9592f57c588", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1890713425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e128138ba483401895a8d8257d2a2600", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef700174-bf", "ovs_interfaceid": "ef700174-bf23-4263-8272-084d9d62b2bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:25:03 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-168eac38-e8ed-4859-afe9-ade53f1798aa tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:13:2f,bridge_name='br-int',has_traffic_filtering=True,id=ef700174-bf23-4263-8272-084d9d62b2bf,network=Network(198d348c-3661-477f-9e09-f9592f57c588),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef700174-bf') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:25:03 user nova-compute[72586]: DEBUG os_vif [None req-168eac38-e8ed-4859-afe9-ade53f1798aa tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:13:2f,bridge_name='br-int',has_traffic_filtering=True,id=ef700174-bf23-4263-8272-084d9d62b2bf,network=Network(198d348c-3661-477f-9e09-f9592f57c588),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef700174-bf') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:25:03 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:25:03 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapef700174-bf, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:25:03 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:25:03 user nova-compute[72586]: INFO os_vif [None req-168eac38-e8ed-4859-afe9-ade53f1798aa tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:13:2f,bridge_name='br-int',has_traffic_filtering=True,id=ef700174-bf23-4263-8272-084d9d62b2bf,network=Network(198d348c-3661-477f-9e09-f9592f57c588),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef700174-bf')
Aug 01 21:25:03 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-168eac38-e8ed-4859-afe9-ade53f1798aa tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] Deleting instance files /opt/stack/data/nova/instances/8fe2afa2-730a-4c17-adb6-f6b875aba3b6_del
Aug 01 21:25:03 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-168eac38-e8ed-4859-afe9-ade53f1798aa tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] Deletion of /opt/stack/data/nova/instances/8fe2afa2-730a-4c17-adb6-f6b875aba3b6_del complete
Aug 01 21:25:04 user nova-compute[72586]: INFO nova.compute.manager [None req-168eac38-e8ed-4859-afe9-ade53f1798aa tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] Took 1.02 seconds to destroy the instance on the hypervisor.
Aug 01 21:25:04 user nova-compute[72586]: DEBUG oslo.service.loopingcall [None req-168eac38-e8ed-4859-afe9-ade53f1798aa tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72586) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 21:25:04 user nova-compute[72586]: DEBUG nova.compute.manager [-] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] Deallocating network for instance {{(pid=72586) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 21:25:04 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] deallocate_for_instance() {{(pid=72586) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 21:25:04 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:25:04 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:25:04 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] Took 0.79 seconds to deallocate network for instance.
Aug 01 21:25:04 user nova-compute[72586]: DEBUG nova.compute.manager [req-b2b05aa5-6207-49c4-967c-d238132093c1 req-f140668a-132e-43c6-b6c1-4b658b683a4c service nova] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] Received event network-vif-deleted-ef700174-bf23-4263-8272-084d9d62b2bf {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:25:04 user nova-compute[72586]: INFO nova.compute.manager [req-b2b05aa5-6207-49c4-967c-d238132093c1 req-f140668a-132e-43c6-b6c1-4b658b683a4c service nova] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] Neutron deleted interface ef700174-bf23-4263-8272-084d9d62b2bf; detaching it from the instance and deleting it from the info cache
Aug 01 21:25:04 user nova-compute[72586]: DEBUG nova.network.neutron [req-b2b05aa5-6207-49c4-967c-d238132093c1 req-f140668a-132e-43c6-b6c1-4b658b683a4c service nova] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:25:04 user nova-compute[72586]: DEBUG nova.compute.manager [req-b2b05aa5-6207-49c4-967c-d238132093c1 req-f140668a-132e-43c6-b6c1-4b658b683a4c service nova] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] Detach interface failed, port_id=ef700174-bf23-4263-8272-084d9d62b2bf, reason: Instance 8fe2afa2-730a-4c17-adb6-f6b875aba3b6 could not be found. {{(pid=72586) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 21:25:04 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-168eac38-e8ed-4859-afe9-ade53f1798aa tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:25:04 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-168eac38-e8ed-4859-afe9-ade53f1798aa tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:25:05 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:25:05 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-168eac38-e8ed-4859-afe9-ade53f1798aa tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:25:05 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-168eac38-e8ed-4859-afe9-ade53f1798aa tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:25:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-168eac38-e8ed-4859-afe9-ade53f1798aa tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.523s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:25:05 user nova-compute[72586]: INFO nova.scheduler.client.report [None req-168eac38-e8ed-4859-afe9-ade53f1798aa tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Deleted allocations for instance 8fe2afa2-730a-4c17-adb6-f6b875aba3b6
Aug 01 21:25:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-168eac38-e8ed-4859-afe9-ade53f1798aa tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Lock "8fe2afa2-730a-4c17-adb6-f6b875aba3b6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.586s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:25:05 user nova-compute[72586]: DEBUG nova.compute.manager [req-ccbdc4ce-c8c0-4653-90a8-d15262420978 req-bf3f99a0-e204-41c8-b2d6-c949eb6d31c2 service nova] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] Received event network-vif-plugged-ef700174-bf23-4263-8272-084d9d62b2bf {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:25:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ccbdc4ce-c8c0-4653-90a8-d15262420978 req-bf3f99a0-e204-41c8-b2d6-c949eb6d31c2 service nova] Acquiring lock "8fe2afa2-730a-4c17-adb6-f6b875aba3b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:25:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ccbdc4ce-c8c0-4653-90a8-d15262420978 req-bf3f99a0-e204-41c8-b2d6-c949eb6d31c2 service nova] Lock "8fe2afa2-730a-4c17-adb6-f6b875aba3b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:25:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ccbdc4ce-c8c0-4653-90a8-d15262420978 req-bf3f99a0-e204-41c8-b2d6-c949eb6d31c2 service nova] Lock "8fe2afa2-730a-4c17-adb6-f6b875aba3b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:25:05 user nova-compute[72586]: DEBUG nova.compute.manager [req-ccbdc4ce-c8c0-4653-90a8-d15262420978 req-bf3f99a0-e204-41c8-b2d6-c949eb6d31c2 service nova] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] No waiting events found dispatching network-vif-plugged-ef700174-bf23-4263-8272-084d9d62b2bf {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:25:05 user nova-compute[72586]: WARNING nova.compute.manager [req-ccbdc4ce-c8c0-4653-90a8-d15262420978 req-bf3f99a0-e204-41c8-b2d6-c949eb6d31c2 service nova] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] Received unexpected event network-vif-plugged-ef700174-bf23-4263-8272-084d9d62b2bf for instance with vm_state deleted and task_state None.
Aug 01 21:25:08 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:25:09 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:25:13 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-bbbdd1c9-c7ef-405e-bac3-336a9ccd2635 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Acquiring lock "29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:25:13 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-bbbdd1c9-c7ef-405e-bac3-336a9ccd2635 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Lock "29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:25:13 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-bbbdd1c9-c7ef-405e-bac3-336a9ccd2635 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Acquiring lock "29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:25:13 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-bbbdd1c9-c7ef-405e-bac3-336a9ccd2635 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Lock "29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:25:13 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-bbbdd1c9-c7ef-405e-bac3-336a9ccd2635 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Lock "29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:25:13 user nova-compute[72586]: INFO nova.compute.manager [None req-bbbdd1c9-c7ef-405e-bac3-336a9ccd2635 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] Terminating instance
Aug 01 21:25:13 user nova-compute[72586]: DEBUG nova.compute.manager [None req-bbbdd1c9-c7ef-405e-bac3-336a9ccd2635 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] Start destroying the instance on the hypervisor. {{(pid=72586) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 21:25:13 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:25:13 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:25:13 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:25:13 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:25:13 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:25:13 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:25:14 user nova-compute[72586]: DEBUG nova.compute.manager [req-06702d42-a988-43fc-bf97-caeb42edf528 req-e41e7f1d-e145-4162-8186-cf766dedf3cb service nova] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] Received event network-vif-unplugged-e94821de-3c0a-43a0-ba20-b7d22e0311a4 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:25:14 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-06702d42-a988-43fc-bf97-caeb42edf528 req-e41e7f1d-e145-4162-8186-cf766dedf3cb service nova] Acquiring lock "29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:25:14 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-06702d42-a988-43fc-bf97-caeb42edf528 req-e41e7f1d-e145-4162-8186-cf766dedf3cb service nova] Lock "29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:25:14 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-06702d42-a988-43fc-bf97-caeb42edf528 req-e41e7f1d-e145-4162-8186-cf766dedf3cb service nova] Lock "29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:25:14 user nova-compute[72586]: DEBUG nova.compute.manager [req-06702d42-a988-43fc-bf97-caeb42edf528 req-e41e7f1d-e145-4162-8186-cf766dedf3cb service nova] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] No waiting events found dispatching network-vif-unplugged-e94821de-3c0a-43a0-ba20-b7d22e0311a4 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:25:14 user nova-compute[72586]: DEBUG nova.compute.manager [req-06702d42-a988-43fc-bf97-caeb42edf528 req-e41e7f1d-e145-4162-8186-cf766dedf3cb service nova] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] Received event network-vif-unplugged-e94821de-3c0a-43a0-ba20-b7d22e0311a4 for instance with task_state deleting. {{(pid=72586) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 21:25:14 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:25:14 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] Instance destroyed successfully.
Aug 01 21:25:14 user nova-compute[72586]: DEBUG nova.objects.instance [None req-bbbdd1c9-c7ef-405e-bac3-336a9ccd2635 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Lazy-loading 'resources' on Instance uuid 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:25:14 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-bbbdd1c9-c7ef-405e-bac3-336a9ccd2635 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:23:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-64591421',display_name='tempest-VolumesNegativeTest-instance-64591421',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-64591421',id=14,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:23:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='889ddc1d6f0a4f14b6c0467841227785',ramdisk_id='',reservation_id='r-icwj2sub',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1478076533',owner_user_name='tempest-VolumesNegativeTest-1478076533-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:23:31Z,user_data=None,user_id='b60f16a82439448e9c83bad255217265',uuid=29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e94821de-3c0a-43a0-ba20-b7d22e0311a4", "address": "fa:16:3e:ef:19:b8", "network": {"id": "4efef1cc-73df-4525-b4fd-b7211e04068b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1d9dd3f41aa143a5832ea7aa47fa192a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape94821de-3c", "ovs_interfaceid": "e94821de-3c0a-43a0-ba20-b7d22e0311a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:25:14 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-bbbdd1c9-c7ef-405e-bac3-336a9ccd2635 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Converting VIF {"id": "e94821de-3c0a-43a0-ba20-b7d22e0311a4", "address": "fa:16:3e:ef:19:b8", "network": {"id": "4efef1cc-73df-4525-b4fd-b7211e04068b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1d9dd3f41aa143a5832ea7aa47fa192a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape94821de-3c", "ovs_interfaceid": "e94821de-3c0a-43a0-ba20-b7d22e0311a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:25:14 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-bbbdd1c9-c7ef-405e-bac3-336a9ccd2635 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:19:b8,bridge_name='br-int',has_traffic_filtering=True,id=e94821de-3c0a-43a0-ba20-b7d22e0311a4,network=Network(4efef1cc-73df-4525-b4fd-b7211e04068b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape94821de-3c') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:25:14 user nova-compute[72586]: DEBUG os_vif [None req-bbbdd1c9-c7ef-405e-bac3-336a9ccd2635 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:19:b8,bridge_name='br-int',has_traffic_filtering=True,id=e94821de-3c0a-43a0-ba20-b7d22e0311a4,network=Network(4efef1cc-73df-4525-b4fd-b7211e04068b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape94821de-3c') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:25:14 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:25:14 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape94821de-3c, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:25:14 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:25:14 user nova-compute[72586]: INFO os_vif [None req-bbbdd1c9-c7ef-405e-bac3-336a9ccd2635 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:19:b8,bridge_name='br-int',has_traffic_filtering=True,id=e94821de-3c0a-43a0-ba20-b7d22e0311a4,network=Network(4efef1cc-73df-4525-b4fd-b7211e04068b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape94821de-3c')
Aug 01 21:25:14 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-bbbdd1c9-c7ef-405e-bac3-336a9ccd2635 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] Deleting instance files /opt/stack/data/nova/instances/29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a_del
Aug 01 21:25:14 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-bbbdd1c9-c7ef-405e-bac3-336a9ccd2635 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] Deletion of /opt/stack/data/nova/instances/29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a_del complete
Aug 01 21:25:14 user nova-compute[72586]: INFO nova.compute.manager [None req-bbbdd1c9-c7ef-405e-bac3-336a9ccd2635 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 01 21:25:14 user nova-compute[72586]: DEBUG oslo.service.loopingcall [None req-bbbdd1c9-c7ef-405e-bac3-336a9ccd2635 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72586) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 21:25:14 user nova-compute[72586]: DEBUG nova.compute.manager [-] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] Deallocating network for instance {{(pid=72586) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 21:25:14 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] deallocate_for_instance() {{(pid=72586) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 21:25:15 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:25:15 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] Took 0.69 seconds to deallocate network for instance.
Aug 01 21:25:15 user nova-compute[72586]: DEBUG nova.compute.manager [req-8d372d4d-bebf-41b8-aa84-a8e34ed37a66 req-b18b7dc2-cdb0-431f-8211-5cc508466493 service nova] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] Received event network-vif-deleted-e94821de-3c0a-43a0-ba20-b7d22e0311a4 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:25:15 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-bbbdd1c9-c7ef-405e-bac3-336a9ccd2635 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:25:15 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-bbbdd1c9-c7ef-405e-bac3-336a9ccd2635 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:25:15 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-bbbdd1c9-c7ef-405e-bac3-336a9ccd2635 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:25:15 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-bbbdd1c9-c7ef-405e-bac3-336a9ccd2635 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:25:15 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-bbbdd1c9-c7ef-405e-bac3-336a9ccd2635 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.390s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:25:15 user nova-compute[72586]: INFO nova.scheduler.client.report [None req-bbbdd1c9-c7ef-405e-bac3-336a9ccd2635 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Deleted allocations for instance 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a
Aug 01 21:25:15 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-bbbdd1c9-c7ef-405e-bac3-336a9ccd2635 tempest-VolumesNegativeTest-1478076533 tempest-VolumesNegativeTest-1478076533-project-member] Lock "29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.164s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:25:16 user nova-compute[72586]: DEBUG nova.compute.manager [req-c7af95db-2e2f-4b30-8a99-0836e82a5c98 req-e3cfb540-3cb0-45d3-aee6-1cd4cbbb336e service nova] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] Received event network-vif-plugged-e94821de-3c0a-43a0-ba20-b7d22e0311a4 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:25:16 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-c7af95db-2e2f-4b30-8a99-0836e82a5c98 req-e3cfb540-3cb0-45d3-aee6-1cd4cbbb336e service nova] Acquiring lock "29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:25:16 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-c7af95db-2e2f-4b30-8a99-0836e82a5c98 req-e3cfb540-3cb0-45d3-aee6-1cd4cbbb336e service nova] Lock "29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:25:16 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-c7af95db-2e2f-4b30-8a99-0836e82a5c98 req-e3cfb540-3cb0-45d3-aee6-1cd4cbbb336e service nova] Lock "29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:25:16 user nova-compute[72586]: DEBUG nova.compute.manager [req-c7af95db-2e2f-4b30-8a99-0836e82a5c98 req-e3cfb540-3cb0-45d3-aee6-1cd4cbbb336e service nova] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] No waiting events found dispatching network-vif-plugged-e94821de-3c0a-43a0-ba20-b7d22e0311a4 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:25:16 user nova-compute[72586]: WARNING nova.compute.manager [req-c7af95db-2e2f-4b30-8a99-0836e82a5c98 req-e3cfb540-3cb0-45d3-aee6-1cd4cbbb336e service nova] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] Received unexpected event network-vif-plugged-e94821de-3c0a-43a0-ba20-b7d22e0311a4 for instance with vm_state deleted and task_state None.
Aug 01 21:25:16 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:25:16 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Cleaning up deleted instances with incomplete migration  {{(pid=72586) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 21:25:17 user nova-compute[72586]: DEBUG nova.compute.manager [req-4354d738-5fc9-4a01-90bc-c54b3878551b req-61dfba53-cb6e-4d00-99b6-6ad25238a6b8 service nova] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Received event network-changed-99688c7a-3e71-49d8-9002-0075560858c9 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:25:17 user nova-compute[72586]: DEBUG nova.compute.manager [req-4354d738-5fc9-4a01-90bc-c54b3878551b req-61dfba53-cb6e-4d00-99b6-6ad25238a6b8 service nova] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Refreshing instance network info cache due to event network-changed-99688c7a-3e71-49d8-9002-0075560858c9. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:25:17 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-4354d738-5fc9-4a01-90bc-c54b3878551b req-61dfba53-cb6e-4d00-99b6-6ad25238a6b8 service nova] Acquiring lock "refresh_cache-49c24c77-f102-4aed-8314-b04aad5f6b3a" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:25:17 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-4354d738-5fc9-4a01-90bc-c54b3878551b req-61dfba53-cb6e-4d00-99b6-6ad25238a6b8 service nova] Acquired lock "refresh_cache-49c24c77-f102-4aed-8314-b04aad5f6b3a" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:25:17 user nova-compute[72586]: DEBUG nova.network.neutron [req-4354d738-5fc9-4a01-90bc-c54b3878551b req-61dfba53-cb6e-4d00-99b6-6ad25238a6b8 service nova] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Refreshing network info cache for port 99688c7a-3e71-49d8-9002-0075560858c9 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:25:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f0c29692-1626-4b13-822f-54ce0608a7bf tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Acquiring lock "eccf50b0-9acc-49b6-8044-601e47d18c38" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:25:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f0c29692-1626-4b13-822f-54ce0608a7bf tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "eccf50b0-9acc-49b6-8044-601e47d18c38" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:25:18 user nova-compute[72586]: INFO nova.compute.manager [None req-f0c29692-1626-4b13-822f-54ce0608a7bf tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Detaching volume eb131549-cfa4-4f5f-bfd4-e34009dc6686
Aug 01 21:25:18 user nova-compute[72586]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690925103.8600879, 8fe2afa2-730a-4c17-adb6-f6b875aba3b6 => Stopped> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:25:18 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] VM Stopped (Lifecycle Event)
Aug 01 21:25:18 user nova-compute[72586]: INFO nova.virt.block_device [None req-f0c29692-1626-4b13-822f-54ce0608a7bf tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Attempting to driver detach volume eb131549-cfa4-4f5f-bfd4-e34009dc6686 from mountpoint /dev/vdc
Aug 01 21:25:18 user nova-compute[72586]: DEBUG nova.compute.manager [None req-c7a5beee-7745-4569-a3f0-96c3dc4d92c6 None None] [instance: 8fe2afa2-730a-4c17-adb6-f6b875aba3b6] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:25:18 user nova-compute[72586]: DEBUG nova.network.neutron [req-4354d738-5fc9-4a01-90bc-c54b3878551b req-61dfba53-cb6e-4d00-99b6-6ad25238a6b8 service nova] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Updated VIF entry in instance network info cache for port 99688c7a-3e71-49d8-9002-0075560858c9. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:25:18 user nova-compute[72586]: DEBUG nova.network.neutron [req-4354d738-5fc9-4a01-90bc-c54b3878551b req-61dfba53-cb6e-4d00-99b6-6ad25238a6b8 service nova] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Updating instance_info_cache with network_info: [{"id": "99688c7a-3e71-49d8-9002-0075560858c9", "address": "fa:16:3e:8a:03:a7", "network": {"id": "aab9a541-2149-4c65-b60e-80a1daca6632", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1355256264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19af48ffce7e4703b6d978bc3563680e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99688c7a-3e", "ovs_interfaceid": "99688c7a-3e71-49d8-9002-0075560858c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:25:18 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f0c29692-1626-4b13-822f-54ce0608a7bf tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Attempting to detach device vdc from instance eccf50b0-9acc-49b6-8044-601e47d18c38 from the persistent domain config. {{(pid=72586) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 21:25:18 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-f0c29692-1626-4b13-822f-54ce0608a7bf tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 21:25:18 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:25:18 user nova-compute[72586]:   <source dev="/dev/sdb"/>
Aug 01 21:25:18 user nova-compute[72586]:   <target dev="vdc" bus="virtio"/>
Aug 01 21:25:18 user nova-compute[72586]:   <serial>eb131549-cfa4-4f5f-bfd4-e34009dc6686</serial>
Aug 01 21:25:18 user nova-compute[72586]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 01 21:25:18 user nova-compute[72586]: </disk>
Aug 01 21:25:18 user nova-compute[72586]:  {{(pid=72586) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 21:25:18 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:25:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-4354d738-5fc9-4a01-90bc-c54b3878551b req-61dfba53-cb6e-4d00-99b6-6ad25238a6b8 service nova] Releasing lock "refresh_cache-49c24c77-f102-4aed-8314-b04aad5f6b3a" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:25:18 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-f0c29692-1626-4b13-822f-54ce0608a7bf tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Successfully detached device vdc from instance eccf50b0-9acc-49b6-8044-601e47d18c38 from the persistent domain config.
Aug 01 21:25:18 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f0c29692-1626-4b13-822f-54ce0608a7bf tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance eccf50b0-9acc-49b6-8044-601e47d18c38 from the live domain config. {{(pid=72586) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 21:25:18 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-f0c29692-1626-4b13-822f-54ce0608a7bf tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 21:25:18 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:25:18 user nova-compute[72586]:   <source dev="/dev/sdb"/>
Aug 01 21:25:18 user nova-compute[72586]:   <target dev="vdc" bus="virtio"/>
Aug 01 21:25:18 user nova-compute[72586]:   <serial>eb131549-cfa4-4f5f-bfd4-e34009dc6686</serial>
Aug 01 21:25:18 user nova-compute[72586]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 01 21:25:18 user nova-compute[72586]: </disk>
Aug 01 21:25:18 user nova-compute[72586]:  {{(pid=72586) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 21:25:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:25:19 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Received event <DeviceRemovedEvent: 1690925119.3612804, eccf50b0-9acc-49b6-8044-601e47d18c38 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72586) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 21:25:19 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f0c29692-1626-4b13-822f-54ce0608a7bf tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance eccf50b0-9acc-49b6-8044-601e47d18c38 {{(pid=72586) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 21:25:19 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-f0c29692-1626-4b13-822f-54ce0608a7bf tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Successfully detached device vdc from instance eccf50b0-9acc-49b6-8044-601e47d18c38 from the live domain config.
Aug 01 21:25:19 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0c29692-1626-4b13-822f-54ce0608a7bf tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] calling os-brick to detach iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 21:25:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c29692-1626-4b13-822f-54ce0608a7bf tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, {'target_iqns': ['iqn.2010-10.org.openstack:eb131549-cfa4-4f5f-bfd4-e34009dc6686'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iJAPkuyl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:25:19 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-f0c29692-1626-4b13-822f-54ce0608a7bf tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:25:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-f0c29692-1626-4b13-822f-54ce0608a7bf tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:25:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-f0c29692-1626-4b13-822f-54ce0608a7bf tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:25:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c29692-1626-4b13-822f-54ce0608a7bf tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb131549-cfa4-4f5f-bfd4-e34009dc6686', 0)] {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 21:25:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:25:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:25:19 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b06e9b1-ceee-4ef9-bc29-728ce59249be]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb131549-cfa4-4f5f-bfd4-e34009dc6686\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:25:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:25:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:25:19 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[95243688-290c-4fd6-9a26-396b5b161a31]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb131549-cfa4-4f5f-bfd4-e34009dc6686 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:25:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c29692-1626-4b13-822f-54ce0608a7bf tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb131549-cfa4-4f5f-bfd4-e34009dc6686 (non-flash)
Aug 01 21:25:19 user nova-compute[72586]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)
Aug 01 21:25:19 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:25:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c29692-1626-4b13-822f-54ce0608a7bf tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb131549-cfa4-4f5f-bfd4-e34009dc6686 (non-flash)
Aug 01 21:25:19 user nova-compute[72586]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)
Aug 01 21:25:19 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:25:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c29692-1626-4b13-822f-54ce0608a7bf tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ed03d3400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb131549-cfa4-4f5f-bfd4-e34009dc6686'): ({'sdb'}, set())}) {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 21:25:19 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-f0c29692-1626-4b13-822f-54ce0608a7bf tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Removing single pathed devices sdb {{(pid=72586) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 21:25:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:25:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:25:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:25:19 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6822b0-0e45-4562-aaae-8e1167a52706]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:25:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:25:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:25:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:25:19 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0185b16a-5dc0-43fb-8ba8-b59298828748]: (4, ('ok\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:25:19 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-f0c29692-1626-4b13-822f-54ce0608a7bf tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Flushing IO for device /dev/sdb {{(pid=72586) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 21:25:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:25:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:25:19 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[123f46c5-fece-44ce-a328-1075f97f022f]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:25:19 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-f0c29692-1626-4b13-822f-54ce0608a7bf tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72586) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 21:25:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:25:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:25:19 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc41256-0aa1-4235-a2cf-2912b885ce08]: (4, ('1', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:25:19 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-f0c29692-1626-4b13-822f-54ce0608a7bf tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 21:25:19 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-f0c29692-1626-4b13-822f-54ce0608a7bf tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] SCSI volumes sdb have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 21:25:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c29692-1626-4b13-822f-54ce0608a7bf tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb131549-cfa4-4f5f-bfd4-e34009dc6686')] {{(pid=72586) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 21:25:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb131549-cfa4-4f5f-bfd4-e34009dc6686 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:25:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb131549-cfa4-4f5f-bfd4-e34009dc6686 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:25:19 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f56b72-aa17-4a54-9c4d-1dbb242ac1ac]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:25:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c29692-1626-4b13-822f-54ce0608a7bf tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:25:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb131549-cfa4-4f5f-bfd4-e34009dc6686 -p 172.16.0.220:3260 --logout {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:25:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb131549-cfa4-4f5f-bfd4-e34009dc6686 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:25:19 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9d5ef0-4ec8-44b0-bbbb-fd200c059aec]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:eb131549-cfa4-4f5f-bfd4-e34009dc6686, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:eb131549-cfa4-4f5f-bfd4-e34009dc6686, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:25:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c29692-1626-4b13-822f-54ce0608a7bf tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:eb131549-cfa4-4f5f-bfd4-e34009dc6686, portal: 172.16.0.220,3260]
Aug 01 21:25:19 user nova-compute[72586]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:eb131549-cfa4-4f5f-bfd4-e34009dc6686, portal: 172.16.0.220,3260] successful.
Aug 01 21:25:19 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:25:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb131549-cfa4-4f5f-bfd4-e34009dc6686 -p 172.16.0.220:3260 --op delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:25:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb131549-cfa4-4f5f-bfd4-e34009dc6686 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:25:19 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ab0247-af51-4aba-b0bc-8b16a85a8e75]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:25:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c29692-1626-4b13-822f-54ce0608a7bf tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:25:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-f0c29692-1626-4b13-822f-54ce0608a7bf tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:25:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c29692-1626-4b13-822f-54ce0608a7bf tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] <== disconnect_volume: return (307ms) None {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:25:19 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0c29692-1626-4b13-822f-54ce0608a7bf tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Disconnected iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 21:25:19 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:25:19 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:25:20 user nova-compute[72586]: DEBUG nova.objects.instance [None req-f0c29692-1626-4b13-822f-54ce0608a7bf tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lazy-loading 'flavor' on Instance uuid eccf50b0-9acc-49b6-8044-601e47d18c38 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:25:20 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f0c29692-1626-4b13-822f-54ce0608a7bf tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "eccf50b0-9acc-49b6-8044-601e47d18c38" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.943s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:25:21 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:25:22 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:25:22 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Starting heal instance info cache {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 21:25:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "refresh_cache-413c3426-18ad-4a5c-af04-e0e7fc90f050" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:25:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquired lock "refresh_cache-413c3426-18ad-4a5c-af04-e0e7fc90f050" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:25:22 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Forcefully refreshing network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 21:25:23 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Updating instance_info_cache with network_info: [{"id": "38381409-a508-45f7-ad5c-53e84d2d5adb", "address": "fa:16:3e:73:a7:41", "network": {"id": "d229a8de-7a2b-4dcd-a9ac-44a40349676e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-67691992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b1a1d82f39347119a9fb49fb8e8893f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38381409-a5", "ovs_interfaceid": "38381409-a508-45f7-ad5c-53e84d2d5adb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:25:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Releasing lock "refresh_cache-413c3426-18ad-4a5c-af04-e0e7fc90f050" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:25:23 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Updated the network info_cache for instance {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 21:25:23 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:25:23 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72586) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 21:25:23 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:25:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:25:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:25:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:25:23 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Auditing locally available compute resources for user (node: user) {{(pid=72586) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 21:25:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk.rescue --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:25:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:25:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk.rescue --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:25:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:25:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:25:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:25:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:25:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:25:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:25:24 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:25:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:25:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:25:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:25:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eccf50b0-9acc-49b6-8044-601e47d18c38/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:25:24 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:25:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eccf50b0-9acc-49b6-8044-601e47d18c38/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:25:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eccf50b0-9acc-49b6-8044-601e47d18c38/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:25:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eccf50b0-9acc-49b6-8044-601e47d18c38/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:25:24 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:25:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3830c8b3-27b8-45f3-bbdb-8a081dfcadc4/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:25:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3830c8b3-27b8-45f3-bbdb-8a081dfcadc4/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:25:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3830c8b3-27b8-45f3-bbdb-8a081dfcadc4/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:25:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3830c8b3-27b8-45f3-bbdb-8a081dfcadc4/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:25:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51eb56c-bce2-4593-abc3-878c358c9a74/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:25:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51eb56c-bce2-4593-abc3-878c358c9a74/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:25:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51eb56c-bce2-4593-abc3-878c358c9a74/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:25:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51eb56c-bce2-4593-abc3-878c358c9a74/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:25:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:25:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:25:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:25:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:25:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fde640d-b731-405d-af91-fb4ef85fe90a/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:25:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fde640d-b731-405d-af91-fb4ef85fe90a/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:25:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fde640d-b731-405d-af91-fb4ef85fe90a/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:25:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fde640d-b731-405d-af91-fb4ef85fe90a/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:25:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.rescue --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:25:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.rescue --force-share --output=json" returned: 0 in 0.161s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:25:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.rescue --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:25:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:25:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:25:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:25:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:25:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Acquiring lock "c39c7bd5-0495-484b-a252-ad01ddc68cc1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:25:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Lock "c39c7bd5-0495-484b-a252-ad01ddc68cc1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:25:26 user nova-compute[72586]: DEBUG nova.compute.manager [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] Starting instance... {{(pid=72586) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 21:25:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:25:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:25:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:25:26 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72586) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 21:25:26 user nova-compute[72586]: INFO nova.compute.claims [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] Claim successful on node user
Aug 01 21:25:26 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:25:26 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:25:26 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Hypervisor/Node resource view: name=user free_ram=7271MB free_disk=25.597915649414062GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72586) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 21:25:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:25:27 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Refreshing inventories for resource provider ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 21:25:27 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Updating ProviderTree inventory for provider ca6775c1-2a64-43f9-9467-372aa0457b1d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 21:25:27 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Updating inventory in ProviderTree for provider ca6775c1-2a64-43f9-9467-372aa0457b1d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 21:25:27 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Refreshing aggregate associations for resource provider ca6775c1-2a64-43f9-9467-372aa0457b1d, aggregates: None {{(pid=72586) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 21:25:27 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Refreshing trait associations for resource provider ca6775c1-2a64-43f9-9467-372aa0457b1d, traits: COMPUTE_NODE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_TRUSTED_CERTS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AMI {{(pid=72586) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 21:25:27 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:25:27 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:25:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.598s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:25:27 user nova-compute[72586]: DEBUG nova.compute.manager [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] Start building networks asynchronously for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 21:25:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.576s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:25:27 user nova-compute[72586]: DEBUG nova.compute.manager [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] Allocating IP information in the background. {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 21:25:27 user nova-compute[72586]: DEBUG nova.network.neutron [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] allocate_for_instance() {{(pid=72586) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 21:25:27 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 21:25:27 user nova-compute[72586]: DEBUG nova.compute.manager [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] Start building block device mappings for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 21:25:27 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 042f0031-1e4d-41d0-8bfa-36001675cfe3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:25:27 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 413c3426-18ad-4a5c-af04-e0e7fc90f050 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:25:27 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 0fde640d-b731-405d-af91-fb4ef85fe90a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:25:27 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:25:27 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 644c949c-3ac3-46ec-a62f-b38224f0a85c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:25:27 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 49c24c77-f102-4aed-8314-b04aad5f6b3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:25:27 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance eccf50b0-9acc-49b6-8044-601e47d18c38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:25:27 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance d51eb56c-bce2-4593-abc3-878c358c9a74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:25:27 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance c3798403-855b-45e4-af48-ba6b62570dba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:25:27 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance c39c7bd5-0495-484b-a252-ad01ddc68cc1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:25:27 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 21:25:27 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 21:25:27 user nova-compute[72586]: DEBUG nova.policy [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5038f09f5e404c28bca02fc1ecb485b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724b3e26f64c47b8bb521981a4c5ff94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72586) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 21:25:27 user nova-compute[72586]: DEBUG nova.compute.manager [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] Start spawning the instance on the hypervisor. {{(pid=72586) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 21:25:27 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] Creating instance directory {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 21:25:27 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] Creating image(s)
Aug 01 21:25:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Acquiring lock "/opt/stack/data/nova/instances/c39c7bd5-0495-484b-a252-ad01ddc68cc1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:25:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Lock "/opt/stack/data/nova/instances/c39c7bd5-0495-484b-a252-ad01ddc68cc1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:25:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Lock "/opt/stack/data/nova/instances/c39c7bd5-0495-484b-a252-ad01ddc68cc1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:25:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:25:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.146s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:25:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Acquiring lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:25:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:25:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:25:28 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:25:28 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:25:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.174s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:25:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/c39c7bd5-0495-484b-a252-ad01ddc68cc1/disk 1073741824 {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:25:28 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Compute_service record updated for user:user {{(pid=72586) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 21:25:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.617s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:25:28 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:25:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/c39c7bd5-0495-484b-a252-ad01ddc68cc1/disk 1073741824" returned: 0 in 0.052s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:25:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:25:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:25:28 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:25:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.161s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:25:28 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c39c7bd5-0495-484b-a252-ad01ddc68cc1/disk. size=1073741824 {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 21:25:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c39c7bd5-0495-484b-a252-ad01ddc68cc1/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:25:28 user nova-compute[72586]: DEBUG nova.network.neutron [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] Successfully created port: 91aba8f4-dcde-47b3-94c9-fe5f5bdd6af8 {{(pid=72586) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 21:25:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c39c7bd5-0495-484b-a252-ad01ddc68cc1/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:25:28 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Cannot resize image /opt/stack/data/nova/instances/c39c7bd5-0495-484b-a252-ad01ddc68cc1/disk to a smaller size. {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 21:25:28 user nova-compute[72586]: DEBUG nova.objects.instance [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Lazy-loading 'migration_context' on Instance uuid c39c7bd5-0495-484b-a252-ad01ddc68cc1 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:25:28 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] Created local disks {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 21:25:28 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] Ensure instance console log exists: /opt/stack/data/nova/instances/c39c7bd5-0495-484b-a252-ad01ddc68cc1/console.log {{(pid=72586) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 21:25:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:25:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:25:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:25:28 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:25:28 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:25:28 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:25:28 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:25:28 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Cleaning up deleted instances {{(pid=72586) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 21:25:28 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] There are 0 instances to clean {{(pid=72586) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG nova.network.neutron [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] Successfully updated port: 91aba8f4-dcde-47b3-94c9-fe5f5bdd6af8 {{(pid=72586) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Acquiring lock "refresh_cache-c39c7bd5-0495-484b-a252-ad01ddc68cc1" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Acquired lock "refresh_cache-c39c7bd5-0495-484b-a252-ad01ddc68cc1" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG nova.network.neutron [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._sync_power_states {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG nova.compute.manager [req-6e43dabd-2cad-4583-9dcd-9870b4745f80 req-9f32447c-4f54-434c-bb5b-6bdc001a249a service nova] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] Received event network-changed-91aba8f4-dcde-47b3-94c9-fe5f5bdd6af8 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG nova.compute.manager [req-6e43dabd-2cad-4583-9dcd-9870b4745f80 req-9f32447c-4f54-434c-bb5b-6bdc001a249a service nova] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] Refreshing instance network info cache due to event network-changed-91aba8f4-dcde-47b3-94c9-fe5f5bdd6af8. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-6e43dabd-2cad-4583-9dcd-9870b4745f80 req-9f32447c-4f54-434c-bb5b-6bdc001a249a service nova] Acquiring lock "refresh_cache-c39c7bd5-0495-484b-a252-ad01ddc68cc1" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:25:29 user nova-compute[72586]: WARNING nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] While synchronizing instance power states, found 10 instances in the database and 9 instances on the hypervisor.
Aug 01 21:25:29 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Triggering sync for uuid 042f0031-1e4d-41d0-8bfa-36001675cfe3 {{(pid=72586) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Triggering sync for uuid 413c3426-18ad-4a5c-af04-e0e7fc90f050 {{(pid=72586) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Triggering sync for uuid eccf50b0-9acc-49b6-8044-601e47d18c38 {{(pid=72586) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Triggering sync for uuid 0fde640d-b731-405d-af91-fb4ef85fe90a {{(pid=72586) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Triggering sync for uuid 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4 {{(pid=72586) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Triggering sync for uuid 644c949c-3ac3-46ec-a62f-b38224f0a85c {{(pid=72586) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Triggering sync for uuid 49c24c77-f102-4aed-8314-b04aad5f6b3a {{(pid=72586) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Triggering sync for uuid d51eb56c-bce2-4593-abc3-878c358c9a74 {{(pid=72586) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Triggering sync for uuid c3798403-855b-45e4-af48-ba6b62570dba {{(pid=72586) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Triggering sync for uuid c39c7bd5-0495-484b-a252-ad01ddc68cc1 {{(pid=72586) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "042f0031-1e4d-41d0-8bfa-36001675cfe3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "042f0031-1e4d-41d0-8bfa-36001675cfe3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "413c3426-18ad-4a5c-af04-e0e7fc90f050" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "413c3426-18ad-4a5c-af04-e0e7fc90f050" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "eccf50b0-9acc-49b6-8044-601e47d18c38" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "eccf50b0-9acc-49b6-8044-601e47d18c38" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "0fde640d-b731-405d-af91-fb4ef85fe90a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "0fde640d-b731-405d-af91-fb4ef85fe90a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "3830c8b3-27b8-45f3-bbdb-8a081dfcadc4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "3830c8b3-27b8-45f3-bbdb-8a081dfcadc4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "644c949c-3ac3-46ec-a62f-b38224f0a85c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "644c949c-3ac3-46ec-a62f-b38224f0a85c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "49c24c77-f102-4aed-8314-b04aad5f6b3a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "49c24c77-f102-4aed-8314-b04aad5f6b3a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "d51eb56c-bce2-4593-abc3-878c358c9a74" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "d51eb56c-bce2-4593-abc3-878c358c9a74" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "c3798403-855b-45e4-af48-ba6b62570dba" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "c3798403-855b-45e4-af48-ba6b62570dba" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "c39c7bd5-0495-484b-a252-ad01ddc68cc1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG nova.network.neutron [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] Instance cache missing network info. {{(pid=72586) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690925114.4156063, 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a => Stopped> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:25:29 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] VM Stopped (Lifecycle Event)
Aug 01 21:25:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "042f0031-1e4d-41d0-8bfa-36001675cfe3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.092s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "0fde640d-b731-405d-af91-fb4ef85fe90a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.093s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "eccf50b0-9acc-49b6-8044-601e47d18c38" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.094s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "644c949c-3ac3-46ec-a62f-b38224f0a85c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.097s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "413c3426-18ad-4a5c-af04-e0e7fc90f050" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.101s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "3830c8b3-27b8-45f3-bbdb-8a081dfcadc4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.104s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG nova.compute.manager [None req-54cf53b1-6770-470b-9a37-0c3956ec4760 None None] [instance: 29ecf2b6-27a9-4ffd-a10e-5d4e8e439e0a] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "d51eb56c-bce2-4593-abc3-878c358c9a74" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.115s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "49c24c77-f102-4aed-8314-b04aad5f6b3a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.117s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "c3798403-855b-45e4-af48-ba6b62570dba" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.124s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG nova.network.neutron [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] Updating instance_info_cache with network_info: [{"id": "91aba8f4-dcde-47b3-94c9-fe5f5bdd6af8", "address": "fa:16:3e:59:43:47", "network": {"id": "6aa30f19-4fe9-497b-a1cd-9279113f1153", "bridge": "br-int", "label": "tempest-VolumesActionsTest-513072853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "724b3e26f64c47b8bb521981a4c5ff94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91aba8f4-dc", "ovs_interfaceid": "91aba8f4-dcde-47b3-94c9-fe5f5bdd6af8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Releasing lock "refresh_cache-c39c7bd5-0495-484b-a252-ad01ddc68cc1" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG nova.compute.manager [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] Instance network_info: |[{"id": "91aba8f4-dcde-47b3-94c9-fe5f5bdd6af8", "address": "fa:16:3e:59:43:47", "network": {"id": "6aa30f19-4fe9-497b-a1cd-9279113f1153", "bridge": "br-int", "label": "tempest-VolumesActionsTest-513072853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "724b3e26f64c47b8bb521981a4c5ff94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91aba8f4-dc", "ovs_interfaceid": "91aba8f4-dcde-47b3-94c9-fe5f5bdd6af8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-6e43dabd-2cad-4583-9dcd-9870b4745f80 req-9f32447c-4f54-434c-bb5b-6bdc001a249a service nova] Acquired lock "refresh_cache-c39c7bd5-0495-484b-a252-ad01ddc68cc1" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG nova.network.neutron [req-6e43dabd-2cad-4583-9dcd-9870b4745f80 req-9f32447c-4f54-434c-bb5b-6bdc001a249a service nova] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] Refreshing network info cache for port 91aba8f4-dcde-47b3-94c9-fe5f5bdd6af8 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] Start _get_guest_xml network_info=[{"id": "91aba8f4-dcde-47b3-94c9-fe5f5bdd6af8", "address": "fa:16:3e:59:43:47", "network": {"id": "6aa30f19-4fe9-497b-a1cd-9279113f1153", "bridge": "br-int", "label": "tempest-VolumesActionsTest-513072853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "724b3e26f64c47b8bb521981a4c5ff94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91aba8f4-dc", "ovs_interfaceid": "91aba8f4-dcde-47b3-94c9-fe5f5bdd6af8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '0243d46b-6819-42a5-926f-42b71f0c97ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:25:29 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:25:29 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:25:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:25:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1488252148',display_name='tempest-VolumesActionsTest-instance-1488252148',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1488252148',id=18,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='724b3e26f64c47b8bb521981a4c5ff94',ramdisk_id='',reservation_id='r-pomdysrr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-647755296',owner_user_name='tempest-VolumesActionsTest-647755296-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:25:28Z,user_data=None,user_id='5038f09f5e404c28bca02fc1ecb485b3',uuid=c39c7bd5-0495-484b-a252-ad01ddc68cc1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91aba8f4-dcde-47b3-94c9-fe5f5bdd6af8", "address": "fa:16:3e:59:43:47", "network": {"id": "6aa30f19-4fe9-497b-a1cd-9279113f1153", "bridge": "br-int", "label": "tempest-VolumesActionsTest-513072853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "724b3e26f64c47b8bb521981a4c5ff94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91aba8f4-dc", "ovs_interfaceid": "91aba8f4-dcde-47b3-94c9-fe5f5bdd6af8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Converting VIF {"id": "91aba8f4-dcde-47b3-94c9-fe5f5bdd6af8", "address": "fa:16:3e:59:43:47", "network": {"id": "6aa30f19-4fe9-497b-a1cd-9279113f1153", "bridge": "br-int", "label": "tempest-VolumesActionsTest-513072853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "724b3e26f64c47b8bb521981a4c5ff94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91aba8f4-dc", "ovs_interfaceid": "91aba8f4-dcde-47b3-94c9-fe5f5bdd6af8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:43:47,bridge_name='br-int',has_traffic_filtering=True,id=91aba8f4-dcde-47b3-94c9-fe5f5bdd6af8,network=Network(6aa30f19-4fe9-497b-a1cd-9279113f1153),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91aba8f4-dc') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG nova.objects.instance [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Lazy-loading 'pci_devices' on Instance uuid c39c7bd5-0495-484b-a252-ad01ddc68cc1 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:25:29 user nova-compute[72586]:   <uuid>c39c7bd5-0495-484b-a252-ad01ddc68cc1</uuid>
Aug 01 21:25:29 user nova-compute[72586]:   <name>instance-00000012</name>
Aug 01 21:25:29 user nova-compute[72586]:   <memory>524288</memory>
Aug 01 21:25:29 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:25:29 user nova-compute[72586]:   <metadata>
Aug 01 21:25:29 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:25:29 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:25:29 user nova-compute[72586]:       <nova:name>tempest-VolumesActionsTest-instance-1488252148</nova:name>
Aug 01 21:25:29 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:25:29</nova:creationTime>
Aug 01 21:25:29 user nova-compute[72586]:       <nova:flavor name="m1.tiny">
Aug 01 21:25:29 user nova-compute[72586]:         <nova:memory>512</nova:memory>
Aug 01 21:25:29 user nova-compute[72586]:         <nova:disk>1</nova:disk>
Aug 01 21:25:29 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:25:29 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:25:29 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:25:29 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:25:29 user nova-compute[72586]:       <nova:owner>
Aug 01 21:25:29 user nova-compute[72586]:         <nova:user uuid="5038f09f5e404c28bca02fc1ecb485b3">tempest-VolumesActionsTest-647755296-project-member</nova:user>
Aug 01 21:25:29 user nova-compute[72586]:         <nova:project uuid="724b3e26f64c47b8bb521981a4c5ff94">tempest-VolumesActionsTest-647755296</nova:project>
Aug 01 21:25:29 user nova-compute[72586]:       </nova:owner>
Aug 01 21:25:29 user nova-compute[72586]:       <nova:root type="image" uuid="0243d46b-6819-42a5-926f-42b71f0c97ad"/>
Aug 01 21:25:29 user nova-compute[72586]:       <nova:ports>
Aug 01 21:25:29 user nova-compute[72586]:         <nova:port uuid="91aba8f4-dcde-47b3-94c9-fe5f5bdd6af8">
Aug 01 21:25:29 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 01 21:25:29 user nova-compute[72586]:         </nova:port>
Aug 01 21:25:29 user nova-compute[72586]:       </nova:ports>
Aug 01 21:25:29 user nova-compute[72586]:     </nova:instance>
Aug 01 21:25:29 user nova-compute[72586]:   </metadata>
Aug 01 21:25:29 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:25:29 user nova-compute[72586]:     <system>
Aug 01 21:25:29 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:25:29 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:25:29 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:25:29 user nova-compute[72586]:       <entry name="serial">c39c7bd5-0495-484b-a252-ad01ddc68cc1</entry>
Aug 01 21:25:29 user nova-compute[72586]:       <entry name="uuid">c39c7bd5-0495-484b-a252-ad01ddc68cc1</entry>
Aug 01 21:25:29 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:25:29 user nova-compute[72586]:     </system>
Aug 01 21:25:29 user nova-compute[72586]:   </sysinfo>
Aug 01 21:25:29 user nova-compute[72586]:   <os>
Aug 01 21:25:29 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:25:29 user nova-compute[72586]:     <boot dev="hd"/>
Aug 01 21:25:29 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:25:29 user nova-compute[72586]:   </os>
Aug 01 21:25:29 user nova-compute[72586]:   <features>
Aug 01 21:25:29 user nova-compute[72586]:     <acpi/>
Aug 01 21:25:29 user nova-compute[72586]:     <apic/>
Aug 01 21:25:29 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:25:29 user nova-compute[72586]:   </features>
Aug 01 21:25:29 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:25:29 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:25:29 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:25:29 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:25:29 user nova-compute[72586]:   </clock>
Aug 01 21:25:29 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:25:29 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:25:29 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:25:29 user nova-compute[72586]:   </cpu>
Aug 01 21:25:29 user nova-compute[72586]:   <devices>
Aug 01 21:25:29 user nova-compute[72586]:     <disk type="file" device="disk">
Aug 01 21:25:29 user nova-compute[72586]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 21:25:29 user nova-compute[72586]:       <source file="/opt/stack/data/nova/instances/c39c7bd5-0495-484b-a252-ad01ddc68cc1/disk"/>
Aug 01 21:25:29 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:25:29 user nova-compute[72586]:     </disk>
Aug 01 21:25:29 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:25:29 user nova-compute[72586]:       <mac address="fa:16:3e:59:43:47"/>
Aug 01 21:25:29 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:25:29 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:25:29 user nova-compute[72586]:       <target dev="tap91aba8f4-dc"/>
Aug 01 21:25:29 user nova-compute[72586]:     </interface>
Aug 01 21:25:29 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:25:29 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/c39c7bd5-0495-484b-a252-ad01ddc68cc1/console.log" append="off"/>
Aug 01 21:25:29 user nova-compute[72586]:     </serial>
Aug 01 21:25:29 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:25:29 user nova-compute[72586]:     <video>
Aug 01 21:25:29 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:25:29 user nova-compute[72586]:     </video>
Aug 01 21:25:29 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:25:29 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:25:29 user nova-compute[72586]:     </rng>
Aug 01 21:25:29 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:25:29 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:25:29 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:25:29 user nova-compute[72586]:     </memballoon>
Aug 01 21:25:29 user nova-compute[72586]:   </devices>
Aug 01 21:25:29 user nova-compute[72586]: </domain>
Aug 01 21:25:29 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:25:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1488252148',display_name='tempest-VolumesActionsTest-instance-1488252148',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1488252148',id=18,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='724b3e26f64c47b8bb521981a4c5ff94',ramdisk_id='',reservation_id='r-pomdysrr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-647755296',owner_user_name='tempest-VolumesActionsTest-647755296-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:25:28Z,user_data=None,user_id='5038f09f5e404c28bca02fc1ecb485b3',uuid=c39c7bd5-0495-484b-a252-ad01ddc68cc1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91aba8f4-dcde-47b3-94c9-fe5f5bdd6af8", "address": "fa:16:3e:59:43:47", "network": {"id": "6aa30f19-4fe9-497b-a1cd-9279113f1153", "bridge": "br-int", "label": "tempest-VolumesActionsTest-513072853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "724b3e26f64c47b8bb521981a4c5ff94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91aba8f4-dc", "ovs_interfaceid": "91aba8f4-dcde-47b3-94c9-fe5f5bdd6af8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Converting VIF {"id": "91aba8f4-dcde-47b3-94c9-fe5f5bdd6af8", "address": "fa:16:3e:59:43:47", "network": {"id": "6aa30f19-4fe9-497b-a1cd-9279113f1153", "bridge": "br-int", "label": "tempest-VolumesActionsTest-513072853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "724b3e26f64c47b8bb521981a4c5ff94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91aba8f4-dc", "ovs_interfaceid": "91aba8f4-dcde-47b3-94c9-fe5f5bdd6af8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:43:47,bridge_name='br-int',has_traffic_filtering=True,id=91aba8f4-dcde-47b3-94c9-fe5f5bdd6af8,network=Network(6aa30f19-4fe9-497b-a1cd-9279113f1153),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91aba8f4-dc') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG os_vif [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:43:47,bridge_name='br-int',has_traffic_filtering=True,id=91aba8f4-dcde-47b3-94c9-fe5f5bdd6af8,network=Network(6aa30f19-4fe9-497b-a1cd-9279113f1153),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91aba8f4-dc') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap91aba8f4-dc, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap91aba8f4-dc, col_values=(('external_ids', {'iface-id': '91aba8f4-dcde-47b3-94c9-fe5f5bdd6af8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:43:47', 'vm-uuid': 'c39c7bd5-0495-484b-a252-ad01ddc68cc1'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:25:29 user nova-compute[72586]: INFO os_vif [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:43:47,bridge_name='br-int',has_traffic_filtering=True,id=91aba8f4-dcde-47b3-94c9-fe5f5bdd6af8,network=Network(6aa30f19-4fe9-497b-a1cd-9279113f1153),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91aba8f4-dc')
Aug 01 21:25:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:25:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] No VIF found with MAC fa:16:3e:59:43:47, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:25:30 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9d540acc-c2e7-494f-a77f-1e25dede6e40 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Acquiring lock "644c949c-3ac3-46ec-a62f-b38224f0a85c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:25:30 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9d540acc-c2e7-494f-a77f-1e25dede6e40 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Lock "644c949c-3ac3-46ec-a62f-b38224f0a85c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:25:30 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9d540acc-c2e7-494f-a77f-1e25dede6e40 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Acquiring lock "644c949c-3ac3-46ec-a62f-b38224f0a85c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:25:30 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9d540acc-c2e7-494f-a77f-1e25dede6e40 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Lock "644c949c-3ac3-46ec-a62f-b38224f0a85c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:25:30 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9d540acc-c2e7-494f-a77f-1e25dede6e40 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Lock "644c949c-3ac3-46ec-a62f-b38224f0a85c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:25:30 user nova-compute[72586]: INFO nova.compute.manager [None req-9d540acc-c2e7-494f-a77f-1e25dede6e40 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Terminating instance
Aug 01 21:25:30 user nova-compute[72586]: DEBUG nova.compute.manager [None req-9d540acc-c2e7-494f-a77f-1e25dede6e40 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Start destroying the instance on the hypervisor. {{(pid=72586) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 21:25:30 user nova-compute[72586]: DEBUG nova.network.neutron [req-6e43dabd-2cad-4583-9dcd-9870b4745f80 req-9f32447c-4f54-434c-bb5b-6bdc001a249a service nova] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] Updated VIF entry in instance network info cache for port 91aba8f4-dcde-47b3-94c9-fe5f5bdd6af8. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:25:30 user nova-compute[72586]: DEBUG nova.network.neutron [req-6e43dabd-2cad-4583-9dcd-9870b4745f80 req-9f32447c-4f54-434c-bb5b-6bdc001a249a service nova] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] Updating instance_info_cache with network_info: [{"id": "91aba8f4-dcde-47b3-94c9-fe5f5bdd6af8", "address": "fa:16:3e:59:43:47", "network": {"id": "6aa30f19-4fe9-497b-a1cd-9279113f1153", "bridge": "br-int", "label": "tempest-VolumesActionsTest-513072853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "724b3e26f64c47b8bb521981a4c5ff94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91aba8f4-dc", "ovs_interfaceid": "91aba8f4-dcde-47b3-94c9-fe5f5bdd6af8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:25:30 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-6e43dabd-2cad-4583-9dcd-9870b4745f80 req-9f32447c-4f54-434c-bb5b-6bdc001a249a service nova] Releasing lock "refresh_cache-c39c7bd5-0495-484b-a252-ad01ddc68cc1" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:25:30 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:25:30 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:25:30 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:25:30 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:25:30 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:25:31 user nova-compute[72586]: DEBUG nova.compute.manager [req-6f88badd-14ff-4d49-9b25-b22cfb9e32d9 req-cf6489b6-b410-4345-b79e-3e97bd5c9403 service nova] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Received event network-vif-unplugged-8994785a-c6c5-4bb6-9709-4c1f802e47d6 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:25:31 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-6f88badd-14ff-4d49-9b25-b22cfb9e32d9 req-cf6489b6-b410-4345-b79e-3e97bd5c9403 service nova] Acquiring lock "644c949c-3ac3-46ec-a62f-b38224f0a85c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:25:31 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-6f88badd-14ff-4d49-9b25-b22cfb9e32d9 req-cf6489b6-b410-4345-b79e-3e97bd5c9403 service nova] Lock "644c949c-3ac3-46ec-a62f-b38224f0a85c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:25:31 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-6f88badd-14ff-4d49-9b25-b22cfb9e32d9 req-cf6489b6-b410-4345-b79e-3e97bd5c9403 service nova] Lock "644c949c-3ac3-46ec-a62f-b38224f0a85c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:25:31 user nova-compute[72586]: DEBUG nova.compute.manager [req-6f88badd-14ff-4d49-9b25-b22cfb9e32d9 req-cf6489b6-b410-4345-b79e-3e97bd5c9403 service nova] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] No waiting events found dispatching network-vif-unplugged-8994785a-c6c5-4bb6-9709-4c1f802e47d6 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:25:31 user nova-compute[72586]: DEBUG nova.compute.manager [req-6f88badd-14ff-4d49-9b25-b22cfb9e32d9 req-cf6489b6-b410-4345-b79e-3e97bd5c9403 service nova] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Received event network-vif-unplugged-8994785a-c6c5-4bb6-9709-4c1f802e47d6 for instance with task_state deleting. {{(pid=72586) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 21:25:31 user nova-compute[72586]: DEBUG nova.compute.manager [req-6f88badd-14ff-4d49-9b25-b22cfb9e32d9 req-cf6489b6-b410-4345-b79e-3e97bd5c9403 service nova] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Received event network-vif-plugged-8994785a-c6c5-4bb6-9709-4c1f802e47d6 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:25:31 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-6f88badd-14ff-4d49-9b25-b22cfb9e32d9 req-cf6489b6-b410-4345-b79e-3e97bd5c9403 service nova] Acquiring lock "644c949c-3ac3-46ec-a62f-b38224f0a85c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:25:31 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-6f88badd-14ff-4d49-9b25-b22cfb9e32d9 req-cf6489b6-b410-4345-b79e-3e97bd5c9403 service nova] Lock "644c949c-3ac3-46ec-a62f-b38224f0a85c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:25:31 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-6f88badd-14ff-4d49-9b25-b22cfb9e32d9 req-cf6489b6-b410-4345-b79e-3e97bd5c9403 service nova] Lock "644c949c-3ac3-46ec-a62f-b38224f0a85c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:25:31 user nova-compute[72586]: DEBUG nova.compute.manager [req-6f88badd-14ff-4d49-9b25-b22cfb9e32d9 req-cf6489b6-b410-4345-b79e-3e97bd5c9403 service nova] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] No waiting events found dispatching network-vif-plugged-8994785a-c6c5-4bb6-9709-4c1f802e47d6 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:25:31 user nova-compute[72586]: WARNING nova.compute.manager [req-6f88badd-14ff-4d49-9b25-b22cfb9e32d9 req-cf6489b6-b410-4345-b79e-3e97bd5c9403 service nova] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Received unexpected event network-vif-plugged-8994785a-c6c5-4bb6-9709-4c1f802e47d6 for instance with vm_state active and task_state deleting.
Aug 01 21:25:31 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Instance destroyed successfully.
Aug 01 21:25:31 user nova-compute[72586]: DEBUG nova.objects.instance [None req-9d540acc-c2e7-494f-a77f-1e25dede6e40 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Lazy-loading 'resources' on Instance uuid 644c949c-3ac3-46ec-a62f-b38224f0a85c {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:25:31 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:25:31 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-9d540acc-c2e7-494f-a77f-1e25dede6e40 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T21:21:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-898739020',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1632168252',id=12,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFN1pax4r2Rtmt0MkJzmJ/B3FoEGAYCOmWATKfk3X9qByC/jEbHy6mIDIfw7u2k/a61UypCjORkPhSH3mzITgt2N1Y/szofLIQYe2HUTFUXje2O0sR9hELC20XHTZIMgbQ==',key_name='tempest-keypair-16295814',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:24:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2fc531307652485c99598d21cacc2f93',ramdisk_id='',reservation_id='r-7sq1d2d0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-390719395',owner_user_name='tempest-ServerActionsV293TestJSON-390719395-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:24:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89385b6c1686413db06c1c08a7c2e442',uuid=644c949c-3ac3-46ec-a62f-b38224f0a85c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8994785a-c6c5-4bb6-9709-4c1f802e47d6", "address": "fa:16:3e:b6:f1:83", "network": {"id": "d8cf5f10-6a59-4aa2-b8e8-b53932d3734e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1728024316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc531307652485c99598d21cacc2f93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8994785a-c6", "ovs_interfaceid": "8994785a-c6c5-4bb6-9709-4c1f802e47d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:25:31 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-9d540acc-c2e7-494f-a77f-1e25dede6e40 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Converting VIF {"id": "8994785a-c6c5-4bb6-9709-4c1f802e47d6", "address": "fa:16:3e:b6:f1:83", "network": {"id": "d8cf5f10-6a59-4aa2-b8e8-b53932d3734e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1728024316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc531307652485c99598d21cacc2f93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8994785a-c6", "ovs_interfaceid": "8994785a-c6c5-4bb6-9709-4c1f802e47d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:25:31 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-9d540acc-c2e7-494f-a77f-1e25dede6e40 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:f1:83,bridge_name='br-int',has_traffic_filtering=True,id=8994785a-c6c5-4bb6-9709-4c1f802e47d6,network=Network(d8cf5f10-6a59-4aa2-b8e8-b53932d3734e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8994785a-c6') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:25:31 user nova-compute[72586]: DEBUG os_vif [None req-9d540acc-c2e7-494f-a77f-1e25dede6e40 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:f1:83,bridge_name='br-int',has_traffic_filtering=True,id=8994785a-c6c5-4bb6-9709-4c1f802e47d6,network=Network(d8cf5f10-6a59-4aa2-b8e8-b53932d3734e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8994785a-c6') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:25:31 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:25:31 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8994785a-c6, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:25:31 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:25:31 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:25:31 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:25:31 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:25:31 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:25:31 user nova-compute[72586]: INFO os_vif [None req-9d540acc-c2e7-494f-a77f-1e25dede6e40 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:f1:83,bridge_name='br-int',has_traffic_filtering=True,id=8994785a-c6c5-4bb6-9709-4c1f802e47d6,network=Network(d8cf5f10-6a59-4aa2-b8e8-b53932d3734e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8994785a-c6')
Aug 01 21:25:31 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d540acc-c2e7-494f-a77f-1e25dede6e40 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] calling os-brick to detach iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 21:25:31 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d540acc-c2e7-494f-a77f-1e25dede6e40 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, {'target_iqns': ['iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NiSdhavK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:25:31 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-9d540acc-c2e7-494f-a77f-1e25dede6e40 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:25:31 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-9d540acc-c2e7-494f-a77f-1e25dede6e40 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:25:31 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-9d540acc-c2e7-494f-a77f-1e25dede6e40 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:25:31 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d540acc-c2e7-494f-a77f-1e25dede6e40 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf', 0)] {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 21:25:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:25:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:25:31 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d942c0-ffd1-41e0-aae5-a892aebf36da]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:25:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:25:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:25:31 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f46fc60-c61e-4a79-a561-07e3e24e8aa5]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:25:31 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d540acc-c2e7-494f-a77f-1e25dede6e40 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)
Aug 01 21:25:31 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:25:31 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d540acc-c2e7-494f-a77f-1e25dede6e40 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf (non-flash)
Aug 01 21:25:31 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:25:31 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d540acc-c2e7-494f-a77f-1e25dede6e40 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ed03aeb90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf'): ({'sdc'}, set())}) {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 21:25:31 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-9d540acc-c2e7-494f-a77f-1e25dede6e40 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Removing single pathed devices sdc {{(pid=72586) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 21:25:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:25:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:25:31 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0029d8-8bbb-453c-93e6-39611fae4de9]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:25:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:25:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:25:31 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e41520-7776-4db3-97ef-71966d8903d4]: (4, ('ok\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:25:31 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-9d540acc-c2e7-494f-a77f-1e25dede6e40 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Flushing IO for device /dev/sdc {{(pid=72586) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 21:25:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:25:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.027s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:25:31 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d74a51-71f5-448f-98f6-6d911684e5f0]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:25:31 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-9d540acc-c2e7-494f-a77f-1e25dede6e40 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72586) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 21:25:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:25:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.055s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:25:31 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec0a9b6-2b4a-438e-bd15-9af04782e0a1]: (4, ('1', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:25:31 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-9d540acc-c2e7-494f-a77f-1e25dede6e40 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 21:25:31 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-9d540acc-c2e7-494f-a77f-1e25dede6e40 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] SCSI volumes sdc have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 21:25:31 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d540acc-c2e7-494f-a77f-1e25dede6e40 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf')] {{(pid=72586) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 21:25:31 user nova-compute[72586]: DEBUG nova.compute.manager [req-44a0e1b4-e98d-4885-924a-d645cc25d059 req-5d34c29e-2503-4a22-bd40-f076e3e984f6 service nova] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] Received event network-vif-plugged-91aba8f4-dcde-47b3-94c9-fe5f5bdd6af8 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:25:31 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-44a0e1b4-e98d-4885-924a-d645cc25d059 req-5d34c29e-2503-4a22-bd40-f076e3e984f6 service nova] Acquiring lock "c39c7bd5-0495-484b-a252-ad01ddc68cc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:25:31 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-44a0e1b4-e98d-4885-924a-d645cc25d059 req-5d34c29e-2503-4a22-bd40-f076e3e984f6 service nova] Lock "c39c7bd5-0495-484b-a252-ad01ddc68cc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:25:31 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-44a0e1b4-e98d-4885-924a-d645cc25d059 req-5d34c29e-2503-4a22-bd40-f076e3e984f6 service nova] Lock "c39c7bd5-0495-484b-a252-ad01ddc68cc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:25:31 user nova-compute[72586]: DEBUG nova.compute.manager [req-44a0e1b4-e98d-4885-924a-d645cc25d059 req-5d34c29e-2503-4a22-bd40-f076e3e984f6 service nova] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] No waiting events found dispatching network-vif-plugged-91aba8f4-dcde-47b3-94c9-fe5f5bdd6af8 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:25:31 user nova-compute[72586]: WARNING nova.compute.manager [req-44a0e1b4-e98d-4885-924a-d645cc25d059 req-5d34c29e-2503-4a22-bd40-f076e3e984f6 service nova] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] Received unexpected event network-vif-plugged-91aba8f4-dcde-47b3-94c9-fe5f5bdd6af8 for instance with vm_state building and task_state spawning.
Aug 01 21:25:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:25:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:25:31 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d15ce4-3a0b-4b99-8d06-b9628652ff3f]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:25:31 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d540acc-c2e7-494f-a77f-1e25dede6e40 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:25:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf -p 172.16.0.220:3260 --logout {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:25:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:25:31 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a485f2-5b70-41a0-81b7-c6c28ef8c6f8]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:25:31 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d540acc-c2e7-494f-a77f-1e25dede6e40 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf, portal: 172.16.0.220,3260]
Aug 01 21:25:31 user nova-compute[72586]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf, portal: 172.16.0.220,3260] successful.
Aug 01 21:25:31 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:25:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf -p 172.16.0.220:3260 --op delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:25:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a04f408-4471-4c55-8ba3-ac6f023f49bf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:25:32 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc761f4-8a52-4476-af1f-6b70f96b3229]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:25:32 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d540acc-c2e7-494f-a77f-1e25dede6e40 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:25:32 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-9d540acc-c2e7-494f-a77f-1e25dede6e40 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:25:32 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d540acc-c2e7-494f-a77f-1e25dede6e40 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] <== disconnect_volume: return (354ms) None {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:25:32 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d540acc-c2e7-494f-a77f-1e25dede6e40 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Disconnected iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 21:25:32 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-9d540acc-c2e7-494f-a77f-1e25dede6e40 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Deleting instance files /opt/stack/data/nova/instances/644c949c-3ac3-46ec-a62f-b38224f0a85c_del
Aug 01 21:25:32 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-9d540acc-c2e7-494f-a77f-1e25dede6e40 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Deletion of /opt/stack/data/nova/instances/644c949c-3ac3-46ec-a62f-b38224f0a85c_del complete
Aug 01 21:25:32 user nova-compute[72586]: INFO nova.compute.manager [None req-9d540acc-c2e7-494f-a77f-1e25dede6e40 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Took 1.91 seconds to destroy the instance on the hypervisor.
Aug 01 21:25:32 user nova-compute[72586]: DEBUG oslo.service.loopingcall [None req-9d540acc-c2e7-494f-a77f-1e25dede6e40 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72586) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 21:25:32 user nova-compute[72586]: DEBUG nova.compute.manager [-] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Deallocating network for instance {{(pid=72586) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 21:25:32 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] deallocate_for_instance() {{(pid=72586) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 21:25:32 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:25:32 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:25:32 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:25:33 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:25:33 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Took 1.05 seconds to deallocate network for instance.
Aug 01 21:25:33 user nova-compute[72586]: DEBUG nova.compute.manager [req-74fe6a40-abb1-4ff6-80c0-dae79b8636f3 req-a223583d-327a-4f4f-ab6f-db9ae72746c3 service nova] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Received event network-vif-deleted-8994785a-c6c5-4bb6-9709-4c1f802e47d6 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:25:33 user nova-compute[72586]: INFO nova.compute.manager [None req-9d540acc-c2e7-494f-a77f-1e25dede6e40 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Took 0.75 seconds to detach 1 volumes for instance.
Aug 01 21:25:33 user nova-compute[72586]: DEBUG nova.compute.manager [None req-9d540acc-c2e7-494f-a77f-1e25dede6e40 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Deleting volume: 4a04f408-4471-4c55-8ba3-ac6f023f49bf {{(pid=72586) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 01 21:25:34 user nova-compute[72586]: DEBUG nova.compute.manager [req-fe99d406-5ecb-4ce7-98fd-754fca636a5e req-86d8b5a5-f099-4881-98fc-3a01bfe40a5f service nova] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] Received event network-vif-plugged-91aba8f4-dcde-47b3-94c9-fe5f5bdd6af8 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:25:34 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-fe99d406-5ecb-4ce7-98fd-754fca636a5e req-86d8b5a5-f099-4881-98fc-3a01bfe40a5f service nova] Acquiring lock "c39c7bd5-0495-484b-a252-ad01ddc68cc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:25:34 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-fe99d406-5ecb-4ce7-98fd-754fca636a5e req-86d8b5a5-f099-4881-98fc-3a01bfe40a5f service nova] Lock "c39c7bd5-0495-484b-a252-ad01ddc68cc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:25:34 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-fe99d406-5ecb-4ce7-98fd-754fca636a5e req-86d8b5a5-f099-4881-98fc-3a01bfe40a5f service nova] Lock "c39c7bd5-0495-484b-a252-ad01ddc68cc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:25:34 user nova-compute[72586]: DEBUG nova.compute.manager [req-fe99d406-5ecb-4ce7-98fd-754fca636a5e req-86d8b5a5-f099-4881-98fc-3a01bfe40a5f service nova] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] No waiting events found dispatching network-vif-plugged-91aba8f4-dcde-47b3-94c9-fe5f5bdd6af8 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:25:34 user nova-compute[72586]: WARNING nova.compute.manager [req-fe99d406-5ecb-4ce7-98fd-754fca636a5e req-86d8b5a5-f099-4881-98fc-3a01bfe40a5f service nova] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] Received unexpected event network-vif-plugged-91aba8f4-dcde-47b3-94c9-fe5f5bdd6af8 for instance with vm_state building and task_state spawning.
Aug 01 21:25:34 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9d540acc-c2e7-494f-a77f-1e25dede6e40 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:25:34 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9d540acc-c2e7-494f-a77f-1e25dede6e40 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:25:34 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925134.084194, c39c7bd5-0495-484b-a252-ad01ddc68cc1 => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:25:34 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] VM Resumed (Lifecycle Event)
Aug 01 21:25:34 user nova-compute[72586]: DEBUG nova.compute.manager [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] Instance event wait completed in 0 seconds for  {{(pid=72586) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 21:25:34 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] Guest created on hypervisor {{(pid=72586) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 21:25:34 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] Instance spawned successfully.
Aug 01 21:25:34 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 21:25:34 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:25:34 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:25:34 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] Found default for hw_cdrom_bus of ide {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:25:34 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] Found default for hw_disk_bus of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:25:34 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] Found default for hw_input_bus of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:25:34 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] Found default for hw_pointer_model of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:25:34 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] Found default for hw_video_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:25:34 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] Found default for hw_vif_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:25:34 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:25:34 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925134.0857263, c39c7bd5-0495-484b-a252-ad01ddc68cc1 => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:25:34 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] VM Started (Lifecycle Event)
Aug 01 21:25:34 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:25:34 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:25:34 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:25:34 user nova-compute[72586]: INFO nova.compute.manager [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] Took 6.44 seconds to spawn the instance on the hypervisor.
Aug 01 21:25:34 user nova-compute[72586]: DEBUG nova.compute.manager [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:25:34 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:25:34 user nova-compute[72586]: INFO nova.compute.manager [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] Took 7.83 seconds to build instance.
Aug 01 21:25:34 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-08180fb2-507a-4077-9f88-5517e88e9e84 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Lock "c39c7bd5-0495-484b-a252-ad01ddc68cc1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.945s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:25:34 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "c39c7bd5-0495-484b-a252-ad01ddc68cc1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 5.003s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:25:34 user nova-compute[72586]: INFO nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:25:34 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "c39c7bd5-0495-484b-a252-ad01ddc68cc1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:25:34 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-9d540acc-c2e7-494f-a77f-1e25dede6e40 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:25:34 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-9d540acc-c2e7-494f-a77f-1e25dede6e40 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:25:34 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9d540acc-c2e7-494f-a77f-1e25dede6e40 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.417s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:25:34 user nova-compute[72586]: INFO nova.scheduler.client.report [None req-9d540acc-c2e7-494f-a77f-1e25dede6e40 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Deleted allocations for instance 644c949c-3ac3-46ec-a62f-b38224f0a85c
Aug 01 21:25:34 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9d540acc-c2e7-494f-a77f-1e25dede6e40 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Lock "644c949c-3ac3-46ec-a62f-b38224f0a85c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.457s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:25:36 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:25:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:25:41 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:25:46 user nova-compute[72586]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690925131.5361574, 644c949c-3ac3-46ec-a62f-b38224f0a85c => Stopped> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:25:46 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] VM Stopped (Lifecycle Event)
Aug 01 21:25:46 user nova-compute[72586]: DEBUG nova.compute.manager [None req-462b361c-4fdb-4228-90ad-9623ad0a9bb7 None None] [instance: 644c949c-3ac3-46ec-a62f-b38224f0a85c] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:25:46 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:25:46 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:25:46 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72586) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 21:25:46 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72586) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 21:25:46 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72586) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 21:25:46 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:25:49 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:25:51 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:25:54 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:25:56 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:25:59 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:25:59 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-d8e06a6a-24dc-4a55-9b24-eec0594ec99c tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Acquiring lock "3830c8b3-27b8-45f3-bbdb-8a081dfcadc4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:25:59 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-d8e06a6a-24dc-4a55-9b24-eec0594ec99c tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Lock "3830c8b3-27b8-45f3-bbdb-8a081dfcadc4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:25:59 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-d8e06a6a-24dc-4a55-9b24-eec0594ec99c tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Acquiring lock "3830c8b3-27b8-45f3-bbdb-8a081dfcadc4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:25:59 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-d8e06a6a-24dc-4a55-9b24-eec0594ec99c tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Lock "3830c8b3-27b8-45f3-bbdb-8a081dfcadc4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:25:59 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-d8e06a6a-24dc-4a55-9b24-eec0594ec99c tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Lock "3830c8b3-27b8-45f3-bbdb-8a081dfcadc4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:25:59 user nova-compute[72586]: INFO nova.compute.manager [None req-d8e06a6a-24dc-4a55-9b24-eec0594ec99c tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Terminating instance
Aug 01 21:25:59 user nova-compute[72586]: DEBUG nova.compute.manager [None req-d8e06a6a-24dc-4a55-9b24-eec0594ec99c tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Start destroying the instance on the hypervisor. {{(pid=72586) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 21:25:59 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:25:59 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:25:59 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:25:59 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:25:59 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:25:59 user nova-compute[72586]: DEBUG nova.compute.manager [req-9bc4c253-3b4f-4278-bfd4-15ca228414cb req-243fc6db-e7fc-4cab-b76c-10eeb6c7307c service nova] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Received event network-vif-unplugged-3a9c6772-38fc-4b17-9aee-089515b4a73e {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:25:59 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-9bc4c253-3b4f-4278-bfd4-15ca228414cb req-243fc6db-e7fc-4cab-b76c-10eeb6c7307c service nova] Acquiring lock "3830c8b3-27b8-45f3-bbdb-8a081dfcadc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:25:59 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-9bc4c253-3b4f-4278-bfd4-15ca228414cb req-243fc6db-e7fc-4cab-b76c-10eeb6c7307c service nova] Lock "3830c8b3-27b8-45f3-bbdb-8a081dfcadc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:25:59 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-9bc4c253-3b4f-4278-bfd4-15ca228414cb req-243fc6db-e7fc-4cab-b76c-10eeb6c7307c service nova] Lock "3830c8b3-27b8-45f3-bbdb-8a081dfcadc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:25:59 user nova-compute[72586]: DEBUG nova.compute.manager [req-9bc4c253-3b4f-4278-bfd4-15ca228414cb req-243fc6db-e7fc-4cab-b76c-10eeb6c7307c service nova] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] No waiting events found dispatching network-vif-unplugged-3a9c6772-38fc-4b17-9aee-089515b4a73e {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:25:59 user nova-compute[72586]: DEBUG nova.compute.manager [req-9bc4c253-3b4f-4278-bfd4-15ca228414cb req-243fc6db-e7fc-4cab-b76c-10eeb6c7307c service nova] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Received event network-vif-unplugged-3a9c6772-38fc-4b17-9aee-089515b4a73e for instance with task_state deleting. {{(pid=72586) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 21:25:59 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Instance destroyed successfully.
Aug 01 21:25:59 user nova-compute[72586]: DEBUG nova.objects.instance [None req-d8e06a6a-24dc-4a55-9b24-eec0594ec99c tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Lazy-loading 'resources' on Instance uuid 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:25:59 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-d8e06a6a-24dc-4a55-9b24-eec0594ec99c tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:20:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-872367695',display_name='tempest-VolumesAdminNegativeTest-server-872367695',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-872367695',id=7,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHB0OXfIzMTj1Mw98zTadhsEbG2vzvBVblTkf0S3n6x2F/U2DyYjRtgHoMqGIkZvODKY4ml3YHG5+btySbfN03XwQqvQ2ey9EzCRwTEe8ouqCViMafbOBtBtrUELG0BCXQ==',key_name='tempest-keypair-370931383',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:20:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e128138ba483401895a8d8257d2a2600',ramdisk_id='',reservation_id='r-v2tnjnoa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1961775269',owner_user_name='tempest-VolumesAdminNegativeTest-1961775269-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:20:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='06a57074fd8148679aec2090afa47ff5',uuid=3830c8b3-27b8-45f3-bbdb-8a081dfcadc4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a9c6772-38fc-4b17-9aee-089515b4a73e", "address": "fa:16:3e:a5:91:07", "network": {"id": "198d348c-3661-477f-9e09-f9592f57c588", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1890713425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e128138ba483401895a8d8257d2a2600", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a9c6772-38", "ovs_interfaceid": "3a9c6772-38fc-4b17-9aee-089515b4a73e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:25:59 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-d8e06a6a-24dc-4a55-9b24-eec0594ec99c tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Converting VIF {"id": "3a9c6772-38fc-4b17-9aee-089515b4a73e", "address": "fa:16:3e:a5:91:07", "network": {"id": "198d348c-3661-477f-9e09-f9592f57c588", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1890713425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e128138ba483401895a8d8257d2a2600", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a9c6772-38", "ovs_interfaceid": "3a9c6772-38fc-4b17-9aee-089515b4a73e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:25:59 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-d8e06a6a-24dc-4a55-9b24-eec0594ec99c tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:91:07,bridge_name='br-int',has_traffic_filtering=True,id=3a9c6772-38fc-4b17-9aee-089515b4a73e,network=Network(198d348c-3661-477f-9e09-f9592f57c588),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a9c6772-38') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:25:59 user nova-compute[72586]: DEBUG os_vif [None req-d8e06a6a-24dc-4a55-9b24-eec0594ec99c tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:91:07,bridge_name='br-int',has_traffic_filtering=True,id=3a9c6772-38fc-4b17-9aee-089515b4a73e,network=Network(198d348c-3661-477f-9e09-f9592f57c588),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a9c6772-38') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:25:59 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:25:59 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a9c6772-38, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:25:59 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:25:59 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:25:59 user nova-compute[72586]: INFO os_vif [None req-d8e06a6a-24dc-4a55-9b24-eec0594ec99c tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:91:07,bridge_name='br-int',has_traffic_filtering=True,id=3a9c6772-38fc-4b17-9aee-089515b4a73e,network=Network(198d348c-3661-477f-9e09-f9592f57c588),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a9c6772-38')
Aug 01 21:25:59 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-d8e06a6a-24dc-4a55-9b24-eec0594ec99c tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Deleting instance files /opt/stack/data/nova/instances/3830c8b3-27b8-45f3-bbdb-8a081dfcadc4_del
Aug 01 21:25:59 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-d8e06a6a-24dc-4a55-9b24-eec0594ec99c tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Deletion of /opt/stack/data/nova/instances/3830c8b3-27b8-45f3-bbdb-8a081dfcadc4_del complete
Aug 01 21:26:00 user nova-compute[72586]: INFO nova.compute.manager [None req-d8e06a6a-24dc-4a55-9b24-eec0594ec99c tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 01 21:26:00 user nova-compute[72586]: DEBUG oslo.service.loopingcall [None req-d8e06a6a-24dc-4a55-9b24-eec0594ec99c tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72586) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 21:26:00 user nova-compute[72586]: DEBUG nova.compute.manager [-] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Deallocating network for instance {{(pid=72586) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 21:26:00 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] deallocate_for_instance() {{(pid=72586) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 21:26:00 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:26:00 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Took 0.85 seconds to deallocate network for instance.
Aug 01 21:26:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-d8e06a6a-24dc-4a55-9b24-eec0594ec99c tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:26:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-d8e06a6a-24dc-4a55-9b24-eec0594ec99c tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:26:01 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-d8e06a6a-24dc-4a55-9b24-eec0594ec99c tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:26:01 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-d8e06a6a-24dc-4a55-9b24-eec0594ec99c tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:26:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-d8e06a6a-24dc-4a55-9b24-eec0594ec99c tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.317s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:26:01 user nova-compute[72586]: INFO nova.scheduler.client.report [None req-d8e06a6a-24dc-4a55-9b24-eec0594ec99c tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Deleted allocations for instance 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4
Aug 01 21:26:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-d8e06a6a-24dc-4a55-9b24-eec0594ec99c tempest-VolumesAdminNegativeTest-1961775269 tempest-VolumesAdminNegativeTest-1961775269-project-member] Lock "3830c8b3-27b8-45f3-bbdb-8a081dfcadc4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.219s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:26:01 user nova-compute[72586]: DEBUG nova.compute.manager [req-97eac3fc-cced-4857-a2d1-66d169e93aa3 req-12886b04-8a8b-429d-8c3a-4d3e380f7d82 service nova] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Received event network-vif-plugged-3a9c6772-38fc-4b17-9aee-089515b4a73e {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:26:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-97eac3fc-cced-4857-a2d1-66d169e93aa3 req-12886b04-8a8b-429d-8c3a-4d3e380f7d82 service nova] Acquiring lock "3830c8b3-27b8-45f3-bbdb-8a081dfcadc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:26:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-97eac3fc-cced-4857-a2d1-66d169e93aa3 req-12886b04-8a8b-429d-8c3a-4d3e380f7d82 service nova] Lock "3830c8b3-27b8-45f3-bbdb-8a081dfcadc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:26:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-97eac3fc-cced-4857-a2d1-66d169e93aa3 req-12886b04-8a8b-429d-8c3a-4d3e380f7d82 service nova] Lock "3830c8b3-27b8-45f3-bbdb-8a081dfcadc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:26:01 user nova-compute[72586]: DEBUG nova.compute.manager [req-97eac3fc-cced-4857-a2d1-66d169e93aa3 req-12886b04-8a8b-429d-8c3a-4d3e380f7d82 service nova] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] No waiting events found dispatching network-vif-plugged-3a9c6772-38fc-4b17-9aee-089515b4a73e {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:26:01 user nova-compute[72586]: WARNING nova.compute.manager [req-97eac3fc-cced-4857-a2d1-66d169e93aa3 req-12886b04-8a8b-429d-8c3a-4d3e380f7d82 service nova] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Received unexpected event network-vif-plugged-3a9c6772-38fc-4b17-9aee-089515b4a73e for instance with vm_state deleted and task_state None.
Aug 01 21:26:01 user nova-compute[72586]: DEBUG nova.compute.manager [req-97eac3fc-cced-4857-a2d1-66d169e93aa3 req-12886b04-8a8b-429d-8c3a-4d3e380f7d82 service nova] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Received event network-vif-deleted-3a9c6772-38fc-4b17-9aee-089515b4a73e {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:26:01 user nova-compute[72586]: INFO nova.compute.manager [None req-cc7253fe-571a-4ebd-93d1-6655f4c32871 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Unrescuing
Aug 01 21:26:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-cc7253fe-571a-4ebd-93d1-6655f4c32871 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Acquiring lock "refresh_cache-042f0031-1e4d-41d0-8bfa-36001675cfe3" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:26:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-cc7253fe-571a-4ebd-93d1-6655f4c32871 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Acquired lock "refresh_cache-042f0031-1e4d-41d0-8bfa-36001675cfe3" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:26:01 user nova-compute[72586]: DEBUG nova.network.neutron [None req-cc7253fe-571a-4ebd-93d1-6655f4c32871 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:26:02 user nova-compute[72586]: DEBUG nova.network.neutron [None req-cc7253fe-571a-4ebd-93d1-6655f4c32871 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Updating instance_info_cache with network_info: [{"id": "fb56dcd2-b1ea-4992-a896-22f65127a96c", "address": "fa:16:3e:8e:7c:d3", "network": {"id": "d229a8de-7a2b-4dcd-a9ac-44a40349676e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-67691992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b1a1d82f39347119a9fb49fb8e8893f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb56dcd2-b1", "ovs_interfaceid": "fb56dcd2-b1ea-4992-a896-22f65127a96c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:26:02 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-cc7253fe-571a-4ebd-93d1-6655f4c32871 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Releasing lock "refresh_cache-042f0031-1e4d-41d0-8bfa-36001675cfe3" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:26:02 user nova-compute[72586]: DEBUG nova.objects.instance [None req-cc7253fe-571a-4ebd-93d1-6655f4c32871 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lazy-loading 'flavor' on Instance uuid 042f0031-1e4d-41d0-8bfa-36001675cfe3 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:26:02 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:02 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:02 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:02 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:02 user nova-compute[72586]: DEBUG nova.compute.manager [req-f72a7df3-316e-4032-8e67-ee136f1c3299 req-615dfc43-2be4-4e12-a694-ee9e7439fab8 service nova] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Received event network-vif-unplugged-fb56dcd2-b1ea-4992-a896-22f65127a96c {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:26:02 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-f72a7df3-316e-4032-8e67-ee136f1c3299 req-615dfc43-2be4-4e12-a694-ee9e7439fab8 service nova] Acquiring lock "042f0031-1e4d-41d0-8bfa-36001675cfe3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:26:02 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-f72a7df3-316e-4032-8e67-ee136f1c3299 req-615dfc43-2be4-4e12-a694-ee9e7439fab8 service nova] Lock "042f0031-1e4d-41d0-8bfa-36001675cfe3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:26:02 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-f72a7df3-316e-4032-8e67-ee136f1c3299 req-615dfc43-2be4-4e12-a694-ee9e7439fab8 service nova] Lock "042f0031-1e4d-41d0-8bfa-36001675cfe3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:26:02 user nova-compute[72586]: DEBUG nova.compute.manager [req-f72a7df3-316e-4032-8e67-ee136f1c3299 req-615dfc43-2be4-4e12-a694-ee9e7439fab8 service nova] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] No waiting events found dispatching network-vif-unplugged-fb56dcd2-b1ea-4992-a896-22f65127a96c {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:26:02 user nova-compute[72586]: WARNING nova.compute.manager [req-f72a7df3-316e-4032-8e67-ee136f1c3299 req-615dfc43-2be4-4e12-a694-ee9e7439fab8 service nova] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Received unexpected event network-vif-unplugged-fb56dcd2-b1ea-4992-a896-22f65127a96c for instance with vm_state rescued and task_state unrescuing.
Aug 01 21:26:03 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:03 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:03 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Instance destroyed successfully.
Aug 01 21:26:04 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:04 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:04 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:04 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:04 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:04 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:04 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:05 user nova-compute[72586]: DEBUG nova.compute.manager [req-3ac7ab3a-ea60-455f-915c-6963a3f90aa9 req-231b4406-e4a6-42f1-800a-1efaa74d0d4d service nova] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Received event network-vif-plugged-fb56dcd2-b1ea-4992-a896-22f65127a96c {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:26:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-3ac7ab3a-ea60-455f-915c-6963a3f90aa9 req-231b4406-e4a6-42f1-800a-1efaa74d0d4d service nova] Acquiring lock "042f0031-1e4d-41d0-8bfa-36001675cfe3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:26:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-3ac7ab3a-ea60-455f-915c-6963a3f90aa9 req-231b4406-e4a6-42f1-800a-1efaa74d0d4d service nova] Lock "042f0031-1e4d-41d0-8bfa-36001675cfe3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:26:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-3ac7ab3a-ea60-455f-915c-6963a3f90aa9 req-231b4406-e4a6-42f1-800a-1efaa74d0d4d service nova] Lock "042f0031-1e4d-41d0-8bfa-36001675cfe3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:26:05 user nova-compute[72586]: DEBUG nova.compute.manager [req-3ac7ab3a-ea60-455f-915c-6963a3f90aa9 req-231b4406-e4a6-42f1-800a-1efaa74d0d4d service nova] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] No waiting events found dispatching network-vif-plugged-fb56dcd2-b1ea-4992-a896-22f65127a96c {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:26:05 user nova-compute[72586]: WARNING nova.compute.manager [req-3ac7ab3a-ea60-455f-915c-6963a3f90aa9 req-231b4406-e4a6-42f1-800a-1efaa74d0d4d service nova] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Received unexpected event network-vif-plugged-fb56dcd2-b1ea-4992-a896-22f65127a96c for instance with vm_state rescued and task_state unrescuing.
Aug 01 21:26:05 user nova-compute[72586]: DEBUG nova.compute.manager [req-3ac7ab3a-ea60-455f-915c-6963a3f90aa9 req-231b4406-e4a6-42f1-800a-1efaa74d0d4d service nova] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Received event network-vif-plugged-fb56dcd2-b1ea-4992-a896-22f65127a96c {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:26:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-3ac7ab3a-ea60-455f-915c-6963a3f90aa9 req-231b4406-e4a6-42f1-800a-1efaa74d0d4d service nova] Acquiring lock "042f0031-1e4d-41d0-8bfa-36001675cfe3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:26:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-3ac7ab3a-ea60-455f-915c-6963a3f90aa9 req-231b4406-e4a6-42f1-800a-1efaa74d0d4d service nova] Lock "042f0031-1e4d-41d0-8bfa-36001675cfe3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:26:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-3ac7ab3a-ea60-455f-915c-6963a3f90aa9 req-231b4406-e4a6-42f1-800a-1efaa74d0d4d service nova] Lock "042f0031-1e4d-41d0-8bfa-36001675cfe3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:26:05 user nova-compute[72586]: DEBUG nova.compute.manager [req-3ac7ab3a-ea60-455f-915c-6963a3f90aa9 req-231b4406-e4a6-42f1-800a-1efaa74d0d4d service nova] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] No waiting events found dispatching network-vif-plugged-fb56dcd2-b1ea-4992-a896-22f65127a96c {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:26:05 user nova-compute[72586]: WARNING nova.compute.manager [req-3ac7ab3a-ea60-455f-915c-6963a3f90aa9 req-231b4406-e4a6-42f1-800a-1efaa74d0d4d service nova] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Received unexpected event network-vif-plugged-fb56dcd2-b1ea-4992-a896-22f65127a96c for instance with vm_state rescued and task_state unrescuing.
Aug 01 21:26:06 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Removed pending event for 042f0031-1e4d-41d0-8bfa-36001675cfe3 due to event {{(pid=72586) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 21:26:06 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925166.6652377, 042f0031-1e4d-41d0-8bfa-36001675cfe3 => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:26:06 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] VM Resumed (Lifecycle Event)
Aug 01 21:26:06 user nova-compute[72586]: DEBUG nova.compute.manager [None req-cc7253fe-571a-4ebd-93d1-6655f4c32871 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:26:06 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:26:06 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:26:06 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 01 21:26:06 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925166.6672404, 042f0031-1e4d-41d0-8bfa-36001675cfe3 => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:26:06 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] VM Started (Lifecycle Event)
Aug 01 21:26:06 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:26:06 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:26:07 user nova-compute[72586]: DEBUG nova.compute.manager [req-60c3425e-a2e0-4905-b063-872855116525 req-5477b994-46ad-4c0a-92cf-dafcb8719f88 service nova] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Received event network-vif-plugged-fb56dcd2-b1ea-4992-a896-22f65127a96c {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:26:07 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-60c3425e-a2e0-4905-b063-872855116525 req-5477b994-46ad-4c0a-92cf-dafcb8719f88 service nova] Acquiring lock "042f0031-1e4d-41d0-8bfa-36001675cfe3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:26:07 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-60c3425e-a2e0-4905-b063-872855116525 req-5477b994-46ad-4c0a-92cf-dafcb8719f88 service nova] Lock "042f0031-1e4d-41d0-8bfa-36001675cfe3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:26:07 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-60c3425e-a2e0-4905-b063-872855116525 req-5477b994-46ad-4c0a-92cf-dafcb8719f88 service nova] Lock "042f0031-1e4d-41d0-8bfa-36001675cfe3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:26:07 user nova-compute[72586]: DEBUG nova.compute.manager [req-60c3425e-a2e0-4905-b063-872855116525 req-5477b994-46ad-4c0a-92cf-dafcb8719f88 service nova] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] No waiting events found dispatching network-vif-plugged-fb56dcd2-b1ea-4992-a896-22f65127a96c {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:26:07 user nova-compute[72586]: WARNING nova.compute.manager [req-60c3425e-a2e0-4905-b063-872855116525 req-5477b994-46ad-4c0a-92cf-dafcb8719f88 service nova] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Received unexpected event network-vif-plugged-fb56dcd2-b1ea-4992-a896-22f65127a96c for instance with vm_state active and task_state None.
Aug 01 21:26:09 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-6344cf68-a34c-4716-9855-511344725e27 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Acquiring lock "eccf50b0-9acc-49b6-8044-601e47d18c38" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:26:09 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-6344cf68-a34c-4716-9855-511344725e27 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "eccf50b0-9acc-49b6-8044-601e47d18c38" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:26:09 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-6344cf68-a34c-4716-9855-511344725e27 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Acquiring lock "eccf50b0-9acc-49b6-8044-601e47d18c38-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:26:09 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-6344cf68-a34c-4716-9855-511344725e27 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "eccf50b0-9acc-49b6-8044-601e47d18c38-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:26:09 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-6344cf68-a34c-4716-9855-511344725e27 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "eccf50b0-9acc-49b6-8044-601e47d18c38-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:26:09 user nova-compute[72586]: INFO nova.compute.manager [None req-6344cf68-a34c-4716-9855-511344725e27 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Terminating instance
Aug 01 21:26:09 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:09 user nova-compute[72586]: DEBUG nova.compute.manager [None req-6344cf68-a34c-4716-9855-511344725e27 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Start destroying the instance on the hypervisor. {{(pid=72586) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 21:26:09 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:09 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:09 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:09 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:09 user nova-compute[72586]: DEBUG nova.compute.manager [req-22d1196e-6354-42a8-a60a-f34e9ff290c1 req-3763a579-cc1e-4358-8dff-578b99b1a419 service nova] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Received event network-vif-unplugged-a766e2fb-84bd-40c0-a6d7-cdd68b728cd9 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:26:09 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-22d1196e-6354-42a8-a60a-f34e9ff290c1 req-3763a579-cc1e-4358-8dff-578b99b1a419 service nova] Acquiring lock "eccf50b0-9acc-49b6-8044-601e47d18c38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:26:09 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-22d1196e-6354-42a8-a60a-f34e9ff290c1 req-3763a579-cc1e-4358-8dff-578b99b1a419 service nova] Lock "eccf50b0-9acc-49b6-8044-601e47d18c38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:26:09 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-22d1196e-6354-42a8-a60a-f34e9ff290c1 req-3763a579-cc1e-4358-8dff-578b99b1a419 service nova] Lock "eccf50b0-9acc-49b6-8044-601e47d18c38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:26:09 user nova-compute[72586]: DEBUG nova.compute.manager [req-22d1196e-6354-42a8-a60a-f34e9ff290c1 req-3763a579-cc1e-4358-8dff-578b99b1a419 service nova] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] No waiting events found dispatching network-vif-unplugged-a766e2fb-84bd-40c0-a6d7-cdd68b728cd9 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:26:09 user nova-compute[72586]: DEBUG nova.compute.manager [req-22d1196e-6354-42a8-a60a-f34e9ff290c1 req-3763a579-cc1e-4358-8dff-578b99b1a419 service nova] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Received event network-vif-unplugged-a766e2fb-84bd-40c0-a6d7-cdd68b728cd9 for instance with task_state deleting. {{(pid=72586) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 21:26:09 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:09 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Instance destroyed successfully.
Aug 01 21:26:09 user nova-compute[72586]: DEBUG nova.objects.instance [None req-6344cf68-a34c-4716-9855-511344725e27 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lazy-loading 'resources' on Instance uuid eccf50b0-9acc-49b6-8044-601e47d18c38 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:26:10 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:10 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-6344cf68-a34c-4716-9855-511344725e27 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T21:19:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1431613257',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1431613257',id=4,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAzEKXFXyPEjmIAPh8qhlm5PDtJ745fuzeyPBR5mURReQVRsVkj1Kaj9A+C0pWvsCvlNKTWjeyuZ2oyzNMfwG0yhQo8/3Rvrhu8rmxObx77lv5HbcJYhByjJ1JwrLFHn7w==',key_name='tempest-keypair-2087820494',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:23:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae659e4ad43c44e2a8f6d48818bb796a',ramdisk_id='',reservation_id='r-kpiui11s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1935542868',owner_user_name='tempest-AttachVolumeShelveTestJSON-1935542868-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:23:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1a0d71c79c04216b9bf278f650aeb77',uuid=eccf50b0-9acc-49b6-8044-601e47d18c38,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a766e2fb-84bd-40c0-a6d7-cdd68b728cd9", "address": "fa:16:3e:fe:82:a2", "network": {"id": "a5da07bc-2f5d-461e-b31f-df624d9c6557", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948878141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae659e4ad43c44e2a8f6d48818bb796a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa766e2fb-84", "ovs_interfaceid": "a766e2fb-84bd-40c0-a6d7-cdd68b728cd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:26:10 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-6344cf68-a34c-4716-9855-511344725e27 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Converting VIF {"id": "a766e2fb-84bd-40c0-a6d7-cdd68b728cd9", "address": "fa:16:3e:fe:82:a2", "network": {"id": "a5da07bc-2f5d-461e-b31f-df624d9c6557", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948878141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae659e4ad43c44e2a8f6d48818bb796a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa766e2fb-84", "ovs_interfaceid": "a766e2fb-84bd-40c0-a6d7-cdd68b728cd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:26:10 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-6344cf68-a34c-4716-9855-511344725e27 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:82:a2,bridge_name='br-int',has_traffic_filtering=True,id=a766e2fb-84bd-40c0-a6d7-cdd68b728cd9,network=Network(a5da07bc-2f5d-461e-b31f-df624d9c6557),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa766e2fb-84') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:26:10 user nova-compute[72586]: DEBUG os_vif [None req-6344cf68-a34c-4716-9855-511344725e27 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:82:a2,bridge_name='br-int',has_traffic_filtering=True,id=a766e2fb-84bd-40c0-a6d7-cdd68b728cd9,network=Network(a5da07bc-2f5d-461e-b31f-df624d9c6557),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa766e2fb-84') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:26:10 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:10 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa766e2fb-84, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:26:10 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:10 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:26:10 user nova-compute[72586]: INFO os_vif [None req-6344cf68-a34c-4716-9855-511344725e27 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:82:a2,bridge_name='br-int',has_traffic_filtering=True,id=a766e2fb-84bd-40c0-a6d7-cdd68b728cd9,network=Network(a5da07bc-2f5d-461e-b31f-df624d9c6557),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa766e2fb-84')
Aug 01 21:26:10 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-6344cf68-a34c-4716-9855-511344725e27 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Deleting instance files /opt/stack/data/nova/instances/eccf50b0-9acc-49b6-8044-601e47d18c38_del
Aug 01 21:26:10 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-6344cf68-a34c-4716-9855-511344725e27 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Deletion of /opt/stack/data/nova/instances/eccf50b0-9acc-49b6-8044-601e47d18c38_del complete
Aug 01 21:26:10 user nova-compute[72586]: INFO nova.compute.manager [None req-6344cf68-a34c-4716-9855-511344725e27 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 01 21:26:10 user nova-compute[72586]: DEBUG oslo.service.loopingcall [None req-6344cf68-a34c-4716-9855-511344725e27 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72586) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 21:26:10 user nova-compute[72586]: DEBUG nova.compute.manager [-] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Deallocating network for instance {{(pid=72586) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 21:26:10 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] deallocate_for_instance() {{(pid=72586) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 21:26:11 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:26:11 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Took 1.07 seconds to deallocate network for instance.
Aug 01 21:26:11 user nova-compute[72586]: DEBUG nova.compute.manager [req-50dc6b55-138c-4f05-9403-c52d87504e61 req-5fa5dfff-19ac-4120-9489-34de165653fa service nova] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Received event network-vif-deleted-a766e2fb-84bd-40c0-a6d7-cdd68b728cd9 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:26:11 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-6344cf68-a34c-4716-9855-511344725e27 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:26:11 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-6344cf68-a34c-4716-9855-511344725e27 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:26:11 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-6344cf68-a34c-4716-9855-511344725e27 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:26:11 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-6344cf68-a34c-4716-9855-511344725e27 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:26:11 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-6344cf68-a34c-4716-9855-511344725e27 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.419s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:26:11 user nova-compute[72586]: DEBUG nova.compute.manager [req-049bf589-9914-459d-bde0-35efa91f10c3 req-d947bde9-ddce-4e53-9735-db6389b86d65 service nova] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Received event network-vif-plugged-a766e2fb-84bd-40c0-a6d7-cdd68b728cd9 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:26:11 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-049bf589-9914-459d-bde0-35efa91f10c3 req-d947bde9-ddce-4e53-9735-db6389b86d65 service nova] Acquiring lock "eccf50b0-9acc-49b6-8044-601e47d18c38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:26:11 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-049bf589-9914-459d-bde0-35efa91f10c3 req-d947bde9-ddce-4e53-9735-db6389b86d65 service nova] Lock "eccf50b0-9acc-49b6-8044-601e47d18c38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:26:11 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-049bf589-9914-459d-bde0-35efa91f10c3 req-d947bde9-ddce-4e53-9735-db6389b86d65 service nova] Lock "eccf50b0-9acc-49b6-8044-601e47d18c38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:26:11 user nova-compute[72586]: DEBUG nova.compute.manager [req-049bf589-9914-459d-bde0-35efa91f10c3 req-d947bde9-ddce-4e53-9735-db6389b86d65 service nova] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] No waiting events found dispatching network-vif-plugged-a766e2fb-84bd-40c0-a6d7-cdd68b728cd9 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:26:11 user nova-compute[72586]: WARNING nova.compute.manager [req-049bf589-9914-459d-bde0-35efa91f10c3 req-d947bde9-ddce-4e53-9735-db6389b86d65 service nova] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Received unexpected event network-vif-plugged-a766e2fb-84bd-40c0-a6d7-cdd68b728cd9 for instance with vm_state deleted and task_state None.
Aug 01 21:26:11 user nova-compute[72586]: INFO nova.scheduler.client.report [None req-6344cf68-a34c-4716-9855-511344725e27 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Deleted allocations for instance eccf50b0-9acc-49b6-8044-601e47d18c38
Aug 01 21:26:11 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-6344cf68-a34c-4716-9855-511344725e27 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "eccf50b0-9acc-49b6-8044-601e47d18c38" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.633s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:26:14 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:14 user nova-compute[72586]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690925159.9571264, 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4 => Stopped> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:26:14 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] VM Stopped (Lifecycle Event)
Aug 01 21:26:14 user nova-compute[72586]: DEBUG nova.compute.manager [None req-8d4f0deb-21c9-46f7-b6b6-4a9bdb66255d None None] [instance: 3830c8b3-27b8-45f3-bbdb-8a081dfcadc4] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:26:15 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:16 user nova-compute[72586]: DEBUG nova.compute.manager [req-a78124c7-6372-4ac8-956e-bfdf381d7b98 req-f94657f9-2131-4b7e-9739-558b7956a421 service nova] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Received event network-changed-0cdd112b-f316-4cf2-b3e5-82897e241453 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:26:16 user nova-compute[72586]: DEBUG nova.compute.manager [req-a78124c7-6372-4ac8-956e-bfdf381d7b98 req-f94657f9-2131-4b7e-9739-558b7956a421 service nova] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Refreshing instance network info cache due to event network-changed-0cdd112b-f316-4cf2-b3e5-82897e241453. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:26:16 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-a78124c7-6372-4ac8-956e-bfdf381d7b98 req-f94657f9-2131-4b7e-9739-558b7956a421 service nova] Acquiring lock "refresh_cache-d51eb56c-bce2-4593-abc3-878c358c9a74" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:26:16 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-a78124c7-6372-4ac8-956e-bfdf381d7b98 req-f94657f9-2131-4b7e-9739-558b7956a421 service nova] Acquired lock "refresh_cache-d51eb56c-bce2-4593-abc3-878c358c9a74" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:26:16 user nova-compute[72586]: DEBUG nova.network.neutron [req-a78124c7-6372-4ac8-956e-bfdf381d7b98 req-f94657f9-2131-4b7e-9739-558b7956a421 service nova] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Refreshing network info cache for port 0cdd112b-f316-4cf2-b3e5-82897e241453 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:26:17 user nova-compute[72586]: DEBUG nova.network.neutron [req-a78124c7-6372-4ac8-956e-bfdf381d7b98 req-f94657f9-2131-4b7e-9739-558b7956a421 service nova] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Updated VIF entry in instance network info cache for port 0cdd112b-f316-4cf2-b3e5-82897e241453. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:26:17 user nova-compute[72586]: DEBUG nova.network.neutron [req-a78124c7-6372-4ac8-956e-bfdf381d7b98 req-f94657f9-2131-4b7e-9739-558b7956a421 service nova] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Updating instance_info_cache with network_info: [{"id": "0cdd112b-f316-4cf2-b3e5-82897e241453", "address": "fa:16:3e:f2:07:05", "network": {"id": "b40254e1-7668-4ef6-b133-681304d57290", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1667586785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f911c1cbc98a4d93b73090da5f655812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cdd112b-f3", "ovs_interfaceid": "0cdd112b-f316-4cf2-b3e5-82897e241453", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:26:17 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-a78124c7-6372-4ac8-956e-bfdf381d7b98 req-f94657f9-2131-4b7e-9739-558b7956a421 service nova] Releasing lock "refresh_cache-d51eb56c-bce2-4593-abc3-878c358c9a74" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:26:17 user nova-compute[72586]: DEBUG nova.compute.manager [None req-74592297-de66-4c09-9cee-097ae5fa5523 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:26:18 user nova-compute[72586]: INFO nova.compute.manager [None req-74592297-de66-4c09-9cee-097ae5fa5523 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] instance snapshotting
Aug 01 21:26:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:18 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-74592297-de66-4c09-9cee-097ae5fa5523 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Beginning live snapshot process
Aug 01 21:26:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-74592297-de66-4c09-9cee-097ae5fa5523 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51eb56c-bce2-4593-abc3-878c358c9a74/disk --force-share --output=json -f qcow2 {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:26:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-74592297-de66-4c09-9cee-097ae5fa5523 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51eb56c-bce2-4593-abc3-878c358c9a74/disk --force-share --output=json -f qcow2" returned: 0 in 0.141s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:26:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-74592297-de66-4c09-9cee-097ae5fa5523 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51eb56c-bce2-4593-abc3-878c358c9a74/disk --force-share --output=json -f qcow2 {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:26:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-74592297-de66-4c09-9cee-097ae5fa5523 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51eb56c-bce2-4593-abc3-878c358c9a74/disk --force-share --output=json -f qcow2" returned: 0 in 0.184s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:26:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-74592297-de66-4c09-9cee-097ae5fa5523 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:26:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-74592297-de66-4c09-9cee-097ae5fa5523 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.133s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:26:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-74592297-de66-4c09-9cee-097ae5fa5523 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpe0701gxu/af27e44d20ba466a9ef7c5232d94db21.delta 1073741824 {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:26:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-74592297-de66-4c09-9cee-097ae5fa5523 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpe0701gxu/af27e44d20ba466a9ef7c5232d94db21.delta 1073741824" returned: 0 in 0.063s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:26:18 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-74592297-de66-4c09-9cee-097ae5fa5523 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 01 21:26:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:19 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-74592297-de66-4c09-9cee-097ae5fa5523 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72586) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 21:26:19 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:26:20 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:20 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-74592297-de66-4c09-9cee-097ae5fa5523 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72586) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 21:26:20 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-74592297-de66-4c09-9cee-097ae5fa5523 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 01 21:26:20 user nova-compute[72586]: DEBUG nova.privsep.utils [None req-74592297-de66-4c09-9cee-097ae5fa5523 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72586) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 21:26:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-74592297-de66-4c09-9cee-097ae5fa5523 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpe0701gxu/af27e44d20ba466a9ef7c5232d94db21.delta /opt/stack/data/nova/instances/snapshots/tmpe0701gxu/af27e44d20ba466a9ef7c5232d94db21 {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:26:20 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:26:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-74592297-de66-4c09-9cee-097ae5fa5523 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpe0701gxu/af27e44d20ba466a9ef7c5232d94db21.delta /opt/stack/data/nova/instances/snapshots/tmpe0701gxu/af27e44d20ba466a9ef7c5232d94db21" returned: 0 in 0.754s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:26:20 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-74592297-de66-4c09-9cee-097ae5fa5523 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Snapshot extracted, beginning image upload
Aug 01 21:26:21 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:26:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-12c9784a-388b-43d3-9141-1e4348cd7124 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Acquiring lock "0fde640d-b731-405d-af91-fb4ef85fe90a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:26:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-12c9784a-388b-43d3-9141-1e4348cd7124 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Lock "0fde640d-b731-405d-af91-fb4ef85fe90a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:26:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-12c9784a-388b-43d3-9141-1e4348cd7124 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Acquiring lock "0fde640d-b731-405d-af91-fb4ef85fe90a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:26:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-12c9784a-388b-43d3-9141-1e4348cd7124 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Lock "0fde640d-b731-405d-af91-fb4ef85fe90a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:26:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-12c9784a-388b-43d3-9141-1e4348cd7124 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Lock "0fde640d-b731-405d-af91-fb4ef85fe90a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:26:21 user nova-compute[72586]: INFO nova.compute.manager [None req-12c9784a-388b-43d3-9141-1e4348cd7124 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Terminating instance
Aug 01 21:26:21 user nova-compute[72586]: DEBUG nova.compute.manager [None req-12c9784a-388b-43d3-9141-1e4348cd7124 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Start destroying the instance on the hypervisor. {{(pid=72586) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 21:26:22 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:22 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:22 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:22 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:22 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:22 user nova-compute[72586]: DEBUG nova.compute.manager [req-9a4590ea-d9e0-4709-929d-47777e1a938f req-0c252d14-6846-47a1-8009-d28e1f914500 service nova] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Received event network-vif-unplugged-4a722ba3-a6e6-4e2f-963d-f4938bc14926 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:26:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-9a4590ea-d9e0-4709-929d-47777e1a938f req-0c252d14-6846-47a1-8009-d28e1f914500 service nova] Acquiring lock "0fde640d-b731-405d-af91-fb4ef85fe90a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:26:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-9a4590ea-d9e0-4709-929d-47777e1a938f req-0c252d14-6846-47a1-8009-d28e1f914500 service nova] Lock "0fde640d-b731-405d-af91-fb4ef85fe90a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:26:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-9a4590ea-d9e0-4709-929d-47777e1a938f req-0c252d14-6846-47a1-8009-d28e1f914500 service nova] Lock "0fde640d-b731-405d-af91-fb4ef85fe90a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:26:22 user nova-compute[72586]: DEBUG nova.compute.manager [req-9a4590ea-d9e0-4709-929d-47777e1a938f req-0c252d14-6846-47a1-8009-d28e1f914500 service nova] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] No waiting events found dispatching network-vif-unplugged-4a722ba3-a6e6-4e2f-963d-f4938bc14926 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:26:22 user nova-compute[72586]: DEBUG nova.compute.manager [req-9a4590ea-d9e0-4709-929d-47777e1a938f req-0c252d14-6846-47a1-8009-d28e1f914500 service nova] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Received event network-vif-unplugged-4a722ba3-a6e6-4e2f-963d-f4938bc14926 for instance with task_state deleting. {{(pid=72586) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 21:26:22 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:22 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:22 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:22 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:22 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Instance destroyed successfully.
Aug 01 21:26:22 user nova-compute[72586]: DEBUG nova.objects.instance [None req-12c9784a-388b-43d3-9141-1e4348cd7124 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Lazy-loading 'resources' on Instance uuid 0fde640d-b731-405d-af91-fb4ef85fe90a {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:26:22 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-12c9784a-388b-43d3-9141-1e4348cd7124 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:19:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-88921891',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-88921891',id=5,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGHrswvETVG0LRQ/0omeZrlpFNxA8jORgA8WjXRVoWgF1tDq9Gtuy3iR/X+aKJhzLAAdPZD6DgVxCF6brJznds0mWHOXjexn2sym7WZFHC1Zen4+emSAH5/JnC5a5wZPw==',key_name='tempest-keypair-1238992116',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:19:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2fc531307652485c99598d21cacc2f93',ramdisk_id='',reservation_id='r-y0g01qqi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-390719395',owner_user_name='tempest-ServerActionsV293TestJSON-390719395-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:19:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89385b6c1686413db06c1c08a7c2e442',uuid=0fde640d-b731-405d-af91-fb4ef85fe90a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a722ba3-a6e6-4e2f-963d-f4938bc14926", "address": "fa:16:3e:f7:58:6a", "network": {"id": "d8cf5f10-6a59-4aa2-b8e8-b53932d3734e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1728024316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc531307652485c99598d21cacc2f93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a722ba3-a6", "ovs_interfaceid": "4a722ba3-a6e6-4e2f-963d-f4938bc14926", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:26:22 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-12c9784a-388b-43d3-9141-1e4348cd7124 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Converting VIF {"id": "4a722ba3-a6e6-4e2f-963d-f4938bc14926", "address": "fa:16:3e:f7:58:6a", "network": {"id": "d8cf5f10-6a59-4aa2-b8e8-b53932d3734e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1728024316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc531307652485c99598d21cacc2f93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a722ba3-a6", "ovs_interfaceid": "4a722ba3-a6e6-4e2f-963d-f4938bc14926", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:26:22 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-12c9784a-388b-43d3-9141-1e4348cd7124 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f7:58:6a,bridge_name='br-int',has_traffic_filtering=True,id=4a722ba3-a6e6-4e2f-963d-f4938bc14926,network=Network(d8cf5f10-6a59-4aa2-b8e8-b53932d3734e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a722ba3-a6') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:26:22 user nova-compute[72586]: DEBUG os_vif [None req-12c9784a-388b-43d3-9141-1e4348cd7124 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:58:6a,bridge_name='br-int',has_traffic_filtering=True,id=4a722ba3-a6e6-4e2f-963d-f4938bc14926,network=Network(d8cf5f10-6a59-4aa2-b8e8-b53932d3734e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a722ba3-a6') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:26:22 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:22 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4a722ba3-a6, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:26:22 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:22 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:26:22 user nova-compute[72586]: INFO os_vif [None req-12c9784a-388b-43d3-9141-1e4348cd7124 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:58:6a,bridge_name='br-int',has_traffic_filtering=True,id=4a722ba3-a6e6-4e2f-963d-f4938bc14926,network=Network(d8cf5f10-6a59-4aa2-b8e8-b53932d3734e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a722ba3-a6')
Aug 01 21:26:22 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-12c9784a-388b-43d3-9141-1e4348cd7124 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Deleting instance files /opt/stack/data/nova/instances/0fde640d-b731-405d-af91-fb4ef85fe90a_del
Aug 01 21:26:22 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-12c9784a-388b-43d3-9141-1e4348cd7124 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Deletion of /opt/stack/data/nova/instances/0fde640d-b731-405d-af91-fb4ef85fe90a_del complete
Aug 01 21:26:22 user nova-compute[72586]: INFO nova.compute.manager [None req-12c9784a-388b-43d3-9141-1e4348cd7124 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Took 0.74 seconds to destroy the instance on the hypervisor.
Aug 01 21:26:22 user nova-compute[72586]: DEBUG oslo.service.loopingcall [None req-12c9784a-388b-43d3-9141-1e4348cd7124 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72586) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 21:26:22 user nova-compute[72586]: DEBUG nova.compute.manager [-] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Deallocating network for instance {{(pid=72586) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 21:26:22 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] deallocate_for_instance() {{(pid=72586) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 21:26:22 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:26:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:26:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:26:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:26:22 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Auditing locally available compute resources for user (node: user) {{(pid=72586) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 21:26:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:26:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:26:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:26:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:26:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:26:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:26:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:26:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:26:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c39c7bd5-0495-484b-a252-ad01ddc68cc1/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:26:23 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-74592297-de66-4c09-9cee-097ae5fa5523 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Snapshot image upload complete
Aug 01 21:26:23 user nova-compute[72586]: INFO nova.compute.manager [None req-74592297-de66-4c09-9cee-097ae5fa5523 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Took 5.75 seconds to snapshot the instance on the hypervisor.
Aug 01 21:26:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c39c7bd5-0495-484b-a252-ad01ddc68cc1/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:26:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c39c7bd5-0495-484b-a252-ad01ddc68cc1/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:26:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c39c7bd5-0495-484b-a252-ad01ddc68cc1/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:26:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51eb56c-bce2-4593-abc3-878c358c9a74/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:26:24 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:26:24 user nova-compute[72586]: DEBUG nova.compute.manager [req-df7d3dae-0063-46c9-bf7d-4173fa87371f req-d4af5eb3-4597-4633-875c-0556b2379449 service nova] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Received event network-vif-deleted-4a722ba3-a6e6-4e2f-963d-f4938bc14926 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:26:24 user nova-compute[72586]: INFO nova.compute.manager [req-df7d3dae-0063-46c9-bf7d-4173fa87371f req-d4af5eb3-4597-4633-875c-0556b2379449 service nova] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Neutron deleted interface 4a722ba3-a6e6-4e2f-963d-f4938bc14926; detaching it from the instance and deleting it from the info cache
Aug 01 21:26:24 user nova-compute[72586]: DEBUG nova.network.neutron [req-df7d3dae-0063-46c9-bf7d-4173fa87371f req-d4af5eb3-4597-4633-875c-0556b2379449 service nova] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:26:24 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:24 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Took 1.46 seconds to deallocate network for instance.
Aug 01 21:26:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51eb56c-bce2-4593-abc3-878c358c9a74/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:26:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51eb56c-bce2-4593-abc3-878c358c9a74/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:26:24 user nova-compute[72586]: DEBUG nova.compute.manager [req-df7d3dae-0063-46c9-bf7d-4173fa87371f req-d4af5eb3-4597-4633-875c-0556b2379449 service nova] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Detach interface failed, port_id=4a722ba3-a6e6-4e2f-963d-f4938bc14926, reason: Instance 0fde640d-b731-405d-af91-fb4ef85fe90a could not be found. {{(pid=72586) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 21:26:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-12c9784a-388b-43d3-9141-1e4348cd7124 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:26:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-12c9784a-388b-43d3-9141-1e4348cd7124 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:26:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51eb56c-bce2-4593-abc3-878c358c9a74/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:26:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:26:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:26:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:26:24 user nova-compute[72586]: DEBUG nova.compute.manager [req-5318e079-a7b0-49ba-97f1-a870fdc856b1 req-5806b67f-43dc-4add-95a8-876de5da09e6 service nova] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Received event network-vif-plugged-4a722ba3-a6e6-4e2f-963d-f4938bc14926 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:26:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-5318e079-a7b0-49ba-97f1-a870fdc856b1 req-5806b67f-43dc-4add-95a8-876de5da09e6 service nova] Acquiring lock "0fde640d-b731-405d-af91-fb4ef85fe90a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:26:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-5318e079-a7b0-49ba-97f1-a870fdc856b1 req-5806b67f-43dc-4add-95a8-876de5da09e6 service nova] Lock "0fde640d-b731-405d-af91-fb4ef85fe90a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:26:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-5318e079-a7b0-49ba-97f1-a870fdc856b1 req-5806b67f-43dc-4add-95a8-876de5da09e6 service nova] Lock "0fde640d-b731-405d-af91-fb4ef85fe90a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:26:24 user nova-compute[72586]: DEBUG nova.compute.manager [req-5318e079-a7b0-49ba-97f1-a870fdc856b1 req-5806b67f-43dc-4add-95a8-876de5da09e6 service nova] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] No waiting events found dispatching network-vif-plugged-4a722ba3-a6e6-4e2f-963d-f4938bc14926 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:26:24 user nova-compute[72586]: WARNING nova.compute.manager [req-5318e079-a7b0-49ba-97f1-a870fdc856b1 req-5806b67f-43dc-4add-95a8-876de5da09e6 service nova] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Received unexpected event network-vif-plugged-4a722ba3-a6e6-4e2f-963d-f4938bc14926 for instance with vm_state deleted and task_state None.
Aug 01 21:26:24 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-12c9784a-388b-43d3-9141-1e4348cd7124 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:26:24 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-12c9784a-388b-43d3-9141-1e4348cd7124 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:26:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:26:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.rescue --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:26:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-12c9784a-388b-43d3-9141-1e4348cd7124 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.425s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:26:24 user nova-compute[72586]: INFO nova.scheduler.client.report [None req-12c9784a-388b-43d3-9141-1e4348cd7124 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Deleted allocations for instance 0fde640d-b731-405d-af91-fb4ef85fe90a
Aug 01 21:26:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.rescue --force-share --output=json" returned: 0 in 0.157s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:26:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.rescue --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:26:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-12c9784a-388b-43d3-9141-1e4348cd7124 tempest-ServerActionsV293TestJSON-390719395 tempest-ServerActionsV293TestJSON-390719395-project-member] Lock "0fde640d-b731-405d-af91-fb4ef85fe90a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.898s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:26:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:26:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:26:25 user nova-compute[72586]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690925169.9833057, eccf50b0-9acc-49b6-8044-601e47d18c38 => Stopped> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:26:25 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] VM Stopped (Lifecycle Event)
Aug 01 21:26:25 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5ac356ec-b658-4306-b413-0e76bca2c5cb None None] [instance: eccf50b0-9acc-49b6-8044-601e47d18c38] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:26:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:26:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:26:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:26:25 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:25 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:26:25 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:26:25 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Hypervisor/Node resource view: name=user free_ram=7658MB free_disk=25.5753173828125GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72586) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 21:26:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:26:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:26:25 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 042f0031-1e4d-41d0-8bfa-36001675cfe3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:26:25 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 413c3426-18ad-4a5c-af04-e0e7fc90f050 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:26:25 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 49c24c77-f102-4aed-8314-b04aad5f6b3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:26:25 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance d51eb56c-bce2-4593-abc3-878c358c9a74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:26:25 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance c3798403-855b-45e4-af48-ba6b62570dba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:26:25 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance c39c7bd5-0495-484b-a252-ad01ddc68cc1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:26:25 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 21:26:25 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 21:26:25 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:26 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:26:26 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:26:26 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Compute_service record updated for user:user {{(pid=72586) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 21:26:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.353s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:26:26 user nova-compute[72586]: DEBUG nova.compute.manager [req-14d88538-52b5-4ab1-b4a5-ac96f648c10e req-2ab4f927-0f72-4a02-a18a-325929d9bcf5 service nova] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Received event network-changed-68b636e3-234f-49e5-b0fb-9f99fffab5c5 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:26:26 user nova-compute[72586]: DEBUG nova.compute.manager [req-14d88538-52b5-4ab1-b4a5-ac96f648c10e req-2ab4f927-0f72-4a02-a18a-325929d9bcf5 service nova] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Refreshing instance network info cache due to event network-changed-68b636e3-234f-49e5-b0fb-9f99fffab5c5. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:26:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-14d88538-52b5-4ab1-b4a5-ac96f648c10e req-2ab4f927-0f72-4a02-a18a-325929d9bcf5 service nova] Acquiring lock "refresh_cache-c3798403-855b-45e4-af48-ba6b62570dba" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:26:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-14d88538-52b5-4ab1-b4a5-ac96f648c10e req-2ab4f927-0f72-4a02-a18a-325929d9bcf5 service nova] Acquired lock "refresh_cache-c3798403-855b-45e4-af48-ba6b62570dba" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:26:26 user nova-compute[72586]: DEBUG nova.network.neutron [req-14d88538-52b5-4ab1-b4a5-ac96f648c10e req-2ab4f927-0f72-4a02-a18a-325929d9bcf5 service nova] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Refreshing network info cache for port 68b636e3-234f-49e5-b0fb-9f99fffab5c5 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:26:27 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:26:27 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:26:27 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Starting heal instance info cache {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 21:26:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "refresh_cache-49c24c77-f102-4aed-8314-b04aad5f6b3a" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:26:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquired lock "refresh_cache-49c24c77-f102-4aed-8314-b04aad5f6b3a" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:26:27 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Forcefully refreshing network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 21:26:27 user nova-compute[72586]: DEBUG nova.network.neutron [req-14d88538-52b5-4ab1-b4a5-ac96f648c10e req-2ab4f927-0f72-4a02-a18a-325929d9bcf5 service nova] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Updated VIF entry in instance network info cache for port 68b636e3-234f-49e5-b0fb-9f99fffab5c5. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:26:27 user nova-compute[72586]: DEBUG nova.network.neutron [req-14d88538-52b5-4ab1-b4a5-ac96f648c10e req-2ab4f927-0f72-4a02-a18a-325929d9bcf5 service nova] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Updating instance_info_cache with network_info: [{"id": "68b636e3-234f-49e5-b0fb-9f99fffab5c5", "address": "fa:16:3e:a4:40:ed", "network": {"id": "42af123b-86fc-427d-b74a-a2e30c38720c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1787263710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c49158afdb04ea48c05f32782106197", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b636e3-23", "ovs_interfaceid": "68b636e3-234f-49e5-b0fb-9f99fffab5c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:26:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-14d88538-52b5-4ab1-b4a5-ac96f648c10e req-2ab4f927-0f72-4a02-a18a-325929d9bcf5 service nova] Releasing lock "refresh_cache-c3798403-855b-45e4-af48-ba6b62570dba" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:26:27 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:28 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Updating instance_info_cache with network_info: [{"id": "99688c7a-3e71-49d8-9002-0075560858c9", "address": "fa:16:3e:8a:03:a7", "network": {"id": "aab9a541-2149-4c65-b60e-80a1daca6632", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1355256264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19af48ffce7e4703b6d978bc3563680e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99688c7a-3e", "ovs_interfaceid": "99688c7a-3e71-49d8-9002-0075560858c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:26:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Releasing lock "refresh_cache-49c24c77-f102-4aed-8314-b04aad5f6b3a" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:26:28 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Updated the network info_cache for instance {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 21:26:28 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:26:28 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:26:28 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:26:28 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72586) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 21:26:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:30 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Acquiring lock "f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:26:30 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lock "f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:26:30 user nova-compute[72586]: DEBUG nova.compute.manager [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Starting instance... {{(pid=72586) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 21:26:30 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:26:30 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:26:30 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72586) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 21:26:30 user nova-compute[72586]: INFO nova.compute.claims [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Claim successful on node user
Aug 01 21:26:30 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:26:30 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:26:30 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.366s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:26:30 user nova-compute[72586]: DEBUG nova.compute.manager [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Start building networks asynchronously for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 21:26:30 user nova-compute[72586]: DEBUG nova.compute.manager [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Allocating IP information in the background. {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 21:26:30 user nova-compute[72586]: DEBUG nova.network.neutron [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] allocate_for_instance() {{(pid=72586) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 21:26:30 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 21:26:31 user nova-compute[72586]: DEBUG nova.compute.manager [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Start building block device mappings for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 21:26:31 user nova-compute[72586]: DEBUG nova.policy [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '794eb6a1fe4e4d3f868b57f774918b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6493ab8139843b191e013e61f12c877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72586) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 21:26:31 user nova-compute[72586]: DEBUG nova.compute.manager [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Start spawning the instance on the hypervisor. {{(pid=72586) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 21:26:31 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Creating instance directory {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 21:26:31 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Creating image(s)
Aug 01 21:26:31 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Acquiring lock "/opt/stack/data/nova/instances/f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:26:31 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lock "/opt/stack/data/nova/instances/f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:26:31 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lock "/opt/stack/data/nova/instances/f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:26:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:26:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.129s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:26:31 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Acquiring lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:26:31 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:26:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:26:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.136s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:26:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536/disk 1073741824 {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:26:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536/disk 1073741824" returned: 0 in 0.050s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:26:31 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.192s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:26:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:26:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.129s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:26:31 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536/disk. size=1073741824 {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 21:26:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:26:31 user nova-compute[72586]: DEBUG nova.network.neutron [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Successfully created port: c9c37169-5d08-49e3-9fdf-705b9bbe1d2f {{(pid=72586) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 21:26:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:26:31 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Cannot resize image /opt/stack/data/nova/instances/f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536/disk to a smaller size. {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 21:26:31 user nova-compute[72586]: DEBUG nova.objects.instance [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lazy-loading 'migration_context' on Instance uuid f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:26:31 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Created local disks {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 21:26:31 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Ensure instance console log exists: /opt/stack/data/nova/instances/f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536/console.log {{(pid=72586) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 21:26:31 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:26:31 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:26:31 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:26:32 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:32 user nova-compute[72586]: DEBUG nova.network.neutron [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Successfully updated port: c9c37169-5d08-49e3-9fdf-705b9bbe1d2f {{(pid=72586) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 21:26:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Acquiring lock "refresh_cache-f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:26:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Acquired lock "refresh_cache-f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:26:32 user nova-compute[72586]: DEBUG nova.network.neutron [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:26:32 user nova-compute[72586]: DEBUG nova.compute.manager [req-bf735ad0-0a65-4983-b8e3-a9e088d90311 req-946aef0a-83d0-43fb-8fa6-7fc7b41c729c service nova] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Received event network-changed-c9c37169-5d08-49e3-9fdf-705b9bbe1d2f {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:26:32 user nova-compute[72586]: DEBUG nova.compute.manager [req-bf735ad0-0a65-4983-b8e3-a9e088d90311 req-946aef0a-83d0-43fb-8fa6-7fc7b41c729c service nova] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Refreshing instance network info cache due to event network-changed-c9c37169-5d08-49e3-9fdf-705b9bbe1d2f. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:26:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-bf735ad0-0a65-4983-b8e3-a9e088d90311 req-946aef0a-83d0-43fb-8fa6-7fc7b41c729c service nova] Acquiring lock "refresh_cache-f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:26:32 user nova-compute[72586]: DEBUG nova.network.neutron [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Instance cache missing network info. {{(pid=72586) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 21:26:33 user nova-compute[72586]: DEBUG nova.network.neutron [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Updating instance_info_cache with network_info: [{"id": "c9c37169-5d08-49e3-9fdf-705b9bbe1d2f", "address": "fa:16:3e:ac:44:36", "network": {"id": "9ac81b44-4ebf-4780-8146-bebeb56a36b8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1925422576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6493ab8139843b191e013e61f12c877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9c37169-5d", "ovs_interfaceid": "c9c37169-5d08-49e3-9fdf-705b9bbe1d2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:26:33 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Releasing lock "refresh_cache-f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:26:33 user nova-compute[72586]: DEBUG nova.compute.manager [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Instance network_info: |[{"id": "c9c37169-5d08-49e3-9fdf-705b9bbe1d2f", "address": "fa:16:3e:ac:44:36", "network": {"id": "9ac81b44-4ebf-4780-8146-bebeb56a36b8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1925422576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6493ab8139843b191e013e61f12c877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9c37169-5d", "ovs_interfaceid": "c9c37169-5d08-49e3-9fdf-705b9bbe1d2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 21:26:33 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-bf735ad0-0a65-4983-b8e3-a9e088d90311 req-946aef0a-83d0-43fb-8fa6-7fc7b41c729c service nova] Acquired lock "refresh_cache-f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:26:33 user nova-compute[72586]: DEBUG nova.network.neutron [req-bf735ad0-0a65-4983-b8e3-a9e088d90311 req-946aef0a-83d0-43fb-8fa6-7fc7b41c729c service nova] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Refreshing network info cache for port c9c37169-5d08-49e3-9fdf-705b9bbe1d2f {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:26:33 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Start _get_guest_xml network_info=[{"id": "c9c37169-5d08-49e3-9fdf-705b9bbe1d2f", "address": "fa:16:3e:ac:44:36", "network": {"id": "9ac81b44-4ebf-4780-8146-bebeb56a36b8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1925422576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6493ab8139843b191e013e61f12c877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9c37169-5d", "ovs_interfaceid": "c9c37169-5d08-49e3-9fdf-705b9bbe1d2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '0243d46b-6819-42a5-926f-42b71f0c97ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:26:33 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:26:33 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:26:33 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:26:33 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:26:33 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:26:33 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:26:33 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:26:33 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:26:33 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:26:33 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:26:33 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:26:33 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:26:33 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:26:33 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:26:33 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:26:33 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:26:33 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:26:33 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:26:33 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:26:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-126933273',display_name='tempest-SnapshotDataIntegrityTests-server-126933273',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-126933273',id=19,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7BxuMdIZxuc72OR+/9o2mfTCKogaaJQw0W3UrLNxJOa2XuM1a9MeVmtAUOqc2nCXBIm3RyystcERj8JPuFFrNZnvF6yqV8rDaDg8ZMzzI5LRaDe1X2D+I7obyIzf+ZSg==',key_name='tempest-keypair-685232566',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6493ab8139843b191e013e61f12c877',ramdisk_id='',reservation_id='r-psj7gsuv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-215581212',owner_user_name='tempest-SnapshotDataIntegrityTests-215581212-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:26:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='794eb6a1fe4e4d3f868b57f774918b4f',uuid=f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9c37169-5d08-49e3-9fdf-705b9bbe1d2f", "address": "fa:16:3e:ac:44:36", "network": {"id": "9ac81b44-4ebf-4780-8146-bebeb56a36b8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1925422576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6493ab8139843b191e013e61f12c877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9c37169-5d", "ovs_interfaceid": "c9c37169-5d08-49e3-9fdf-705b9bbe1d2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:26:33 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Converting VIF {"id": "c9c37169-5d08-49e3-9fdf-705b9bbe1d2f", "address": "fa:16:3e:ac:44:36", "network": {"id": "9ac81b44-4ebf-4780-8146-bebeb56a36b8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1925422576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6493ab8139843b191e013e61f12c877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9c37169-5d", "ovs_interfaceid": "c9c37169-5d08-49e3-9fdf-705b9bbe1d2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:26:33 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:44:36,bridge_name='br-int',has_traffic_filtering=True,id=c9c37169-5d08-49e3-9fdf-705b9bbe1d2f,network=Network(9ac81b44-4ebf-4780-8146-bebeb56a36b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9c37169-5d') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:26:33 user nova-compute[72586]: DEBUG nova.objects.instance [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lazy-loading 'pci_devices' on Instance uuid f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:26:33 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:26:33 user nova-compute[72586]:   <uuid>f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536</uuid>
Aug 01 21:26:33 user nova-compute[72586]:   <name>instance-00000013</name>
Aug 01 21:26:33 user nova-compute[72586]:   <memory>524288</memory>
Aug 01 21:26:33 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:26:33 user nova-compute[72586]:   <metadata>
Aug 01 21:26:33 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:26:33 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:26:33 user nova-compute[72586]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-126933273</nova:name>
Aug 01 21:26:33 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:26:33</nova:creationTime>
Aug 01 21:26:33 user nova-compute[72586]:       <nova:flavor name="m1.tiny">
Aug 01 21:26:33 user nova-compute[72586]:         <nova:memory>512</nova:memory>
Aug 01 21:26:33 user nova-compute[72586]:         <nova:disk>1</nova:disk>
Aug 01 21:26:33 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:26:33 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:26:33 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:26:33 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:26:33 user nova-compute[72586]:       <nova:owner>
Aug 01 21:26:33 user nova-compute[72586]:         <nova:user uuid="794eb6a1fe4e4d3f868b57f774918b4f">tempest-SnapshotDataIntegrityTests-215581212-project-member</nova:user>
Aug 01 21:26:33 user nova-compute[72586]:         <nova:project uuid="e6493ab8139843b191e013e61f12c877">tempest-SnapshotDataIntegrityTests-215581212</nova:project>
Aug 01 21:26:33 user nova-compute[72586]:       </nova:owner>
Aug 01 21:26:33 user nova-compute[72586]:       <nova:root type="image" uuid="0243d46b-6819-42a5-926f-42b71f0c97ad"/>
Aug 01 21:26:33 user nova-compute[72586]:       <nova:ports>
Aug 01 21:26:33 user nova-compute[72586]:         <nova:port uuid="c9c37169-5d08-49e3-9fdf-705b9bbe1d2f">
Aug 01 21:26:33 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 01 21:26:33 user nova-compute[72586]:         </nova:port>
Aug 01 21:26:33 user nova-compute[72586]:       </nova:ports>
Aug 01 21:26:33 user nova-compute[72586]:     </nova:instance>
Aug 01 21:26:33 user nova-compute[72586]:   </metadata>
Aug 01 21:26:33 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:26:33 user nova-compute[72586]:     <system>
Aug 01 21:26:33 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:26:33 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:26:33 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:26:33 user nova-compute[72586]:       <entry name="serial">f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536</entry>
Aug 01 21:26:33 user nova-compute[72586]:       <entry name="uuid">f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536</entry>
Aug 01 21:26:33 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:26:33 user nova-compute[72586]:     </system>
Aug 01 21:26:33 user nova-compute[72586]:   </sysinfo>
Aug 01 21:26:33 user nova-compute[72586]:   <os>
Aug 01 21:26:33 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:26:33 user nova-compute[72586]:     <boot dev="hd"/>
Aug 01 21:26:33 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:26:33 user nova-compute[72586]:   </os>
Aug 01 21:26:33 user nova-compute[72586]:   <features>
Aug 01 21:26:33 user nova-compute[72586]:     <acpi/>
Aug 01 21:26:33 user nova-compute[72586]:     <apic/>
Aug 01 21:26:33 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:26:33 user nova-compute[72586]:   </features>
Aug 01 21:26:33 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:26:33 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:26:33 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:26:33 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:26:33 user nova-compute[72586]:   </clock>
Aug 01 21:26:33 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:26:33 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:26:33 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:26:33 user nova-compute[72586]:   </cpu>
Aug 01 21:26:33 user nova-compute[72586]:   <devices>
Aug 01 21:26:33 user nova-compute[72586]:     <disk type="file" device="disk">
Aug 01 21:26:33 user nova-compute[72586]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 21:26:33 user nova-compute[72586]:       <source file="/opt/stack/data/nova/instances/f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536/disk"/>
Aug 01 21:26:33 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:26:33 user nova-compute[72586]:     </disk>
Aug 01 21:26:33 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:26:33 user nova-compute[72586]:       <mac address="fa:16:3e:ac:44:36"/>
Aug 01 21:26:33 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:26:33 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:26:33 user nova-compute[72586]:       <target dev="tapc9c37169-5d"/>
Aug 01 21:26:33 user nova-compute[72586]:     </interface>
Aug 01 21:26:33 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:26:33 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536/console.log" append="off"/>
Aug 01 21:26:33 user nova-compute[72586]:     </serial>
Aug 01 21:26:33 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:26:33 user nova-compute[72586]:     <video>
Aug 01 21:26:33 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:26:33 user nova-compute[72586]:     </video>
Aug 01 21:26:33 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:26:33 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:26:33 user nova-compute[72586]:     </rng>
Aug 01 21:26:33 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:26:33 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:26:33 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:26:33 user nova-compute[72586]:     </memballoon>
Aug 01 21:26:33 user nova-compute[72586]:   </devices>
Aug 01 21:26:33 user nova-compute[72586]: </domain>
Aug 01 21:26:33 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:26:33 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:26:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-126933273',display_name='tempest-SnapshotDataIntegrityTests-server-126933273',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-126933273',id=19,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7BxuMdIZxuc72OR+/9o2mfTCKogaaJQw0W3UrLNxJOa2XuM1a9MeVmtAUOqc2nCXBIm3RyystcERj8JPuFFrNZnvF6yqV8rDaDg8ZMzzI5LRaDe1X2D+I7obyIzf+ZSg==',key_name='tempest-keypair-685232566',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6493ab8139843b191e013e61f12c877',ramdisk_id='',reservation_id='r-psj7gsuv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-215581212',owner_user_name='tempest-SnapshotDataIntegrityTests-215581212-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:26:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='794eb6a1fe4e4d3f868b57f774918b4f',uuid=f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9c37169-5d08-49e3-9fdf-705b9bbe1d2f", "address": "fa:16:3e:ac:44:36", "network": {"id": "9ac81b44-4ebf-4780-8146-bebeb56a36b8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1925422576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6493ab8139843b191e013e61f12c877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9c37169-5d", "ovs_interfaceid": "c9c37169-5d08-49e3-9fdf-705b9bbe1d2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:26:33 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Converting VIF {"id": "c9c37169-5d08-49e3-9fdf-705b9bbe1d2f", "address": "fa:16:3e:ac:44:36", "network": {"id": "9ac81b44-4ebf-4780-8146-bebeb56a36b8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1925422576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6493ab8139843b191e013e61f12c877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9c37169-5d", "ovs_interfaceid": "c9c37169-5d08-49e3-9fdf-705b9bbe1d2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:26:33 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:44:36,bridge_name='br-int',has_traffic_filtering=True,id=c9c37169-5d08-49e3-9fdf-705b9bbe1d2f,network=Network(9ac81b44-4ebf-4780-8146-bebeb56a36b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9c37169-5d') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:26:33 user nova-compute[72586]: DEBUG os_vif [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:44:36,bridge_name='br-int',has_traffic_filtering=True,id=c9c37169-5d08-49e3-9fdf-705b9bbe1d2f,network=Network(9ac81b44-4ebf-4780-8146-bebeb56a36b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9c37169-5d') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:26:33 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:33 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:26:33 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:26:33 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:33 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc9c37169-5d, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:26:33 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc9c37169-5d, col_values=(('external_ids', {'iface-id': 'c9c37169-5d08-49e3-9fdf-705b9bbe1d2f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:44:36', 'vm-uuid': 'f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:26:33 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:33 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:33 user nova-compute[72586]: INFO os_vif [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:44:36,bridge_name='br-int',has_traffic_filtering=True,id=c9c37169-5d08-49e3-9fdf-705b9bbe1d2f,network=Network(9ac81b44-4ebf-4780-8146-bebeb56a36b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9c37169-5d')
Aug 01 21:26:33 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:26:33 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] No VIF found with MAC fa:16:3e:ac:44:36, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:26:33 user nova-compute[72586]: DEBUG nova.network.neutron [req-bf735ad0-0a65-4983-b8e3-a9e088d90311 req-946aef0a-83d0-43fb-8fa6-7fc7b41c729c service nova] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Updated VIF entry in instance network info cache for port c9c37169-5d08-49e3-9fdf-705b9bbe1d2f. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:26:33 user nova-compute[72586]: DEBUG nova.network.neutron [req-bf735ad0-0a65-4983-b8e3-a9e088d90311 req-946aef0a-83d0-43fb-8fa6-7fc7b41c729c service nova] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Updating instance_info_cache with network_info: [{"id": "c9c37169-5d08-49e3-9fdf-705b9bbe1d2f", "address": "fa:16:3e:ac:44:36", "network": {"id": "9ac81b44-4ebf-4780-8146-bebeb56a36b8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1925422576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6493ab8139843b191e013e61f12c877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9c37169-5d", "ovs_interfaceid": "c9c37169-5d08-49e3-9fdf-705b9bbe1d2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:26:33 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-bf735ad0-0a65-4983-b8e3-a9e088d90311 req-946aef0a-83d0-43fb-8fa6-7fc7b41c729c service nova] Releasing lock "refresh_cache-f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:26:34 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:34 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:34 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:34 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:35 user nova-compute[72586]: DEBUG nova.compute.manager [req-f52d70a3-2bb6-4fe2-8584-7cfea910378f req-3fbad3d6-6387-4849-a01c-ba1272565f67 service nova] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Received event network-vif-plugged-c9c37169-5d08-49e3-9fdf-705b9bbe1d2f {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:26:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-f52d70a3-2bb6-4fe2-8584-7cfea910378f req-3fbad3d6-6387-4849-a01c-ba1272565f67 service nova] Acquiring lock "f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:26:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-f52d70a3-2bb6-4fe2-8584-7cfea910378f req-3fbad3d6-6387-4849-a01c-ba1272565f67 service nova] Lock "f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:26:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-f52d70a3-2bb6-4fe2-8584-7cfea910378f req-3fbad3d6-6387-4849-a01c-ba1272565f67 service nova] Lock "f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:26:35 user nova-compute[72586]: DEBUG nova.compute.manager [req-f52d70a3-2bb6-4fe2-8584-7cfea910378f req-3fbad3d6-6387-4849-a01c-ba1272565f67 service nova] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] No waiting events found dispatching network-vif-plugged-c9c37169-5d08-49e3-9fdf-705b9bbe1d2f {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:26:35 user nova-compute[72586]: WARNING nova.compute.manager [req-f52d70a3-2bb6-4fe2-8584-7cfea910378f req-3fbad3d6-6387-4849-a01c-ba1272565f67 service nova] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Received unexpected event network-vif-plugged-c9c37169-5d08-49e3-9fdf-705b9bbe1d2f for instance with vm_state building and task_state spawning.
Aug 01 21:26:35 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:35 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:35 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:36 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925196.8273897, f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536 => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:26:36 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] VM Resumed (Lifecycle Event)
Aug 01 21:26:36 user nova-compute[72586]: DEBUG nova.compute.manager [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Instance event wait completed in 0 seconds for  {{(pid=72586) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 21:26:36 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Guest created on hypervisor {{(pid=72586) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 21:26:36 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Instance spawned successfully.
Aug 01 21:26:36 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 21:26:36 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:26:36 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:26:36 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Found default for hw_cdrom_bus of ide {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:26:36 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Found default for hw_disk_bus of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:26:36 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Found default for hw_input_bus of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:26:36 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Found default for hw_pointer_model of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:26:36 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Found default for hw_video_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:26:36 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Found default for hw_vif_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:26:36 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:26:36 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925196.8289924, f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536 => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:26:36 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] VM Started (Lifecycle Event)
Aug 01 21:26:36 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:26:36 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:26:36 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:26:36 user nova-compute[72586]: INFO nova.compute.manager [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Took 5.80 seconds to spawn the instance on the hypervisor.
Aug 01 21:26:36 user nova-compute[72586]: DEBUG nova.compute.manager [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:26:37 user nova-compute[72586]: INFO nova.compute.manager [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Took 6.51 seconds to build instance.
Aug 01 21:26:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f69f3d61-d8e9-44f4-a14e-e6b9cb2486a0 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lock "f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.621s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:26:37 user nova-compute[72586]: DEBUG nova.compute.manager [req-2b2ae8ac-6f8f-4f23-8e6b-478fbab5a48a req-496cf757-e9b0-42c2-95f7-27fb839c5421 service nova] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Received event network-vif-plugged-c9c37169-5d08-49e3-9fdf-705b9bbe1d2f {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:26:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-2b2ae8ac-6f8f-4f23-8e6b-478fbab5a48a req-496cf757-e9b0-42c2-95f7-27fb839c5421 service nova] Acquiring lock "f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:26:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-2b2ae8ac-6f8f-4f23-8e6b-478fbab5a48a req-496cf757-e9b0-42c2-95f7-27fb839c5421 service nova] Lock "f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:26:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-2b2ae8ac-6f8f-4f23-8e6b-478fbab5a48a req-496cf757-e9b0-42c2-95f7-27fb839c5421 service nova] Lock "f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:26:37 user nova-compute[72586]: DEBUG nova.compute.manager [req-2b2ae8ac-6f8f-4f23-8e6b-478fbab5a48a req-496cf757-e9b0-42c2-95f7-27fb839c5421 service nova] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] No waiting events found dispatching network-vif-plugged-c9c37169-5d08-49e3-9fdf-705b9bbe1d2f {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:26:37 user nova-compute[72586]: WARNING nova.compute.manager [req-2b2ae8ac-6f8f-4f23-8e6b-478fbab5a48a req-496cf757-e9b0-42c2-95f7-27fb839c5421 service nova] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Received unexpected event network-vif-plugged-c9c37169-5d08-49e3-9fdf-705b9bbe1d2f for instance with vm_state active and task_state None.
Aug 01 21:26:37 user nova-compute[72586]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690925182.5745656, 0fde640d-b731-405d-af91-fb4ef85fe90a => Stopped> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:26:37 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] VM Stopped (Lifecycle Event)
Aug 01 21:26:37 user nova-compute[72586]: DEBUG nova.compute.manager [None req-6a7f527b-3537-4767-8129-37114be0b757 None None] [instance: 0fde640d-b731-405d-af91-fb4ef85fe90a] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:26:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Acquiring lock "8c352ce2-5d08-424a-928f-2fd1cf58e491" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:26:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lock "8c352ce2-5d08-424a-928f-2fd1cf58e491" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:26:37 user nova-compute[72586]: DEBUG nova.compute.manager [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Starting instance... {{(pid=72586) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 21:26:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:26:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:26:37 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72586) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 21:26:37 user nova-compute[72586]: INFO nova.compute.claims [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Claim successful on node user
Aug 01 21:26:38 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:26:38 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:26:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.337s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:26:38 user nova-compute[72586]: DEBUG nova.compute.manager [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Start building networks asynchronously for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 21:26:38 user nova-compute[72586]: DEBUG nova.compute.manager [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Allocating IP information in the background. {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 21:26:38 user nova-compute[72586]: DEBUG nova.network.neutron [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] allocate_for_instance() {{(pid=72586) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 21:26:38 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 21:26:38 user nova-compute[72586]: DEBUG nova.compute.manager [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Start building block device mappings for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 21:26:38 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:38 user nova-compute[72586]: DEBUG nova.policy [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0e8daa888b0c4b8fa6e42cab3058bd4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd51ad6ca4045699c8d72f9382f1c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72586) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 21:26:38 user nova-compute[72586]: DEBUG nova.compute.manager [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Start spawning the instance on the hypervisor. {{(pid=72586) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 21:26:38 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Creating instance directory {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 21:26:38 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Creating image(s)
Aug 01 21:26:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Acquiring lock "/opt/stack/data/nova/instances/8c352ce2-5d08-424a-928f-2fd1cf58e491/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:26:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lock "/opt/stack/data/nova/instances/8c352ce2-5d08-424a-928f-2fd1cf58e491/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:26:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lock "/opt/stack/data/nova/instances/8c352ce2-5d08-424a-928f-2fd1cf58e491/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:26:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:26:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.143s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:26:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Acquiring lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:26:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:26:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:26:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.144s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:26:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/8c352ce2-5d08-424a-928f-2fd1cf58e491/disk 1073741824 {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:26:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/8c352ce2-5d08-424a-928f-2fd1cf58e491/disk 1073741824" returned: 0 in 0.056s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:26:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.210s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:26:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:26:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.138s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:26:38 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8c352ce2-5d08-424a-928f-2fd1cf58e491/disk. size=1073741824 {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 21:26:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c352ce2-5d08-424a-928f-2fd1cf58e491/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:26:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c352ce2-5d08-424a-928f-2fd1cf58e491/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:26:39 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Cannot resize image /opt/stack/data/nova/instances/8c352ce2-5d08-424a-928f-2fd1cf58e491/disk to a smaller size. {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 21:26:39 user nova-compute[72586]: DEBUG nova.objects.instance [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lazy-loading 'migration_context' on Instance uuid 8c352ce2-5d08-424a-928f-2fd1cf58e491 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:26:39 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Created local disks {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 21:26:39 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Ensure instance console log exists: /opt/stack/data/nova/instances/8c352ce2-5d08-424a-928f-2fd1cf58e491/console.log {{(pid=72586) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 21:26:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:26:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:26:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:26:39 user nova-compute[72586]: DEBUG nova.network.neutron [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Successfully created port: 8a59a718-b5fe-41d2-b057-971717d0dee6 {{(pid=72586) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 21:26:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:39 user nova-compute[72586]: DEBUG nova.network.neutron [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Successfully updated port: 8a59a718-b5fe-41d2-b057-971717d0dee6 {{(pid=72586) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 21:26:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Acquiring lock "refresh_cache-8c352ce2-5d08-424a-928f-2fd1cf58e491" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:26:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Acquired lock "refresh_cache-8c352ce2-5d08-424a-928f-2fd1cf58e491" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:26:39 user nova-compute[72586]: DEBUG nova.network.neutron [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:26:39 user nova-compute[72586]: DEBUG nova.compute.manager [req-59866269-da05-47d7-8f29-16d858fc476a req-c91bf655-67dd-4363-864b-b556eb3d60e0 service nova] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Received event network-changed-8a59a718-b5fe-41d2-b057-971717d0dee6 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:26:39 user nova-compute[72586]: DEBUG nova.compute.manager [req-59866269-da05-47d7-8f29-16d858fc476a req-c91bf655-67dd-4363-864b-b556eb3d60e0 service nova] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Refreshing instance network info cache due to event network-changed-8a59a718-b5fe-41d2-b057-971717d0dee6. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:26:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-59866269-da05-47d7-8f29-16d858fc476a req-c91bf655-67dd-4363-864b-b556eb3d60e0 service nova] Acquiring lock "refresh_cache-8c352ce2-5d08-424a-928f-2fd1cf58e491" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:26:39 user nova-compute[72586]: DEBUG nova.network.neutron [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Instance cache missing network info. {{(pid=72586) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 21:26:40 user nova-compute[72586]: DEBUG nova.network.neutron [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Updating instance_info_cache with network_info: [{"id": "8a59a718-b5fe-41d2-b057-971717d0dee6", "address": "fa:16:3e:52:0d:35", "network": {"id": "8e60d949-6c06-4e40-b792-d6f516b967d7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-603740209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfd51ad6ca4045699c8d72f9382f1c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a59a718-b5", "ovs_interfaceid": "8a59a718-b5fe-41d2-b057-971717d0dee6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:26:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Releasing lock "refresh_cache-8c352ce2-5d08-424a-928f-2fd1cf58e491" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:26:40 user nova-compute[72586]: DEBUG nova.compute.manager [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Instance network_info: |[{"id": "8a59a718-b5fe-41d2-b057-971717d0dee6", "address": "fa:16:3e:52:0d:35", "network": {"id": "8e60d949-6c06-4e40-b792-d6f516b967d7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-603740209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfd51ad6ca4045699c8d72f9382f1c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a59a718-b5", "ovs_interfaceid": "8a59a718-b5fe-41d2-b057-971717d0dee6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 21:26:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-59866269-da05-47d7-8f29-16d858fc476a req-c91bf655-67dd-4363-864b-b556eb3d60e0 service nova] Acquired lock "refresh_cache-8c352ce2-5d08-424a-928f-2fd1cf58e491" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:26:40 user nova-compute[72586]: DEBUG nova.network.neutron [req-59866269-da05-47d7-8f29-16d858fc476a req-c91bf655-67dd-4363-864b-b556eb3d60e0 service nova] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Refreshing network info cache for port 8a59a718-b5fe-41d2-b057-971717d0dee6 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:26:40 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Start _get_guest_xml network_info=[{"id": "8a59a718-b5fe-41d2-b057-971717d0dee6", "address": "fa:16:3e:52:0d:35", "network": {"id": "8e60d949-6c06-4e40-b792-d6f516b967d7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-603740209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfd51ad6ca4045699c8d72f9382f1c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a59a718-b5", "ovs_interfaceid": "8a59a718-b5fe-41d2-b057-971717d0dee6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '0243d46b-6819-42a5-926f-42b71f0c97ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:26:40 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:26:40 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:26:40 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:26:40 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:26:40 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:26:40 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:26:40 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:26:40 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:26:40 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:26:40 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:26:40 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:26:40 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:26:40 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:26:40 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:26:40 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:26:40 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:26:40 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:26:40 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:26:40 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:26:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-909752833',display_name='tempest-VolumesSnapshotTestJSON-instance-909752833',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-909752833',id=20,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLREhLSRdrG8Gzq2uPhj+STphVmaGtK1Gu+RePBMZJqEPe7FMNXvS6iSQbBh7Z5nBK0bIXLDduFnNyt7UAlwtcP9tT/55rygAQrEwG9sK53JbxFoiiewxxlu/VBobtzY7g==',key_name='tempest-keypair-1179261345',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dfd51ad6ca4045699c8d72f9382f1c62',ramdisk_id='',reservation_id='r-eqqzd3wr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1613093006',owner_user_name='tempest-VolumesSnapshotTestJSON-1613093006-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:26:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e8daa888b0c4b8fa6e42cab3058bd4c',uuid=8c352ce2-5d08-424a-928f-2fd1cf58e491,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a59a718-b5fe-41d2-b057-971717d0dee6", "address": "fa:16:3e:52:0d:35", "network": {"id": "8e60d949-6c06-4e40-b792-d6f516b967d7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-603740209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfd51ad6ca4045699c8d72f9382f1c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a59a718-b5", "ovs_interfaceid": "8a59a718-b5fe-41d2-b057-971717d0dee6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:26:40 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Converting VIF {"id": "8a59a718-b5fe-41d2-b057-971717d0dee6", "address": "fa:16:3e:52:0d:35", "network": {"id": "8e60d949-6c06-4e40-b792-d6f516b967d7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-603740209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfd51ad6ca4045699c8d72f9382f1c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a59a718-b5", "ovs_interfaceid": "8a59a718-b5fe-41d2-b057-971717d0dee6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:26:40 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:0d:35,bridge_name='br-int',has_traffic_filtering=True,id=8a59a718-b5fe-41d2-b057-971717d0dee6,network=Network(8e60d949-6c06-4e40-b792-d6f516b967d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a59a718-b5') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:26:40 user nova-compute[72586]: DEBUG nova.objects.instance [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lazy-loading 'pci_devices' on Instance uuid 8c352ce2-5d08-424a-928f-2fd1cf58e491 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:26:40 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:26:40 user nova-compute[72586]:   <uuid>8c352ce2-5d08-424a-928f-2fd1cf58e491</uuid>
Aug 01 21:26:40 user nova-compute[72586]:   <name>instance-00000014</name>
Aug 01 21:26:40 user nova-compute[72586]:   <memory>524288</memory>
Aug 01 21:26:40 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:26:40 user nova-compute[72586]:   <metadata>
Aug 01 21:26:40 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:26:40 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:26:40 user nova-compute[72586]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-909752833</nova:name>
Aug 01 21:26:40 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:26:40</nova:creationTime>
Aug 01 21:26:40 user nova-compute[72586]:       <nova:flavor name="m1.tiny">
Aug 01 21:26:40 user nova-compute[72586]:         <nova:memory>512</nova:memory>
Aug 01 21:26:40 user nova-compute[72586]:         <nova:disk>1</nova:disk>
Aug 01 21:26:40 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:26:40 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:26:40 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:26:40 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:26:40 user nova-compute[72586]:       <nova:owner>
Aug 01 21:26:40 user nova-compute[72586]:         <nova:user uuid="0e8daa888b0c4b8fa6e42cab3058bd4c">tempest-VolumesSnapshotTestJSON-1613093006-project-member</nova:user>
Aug 01 21:26:40 user nova-compute[72586]:         <nova:project uuid="dfd51ad6ca4045699c8d72f9382f1c62">tempest-VolumesSnapshotTestJSON-1613093006</nova:project>
Aug 01 21:26:40 user nova-compute[72586]:       </nova:owner>
Aug 01 21:26:40 user nova-compute[72586]:       <nova:root type="image" uuid="0243d46b-6819-42a5-926f-42b71f0c97ad"/>
Aug 01 21:26:40 user nova-compute[72586]:       <nova:ports>
Aug 01 21:26:40 user nova-compute[72586]:         <nova:port uuid="8a59a718-b5fe-41d2-b057-971717d0dee6">
Aug 01 21:26:40 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 01 21:26:40 user nova-compute[72586]:         </nova:port>
Aug 01 21:26:40 user nova-compute[72586]:       </nova:ports>
Aug 01 21:26:40 user nova-compute[72586]:     </nova:instance>
Aug 01 21:26:40 user nova-compute[72586]:   </metadata>
Aug 01 21:26:40 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:26:40 user nova-compute[72586]:     <system>
Aug 01 21:26:40 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:26:40 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:26:40 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:26:40 user nova-compute[72586]:       <entry name="serial">8c352ce2-5d08-424a-928f-2fd1cf58e491</entry>
Aug 01 21:26:40 user nova-compute[72586]:       <entry name="uuid">8c352ce2-5d08-424a-928f-2fd1cf58e491</entry>
Aug 01 21:26:40 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:26:40 user nova-compute[72586]:     </system>
Aug 01 21:26:40 user nova-compute[72586]:   </sysinfo>
Aug 01 21:26:40 user nova-compute[72586]:   <os>
Aug 01 21:26:40 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:26:40 user nova-compute[72586]:     <boot dev="hd"/>
Aug 01 21:26:40 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:26:40 user nova-compute[72586]:   </os>
Aug 01 21:26:40 user nova-compute[72586]:   <features>
Aug 01 21:26:40 user nova-compute[72586]:     <acpi/>
Aug 01 21:26:40 user nova-compute[72586]:     <apic/>
Aug 01 21:26:40 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:26:40 user nova-compute[72586]:   </features>
Aug 01 21:26:40 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:26:40 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:26:40 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:26:40 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:26:40 user nova-compute[72586]:   </clock>
Aug 01 21:26:40 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:26:40 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:26:40 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:26:40 user nova-compute[72586]:   </cpu>
Aug 01 21:26:40 user nova-compute[72586]:   <devices>
Aug 01 21:26:40 user nova-compute[72586]:     <disk type="file" device="disk">
Aug 01 21:26:40 user nova-compute[72586]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 21:26:40 user nova-compute[72586]:       <source file="/opt/stack/data/nova/instances/8c352ce2-5d08-424a-928f-2fd1cf58e491/disk"/>
Aug 01 21:26:40 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:26:40 user nova-compute[72586]:     </disk>
Aug 01 21:26:40 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:26:40 user nova-compute[72586]:       <mac address="fa:16:3e:52:0d:35"/>
Aug 01 21:26:40 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:26:40 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:26:40 user nova-compute[72586]:       <target dev="tap8a59a718-b5"/>
Aug 01 21:26:40 user nova-compute[72586]:     </interface>
Aug 01 21:26:40 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:26:40 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/8c352ce2-5d08-424a-928f-2fd1cf58e491/console.log" append="off"/>
Aug 01 21:26:40 user nova-compute[72586]:     </serial>
Aug 01 21:26:40 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:26:40 user nova-compute[72586]:     <video>
Aug 01 21:26:40 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:26:40 user nova-compute[72586]:     </video>
Aug 01 21:26:40 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:26:40 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:26:40 user nova-compute[72586]:     </rng>
Aug 01 21:26:40 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:26:40 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:26:40 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:26:40 user nova-compute[72586]:     </memballoon>
Aug 01 21:26:40 user nova-compute[72586]:   </devices>
Aug 01 21:26:40 user nova-compute[72586]: </domain>
Aug 01 21:26:40 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:26:40 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:26:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-909752833',display_name='tempest-VolumesSnapshotTestJSON-instance-909752833',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-909752833',id=20,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLREhLSRdrG8Gzq2uPhj+STphVmaGtK1Gu+RePBMZJqEPe7FMNXvS6iSQbBh7Z5nBK0bIXLDduFnNyt7UAlwtcP9tT/55rygAQrEwG9sK53JbxFoiiewxxlu/VBobtzY7g==',key_name='tempest-keypair-1179261345',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dfd51ad6ca4045699c8d72f9382f1c62',ramdisk_id='',reservation_id='r-eqqzd3wr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1613093006',owner_user_name='tempest-VolumesSnapshotTestJSON-1613093006-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:26:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e8daa888b0c4b8fa6e42cab3058bd4c',uuid=8c352ce2-5d08-424a-928f-2fd1cf58e491,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a59a718-b5fe-41d2-b057-971717d0dee6", "address": "fa:16:3e:52:0d:35", "network": {"id": "8e60d949-6c06-4e40-b792-d6f516b967d7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-603740209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfd51ad6ca4045699c8d72f9382f1c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a59a718-b5", "ovs_interfaceid": "8a59a718-b5fe-41d2-b057-971717d0dee6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:26:40 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Converting VIF {"id": "8a59a718-b5fe-41d2-b057-971717d0dee6", "address": "fa:16:3e:52:0d:35", "network": {"id": "8e60d949-6c06-4e40-b792-d6f516b967d7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-603740209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfd51ad6ca4045699c8d72f9382f1c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a59a718-b5", "ovs_interfaceid": "8a59a718-b5fe-41d2-b057-971717d0dee6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:26:40 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:0d:35,bridge_name='br-int',has_traffic_filtering=True,id=8a59a718-b5fe-41d2-b057-971717d0dee6,network=Network(8e60d949-6c06-4e40-b792-d6f516b967d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a59a718-b5') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:26:40 user nova-compute[72586]: DEBUG os_vif [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:0d:35,bridge_name='br-int',has_traffic_filtering=True,id=8a59a718-b5fe-41d2-b057-971717d0dee6,network=Network(8e60d949-6c06-4e40-b792-d6f516b967d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a59a718-b5') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:26:40 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:40 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:26:40 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:26:40 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:40 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a59a718-b5, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:26:40 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8a59a718-b5, col_values=(('external_ids', {'iface-id': '8a59a718-b5fe-41d2-b057-971717d0dee6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:0d:35', 'vm-uuid': '8c352ce2-5d08-424a-928f-2fd1cf58e491'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:26:40 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:40 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:26:40 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:40 user nova-compute[72586]: INFO os_vif [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:0d:35,bridge_name='br-int',has_traffic_filtering=True,id=8a59a718-b5fe-41d2-b057-971717d0dee6,network=Network(8e60d949-6c06-4e40-b792-d6f516b967d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a59a718-b5')
Aug 01 21:26:40 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:26:40 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] No VIF found with MAC fa:16:3e:52:0d:35, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:26:40 user nova-compute[72586]: DEBUG nova.network.neutron [req-59866269-da05-47d7-8f29-16d858fc476a req-c91bf655-67dd-4363-864b-b556eb3d60e0 service nova] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Updated VIF entry in instance network info cache for port 8a59a718-b5fe-41d2-b057-971717d0dee6. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:26:40 user nova-compute[72586]: DEBUG nova.network.neutron [req-59866269-da05-47d7-8f29-16d858fc476a req-c91bf655-67dd-4363-864b-b556eb3d60e0 service nova] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Updating instance_info_cache with network_info: [{"id": "8a59a718-b5fe-41d2-b057-971717d0dee6", "address": "fa:16:3e:52:0d:35", "network": {"id": "8e60d949-6c06-4e40-b792-d6f516b967d7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-603740209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfd51ad6ca4045699c8d72f9382f1c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a59a718-b5", "ovs_interfaceid": "8a59a718-b5fe-41d2-b057-971717d0dee6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:26:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-59866269-da05-47d7-8f29-16d858fc476a req-c91bf655-67dd-4363-864b-b556eb3d60e0 service nova] Releasing lock "refresh_cache-8c352ce2-5d08-424a-928f-2fd1cf58e491" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:26:41 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:41 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:41 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:41 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:41 user nova-compute[72586]: DEBUG nova.compute.manager [req-0541472f-847e-4eac-a1cc-c03d80fb146a req-4ac2b195-3452-4fdd-93e3-754001927a46 service nova] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Received event network-vif-plugged-8a59a718-b5fe-41d2-b057-971717d0dee6 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:26:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-0541472f-847e-4eac-a1cc-c03d80fb146a req-4ac2b195-3452-4fdd-93e3-754001927a46 service nova] Acquiring lock "8c352ce2-5d08-424a-928f-2fd1cf58e491-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:26:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-0541472f-847e-4eac-a1cc-c03d80fb146a req-4ac2b195-3452-4fdd-93e3-754001927a46 service nova] Lock "8c352ce2-5d08-424a-928f-2fd1cf58e491-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:26:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-0541472f-847e-4eac-a1cc-c03d80fb146a req-4ac2b195-3452-4fdd-93e3-754001927a46 service nova] Lock "8c352ce2-5d08-424a-928f-2fd1cf58e491-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:26:41 user nova-compute[72586]: DEBUG nova.compute.manager [req-0541472f-847e-4eac-a1cc-c03d80fb146a req-4ac2b195-3452-4fdd-93e3-754001927a46 service nova] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] No waiting events found dispatching network-vif-plugged-8a59a718-b5fe-41d2-b057-971717d0dee6 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:26:41 user nova-compute[72586]: WARNING nova.compute.manager [req-0541472f-847e-4eac-a1cc-c03d80fb146a req-4ac2b195-3452-4fdd-93e3-754001927a46 service nova] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Received unexpected event network-vif-plugged-8a59a718-b5fe-41d2-b057-971717d0dee6 for instance with vm_state building and task_state spawning.
Aug 01 21:26:42 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:42 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:42 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:42 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:43 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925203.833985, 8c352ce2-5d08-424a-928f-2fd1cf58e491 => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:26:43 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] VM Resumed (Lifecycle Event)
Aug 01 21:26:43 user nova-compute[72586]: DEBUG nova.compute.manager [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Instance event wait completed in 0 seconds for  {{(pid=72586) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 21:26:43 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Guest created on hypervisor {{(pid=72586) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 21:26:43 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Instance spawned successfully.
Aug 01 21:26:43 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 21:26:43 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:26:43 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:26:43 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Found default for hw_cdrom_bus of ide {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:26:43 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Found default for hw_disk_bus of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:26:43 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Found default for hw_input_bus of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:26:43 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Found default for hw_pointer_model of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:26:43 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Found default for hw_video_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:26:43 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Found default for hw_vif_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:26:43 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:26:43 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925203.83733, 8c352ce2-5d08-424a-928f-2fd1cf58e491 => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:26:43 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] VM Started (Lifecycle Event)
Aug 01 21:26:43 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:26:43 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:26:43 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:26:43 user nova-compute[72586]: INFO nova.compute.manager [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Took 5.59 seconds to spawn the instance on the hypervisor.
Aug 01 21:26:43 user nova-compute[72586]: DEBUG nova.compute.manager [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:26:44 user nova-compute[72586]: INFO nova.compute.manager [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Took 6.23 seconds to build instance.
Aug 01 21:26:44 user nova-compute[72586]: DEBUG nova.compute.manager [req-0234847d-ea06-4fce-b2d0-da56b7d9ac63 req-b678443a-1c3d-4541-8ae7-1976b6886038 service nova] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Received event network-vif-plugged-8a59a718-b5fe-41d2-b057-971717d0dee6 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:26:44 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-0234847d-ea06-4fce-b2d0-da56b7d9ac63 req-b678443a-1c3d-4541-8ae7-1976b6886038 service nova] Acquiring lock "8c352ce2-5d08-424a-928f-2fd1cf58e491-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:26:44 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-0234847d-ea06-4fce-b2d0-da56b7d9ac63 req-b678443a-1c3d-4541-8ae7-1976b6886038 service nova] Lock "8c352ce2-5d08-424a-928f-2fd1cf58e491-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:26:44 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-0234847d-ea06-4fce-b2d0-da56b7d9ac63 req-b678443a-1c3d-4541-8ae7-1976b6886038 service nova] Lock "8c352ce2-5d08-424a-928f-2fd1cf58e491-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:26:44 user nova-compute[72586]: DEBUG nova.compute.manager [req-0234847d-ea06-4fce-b2d0-da56b7d9ac63 req-b678443a-1c3d-4541-8ae7-1976b6886038 service nova] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] No waiting events found dispatching network-vif-plugged-8a59a718-b5fe-41d2-b057-971717d0dee6 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:26:44 user nova-compute[72586]: WARNING nova.compute.manager [req-0234847d-ea06-4fce-b2d0-da56b7d9ac63 req-b678443a-1c3d-4541-8ae7-1976b6886038 service nova] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Received unexpected event network-vif-plugged-8a59a718-b5fe-41d2-b057-971717d0dee6 for instance with vm_state active and task_state None.
Aug 01 21:26:44 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-550b7704-24a1-431f-a2d8-e90777e222a1 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lock "8c352ce2-5d08-424a-928f-2fd1cf58e491" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.368s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:26:44 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:45 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:49 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:50 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:52 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:54 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:55 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:56 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:26:59 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:00 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:02 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:03 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Acquiring lock "f9b8f9c5-0129-429d-beb6-26d4c9cc085d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:27:03 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "f9b8f9c5-0129-429d-beb6-26d4c9cc085d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:27:03 user nova-compute[72586]: DEBUG nova.compute.manager [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Starting instance... {{(pid=72586) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 21:27:03 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:27:03 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:27:03 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72586) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 21:27:03 user nova-compute[72586]: INFO nova.compute.claims [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Claim successful on node user
Aug 01 21:27:03 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:27:03 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:27:03 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.449s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:27:03 user nova-compute[72586]: DEBUG nova.compute.manager [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Start building networks asynchronously for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 21:27:03 user nova-compute[72586]: DEBUG nova.compute.manager [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Allocating IP information in the background. {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 21:27:03 user nova-compute[72586]: DEBUG nova.network.neutron [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] allocate_for_instance() {{(pid=72586) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 21:27:03 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 21:27:03 user nova-compute[72586]: DEBUG nova.compute.manager [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Start building block device mappings for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 21:27:03 user nova-compute[72586]: DEBUG nova.policy [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e1a0d71c79c04216b9bf278f650aeb77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae659e4ad43c44e2a8f6d48818bb796a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72586) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 21:27:04 user nova-compute[72586]: DEBUG nova.compute.manager [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Start spawning the instance on the hypervisor. {{(pid=72586) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 21:27:04 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Creating instance directory {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 21:27:04 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Creating image(s)
Aug 01 21:27:04 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Acquiring lock "/opt/stack/data/nova/instances/f9b8f9c5-0129-429d-beb6-26d4c9cc085d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:27:04 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "/opt/stack/data/nova/instances/f9b8f9c5-0129-429d-beb6-26d4c9cc085d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:27:04 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "/opt/stack/data/nova/instances/f9b8f9c5-0129-429d-beb6-26d4c9cc085d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:27:04 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:04 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.147s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:04 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Acquiring lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:27:04 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:27:04 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:04 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:04 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.140s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:04 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/f9b8f9c5-0129-429d-beb6-26d4c9cc085d/disk 1073741824 {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:04 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/f9b8f9c5-0129-429d-beb6-26d4c9cc085d/disk 1073741824" returned: 0 in 0.089s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:04 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:27:04 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:04 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.143s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:04 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f9b8f9c5-0129-429d-beb6-26d4c9cc085d/disk. size=1073741824 {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 21:27:04 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9b8f9c5-0129-429d-beb6-26d4c9cc085d/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:04 user nova-compute[72586]: DEBUG nova.network.neutron [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Successfully created port: 46cc59ac-efc1-40c1-8a70-b848a9980413 {{(pid=72586) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 21:27:04 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9b8f9c5-0129-429d-beb6-26d4c9cc085d/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:04 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Cannot resize image /opt/stack/data/nova/instances/f9b8f9c5-0129-429d-beb6-26d4c9cc085d/disk to a smaller size. {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 21:27:04 user nova-compute[72586]: DEBUG nova.objects.instance [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lazy-loading 'migration_context' on Instance uuid f9b8f9c5-0129-429d-beb6-26d4c9cc085d {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:27:04 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Created local disks {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 21:27:04 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Ensure instance console log exists: /opt/stack/data/nova/instances/f9b8f9c5-0129-429d-beb6-26d4c9cc085d/console.log {{(pid=72586) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 21:27:04 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:27:04 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:27:04 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:27:05 user nova-compute[72586]: DEBUG nova.network.neutron [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Successfully updated port: 46cc59ac-efc1-40c1-8a70-b848a9980413 {{(pid=72586) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 21:27:05 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Acquiring lock "refresh_cache-f9b8f9c5-0129-429d-beb6-26d4c9cc085d" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:27:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Acquired lock "refresh_cache-f9b8f9c5-0129-429d-beb6-26d4c9cc085d" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:27:05 user nova-compute[72586]: DEBUG nova.network.neutron [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:27:05 user nova-compute[72586]: DEBUG nova.compute.manager [req-73d8e634-7841-40e8-8f9e-86531a8cbcb5 req-511296ad-ac30-400f-8cb6-5d6244d7b14b service nova] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Received event network-changed-46cc59ac-efc1-40c1-8a70-b848a9980413 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:27:05 user nova-compute[72586]: DEBUG nova.compute.manager [req-73d8e634-7841-40e8-8f9e-86531a8cbcb5 req-511296ad-ac30-400f-8cb6-5d6244d7b14b service nova] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Refreshing instance network info cache due to event network-changed-46cc59ac-efc1-40c1-8a70-b848a9980413. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:27:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-73d8e634-7841-40e8-8f9e-86531a8cbcb5 req-511296ad-ac30-400f-8cb6-5d6244d7b14b service nova] Acquiring lock "refresh_cache-f9b8f9c5-0129-429d-beb6-26d4c9cc085d" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:27:05 user nova-compute[72586]: DEBUG nova.network.neutron [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Instance cache missing network info. {{(pid=72586) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 21:27:05 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:05 user nova-compute[72586]: DEBUG nova.network.neutron [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Updating instance_info_cache with network_info: [{"id": "46cc59ac-efc1-40c1-8a70-b848a9980413", "address": "fa:16:3e:6b:e7:10", "network": {"id": "a5da07bc-2f5d-461e-b31f-df624d9c6557", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948878141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae659e4ad43c44e2a8f6d48818bb796a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46cc59ac-ef", "ovs_interfaceid": "46cc59ac-efc1-40c1-8a70-b848a9980413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:27:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Releasing lock "refresh_cache-f9b8f9c5-0129-429d-beb6-26d4c9cc085d" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:27:05 user nova-compute[72586]: DEBUG nova.compute.manager [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Instance network_info: |[{"id": "46cc59ac-efc1-40c1-8a70-b848a9980413", "address": "fa:16:3e:6b:e7:10", "network": {"id": "a5da07bc-2f5d-461e-b31f-df624d9c6557", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948878141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae659e4ad43c44e2a8f6d48818bb796a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46cc59ac-ef", "ovs_interfaceid": "46cc59ac-efc1-40c1-8a70-b848a9980413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 21:27:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-73d8e634-7841-40e8-8f9e-86531a8cbcb5 req-511296ad-ac30-400f-8cb6-5d6244d7b14b service nova] Acquired lock "refresh_cache-f9b8f9c5-0129-429d-beb6-26d4c9cc085d" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:27:05 user nova-compute[72586]: DEBUG nova.network.neutron [req-73d8e634-7841-40e8-8f9e-86531a8cbcb5 req-511296ad-ac30-400f-8cb6-5d6244d7b14b service nova] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Refreshing network info cache for port 46cc59ac-efc1-40c1-8a70-b848a9980413 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:27:05 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Start _get_guest_xml network_info=[{"id": "46cc59ac-efc1-40c1-8a70-b848a9980413", "address": "fa:16:3e:6b:e7:10", "network": {"id": "a5da07bc-2f5d-461e-b31f-df624d9c6557", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948878141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae659e4ad43c44e2a8f6d48818bb796a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46cc59ac-ef", "ovs_interfaceid": "46cc59ac-efc1-40c1-8a70-b848a9980413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '0243d46b-6819-42a5-926f-42b71f0c97ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:27:05 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:27:05 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:27:05 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:27:05 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:27:05 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:27:05 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:27:05 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:27:05 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:27:05 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:27:05 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:27:05 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:27:05 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:27:05 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:27:05 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:27:05 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:27:05 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:27:05 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:27:05 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:27:05 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:27:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-752033639',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-752033639',id=21,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK+9xUA7KLirmjYXQN9xELNaip42kAK1K7NxqLVfWWWYEllpiSswXBraxjyOXQGON5DFb+0ISh6DPQXFXhdjXqTtRm5876SEIwEXMmgsj++30+zSSmVyL8OhHncTWDSK7g==',key_name='tempest-keypair-105460435',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae659e4ad43c44e2a8f6d48818bb796a',ramdisk_id='',reservation_id='r-odyjetm7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1935542868',owner_user_name='tempest-AttachVolumeShelveTestJSON-1935542868-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:27:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1a0d71c79c04216b9bf278f650aeb77',uuid=f9b8f9c5-0129-429d-beb6-26d4c9cc085d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "46cc59ac-efc1-40c1-8a70-b848a9980413", "address": "fa:16:3e:6b:e7:10", "network": {"id": "a5da07bc-2f5d-461e-b31f-df624d9c6557", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948878141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae659e4ad43c44e2a8f6d48818bb796a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46cc59ac-ef", "ovs_interfaceid": "46cc59ac-efc1-40c1-8a70-b848a9980413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:27:05 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Converting VIF {"id": "46cc59ac-efc1-40c1-8a70-b848a9980413", "address": "fa:16:3e:6b:e7:10", "network": {"id": "a5da07bc-2f5d-461e-b31f-df624d9c6557", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948878141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae659e4ad43c44e2a8f6d48818bb796a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46cc59ac-ef", "ovs_interfaceid": "46cc59ac-efc1-40c1-8a70-b848a9980413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:27:05 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:e7:10,bridge_name='br-int',has_traffic_filtering=True,id=46cc59ac-efc1-40c1-8a70-b848a9980413,network=Network(a5da07bc-2f5d-461e-b31f-df624d9c6557),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46cc59ac-ef') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:27:05 user nova-compute[72586]: DEBUG nova.objects.instance [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lazy-loading 'pci_devices' on Instance uuid f9b8f9c5-0129-429d-beb6-26d4c9cc085d {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:27:05 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:27:05 user nova-compute[72586]:   <uuid>f9b8f9c5-0129-429d-beb6-26d4c9cc085d</uuid>
Aug 01 21:27:05 user nova-compute[72586]:   <name>instance-00000015</name>
Aug 01 21:27:05 user nova-compute[72586]:   <memory>524288</memory>
Aug 01 21:27:05 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:27:05 user nova-compute[72586]:   <metadata>
Aug 01 21:27:05 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:27:05 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:27:05 user nova-compute[72586]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-752033639</nova:name>
Aug 01 21:27:05 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:27:05</nova:creationTime>
Aug 01 21:27:05 user nova-compute[72586]:       <nova:flavor name="m1.tiny">
Aug 01 21:27:05 user nova-compute[72586]:         <nova:memory>512</nova:memory>
Aug 01 21:27:05 user nova-compute[72586]:         <nova:disk>1</nova:disk>
Aug 01 21:27:05 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:27:05 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:27:05 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:27:05 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:27:05 user nova-compute[72586]:       <nova:owner>
Aug 01 21:27:05 user nova-compute[72586]:         <nova:user uuid="e1a0d71c79c04216b9bf278f650aeb77">tempest-AttachVolumeShelveTestJSON-1935542868-project-member</nova:user>
Aug 01 21:27:05 user nova-compute[72586]:         <nova:project uuid="ae659e4ad43c44e2a8f6d48818bb796a">tempest-AttachVolumeShelveTestJSON-1935542868</nova:project>
Aug 01 21:27:05 user nova-compute[72586]:       </nova:owner>
Aug 01 21:27:05 user nova-compute[72586]:       <nova:root type="image" uuid="0243d46b-6819-42a5-926f-42b71f0c97ad"/>
Aug 01 21:27:05 user nova-compute[72586]:       <nova:ports>
Aug 01 21:27:05 user nova-compute[72586]:         <nova:port uuid="46cc59ac-efc1-40c1-8a70-b848a9980413">
Aug 01 21:27:05 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 01 21:27:05 user nova-compute[72586]:         </nova:port>
Aug 01 21:27:05 user nova-compute[72586]:       </nova:ports>
Aug 01 21:27:05 user nova-compute[72586]:     </nova:instance>
Aug 01 21:27:05 user nova-compute[72586]:   </metadata>
Aug 01 21:27:05 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:27:05 user nova-compute[72586]:     <system>
Aug 01 21:27:05 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:27:05 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:27:05 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:27:05 user nova-compute[72586]:       <entry name="serial">f9b8f9c5-0129-429d-beb6-26d4c9cc085d</entry>
Aug 01 21:27:05 user nova-compute[72586]:       <entry name="uuid">f9b8f9c5-0129-429d-beb6-26d4c9cc085d</entry>
Aug 01 21:27:05 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:27:05 user nova-compute[72586]:     </system>
Aug 01 21:27:05 user nova-compute[72586]:   </sysinfo>
Aug 01 21:27:05 user nova-compute[72586]:   <os>
Aug 01 21:27:05 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:27:05 user nova-compute[72586]:     <boot dev="hd"/>
Aug 01 21:27:05 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:27:05 user nova-compute[72586]:   </os>
Aug 01 21:27:05 user nova-compute[72586]:   <features>
Aug 01 21:27:05 user nova-compute[72586]:     <acpi/>
Aug 01 21:27:05 user nova-compute[72586]:     <apic/>
Aug 01 21:27:05 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:27:05 user nova-compute[72586]:   </features>
Aug 01 21:27:05 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:27:05 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:27:05 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:27:05 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:27:05 user nova-compute[72586]:   </clock>
Aug 01 21:27:05 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:27:05 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:27:05 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:27:05 user nova-compute[72586]:   </cpu>
Aug 01 21:27:05 user nova-compute[72586]:   <devices>
Aug 01 21:27:05 user nova-compute[72586]:     <disk type="file" device="disk">
Aug 01 21:27:05 user nova-compute[72586]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 21:27:05 user nova-compute[72586]:       <source file="/opt/stack/data/nova/instances/f9b8f9c5-0129-429d-beb6-26d4c9cc085d/disk"/>
Aug 01 21:27:05 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:27:05 user nova-compute[72586]:     </disk>
Aug 01 21:27:05 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:27:05 user nova-compute[72586]:       <mac address="fa:16:3e:6b:e7:10"/>
Aug 01 21:27:05 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:27:05 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:27:05 user nova-compute[72586]:       <target dev="tap46cc59ac-ef"/>
Aug 01 21:27:05 user nova-compute[72586]:     </interface>
Aug 01 21:27:05 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:27:05 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/f9b8f9c5-0129-429d-beb6-26d4c9cc085d/console.log" append="off"/>
Aug 01 21:27:05 user nova-compute[72586]:     </serial>
Aug 01 21:27:05 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:27:05 user nova-compute[72586]:     <video>
Aug 01 21:27:05 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:27:05 user nova-compute[72586]:     </video>
Aug 01 21:27:05 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:27:05 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:27:05 user nova-compute[72586]:     </rng>
Aug 01 21:27:05 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:27:05 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:27:05 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:27:05 user nova-compute[72586]:     </memballoon>
Aug 01 21:27:05 user nova-compute[72586]:   </devices>
Aug 01 21:27:05 user nova-compute[72586]: </domain>
Aug 01 21:27:05 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:27:05 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:27:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-752033639',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-752033639',id=21,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK+9xUA7KLirmjYXQN9xELNaip42kAK1K7NxqLVfWWWYEllpiSswXBraxjyOXQGON5DFb+0ISh6DPQXFXhdjXqTtRm5876SEIwEXMmgsj++30+zSSmVyL8OhHncTWDSK7g==',key_name='tempest-keypair-105460435',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae659e4ad43c44e2a8f6d48818bb796a',ramdisk_id='',reservation_id='r-odyjetm7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1935542868',owner_user_name='tempest-AttachVolumeShelveTestJSON-1935542868-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:27:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1a0d71c79c04216b9bf278f650aeb77',uuid=f9b8f9c5-0129-429d-beb6-26d4c9cc085d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "46cc59ac-efc1-40c1-8a70-b848a9980413", "address": "fa:16:3e:6b:e7:10", "network": {"id": "a5da07bc-2f5d-461e-b31f-df624d9c6557", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948878141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae659e4ad43c44e2a8f6d48818bb796a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46cc59ac-ef", "ovs_interfaceid": "46cc59ac-efc1-40c1-8a70-b848a9980413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:27:05 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Converting VIF {"id": "46cc59ac-efc1-40c1-8a70-b848a9980413", "address": "fa:16:3e:6b:e7:10", "network": {"id": "a5da07bc-2f5d-461e-b31f-df624d9c6557", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948878141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae659e4ad43c44e2a8f6d48818bb796a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46cc59ac-ef", "ovs_interfaceid": "46cc59ac-efc1-40c1-8a70-b848a9980413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:27:05 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:e7:10,bridge_name='br-int',has_traffic_filtering=True,id=46cc59ac-efc1-40c1-8a70-b848a9980413,network=Network(a5da07bc-2f5d-461e-b31f-df624d9c6557),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46cc59ac-ef') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:27:05 user nova-compute[72586]: DEBUG os_vif [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:e7:10,bridge_name='br-int',has_traffic_filtering=True,id=46cc59ac-efc1-40c1-8a70-b848a9980413,network=Network(a5da07bc-2f5d-461e-b31f-df624d9c6557),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46cc59ac-ef') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:27:05 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:05 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:27:05 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:27:05 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:05 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap46cc59ac-ef, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:27:05 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap46cc59ac-ef, col_values=(('external_ids', {'iface-id': '46cc59ac-efc1-40c1-8a70-b848a9980413', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:e7:10', 'vm-uuid': 'f9b8f9c5-0129-429d-beb6-26d4c9cc085d'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:27:05 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:05 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:27:05 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:05 user nova-compute[72586]: INFO os_vif [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:e7:10,bridge_name='br-int',has_traffic_filtering=True,id=46cc59ac-efc1-40c1-8a70-b848a9980413,network=Network(a5da07bc-2f5d-461e-b31f-df624d9c6557),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46cc59ac-ef')
Aug 01 21:27:05 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:27:05 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] No VIF found with MAC fa:16:3e:6b:e7:10, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:27:06 user nova-compute[72586]: DEBUG nova.network.neutron [req-73d8e634-7841-40e8-8f9e-86531a8cbcb5 req-511296ad-ac30-400f-8cb6-5d6244d7b14b service nova] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Updated VIF entry in instance network info cache for port 46cc59ac-efc1-40c1-8a70-b848a9980413. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:27:06 user nova-compute[72586]: DEBUG nova.network.neutron [req-73d8e634-7841-40e8-8f9e-86531a8cbcb5 req-511296ad-ac30-400f-8cb6-5d6244d7b14b service nova] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Updating instance_info_cache with network_info: [{"id": "46cc59ac-efc1-40c1-8a70-b848a9980413", "address": "fa:16:3e:6b:e7:10", "network": {"id": "a5da07bc-2f5d-461e-b31f-df624d9c6557", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948878141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae659e4ad43c44e2a8f6d48818bb796a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46cc59ac-ef", "ovs_interfaceid": "46cc59ac-efc1-40c1-8a70-b848a9980413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:27:06 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-73d8e634-7841-40e8-8f9e-86531a8cbcb5 req-511296ad-ac30-400f-8cb6-5d6244d7b14b service nova] Releasing lock "refresh_cache-f9b8f9c5-0129-429d-beb6-26d4c9cc085d" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:27:07 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:07 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:07 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Acquiring lock "af2de810-b22f-4fa9-835c-c673abd145db" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:27:07 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "af2de810-b22f-4fa9-835c-c673abd145db" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:27:07 user nova-compute[72586]: DEBUG nova.compute.manager [req-cf7071dc-5a0b-49c9-a39e-a7d191df9e66 req-277b93b8-a9e7-48a3-b00d-23f6d8194569 service nova] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Received event network-vif-plugged-46cc59ac-efc1-40c1-8a70-b848a9980413 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:27:07 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-cf7071dc-5a0b-49c9-a39e-a7d191df9e66 req-277b93b8-a9e7-48a3-b00d-23f6d8194569 service nova] Acquiring lock "f9b8f9c5-0129-429d-beb6-26d4c9cc085d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:27:07 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-cf7071dc-5a0b-49c9-a39e-a7d191df9e66 req-277b93b8-a9e7-48a3-b00d-23f6d8194569 service nova] Lock "f9b8f9c5-0129-429d-beb6-26d4c9cc085d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:27:07 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-cf7071dc-5a0b-49c9-a39e-a7d191df9e66 req-277b93b8-a9e7-48a3-b00d-23f6d8194569 service nova] Lock "f9b8f9c5-0129-429d-beb6-26d4c9cc085d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:27:07 user nova-compute[72586]: DEBUG nova.compute.manager [req-cf7071dc-5a0b-49c9-a39e-a7d191df9e66 req-277b93b8-a9e7-48a3-b00d-23f6d8194569 service nova] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] No waiting events found dispatching network-vif-plugged-46cc59ac-efc1-40c1-8a70-b848a9980413 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:27:07 user nova-compute[72586]: WARNING nova.compute.manager [req-cf7071dc-5a0b-49c9-a39e-a7d191df9e66 req-277b93b8-a9e7-48a3-b00d-23f6d8194569 service nova] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Received unexpected event network-vif-plugged-46cc59ac-efc1-40c1-8a70-b848a9980413 for instance with vm_state building and task_state spawning.
Aug 01 21:27:07 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Starting instance... {{(pid=72586) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 21:27:07 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:27:07 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:27:07 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72586) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 21:27:07 user nova-compute[72586]: INFO nova.compute.claims [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Claim successful on node user
Aug 01 21:27:07 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:07 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:07 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:07 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:08 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:27:08 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:27:08 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.438s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:27:08 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Start building networks asynchronously for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 21:27:08 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Allocating IP information in the background. {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 21:27:08 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: af2de810-b22f-4fa9-835c-c673abd145db] allocate_for_instance() {{(pid=72586) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 21:27:08 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 21:27:08 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Start building block device mappings for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 21:27:08 user nova-compute[72586]: DEBUG nova.policy [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a984642731b9413c97038f65052ab92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d847d04360420c80ea5608d5a2b15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72586) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 21:27:08 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Start spawning the instance on the hypervisor. {{(pid=72586) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 21:27:08 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Creating instance directory {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 21:27:08 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Creating image(s)
Aug 01 21:27:08 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Acquiring lock "/opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:27:08 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "/opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:27:08 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "/opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:27:08 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:08 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.138s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:08 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Acquiring lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:27:08 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:27:08 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:08 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.133s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:08 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk 1073741824 {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:08 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk 1073741824" returned: 0 in 0.050s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:08 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:27:08 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:08 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.152s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:08 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Checking if we can resize image /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk. size=1073741824 {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 21:27:08 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:08 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Successfully created port: b3d7d993-0a45-40ab-8cdd-e3eb06183294 {{(pid=72586) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 21:27:08 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:08 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Cannot resize image /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk to a smaller size. {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 21:27:08 user nova-compute[72586]: DEBUG nova.objects.instance [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lazy-loading 'migration_context' on Instance uuid af2de810-b22f-4fa9-835c-c673abd145db {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:27:09 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Created local disks {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 21:27:09 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Ensure instance console log exists: /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/console.log {{(pid=72586) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 21:27:09 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:27:09 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:27:09 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:27:09 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:09 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925229.3685584, f9b8f9c5-0129-429d-beb6-26d4c9cc085d => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:27:09 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] VM Resumed (Lifecycle Event)
Aug 01 21:27:09 user nova-compute[72586]: DEBUG nova.compute.manager [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Instance event wait completed in 0 seconds for  {{(pid=72586) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 21:27:09 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Guest created on hypervisor {{(pid=72586) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 21:27:09 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Instance spawned successfully.
Aug 01 21:27:09 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 21:27:09 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:27:09 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:27:09 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Found default for hw_cdrom_bus of ide {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:27:09 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Found default for hw_disk_bus of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:27:09 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Found default for hw_input_bus of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:27:09 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Found default for hw_pointer_model of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:27:09 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Found default for hw_video_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:27:09 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Found default for hw_vif_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:27:09 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:27:09 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925229.3703074, f9b8f9c5-0129-429d-beb6-26d4c9cc085d => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:27:09 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] VM Started (Lifecycle Event)
Aug 01 21:27:09 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:27:09 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:27:09 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:27:09 user nova-compute[72586]: DEBUG nova.compute.manager [req-a11d6dfa-dd6f-45cf-afb0-69ffa261a414 req-cd9a5591-06a6-4aa6-9b78-77103d6fc8b5 service nova] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Received event network-vif-plugged-46cc59ac-efc1-40c1-8a70-b848a9980413 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:27:09 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-a11d6dfa-dd6f-45cf-afb0-69ffa261a414 req-cd9a5591-06a6-4aa6-9b78-77103d6fc8b5 service nova] Acquiring lock "f9b8f9c5-0129-429d-beb6-26d4c9cc085d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:27:09 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-a11d6dfa-dd6f-45cf-afb0-69ffa261a414 req-cd9a5591-06a6-4aa6-9b78-77103d6fc8b5 service nova] Lock "f9b8f9c5-0129-429d-beb6-26d4c9cc085d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:27:09 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-a11d6dfa-dd6f-45cf-afb0-69ffa261a414 req-cd9a5591-06a6-4aa6-9b78-77103d6fc8b5 service nova] Lock "f9b8f9c5-0129-429d-beb6-26d4c9cc085d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:27:09 user nova-compute[72586]: DEBUG nova.compute.manager [req-a11d6dfa-dd6f-45cf-afb0-69ffa261a414 req-cd9a5591-06a6-4aa6-9b78-77103d6fc8b5 service nova] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] No waiting events found dispatching network-vif-plugged-46cc59ac-efc1-40c1-8a70-b848a9980413 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:27:09 user nova-compute[72586]: WARNING nova.compute.manager [req-a11d6dfa-dd6f-45cf-afb0-69ffa261a414 req-cd9a5591-06a6-4aa6-9b78-77103d6fc8b5 service nova] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Received unexpected event network-vif-plugged-46cc59ac-efc1-40c1-8a70-b848a9980413 for instance with vm_state building and task_state spawning.
Aug 01 21:27:09 user nova-compute[72586]: INFO nova.compute.manager [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Took 5.50 seconds to spawn the instance on the hypervisor.
Aug 01 21:27:09 user nova-compute[72586]: DEBUG nova.compute.manager [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:27:09 user nova-compute[72586]: INFO nova.compute.manager [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Took 6.35 seconds to build instance.
Aug 01 21:27:09 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-2dff28ef-873c-40a5-a7f1-56ad27ddeee5 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "f9b8f9c5-0129-429d-beb6-26d4c9cc085d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.444s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:27:09 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Successfully updated port: b3d7d993-0a45-40ab-8cdd-e3eb06183294 {{(pid=72586) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 21:27:09 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Acquiring lock "refresh_cache-af2de810-b22f-4fa9-835c-c673abd145db" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:27:09 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Acquired lock "refresh_cache-af2de810-b22f-4fa9-835c-c673abd145db" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:27:09 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:27:09 user nova-compute[72586]: DEBUG nova.compute.manager [req-9b159996-814b-47b1-a5d9-18d3232a95b9 req-bc3ecbf5-e939-4665-a425-4eec45838070 service nova] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Received event network-changed-b3d7d993-0a45-40ab-8cdd-e3eb06183294 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:27:09 user nova-compute[72586]: DEBUG nova.compute.manager [req-9b159996-814b-47b1-a5d9-18d3232a95b9 req-bc3ecbf5-e939-4665-a425-4eec45838070 service nova] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Refreshing instance network info cache due to event network-changed-b3d7d993-0a45-40ab-8cdd-e3eb06183294. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:27:09 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-9b159996-814b-47b1-a5d9-18d3232a95b9 req-bc3ecbf5-e939-4665-a425-4eec45838070 service nova] Acquiring lock "refresh_cache-af2de810-b22f-4fa9-835c-c673abd145db" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:27:09 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Instance cache missing network info. {{(pid=72586) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 21:27:10 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Updating instance_info_cache with network_info: [{"id": "b3d7d993-0a45-40ab-8cdd-e3eb06183294", "address": "fa:16:3e:29:af:12", "network": {"id": "86940e5d-852b-48fc-9b0e-858305321349", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1967467603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d847d04360420c80ea5608d5a2b15a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3d7d993-0a", "ovs_interfaceid": "b3d7d993-0a45-40ab-8cdd-e3eb06183294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:27:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Releasing lock "refresh_cache-af2de810-b22f-4fa9-835c-c673abd145db" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:27:10 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Instance network_info: |[{"id": "b3d7d993-0a45-40ab-8cdd-e3eb06183294", "address": "fa:16:3e:29:af:12", "network": {"id": "86940e5d-852b-48fc-9b0e-858305321349", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1967467603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d847d04360420c80ea5608d5a2b15a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3d7d993-0a", "ovs_interfaceid": "b3d7d993-0a45-40ab-8cdd-e3eb06183294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 21:27:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-9b159996-814b-47b1-a5d9-18d3232a95b9 req-bc3ecbf5-e939-4665-a425-4eec45838070 service nova] Acquired lock "refresh_cache-af2de810-b22f-4fa9-835c-c673abd145db" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:27:10 user nova-compute[72586]: DEBUG nova.network.neutron [req-9b159996-814b-47b1-a5d9-18d3232a95b9 req-bc3ecbf5-e939-4665-a425-4eec45838070 service nova] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Refreshing network info cache for port b3d7d993-0a45-40ab-8cdd-e3eb06183294 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:27:10 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Start _get_guest_xml network_info=[{"id": "b3d7d993-0a45-40ab-8cdd-e3eb06183294", "address": "fa:16:3e:29:af:12", "network": {"id": "86940e5d-852b-48fc-9b0e-858305321349", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1967467603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d847d04360420c80ea5608d5a2b15a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3d7d993-0a", "ovs_interfaceid": "b3d7d993-0a45-40ab-8cdd-e3eb06183294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '0243d46b-6819-42a5-926f-42b71f0c97ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:27:10 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:27:10 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:27:10 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:27:10 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:27:10 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:27:10 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:27:10 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:27:10 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:27:10 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:27:10 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:27:10 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:27:10 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:27:10 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:27:10 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:27:10 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:27:10 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:27:10 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:27:10 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:27:10 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:27:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-243741239',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-243741239',id=22,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88d847d04360420c80ea5608d5a2b15a',ramdisk_id='',reservation_id='r-rjk0saqp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1268085586',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:27:08Z,user_data=None,user_id='a984642731b9413c97038f65052ab92d',uuid=af2de810-b22f-4fa9-835c-c673abd145db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3d7d993-0a45-40ab-8cdd-e3eb06183294", "address": "fa:16:3e:29:af:12", "network": {"id": "86940e5d-852b-48fc-9b0e-858305321349", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1967467603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d847d04360420c80ea5608d5a2b15a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3d7d993-0a", "ovs_interfaceid": "b3d7d993-0a45-40ab-8cdd-e3eb06183294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:27:10 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Converting VIF {"id": "b3d7d993-0a45-40ab-8cdd-e3eb06183294", "address": "fa:16:3e:29:af:12", "network": {"id": "86940e5d-852b-48fc-9b0e-858305321349", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1967467603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d847d04360420c80ea5608d5a2b15a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3d7d993-0a", "ovs_interfaceid": "b3d7d993-0a45-40ab-8cdd-e3eb06183294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:27:10 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:af:12,bridge_name='br-int',has_traffic_filtering=True,id=b3d7d993-0a45-40ab-8cdd-e3eb06183294,network=Network(86940e5d-852b-48fc-9b0e-858305321349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3d7d993-0a') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:27:10 user nova-compute[72586]: DEBUG nova.objects.instance [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lazy-loading 'pci_devices' on Instance uuid af2de810-b22f-4fa9-835c-c673abd145db {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:27:10 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: af2de810-b22f-4fa9-835c-c673abd145db] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:27:10 user nova-compute[72586]:   <uuid>af2de810-b22f-4fa9-835c-c673abd145db</uuid>
Aug 01 21:27:10 user nova-compute[72586]:   <name>instance-00000016</name>
Aug 01 21:27:10 user nova-compute[72586]:   <memory>524288</memory>
Aug 01 21:27:10 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:27:10 user nova-compute[72586]:   <metadata>
Aug 01 21:27:10 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:27:10 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:27:10 user nova-compute[72586]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-243741239</nova:name>
Aug 01 21:27:10 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:27:10</nova:creationTime>
Aug 01 21:27:10 user nova-compute[72586]:       <nova:flavor name="m1.tiny">
Aug 01 21:27:10 user nova-compute[72586]:         <nova:memory>512</nova:memory>
Aug 01 21:27:10 user nova-compute[72586]:         <nova:disk>1</nova:disk>
Aug 01 21:27:10 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:27:10 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:27:10 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:27:10 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:27:10 user nova-compute[72586]:       <nova:owner>
Aug 01 21:27:10 user nova-compute[72586]:         <nova:user uuid="a984642731b9413c97038f65052ab92d">tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member</nova:user>
Aug 01 21:27:10 user nova-compute[72586]:         <nova:project uuid="88d847d04360420c80ea5608d5a2b15a">tempest-ServerBootFromVolumeStableRescueTest-1268085586</nova:project>
Aug 01 21:27:10 user nova-compute[72586]:       </nova:owner>
Aug 01 21:27:10 user nova-compute[72586]:       <nova:root type="image" uuid="0243d46b-6819-42a5-926f-42b71f0c97ad"/>
Aug 01 21:27:10 user nova-compute[72586]:       <nova:ports>
Aug 01 21:27:10 user nova-compute[72586]:         <nova:port uuid="b3d7d993-0a45-40ab-8cdd-e3eb06183294">
Aug 01 21:27:10 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 01 21:27:10 user nova-compute[72586]:         </nova:port>
Aug 01 21:27:10 user nova-compute[72586]:       </nova:ports>
Aug 01 21:27:10 user nova-compute[72586]:     </nova:instance>
Aug 01 21:27:10 user nova-compute[72586]:   </metadata>
Aug 01 21:27:10 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:27:10 user nova-compute[72586]:     <system>
Aug 01 21:27:10 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:27:10 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:27:10 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:27:10 user nova-compute[72586]:       <entry name="serial">af2de810-b22f-4fa9-835c-c673abd145db</entry>
Aug 01 21:27:10 user nova-compute[72586]:       <entry name="uuid">af2de810-b22f-4fa9-835c-c673abd145db</entry>
Aug 01 21:27:10 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:27:10 user nova-compute[72586]:     </system>
Aug 01 21:27:10 user nova-compute[72586]:   </sysinfo>
Aug 01 21:27:10 user nova-compute[72586]:   <os>
Aug 01 21:27:10 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:27:10 user nova-compute[72586]:     <boot dev="hd"/>
Aug 01 21:27:10 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:27:10 user nova-compute[72586]:   </os>
Aug 01 21:27:10 user nova-compute[72586]:   <features>
Aug 01 21:27:10 user nova-compute[72586]:     <acpi/>
Aug 01 21:27:10 user nova-compute[72586]:     <apic/>
Aug 01 21:27:10 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:27:10 user nova-compute[72586]:   </features>
Aug 01 21:27:10 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:27:10 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:27:10 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:27:10 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:27:10 user nova-compute[72586]:   </clock>
Aug 01 21:27:10 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:27:10 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:27:10 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:27:10 user nova-compute[72586]:   </cpu>
Aug 01 21:27:10 user nova-compute[72586]:   <devices>
Aug 01 21:27:10 user nova-compute[72586]:     <disk type="file" device="disk">
Aug 01 21:27:10 user nova-compute[72586]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 21:27:10 user nova-compute[72586]:       <source file="/opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk"/>
Aug 01 21:27:10 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:27:10 user nova-compute[72586]:     </disk>
Aug 01 21:27:10 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:27:10 user nova-compute[72586]:       <mac address="fa:16:3e:29:af:12"/>
Aug 01 21:27:10 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:27:10 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:27:10 user nova-compute[72586]:       <target dev="tapb3d7d993-0a"/>
Aug 01 21:27:10 user nova-compute[72586]:     </interface>
Aug 01 21:27:10 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:27:10 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/console.log" append="off"/>
Aug 01 21:27:10 user nova-compute[72586]:     </serial>
Aug 01 21:27:10 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:27:10 user nova-compute[72586]:     <video>
Aug 01 21:27:10 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:27:10 user nova-compute[72586]:     </video>
Aug 01 21:27:10 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:27:10 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:27:10 user nova-compute[72586]:     </rng>
Aug 01 21:27:10 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:27:10 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:27:10 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:27:10 user nova-compute[72586]:     </memballoon>
Aug 01 21:27:10 user nova-compute[72586]:   </devices>
Aug 01 21:27:10 user nova-compute[72586]: </domain>
Aug 01 21:27:10 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:27:10 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:27:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-243741239',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-243741239',id=22,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88d847d04360420c80ea5608d5a2b15a',ramdisk_id='',reservation_id='r-rjk0saqp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1268085586',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:27:08Z,user_data=None,user_id='a984642731b9413c97038f65052ab92d',uuid=af2de810-b22f-4fa9-835c-c673abd145db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3d7d993-0a45-40ab-8cdd-e3eb06183294", "address": "fa:16:3e:29:af:12", "network": {"id": "86940e5d-852b-48fc-9b0e-858305321349", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1967467603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d847d04360420c80ea5608d5a2b15a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3d7d993-0a", "ovs_interfaceid": "b3d7d993-0a45-40ab-8cdd-e3eb06183294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:27:10 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Converting VIF {"id": "b3d7d993-0a45-40ab-8cdd-e3eb06183294", "address": "fa:16:3e:29:af:12", "network": {"id": "86940e5d-852b-48fc-9b0e-858305321349", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1967467603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d847d04360420c80ea5608d5a2b15a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3d7d993-0a", "ovs_interfaceid": "b3d7d993-0a45-40ab-8cdd-e3eb06183294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:27:10 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:af:12,bridge_name='br-int',has_traffic_filtering=True,id=b3d7d993-0a45-40ab-8cdd-e3eb06183294,network=Network(86940e5d-852b-48fc-9b0e-858305321349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3d7d993-0a') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:27:10 user nova-compute[72586]: DEBUG os_vif [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:af:12,bridge_name='br-int',has_traffic_filtering=True,id=b3d7d993-0a45-40ab-8cdd-e3eb06183294,network=Network(86940e5d-852b-48fc-9b0e-858305321349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3d7d993-0a') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:27:10 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:10 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:27:10 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:27:10 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:10 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3d7d993-0a, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:27:10 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb3d7d993-0a, col_values=(('external_ids', {'iface-id': 'b3d7d993-0a45-40ab-8cdd-e3eb06183294', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:af:12', 'vm-uuid': 'af2de810-b22f-4fa9-835c-c673abd145db'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:27:10 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:10 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:27:10 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:10 user nova-compute[72586]: INFO os_vif [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:af:12,bridge_name='br-int',has_traffic_filtering=True,id=b3d7d993-0a45-40ab-8cdd-e3eb06183294,network=Network(86940e5d-852b-48fc-9b0e-858305321349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3d7d993-0a')
Aug 01 21:27:10 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:27:10 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] No VIF found with MAC fa:16:3e:29:af:12, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:27:10 user nova-compute[72586]: DEBUG nova.network.neutron [req-9b159996-814b-47b1-a5d9-18d3232a95b9 req-bc3ecbf5-e939-4665-a425-4eec45838070 service nova] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Updated VIF entry in instance network info cache for port b3d7d993-0a45-40ab-8cdd-e3eb06183294. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:27:10 user nova-compute[72586]: DEBUG nova.network.neutron [req-9b159996-814b-47b1-a5d9-18d3232a95b9 req-bc3ecbf5-e939-4665-a425-4eec45838070 service nova] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Updating instance_info_cache with network_info: [{"id": "b3d7d993-0a45-40ab-8cdd-e3eb06183294", "address": "fa:16:3e:29:af:12", "network": {"id": "86940e5d-852b-48fc-9b0e-858305321349", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1967467603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d847d04360420c80ea5608d5a2b15a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3d7d993-0a", "ovs_interfaceid": "b3d7d993-0a45-40ab-8cdd-e3eb06183294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:27:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-9b159996-814b-47b1-a5d9-18d3232a95b9 req-bc3ecbf5-e939-4665-a425-4eec45838070 service nova] Releasing lock "refresh_cache-af2de810-b22f-4fa9-835c-c673abd145db" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:27:11 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:11 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:11 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:11 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:11 user nova-compute[72586]: DEBUG nova.compute.manager [req-e019f96f-6337-42d3-b512-ce13fe7ef769 req-c5dc5a3f-5e4a-4b0f-aa06-9f0bb5f7ff8e service nova] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Received event network-vif-plugged-b3d7d993-0a45-40ab-8cdd-e3eb06183294 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:27:11 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-e019f96f-6337-42d3-b512-ce13fe7ef769 req-c5dc5a3f-5e4a-4b0f-aa06-9f0bb5f7ff8e service nova] Acquiring lock "af2de810-b22f-4fa9-835c-c673abd145db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:27:11 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-e019f96f-6337-42d3-b512-ce13fe7ef769 req-c5dc5a3f-5e4a-4b0f-aa06-9f0bb5f7ff8e service nova] Lock "af2de810-b22f-4fa9-835c-c673abd145db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:27:11 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-e019f96f-6337-42d3-b512-ce13fe7ef769 req-c5dc5a3f-5e4a-4b0f-aa06-9f0bb5f7ff8e service nova] Lock "af2de810-b22f-4fa9-835c-c673abd145db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:27:11 user nova-compute[72586]: DEBUG nova.compute.manager [req-e019f96f-6337-42d3-b512-ce13fe7ef769 req-c5dc5a3f-5e4a-4b0f-aa06-9f0bb5f7ff8e service nova] [instance: af2de810-b22f-4fa9-835c-c673abd145db] No waiting events found dispatching network-vif-plugged-b3d7d993-0a45-40ab-8cdd-e3eb06183294 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:27:11 user nova-compute[72586]: WARNING nova.compute.manager [req-e019f96f-6337-42d3-b512-ce13fe7ef769 req-c5dc5a3f-5e4a-4b0f-aa06-9f0bb5f7ff8e service nova] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Received unexpected event network-vif-plugged-b3d7d993-0a45-40ab-8cdd-e3eb06183294 for instance with vm_state building and task_state spawning.
Aug 01 21:27:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:13 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-34e23e3c-e79c-49e5-95a3-60c3e2274920 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Acquiring lock "49c24c77-f102-4aed-8314-b04aad5f6b3a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:27:13 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-34e23e3c-e79c-49e5-95a3-60c3e2274920 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "49c24c77-f102-4aed-8314-b04aad5f6b3a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:27:13 user nova-compute[72586]: DEBUG nova.objects.instance [None req-34e23e3c-e79c-49e5-95a3-60c3e2274920 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lazy-loading 'flavor' on Instance uuid 49c24c77-f102-4aed-8314-b04aad5f6b3a {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:27:13 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-34e23e3c-e79c-49e5-95a3-60c3e2274920 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "49c24c77-f102-4aed-8314-b04aad5f6b3a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.084s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:27:13 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-34e23e3c-e79c-49e5-95a3-60c3e2274920 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Acquiring lock "49c24c77-f102-4aed-8314-b04aad5f6b3a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:27:13 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-34e23e3c-e79c-49e5-95a3-60c3e2274920 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "49c24c77-f102-4aed-8314-b04aad5f6b3a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:27:13 user nova-compute[72586]: INFO nova.compute.manager [None req-34e23e3c-e79c-49e5-95a3-60c3e2274920 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Attaching volume f3a42014-9e54-46c8-a536-7df2939e9e48 to /dev/vdb
Aug 01 21:27:13 user nova-compute[72586]: DEBUG os_brick.utils [None req-34e23e3c-e79c-49e5-95a3-60c3e2274920 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:27:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:13 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[16398b24-5bae-493a-aff9-ffa54f2ed5b8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4bc202fb9cb\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:27:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:13 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8e2692-8393-4e8f-a52d-76bc06c89083]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:27:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:13 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b09e46-3df3-4820-a9f6-f6fba8b213d9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:27:13 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[18593381-c034-45e3-a64d-3e6cad5e01f4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:27:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-34e23e3c-e79c-49e5-95a3-60c3e2274920 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Running cmd (subprocess): nvme version {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-34e23e3c-e79c-49e5-95a3-60c3e2274920 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] 'nvme version' failed. Not Retrying. {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:27:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.nvmeof [None req-34e23e3c-e79c-49e5-95a3-60c3e2274920 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] nvme not present on system {{(pid=72586) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 21:27:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:27:13 user nova-compute[72586]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 21:27:13 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[57be7649-ae35-43a5-bb5f-fad9fbdad9ea]: (4, '') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:27:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-34e23e3c-e79c-49e5-95a3-60c3e2274920 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72586) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 21:27:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-34e23e3c-e79c-49e5-95a3-60c3e2274920 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 21:27:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-34e23e3c-e79c-49e5-95a3-60c3e2274920 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] LIGHTOS: no hostnqn found. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 21:27:13 user nova-compute[72586]: DEBUG os_brick.utils [None req-34e23e3c-e79c-49e5-95a3-60c3e2274920 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4bc202fb9cb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:27:13 user nova-compute[72586]: DEBUG nova.virt.block_device [None req-34e23e3c-e79c-49e5-95a3-60c3e2274920 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Updating existing volume attachment record: 30652ec9-dedb-4cf0-b4e3-b303564d309c {{(pid=72586) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 21:27:13 user nova-compute[72586]: DEBUG nova.compute.manager [req-7d5a9a75-f532-4911-9dc1-8ee9b0d2f834 req-db311c22-7c3c-4004-91b5-81f1f2e2b3c5 service nova] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Received event network-vif-plugged-b3d7d993-0a45-40ab-8cdd-e3eb06183294 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:27:13 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-7d5a9a75-f532-4911-9dc1-8ee9b0d2f834 req-db311c22-7c3c-4004-91b5-81f1f2e2b3c5 service nova] Acquiring lock "af2de810-b22f-4fa9-835c-c673abd145db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:27:13 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-7d5a9a75-f532-4911-9dc1-8ee9b0d2f834 req-db311c22-7c3c-4004-91b5-81f1f2e2b3c5 service nova] Lock "af2de810-b22f-4fa9-835c-c673abd145db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:27:13 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-7d5a9a75-f532-4911-9dc1-8ee9b0d2f834 req-db311c22-7c3c-4004-91b5-81f1f2e2b3c5 service nova] Lock "af2de810-b22f-4fa9-835c-c673abd145db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:27:13 user nova-compute[72586]: DEBUG nova.compute.manager [req-7d5a9a75-f532-4911-9dc1-8ee9b0d2f834 req-db311c22-7c3c-4004-91b5-81f1f2e2b3c5 service nova] [instance: af2de810-b22f-4fa9-835c-c673abd145db] No waiting events found dispatching network-vif-plugged-b3d7d993-0a45-40ab-8cdd-e3eb06183294 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:27:13 user nova-compute[72586]: WARNING nova.compute.manager [req-7d5a9a75-f532-4911-9dc1-8ee9b0d2f834 req-db311c22-7c3c-4004-91b5-81f1f2e2b3c5 service nova] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Received unexpected event network-vif-plugged-b3d7d993-0a45-40ab-8cdd-e3eb06183294 for instance with vm_state building and task_state spawning.
Aug 01 21:27:14 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925234.0055568, af2de810-b22f-4fa9-835c-c673abd145db => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:27:14 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: af2de810-b22f-4fa9-835c-c673abd145db] VM Resumed (Lifecycle Event)
Aug 01 21:27:14 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Instance event wait completed in 0 seconds for  {{(pid=72586) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 21:27:14 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Guest created on hypervisor {{(pid=72586) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 21:27:14 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Instance spawned successfully.
Aug 01 21:27:14 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 21:27:14 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:27:14 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:27:14 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Found default for hw_cdrom_bus of ide {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:27:14 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Found default for hw_disk_bus of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:27:14 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Found default for hw_input_bus of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:27:14 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Found default for hw_pointer_model of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:27:14 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Found default for hw_video_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:27:14 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Found default for hw_vif_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:27:14 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: af2de810-b22f-4fa9-835c-c673abd145db] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:27:14 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925234.0203578, af2de810-b22f-4fa9-835c-c673abd145db => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:27:14 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: af2de810-b22f-4fa9-835c-c673abd145db] VM Started (Lifecycle Event)
Aug 01 21:27:14 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:27:14 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:27:14 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: af2de810-b22f-4fa9-835c-c673abd145db] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:27:14 user nova-compute[72586]: INFO nova.compute.manager [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Took 5.88 seconds to spawn the instance on the hypervisor.
Aug 01 21:27:14 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:27:14 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:14 user nova-compute[72586]: INFO nova.compute.manager [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Took 6.69 seconds to build instance.
Aug 01 21:27:14 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5e0aca8e-79aa-4534-bb0a-3cbb40e4ebc3 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "af2de810-b22f-4fa9-835c-c673abd145db" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.846s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:27:15 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:16 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:16 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:17 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-96187e9c-4ab0-4c55-bcb1-afa676c752c0 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Acquiring lock "c39c7bd5-0495-484b-a252-ad01ddc68cc1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:27:17 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-96187e9c-4ab0-4c55-bcb1-afa676c752c0 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Lock "c39c7bd5-0495-484b-a252-ad01ddc68cc1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:27:17 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-96187e9c-4ab0-4c55-bcb1-afa676c752c0 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Acquiring lock "c39c7bd5-0495-484b-a252-ad01ddc68cc1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:27:17 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-96187e9c-4ab0-4c55-bcb1-afa676c752c0 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Lock "c39c7bd5-0495-484b-a252-ad01ddc68cc1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:27:17 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-96187e9c-4ab0-4c55-bcb1-afa676c752c0 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Lock "c39c7bd5-0495-484b-a252-ad01ddc68cc1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:27:17 user nova-compute[72586]: INFO nova.compute.manager [None req-96187e9c-4ab0-4c55-bcb1-afa676c752c0 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] Terminating instance
Aug 01 21:27:17 user nova-compute[72586]: DEBUG nova.compute.manager [None req-96187e9c-4ab0-4c55-bcb1-afa676c752c0 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] Start destroying the instance on the hypervisor. {{(pid=72586) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 21:27:17 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:17 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:17 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:18 user nova-compute[72586]: DEBUG nova.compute.manager [req-52a5ec81-3356-4575-8287-75fe2e4c7a64 req-8c320597-92e8-4898-8dfd-51f266c9d9fb service nova] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] Received event network-vif-unplugged-91aba8f4-dcde-47b3-94c9-fe5f5bdd6af8 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:27:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-52a5ec81-3356-4575-8287-75fe2e4c7a64 req-8c320597-92e8-4898-8dfd-51f266c9d9fb service nova] Acquiring lock "c39c7bd5-0495-484b-a252-ad01ddc68cc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:27:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-52a5ec81-3356-4575-8287-75fe2e4c7a64 req-8c320597-92e8-4898-8dfd-51f266c9d9fb service nova] Lock "c39c7bd5-0495-484b-a252-ad01ddc68cc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:27:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-52a5ec81-3356-4575-8287-75fe2e4c7a64 req-8c320597-92e8-4898-8dfd-51f266c9d9fb service nova] Lock "c39c7bd5-0495-484b-a252-ad01ddc68cc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:27:18 user nova-compute[72586]: DEBUG nova.compute.manager [req-52a5ec81-3356-4575-8287-75fe2e4c7a64 req-8c320597-92e8-4898-8dfd-51f266c9d9fb service nova] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] No waiting events found dispatching network-vif-unplugged-91aba8f4-dcde-47b3-94c9-fe5f5bdd6af8 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:27:18 user nova-compute[72586]: DEBUG nova.compute.manager [req-52a5ec81-3356-4575-8287-75fe2e4c7a64 req-8c320597-92e8-4898-8dfd-51f266c9d9fb service nova] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] Received event network-vif-unplugged-91aba8f4-dcde-47b3-94c9-fe5f5bdd6af8 for instance with task_state deleting. {{(pid=72586) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 21:27:18 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] Instance destroyed successfully.
Aug 01 21:27:18 user nova-compute[72586]: DEBUG nova.objects.instance [None req-96187e9c-4ab0-4c55-bcb1-afa676c752c0 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Lazy-loading 'resources' on Instance uuid c39c7bd5-0495-484b-a252-ad01ddc68cc1 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:27:18 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-96187e9c-4ab0-4c55-bcb1-afa676c752c0 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:25:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1488252148',display_name='tempest-VolumesActionsTest-instance-1488252148',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1488252148',id=18,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:25:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='724b3e26f64c47b8bb521981a4c5ff94',ramdisk_id='',reservation_id='r-pomdysrr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-647755296',owner_user_name='tempest-VolumesActionsTest-647755296-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:25:34Z,user_data=None,user_id='5038f09f5e404c28bca02fc1ecb485b3',uuid=c39c7bd5-0495-484b-a252-ad01ddc68cc1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "91aba8f4-dcde-47b3-94c9-fe5f5bdd6af8", "address": "fa:16:3e:59:43:47", "network": {"id": "6aa30f19-4fe9-497b-a1cd-9279113f1153", "bridge": "br-int", "label": "tempest-VolumesActionsTest-513072853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "724b3e26f64c47b8bb521981a4c5ff94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91aba8f4-dc", "ovs_interfaceid": "91aba8f4-dcde-47b3-94c9-fe5f5bdd6af8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:27:18 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-96187e9c-4ab0-4c55-bcb1-afa676c752c0 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Converting VIF {"id": "91aba8f4-dcde-47b3-94c9-fe5f5bdd6af8", "address": "fa:16:3e:59:43:47", "network": {"id": "6aa30f19-4fe9-497b-a1cd-9279113f1153", "bridge": "br-int", "label": "tempest-VolumesActionsTest-513072853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "724b3e26f64c47b8bb521981a4c5ff94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91aba8f4-dc", "ovs_interfaceid": "91aba8f4-dcde-47b3-94c9-fe5f5bdd6af8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:27:18 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-96187e9c-4ab0-4c55-bcb1-afa676c752c0 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:43:47,bridge_name='br-int',has_traffic_filtering=True,id=91aba8f4-dcde-47b3-94c9-fe5f5bdd6af8,network=Network(6aa30f19-4fe9-497b-a1cd-9279113f1153),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91aba8f4-dc') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:27:18 user nova-compute[72586]: DEBUG os_vif [None req-96187e9c-4ab0-4c55-bcb1-afa676c752c0 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:43:47,bridge_name='br-int',has_traffic_filtering=True,id=91aba8f4-dcde-47b3-94c9-fe5f5bdd6af8,network=Network(6aa30f19-4fe9-497b-a1cd-9279113f1153),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91aba8f4-dc') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:27:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap91aba8f4-dc, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:27:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:27:18 user nova-compute[72586]: INFO os_vif [None req-96187e9c-4ab0-4c55-bcb1-afa676c752c0 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:43:47,bridge_name='br-int',has_traffic_filtering=True,id=91aba8f4-dcde-47b3-94c9-fe5f5bdd6af8,network=Network(6aa30f19-4fe9-497b-a1cd-9279113f1153),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91aba8f4-dc')
Aug 01 21:27:18 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-96187e9c-4ab0-4c55-bcb1-afa676c752c0 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] Deleting instance files /opt/stack/data/nova/instances/c39c7bd5-0495-484b-a252-ad01ddc68cc1_del
Aug 01 21:27:18 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-96187e9c-4ab0-4c55-bcb1-afa676c752c0 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] Deletion of /opt/stack/data/nova/instances/c39c7bd5-0495-484b-a252-ad01ddc68cc1_del complete
Aug 01 21:27:18 user nova-compute[72586]: INFO nova.compute.manager [None req-96187e9c-4ab0-4c55-bcb1-afa676c752c0 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] Took 0.97 seconds to destroy the instance on the hypervisor.
Aug 01 21:27:18 user nova-compute[72586]: DEBUG oslo.service.loopingcall [None req-96187e9c-4ab0-4c55-bcb1-afa676c752c0 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72586) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 21:27:18 user nova-compute[72586]: DEBUG nova.compute.manager [-] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] Deallocating network for instance {{(pid=72586) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 21:27:18 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] deallocate_for_instance() {{(pid=72586) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 21:27:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:19 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:27:19 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] Took 0.68 seconds to deallocate network for instance.
Aug 01 21:27:19 user nova-compute[72586]: DEBUG nova.compute.manager [req-48292aae-5d17-4d36-b86d-76273bb67d1a req-a556ba5e-bce3-4326-8974-ca74487caa32 service nova] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] Received event network-vif-deleted-91aba8f4-dcde-47b3-94c9-fe5f5bdd6af8 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:27:19 user nova-compute[72586]: INFO nova.compute.manager [req-48292aae-5d17-4d36-b86d-76273bb67d1a req-a556ba5e-bce3-4326-8974-ca74487caa32 service nova] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] Neutron deleted interface 91aba8f4-dcde-47b3-94c9-fe5f5bdd6af8; detaching it from the instance and deleting it from the info cache
Aug 01 21:27:19 user nova-compute[72586]: DEBUG nova.network.neutron [req-48292aae-5d17-4d36-b86d-76273bb67d1a req-a556ba5e-bce3-4326-8974-ca74487caa32 service nova] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:27:19 user nova-compute[72586]: DEBUG nova.compute.manager [req-48292aae-5d17-4d36-b86d-76273bb67d1a req-a556ba5e-bce3-4326-8974-ca74487caa32 service nova] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] Detach interface failed, port_id=91aba8f4-dcde-47b3-94c9-fe5f5bdd6af8, reason: Instance c39c7bd5-0495-484b-a252-ad01ddc68cc1 could not be found. {{(pid=72586) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 21:27:19 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-96187e9c-4ab0-4c55-bcb1-afa676c752c0 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:27:19 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-96187e9c-4ab0-4c55-bcb1-afa676c752c0 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:27:19 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-96187e9c-4ab0-4c55-bcb1-afa676c752c0 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:27:19 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-96187e9c-4ab0-4c55-bcb1-afa676c752c0 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:27:20 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-96187e9c-4ab0-4c55-bcb1-afa676c752c0 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.420s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:27:20 user nova-compute[72586]: INFO nova.scheduler.client.report [None req-96187e9c-4ab0-4c55-bcb1-afa676c752c0 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Deleted allocations for instance c39c7bd5-0495-484b-a252-ad01ddc68cc1
Aug 01 21:27:20 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-96187e9c-4ab0-4c55-bcb1-afa676c752c0 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Lock "c39c7bd5-0495-484b-a252-ad01ddc68cc1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.345s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:27:20 user nova-compute[72586]: DEBUG nova.compute.manager [req-f270d019-b2cf-469b-8986-2991ac678bef req-c2c4382a-a563-4779-bb78-9d5fc482ac5f service nova] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] Received event network-vif-plugged-91aba8f4-dcde-47b3-94c9-fe5f5bdd6af8 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:27:20 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-f270d019-b2cf-469b-8986-2991ac678bef req-c2c4382a-a563-4779-bb78-9d5fc482ac5f service nova] Acquiring lock "c39c7bd5-0495-484b-a252-ad01ddc68cc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:27:20 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-f270d019-b2cf-469b-8986-2991ac678bef req-c2c4382a-a563-4779-bb78-9d5fc482ac5f service nova] Lock "c39c7bd5-0495-484b-a252-ad01ddc68cc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:27:20 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-f270d019-b2cf-469b-8986-2991ac678bef req-c2c4382a-a563-4779-bb78-9d5fc482ac5f service nova] Lock "c39c7bd5-0495-484b-a252-ad01ddc68cc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:27:20 user nova-compute[72586]: DEBUG nova.compute.manager [req-f270d019-b2cf-469b-8986-2991ac678bef req-c2c4382a-a563-4779-bb78-9d5fc482ac5f service nova] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] No waiting events found dispatching network-vif-plugged-91aba8f4-dcde-47b3-94c9-fe5f5bdd6af8 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:27:20 user nova-compute[72586]: WARNING nova.compute.manager [req-f270d019-b2cf-469b-8986-2991ac678bef req-c2c4382a-a563-4779-bb78-9d5fc482ac5f service nova] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] Received unexpected event network-vif-plugged-91aba8f4-dcde-47b3-94c9-fe5f5bdd6af8 for instance with vm_state deleted and task_state None.
Aug 01 21:27:20 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:27:20 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:27:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34e23e3c-e79c-49e5-95a3-60c3e2274920 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Calling os-brick to attach iSCSI Volume {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 21:27:21 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-34e23e3c-e79c-49e5-95a3-60c3e2274920 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SHNWJcYf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:27:21 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-34e23e3c-e79c-49e5-95a3-60c3e2274920 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:27:21 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-34e23e3c-e79c-49e5-95a3-60c3e2274920 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:27:21 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-34e23e3c-e79c-49e5-95a3-60c3e2274920 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:27:21 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-34e23e3c-e79c-49e5-95a3-60c3e2274920 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:27:21 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-34e23e3c-e79c-49e5-95a3-60c3e2274920 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:27:21 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-34e23e3c-e79c-49e5-95a3-60c3e2274920 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:27:21 user nova-compute[72586]: INFO os_brick.initiator.connectors.iscsi [None req-34e23e3c-e79c-49e5-95a3-60c3e2274920 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 21:27:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 -p 172.16.0.220:3260 {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:21 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d2e809-5edc-4970-bb01-03b4593128b2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:27:21 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-34e23e3c-e79c-49e5-95a3-60c3e2274920 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 21:27:21 user nova-compute[72586]:  {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:27:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 -p 172.16.0.220:3260 --interface default --op new {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:21 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c55ddd7-8a50-467b-9f13-ecaeeaaa4d40]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48] added\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:27:21 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-34e23e3c-e79c-49e5-95a3-60c3e2274920 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48] added
Aug 01 21:27:21 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:27:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:21 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[043d17f9-9993-4d92-8f8a-a0ebb36be536]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:27:21 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-34e23e3c-e79c-49e5-95a3-60c3e2274920 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:27:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:21 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9833dbac-97ec-4832-bbda-18469f04a666]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:27:21 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-34e23e3c-e79c-49e5-95a3-60c3e2274920 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:27:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SHNWJcYf {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SHNWJcYf" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:21 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3c347d-b3aa-465c-9357-7f68012704c1]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:27:21 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-34e23e3c-e79c-49e5-95a3-60c3e2274920 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SHNWJcYf'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:27:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:21 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e55cb29-da04-4fc3-ab64-bea50abedf2b]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:27:21 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-34e23e3c-e79c-49e5-95a3-60c3e2274920 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:27:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:21 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a19a7c-2294-4f24-863c-0d21e1b038b6]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:27:21 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-34e23e3c-e79c-49e5-95a3-60c3e2274920 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 21:27:21 user nova-compute[72586]:  {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:27:21 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-34e23e3c-e79c-49e5-95a3-60c3e2274920 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 21:27:21 user nova-compute[72586]:  {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:27:21 user nova-compute[72586]: WARNING os_brick.initiator.connectors.iscsi [None req-34e23e3c-e79c-49e5-95a3-60c3e2274920 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 21:27:21 user nova-compute[72586]: 
Aug 01 21:27:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 -p 172.16.0.220:3260 --login {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:21 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1eed7a6-5cdb-4895-abe5-8a48b9241660]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:27:21 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-34e23e3c-e79c-49e5-95a3-60c3e2274920 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48, portal: 172.16.0.220,3260]
Aug 01 21:27:21 user nova-compute[72586]: Login to [iface: default, target: iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48, portal: 172.16.0.220,3260] successful.
Aug 01 21:27:21 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:27:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:21 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[588014fe-06af-49d9-99ff-4ca64e712635]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:27:21 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-34e23e3c-e79c-49e5-95a3-60c3e2274920 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:27:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:21 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a6d956-a5db-440e-b1c3-87d382de0400]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:27:21 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-34e23e3c-e79c-49e5-95a3-60c3e2274920 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)
Aug 01 21:27:21 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:27:21 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-34e23e3c-e79c-49e5-95a3-60c3e2274920 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)
Aug 01 21:27:21 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:27:21 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-34e23e3c-e79c-49e5-95a3-60c3e2274920 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:27:21 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-34e23e3c-e79c-49e5-95a3-60c3e2274920 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Connected to 172.16.0.220:3260 {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 21:27:21 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-34e23e3c-e79c-49e5-95a3-60c3e2274920 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=72586) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 21:27:21 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-34e23e3c-e79c-49e5-95a3-60c3e2274920 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72586) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 21:27:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:21 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[185dfda8-f7c2-4a68-b5c6-f5ae9fd27c3e]: (4, ('- - 0', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:27:21 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-34e23e3c-e79c-49e5-95a3-60c3e2274920 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:27:21 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-34e23e3c-e79c-49e5-95a3-60c3e2274920 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SHNWJcYf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 21:27:22 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-34e23e3c-e79c-49e5-95a3-60c3e2274920 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:27:22 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-34e23e3c-e79c-49e5-95a3-60c3e2274920 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23137306435616435', 'path': '/dev/sdb'} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:27:22 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34e23e3c-e79c-49e5-95a3-60c3e2274920 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23137306435616435', 'path': '/dev/sdb'} {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 21:27:22 user nova-compute[72586]: DEBUG nova.objects.instance [None req-34e23e3c-e79c-49e5-95a3-60c3e2274920 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lazy-loading 'flavor' on Instance uuid 49c24c77-f102-4aed-8314-b04aad5f6b3a {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:27:22 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:27:22 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-34e23e3c-e79c-49e5-95a3-60c3e2274920 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 21:27:22 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:27:22 user nova-compute[72586]:   <source dev="/dev/sdb"/>
Aug 01 21:27:22 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:27:22 user nova-compute[72586]:   <serial>f3a42014-9e54-46c8-a536-7df2939e9e48</serial>
Aug 01 21:27:22 user nova-compute[72586]: </disk>
Aug 01 21:27:22 user nova-compute[72586]:  {{(pid=72586) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 21:27:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:27:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:27:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:27:22 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Auditing locally available compute resources for user (node: user) {{(pid=72586) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 21:27:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-34e23e3c-e79c-49e5-95a3-60c3e2274920 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:27:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-34e23e3c-e79c-49e5-95a3-60c3e2274920 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:27:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-34e23e3c-e79c-49e5-95a3-60c3e2274920 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] No VIF found with MAC fa:16:3e:8a:03:a7, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:27:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-34e23e3c-e79c-49e5-95a3-60c3e2274920 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "49c24c77-f102-4aed-8314-b04aad5f6b3a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.185s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:27:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c352ce2-5d08-424a-928f-2fd1cf58e491/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c352ce2-5d08-424a-928f-2fd1cf58e491/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c352ce2-5d08-424a-928f-2fd1cf58e491/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:24 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c352ce2-5d08-424a-928f-2fd1cf58e491/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:24 user nova-compute[72586]: INFO nova.compute.manager [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Rebuilding instance
Aug 01 21:27:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51eb56c-bce2-4593-abc3-878c358c9a74/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:25 user nova-compute[72586]: DEBUG nova.objects.instance [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lazy-loading 'trusted_certs' on Instance uuid 49c24c77-f102-4aed-8314-b04aad5f6b3a {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:27:25 user nova-compute[72586]: DEBUG nova.compute.manager [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:27:25 user nova-compute[72586]: DEBUG nova.objects.instance [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lazy-loading 'pci_requests' on Instance uuid 49c24c77-f102-4aed-8314-b04aad5f6b3a {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:27:25 user nova-compute[72586]: DEBUG nova.objects.instance [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lazy-loading 'pci_devices' on Instance uuid 49c24c77-f102-4aed-8314-b04aad5f6b3a {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:27:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51eb56c-bce2-4593-abc3-878c358c9a74/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51eb56c-bce2-4593-abc3-878c358c9a74/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:25 user nova-compute[72586]: DEBUG nova.objects.instance [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lazy-loading 'resources' on Instance uuid 49c24c77-f102-4aed-8314-b04aad5f6b3a {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:27:25 user nova-compute[72586]: DEBUG nova.objects.instance [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lazy-loading 'migration_context' on Instance uuid 49c24c77-f102-4aed-8314-b04aad5f6b3a {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:27:25 user nova-compute[72586]: DEBUG nova.objects.instance [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72586) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Aug 01 21:27:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51eb56c-bce2-4593-abc3-878c358c9a74/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:25 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:25 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:25 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:25 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:25 user nova-compute[72586]: DEBUG nova.compute.manager [req-32ddc906-5e46-40f2-8f7b-b71f6e5ae0c5 req-8b0981dd-85ca-427a-8e33-f5e2484b109c service nova] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Received event network-vif-unplugged-99688c7a-3e71-49d8-9002-0075560858c9 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:27:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-32ddc906-5e46-40f2-8f7b-b71f6e5ae0c5 req-8b0981dd-85ca-427a-8e33-f5e2484b109c service nova] Acquiring lock "49c24c77-f102-4aed-8314-b04aad5f6b3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:27:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-32ddc906-5e46-40f2-8f7b-b71f6e5ae0c5 req-8b0981dd-85ca-427a-8e33-f5e2484b109c service nova] Lock "49c24c77-f102-4aed-8314-b04aad5f6b3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:27:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-32ddc906-5e46-40f2-8f7b-b71f6e5ae0c5 req-8b0981dd-85ca-427a-8e33-f5e2484b109c service nova] Lock "49c24c77-f102-4aed-8314-b04aad5f6b3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:27:25 user nova-compute[72586]: DEBUG nova.compute.manager [req-32ddc906-5e46-40f2-8f7b-b71f6e5ae0c5 req-8b0981dd-85ca-427a-8e33-f5e2484b109c service nova] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] No waiting events found dispatching network-vif-unplugged-99688c7a-3e71-49d8-9002-0075560858c9 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:27:25 user nova-compute[72586]: WARNING nova.compute.manager [req-32ddc906-5e46-40f2-8f7b-b71f6e5ae0c5 req-8b0981dd-85ca-427a-8e33-f5e2484b109c service nova] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Received unexpected event network-vif-unplugged-99688c7a-3e71-49d8-9002-0075560858c9 for instance with vm_state active and task_state rebuilding.
Aug 01 21:27:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:25 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:27:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9b8f9c5-0129-429d-beb6-26d4c9cc085d/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:25 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Instance destroyed successfully.
Aug 01 21:27:26 user nova-compute[72586]: INFO nova.compute.manager [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Detaching volume f3a42014-9e54-46c8-a536-7df2939e9e48
Aug 01 21:27:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9b8f9c5-0129-429d-beb6-26d4c9cc085d/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9b8f9c5-0129-429d-beb6-26d4c9cc085d/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:26 user nova-compute[72586]: INFO nova.virt.block_device [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Attempting to driver detach volume f3a42014-9e54-46c8-a536-7df2939e9e48 from mountpoint /dev/vdb
Aug 01 21:27:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Attempting to detach device vdb from instance 49c24c77-f102-4aed-8314-b04aad5f6b3a from the persistent domain config. {{(pid=72586) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 21:27:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 21:27:26 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:27:26 user nova-compute[72586]:   <source dev="/dev/sdb"/>
Aug 01 21:27:26 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:27:26 user nova-compute[72586]:   <serial>f3a42014-9e54-46c8-a536-7df2939e9e48</serial>
Aug 01 21:27:26 user nova-compute[72586]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 21:27:26 user nova-compute[72586]: </disk>
Aug 01 21:27:26 user nova-compute[72586]:  {{(pid=72586) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 21:27:26 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Successfully detached device vdb from instance 49c24c77-f102-4aed-8314-b04aad5f6b3a from the persistent domain config.
Aug 01 21:27:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] calling os-brick to detach iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 21:27:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, {'target_iqns': ['iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SHNWJcYf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:27:26 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 01 21:27:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:27:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:27:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48', 0)] {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 21:27:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9b8f9c5-0129-429d-beb6-26d4c9cc085d/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.rescue --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:26 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[07833429-fa4e-4273-b131-6fe369c5cb3d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:27:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:26 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67669bf-7f24-4dcc-89b9-a3b62cb97043]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:27:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)
Aug 01 21:27:26 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:27:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)
Aug 01 21:27:26 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:27:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ee837a440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48'): ({'sdb'}, set())}) {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 21:27:26 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Removing single pathed devices sdb {{(pid=72586) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 21:27:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:26 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1ffc8a-16a5-4878-9c54-b807b7171464]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:27:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:26 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f7a2f4-1ef6-48b5-b863-81a1a555e2fc]: (4, ('ok\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:27:26 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Flushing IO for device /dev/sdb {{(pid=72586) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 21:27:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:26 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec3db7b-e44d-48a6-85f2-5c5c41152271]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:27:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:26 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72586) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 21:27:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.rescue --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:26 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[24929599-464b-43b1-9f70-154576fdd3d6]: (4, ('1', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:27:26 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 21:27:26 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] SCSI volumes sdb have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 21:27:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48')] {{(pid=72586) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 21:27:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:26 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f9921c-2296-4169-9140-f4330d0fa493]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:27:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:27:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 -p 172.16.0.220:3260 --logout {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:26 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3ce8f9-4234-44e1-b661-4f7203eeaa8b]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:27:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48, portal: 172.16.0.220,3260]
Aug 01 21:27:26 user nova-compute[72586]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48, portal: 172.16.0.220,3260] successful.
Aug 01 21:27:26 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:27:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 -p 172.16.0.220:3260 --op delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:26 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a2715f-95d9-4436-95cb-0d53ee481f99]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:27:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:27:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:27:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] <== disconnect_volume: return (327ms) None {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:27:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Disconnected iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 21:27:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:27 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:27:27 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:27:27 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Hypervisor/Node resource view: name=user free_ram=7406MB free_disk=25.531322479248047GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72586) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 21:27:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:27:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:27:27 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 042f0031-1e4d-41d0-8bfa-36001675cfe3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:27:27 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 413c3426-18ad-4a5c-af04-e0e7fc90f050 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:27:27 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 49c24c77-f102-4aed-8314-b04aad5f6b3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:27:27 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance d51eb56c-bce2-4593-abc3-878c358c9a74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:27:27 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance c3798403-855b-45e4-af48-ba6b62570dba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:27:27 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:27:27 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 8c352ce2-5d08-424a-928f-2fd1cf58e491 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:27:27 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance f9b8f9c5-0129-429d-beb6-26d4c9cc085d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:27:27 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance af2de810-b22f-4fa9-835c-c673abd145db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:27:27 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 21:27:27 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 21:27:27 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Instance destroyed successfully.
Aug 01 21:27:27 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:23:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-117058961',display_name='tempest-ServerActionsTestOtherA-server-809986017',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-117058961',id=15,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPk4vuGAtPXP/Itqq7TbQ+6Sv+k5bpNQFeCgGdApIPBaVaeUmQBoiJZa5I5091aDIuYBB7Uba3sQDG1YP/kTFSXvqkIW2yu6s2YyWP+iKPKZLzdQkqmU2IfIy2EEsidssA==',key_name='tempest-keypair-400537691',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:23:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='19af48ffce7e4703b6d978bc3563680e',ramdisk_id='',reservation_id='r-xq54880a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-825165282',owner_user_name='tempest-ServerActionsTestOtherA-825165282-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:27:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88d01b1101164c859b19d41e251447a5',uuid=49c24c77-f102-4aed-8314-b04aad5f6b3a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "99688c7a-3e71-49d8-9002-0075560858c9", "address": "fa:16:3e:8a:03:a7", "network": {"id": "aab9a541-2149-4c65-b60e-80a1daca6632", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1355256264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19af48ffce7e4703b6d978bc3563680e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99688c7a-3e", "ovs_interfaceid": "99688c7a-3e71-49d8-9002-0075560858c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:27:27 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Converting VIF {"id": "99688c7a-3e71-49d8-9002-0075560858c9", "address": "fa:16:3e:8a:03:a7", "network": {"id": "aab9a541-2149-4c65-b60e-80a1daca6632", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1355256264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19af48ffce7e4703b6d978bc3563680e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99688c7a-3e", "ovs_interfaceid": "99688c7a-3e71-49d8-9002-0075560858c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:27:27 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8a:03:a7,bridge_name='br-int',has_traffic_filtering=True,id=99688c7a-3e71-49d8-9002-0075560858c9,network=Network(aab9a541-2149-4c65-b60e-80a1daca6632),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99688c7a-3e') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:27:27 user nova-compute[72586]: DEBUG os_vif [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:03:a7,bridge_name='br-int',has_traffic_filtering=True,id=99688c7a-3e71-49d8-9002-0075560858c9,network=Network(aab9a541-2149-4c65-b60e-80a1daca6632),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99688c7a-3e') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:27:27 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:27 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap99688c7a-3e, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:27:27 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:27 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:27:27 user nova-compute[72586]: INFO os_vif [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:03:a7,bridge_name='br-int',has_traffic_filtering=True,id=99688c7a-3e71-49d8-9002-0075560858c9,network=Network(aab9a541-2149-4c65-b60e-80a1daca6632),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99688c7a-3e')
Aug 01 21:27:27 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] calling os-brick to detach iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 21:27:27 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, {'target_iqns': ['iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SHNWJcYf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:27:27 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 01 21:27:27 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:27:27 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:27:27 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48', 0)] {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 21:27:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 21 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:27 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc88d07e-f13d-4820-b623-bb55ac498608]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:27:27 user nova-compute[72586]: WARNING os_brick.initiator.connectors.iscsi [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Couldn't find iSCSI nodes because iscsiadm err: iscsiadm: No records found
Aug 01 21:27:27 user nova-compute[72586]: : NotImplementedError
Aug 01 21:27:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:27 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be95d0a-c3f2-4da6-b486-1a78d25eef04]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:27:27 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 21:27:27 user nova-compute[72586]:  {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:27:27 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 21:27:27 user nova-compute[72586]:  {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:27:27 user nova-compute[72586]: WARNING os_brick.initiator.connectors.iscsi [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 21:27:27 user nova-compute[72586]: : NotImplementedError
Aug 01 21:27:27 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ee80e0ca0>, {}) {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 21:27:27 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Disconnecting from: [] {{(pid=72586) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 21:27:27 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.049s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:27:27 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] <== disconnect_volume: return (51ms) None {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:27:27 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Disconnected iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 21:27:27 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Deleting instance files /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a_del
Aug 01 21:27:27 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Deletion of /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a_del complete
Aug 01 21:27:27 user nova-compute[72586]: DEBUG nova.compute.manager [req-b7da5475-6f80-4196-9a06-b1fbdf11064b req-08e3c493-d7cc-41bb-a015-7462feaf72ef service nova] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Received event network-vif-plugged-99688c7a-3e71-49d8-9002-0075560858c9 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:27:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-b7da5475-6f80-4196-9a06-b1fbdf11064b req-08e3c493-d7cc-41bb-a015-7462feaf72ef service nova] Acquiring lock "49c24c77-f102-4aed-8314-b04aad5f6b3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:27:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-b7da5475-6f80-4196-9a06-b1fbdf11064b req-08e3c493-d7cc-41bb-a015-7462feaf72ef service nova] Lock "49c24c77-f102-4aed-8314-b04aad5f6b3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:27:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-b7da5475-6f80-4196-9a06-b1fbdf11064b req-08e3c493-d7cc-41bb-a015-7462feaf72ef service nova] Lock "49c24c77-f102-4aed-8314-b04aad5f6b3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:27:27 user nova-compute[72586]: DEBUG nova.compute.manager [req-b7da5475-6f80-4196-9a06-b1fbdf11064b req-08e3c493-d7cc-41bb-a015-7462feaf72ef service nova] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] No waiting events found dispatching network-vif-plugged-99688c7a-3e71-49d8-9002-0075560858c9 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:27:27 user nova-compute[72586]: WARNING nova.compute.manager [req-b7da5475-6f80-4196-9a06-b1fbdf11064b req-08e3c493-d7cc-41bb-a015-7462feaf72ef service nova] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Received unexpected event network-vif-plugged-99688c7a-3e71-49d8-9002-0075560858c9 for instance with vm_state active and task_state rebuilding.
Aug 01 21:27:27 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:27:27 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:27:27 user nova-compute[72586]: INFO nova.virt.block_device [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Booting with volume f3a42014-9e54-46c8-a536-7df2939e9e48 at /dev/vdb
Aug 01 21:27:27 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Compute_service record updated for user:user {{(pid=72586) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 21:27:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.482s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:27:27 user nova-compute[72586]: DEBUG os_brick.utils [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:27:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:27 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e965ac-6051-4e7a-82f1-2e0d8a7d5d5f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4bc202fb9cb\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:27:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:27 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7060242-4b23-4a39-8baf-98050dd5adbf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:27:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:27 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8538aa-31eb-469e-95e2-f1aa7804d91c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:27:27 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aac50bf-3fac-4a14-9595-ff7c740d8dcc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:27:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Running cmd (subprocess): nvme version {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] 'nvme version' failed. Not Retrying. {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:27:27 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] nvme not present on system {{(pid=72586) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 21:27:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:27:27 user nova-compute[72586]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 21:27:27 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[61300801-fcc5-498b-bcf7-78adc5c4040e]: (4, '') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:27:27 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72586) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 21:27:27 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 21:27:27 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] LIGHTOS: no hostnqn found. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 21:27:27 user nova-compute[72586]: DEBUG os_brick.utils [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4bc202fb9cb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:27:27 user nova-compute[72586]: DEBUG nova.virt.block_device [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Updating existing volume attachment record: a2ef688d-24eb-42a8-8f51-a5fd29fce3c0 {{(pid=72586) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 21:27:28 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:27:28 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:27:28 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Starting heal instance info cache {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 21:27:28 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Rebuilding the list of instances to heal {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 21:27:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "refresh_cache-042f0031-1e4d-41d0-8bfa-36001675cfe3" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:27:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquired lock "refresh_cache-042f0031-1e4d-41d0-8bfa-36001675cfe3" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:27:28 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Forcefully refreshing network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 21:27:28 user nova-compute[72586]: DEBUG nova.objects.instance [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lazy-loading 'info_cache' on Instance uuid 042f0031-1e4d-41d0-8bfa-36001675cfe3 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:27:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:29 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Updating instance_info_cache with network_info: [{"id": "fb56dcd2-b1ea-4992-a896-22f65127a96c", "address": "fa:16:3e:8e:7c:d3", "network": {"id": "d229a8de-7a2b-4dcd-a9ac-44a40349676e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-67691992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b1a1d82f39347119a9fb49fb8e8893f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb56dcd2-b1", "ovs_interfaceid": "fb56dcd2-b1ea-4992-a896-22f65127a96c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:27:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Releasing lock "refresh_cache-042f0031-1e4d-41d0-8bfa-36001675cfe3" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:27:29 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Updated the network info_cache for instance {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 21:27:29 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:27:29 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:27:29 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:27:29 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:27:29 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72586) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 21:27:32 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:33 user nova-compute[72586]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690925238.6789615, c39c7bd5-0495-484b-a252-ad01ddc68cc1 => Stopped> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:27:33 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] VM Stopped (Lifecycle Event)
Aug 01 21:27:33 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc2d74d-1dac-46d5-a802-5ccbb97d3402 None None] [instance: c39c7bd5-0495-484b-a252-ad01ddc68cc1] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:27:34 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:34 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Creating instance directory {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 21:27:35 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Creating image(s)
Aug 01 21:27:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Acquiring lock "/opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "/opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "/opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.134s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Acquiring lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.130s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk 1073741824 {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk 1073741824" returned: 0 in 0.050s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.188s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.153s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Checking if we can resize image /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk. size=1073741824 {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Cannot resize image /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk to a smaller size. {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Created local disks {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Ensure instance console log exists: /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/console.log {{(pid=72586) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Start _get_guest_xml network_info=[{"id": "99688c7a-3e71-49d8-9002-0075560858c9", "address": "fa:16:3e:8a:03:a7", "network": {"id": "aab9a541-2149-4c65-b60e-80a1daca6632", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1355256264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19af48ffce7e4703b6d978bc3563680e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99688c7a-3e", "ovs_interfaceid": "99688c7a-3e71-49d8-9002-0075560858c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '0243d46b-6819-42a5-926f-42b71f0c97ad'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SHNWJcYf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '49c24c77-f102-4aed-8314-b04aad5f6b3a', 'attached_at': '', 'detached_at': '', 'volume_id': 'f3a42014-9e54-46c8-a536-7df2939e9e48', 'serial': 'f3a42014-9e54-46c8-a536-7df2939e9e48'}, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'a2ef688d-24eb-42a8-8f51-a5fd29fce3c0', 'delete_on_termination': False, 'volume_type': None} {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:27:35 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 01 21:27:35 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 01 21:27:35 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG nova.objects.instance [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lazy-loading 'vcpu_model' on Instance uuid 49c24c77-f102-4aed-8314-b04aad5f6b3a {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Calling os-brick to attach iSCSI Volume {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SHNWJcYf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:27:35 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 01 21:27:35 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:27:35 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 01 21:27:35 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:27:35 user nova-compute[72586]: INFO os_brick.initiator.connectors.iscsi [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 21:27:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 -p 172.16.0.220:3260 {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c86f7c-e477-4aca-936b-594c8189445a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 21:27:35 user nova-compute[72586]:  {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 -p 172.16.0.220:3260 --interface default --op new {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb94c1c-73ba-4ee0-9906-2f908dd61e39]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48] added\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48] added
Aug 01 21:27:35 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[38efd31e-9cac-42b2-b5b2-0f4ecb95a95a]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5206f48-fc9e-4587-aab8-7f8edce76008]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SHNWJcYf {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SHNWJcYf" returned: 0 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[2721f2fb-4070-4fb6-8ce2-f8351b258d6f]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SHNWJcYf'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e925f7ee-8a22-41a5-84ae-699a0b21f44f]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:27:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:36 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[7872297d-f909-4d9d-a424-82e16ad274c4]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:27:36 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 21:27:36 user nova-compute[72586]:  {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:27:36 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 21:27:36 user nova-compute[72586]:  {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:27:36 user nova-compute[72586]: WARNING os_brick.initiator.connectors.iscsi [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 21:27:36 user nova-compute[72586]: : NotImplementedError
Aug 01 21:27:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 -p 172.16.0.220:3260 --login {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:36 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba47d2b2-45fc-4f7e-b819-1d37a712789d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:27:36 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48, portal: 172.16.0.220,3260]
Aug 01 21:27:36 user nova-compute[72586]: Login to [iface: default, target: iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48, portal: 172.16.0.220,3260] successful.
Aug 01 21:27:36 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:27:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:36 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[256b6d51-bf0b-4c60-8834-5fa5de2db8ab]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:27:36 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:27:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:36 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c1891d-9a61-4ef0-a8fa-821576098cdd]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:27:36 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)
Aug 01 21:27:36 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:27:36 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)
Aug 01 21:27:36 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:27:36 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:27:36 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Connected to 172.16.0.220:3260 {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 21:27:36 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=72586) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 21:27:36 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72586) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 21:27:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:36 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d80e0f-b283-41e9-9d1d-7135ac68e0c3]: (4, ('- - 0', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:27:36 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: None {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:27:37 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:27:37 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SHNWJcYf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 21:27:37 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.279s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:27:37 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] <== connect_volume: return (1280ms) {'type': 'block', 'scsi_wwn': '23137306435616435', 'path': '/dev/sdb'} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:27:37 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23137306435616435', 'path': '/dev/sdb'} {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 21:27:37 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T21:23:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-117058961',display_name='tempest-ServerActionsTestOtherA-server-809986017',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-117058961',id=15,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPk4vuGAtPXP/Itqq7TbQ+6Sv+k5bpNQFeCgGdApIPBaVaeUmQBoiJZa5I5091aDIuYBB7Uba3sQDG1YP/kTFSXvqkIW2yu6s2YyWP+iKPKZLzdQkqmU2IfIy2EEsidssA==',key_name='tempest-keypair-400537691',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:23:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='19af48ffce7e4703b6d978bc3563680e',ramdisk_id='',reservation_id='r-xq54880a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-825165282',owner_user_name='tempest-ServerActionsTestOtherA-825165282-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:27:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88d01b1101164c859b19d41e251447a5',uuid=49c24c77-f102-4aed-8314-b04aad5f6b3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "99688c7a-3e71-49d8-9002-0075560858c9", "address": "fa:16:3e:8a:03:a7", "network": {"id": "aab9a541-2149-4c65-b60e-80a1daca6632", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1355256264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19af48ffce7e4703b6d978bc3563680e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99688c7a-3e", "ovs_interfaceid": "99688c7a-3e71-49d8-9002-0075560858c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:27:37 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Converting VIF {"id": "99688c7a-3e71-49d8-9002-0075560858c9", "address": "fa:16:3e:8a:03:a7", "network": {"id": "aab9a541-2149-4c65-b60e-80a1daca6632", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1355256264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19af48ffce7e4703b6d978bc3563680e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99688c7a-3e", "ovs_interfaceid": "99688c7a-3e71-49d8-9002-0075560858c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:27:37 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8a:03:a7,bridge_name='br-int',has_traffic_filtering=True,id=99688c7a-3e71-49d8-9002-0075560858c9,network=Network(aab9a541-2149-4c65-b60e-80a1daca6632),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99688c7a-3e') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:27:37 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:27:37 user nova-compute[72586]:   <uuid>49c24c77-f102-4aed-8314-b04aad5f6b3a</uuid>
Aug 01 21:27:37 user nova-compute[72586]:   <name>instance-0000000f</name>
Aug 01 21:27:37 user nova-compute[72586]:   <memory>524288</memory>
Aug 01 21:27:37 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:27:37 user nova-compute[72586]:   <metadata>
Aug 01 21:27:37 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:27:37 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:27:37 user nova-compute[72586]:       <nova:name>tempest-ServerActionsTestOtherA-server-809986017</nova:name>
Aug 01 21:27:37 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:27:35</nova:creationTime>
Aug 01 21:27:37 user nova-compute[72586]:       <nova:flavor name="m1.tiny">
Aug 01 21:27:37 user nova-compute[72586]:         <nova:memory>512</nova:memory>
Aug 01 21:27:37 user nova-compute[72586]:         <nova:disk>1</nova:disk>
Aug 01 21:27:37 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:27:37 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:27:37 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:27:37 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:27:37 user nova-compute[72586]:       <nova:owner>
Aug 01 21:27:37 user nova-compute[72586]:         <nova:user uuid="88d01b1101164c859b19d41e251447a5">tempest-ServerActionsTestOtherA-825165282-project-member</nova:user>
Aug 01 21:27:37 user nova-compute[72586]:         <nova:project uuid="19af48ffce7e4703b6d978bc3563680e">tempest-ServerActionsTestOtherA-825165282</nova:project>
Aug 01 21:27:37 user nova-compute[72586]:       </nova:owner>
Aug 01 21:27:37 user nova-compute[72586]:       <nova:root type="image" uuid="0243d46b-6819-42a5-926f-42b71f0c97ad"/>
Aug 01 21:27:37 user nova-compute[72586]:       <nova:ports>
Aug 01 21:27:37 user nova-compute[72586]:         <nova:port uuid="99688c7a-3e71-49d8-9002-0075560858c9">
Aug 01 21:27:37 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 01 21:27:37 user nova-compute[72586]:         </nova:port>
Aug 01 21:27:37 user nova-compute[72586]:       </nova:ports>
Aug 01 21:27:37 user nova-compute[72586]:     </nova:instance>
Aug 01 21:27:37 user nova-compute[72586]:   </metadata>
Aug 01 21:27:37 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:27:37 user nova-compute[72586]:     <system>
Aug 01 21:27:37 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:27:37 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:27:37 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:27:37 user nova-compute[72586]:       <entry name="serial">49c24c77-f102-4aed-8314-b04aad5f6b3a</entry>
Aug 01 21:27:37 user nova-compute[72586]:       <entry name="uuid">49c24c77-f102-4aed-8314-b04aad5f6b3a</entry>
Aug 01 21:27:37 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:27:37 user nova-compute[72586]:     </system>
Aug 01 21:27:37 user nova-compute[72586]:   </sysinfo>
Aug 01 21:27:37 user nova-compute[72586]:   <os>
Aug 01 21:27:37 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:27:37 user nova-compute[72586]:     <boot dev="hd"/>
Aug 01 21:27:37 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:27:37 user nova-compute[72586]:   </os>
Aug 01 21:27:37 user nova-compute[72586]:   <features>
Aug 01 21:27:37 user nova-compute[72586]:     <acpi/>
Aug 01 21:27:37 user nova-compute[72586]:     <apic/>
Aug 01 21:27:37 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:27:37 user nova-compute[72586]:   </features>
Aug 01 21:27:37 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:27:37 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:27:37 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:27:37 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:27:37 user nova-compute[72586]:   </clock>
Aug 01 21:27:37 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:27:37 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:27:37 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:27:37 user nova-compute[72586]:   </cpu>
Aug 01 21:27:37 user nova-compute[72586]:   <devices>
Aug 01 21:27:37 user nova-compute[72586]:     <disk type="file" device="disk">
Aug 01 21:27:37 user nova-compute[72586]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 21:27:37 user nova-compute[72586]:       <source file="/opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk"/>
Aug 01 21:27:37 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:27:37 user nova-compute[72586]:     </disk>
Aug 01 21:27:37 user nova-compute[72586]:     <disk type="block" device="disk">
Aug 01 21:27:37 user nova-compute[72586]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:27:37 user nova-compute[72586]:       <source dev="/dev/sdb"/>
Aug 01 21:27:37 user nova-compute[72586]:       <target dev="vdb" bus="virtio"/>
Aug 01 21:27:37 user nova-compute[72586]:       <serial>f3a42014-9e54-46c8-a536-7df2939e9e48</serial>
Aug 01 21:27:37 user nova-compute[72586]:     </disk>
Aug 01 21:27:37 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:27:37 user nova-compute[72586]:       <mac address="fa:16:3e:8a:03:a7"/>
Aug 01 21:27:37 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:27:37 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:27:37 user nova-compute[72586]:       <target dev="tap99688c7a-3e"/>
Aug 01 21:27:37 user nova-compute[72586]:     </interface>
Aug 01 21:27:37 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:27:37 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/console.log" append="off"/>
Aug 01 21:27:37 user nova-compute[72586]:     </serial>
Aug 01 21:27:37 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:27:37 user nova-compute[72586]:     <video>
Aug 01 21:27:37 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:27:37 user nova-compute[72586]:     </video>
Aug 01 21:27:37 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:27:37 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:27:37 user nova-compute[72586]:     </rng>
Aug 01 21:27:37 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:27:37 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:27:37 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:27:37 user nova-compute[72586]:     </memballoon>
Aug 01 21:27:37 user nova-compute[72586]:   </devices>
Aug 01 21:27:37 user nova-compute[72586]: </domain>
Aug 01 21:27:37 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:27:37 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T21:23:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-117058961',display_name='tempest-ServerActionsTestOtherA-server-809986017',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-117058961',id=15,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPk4vuGAtPXP/Itqq7TbQ+6Sv+k5bpNQFeCgGdApIPBaVaeUmQBoiJZa5I5091aDIuYBB7Uba3sQDG1YP/kTFSXvqkIW2yu6s2YyWP+iKPKZLzdQkqmU2IfIy2EEsidssA==',key_name='tempest-keypair-400537691',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:23:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='19af48ffce7e4703b6d978bc3563680e',ramdisk_id='',reservation_id='r-xq54880a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-825165282',owner_user_name='tempest-ServerActionsTestOtherA-825165282-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:27:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88d01b1101164c859b19d41e251447a5',uuid=49c24c77-f102-4aed-8314-b04aad5f6b3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "99688c7a-3e71-49d8-9002-0075560858c9", "address": "fa:16:3e:8a:03:a7", "network": {"id": "aab9a541-2149-4c65-b60e-80a1daca6632", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1355256264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19af48ffce7e4703b6d978bc3563680e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99688c7a-3e", "ovs_interfaceid": "99688c7a-3e71-49d8-9002-0075560858c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:27:37 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Converting VIF {"id": "99688c7a-3e71-49d8-9002-0075560858c9", "address": "fa:16:3e:8a:03:a7", "network": {"id": "aab9a541-2149-4c65-b60e-80a1daca6632", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1355256264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19af48ffce7e4703b6d978bc3563680e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99688c7a-3e", "ovs_interfaceid": "99688c7a-3e71-49d8-9002-0075560858c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:27:37 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8a:03:a7,bridge_name='br-int',has_traffic_filtering=True,id=99688c7a-3e71-49d8-9002-0075560858c9,network=Network(aab9a541-2149-4c65-b60e-80a1daca6632),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99688c7a-3e') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:27:37 user nova-compute[72586]: DEBUG os_vif [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:03:a7,bridge_name='br-int',has_traffic_filtering=True,id=99688c7a-3e71-49d8-9002-0075560858c9,network=Network(aab9a541-2149-4c65-b60e-80a1daca6632),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99688c7a-3e') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:27:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:27:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:27:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap99688c7a-3e, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:27:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap99688c7a-3e, col_values=(('external_ids', {'iface-id': '99688c7a-3e71-49d8-9002-0075560858c9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:03:a7', 'vm-uuid': '49c24c77-f102-4aed-8314-b04aad5f6b3a'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:27:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:27:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:37 user nova-compute[72586]: INFO os_vif [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:03:a7,bridge_name='br-int',has_traffic_filtering=True,id=99688c7a-3e71-49d8-9002-0075560858c9,network=Network(aab9a541-2149-4c65-b60e-80a1daca6632),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99688c7a-3e')
Aug 01 21:27:37 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:27:37 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:27:37 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] No VIF found with MAC fa:16:3e:8a:03:a7, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:27:38 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:38 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:38 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:38 user nova-compute[72586]: DEBUG nova.compute.manager [req-348b2284-512f-4195-80a5-b361c0033020 req-8953871d-d21b-4da6-bc41-6c85c2f3b3f9 service nova] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Received event network-vif-plugged-99688c7a-3e71-49d8-9002-0075560858c9 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:27:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-348b2284-512f-4195-80a5-b361c0033020 req-8953871d-d21b-4da6-bc41-6c85c2f3b3f9 service nova] Acquiring lock "49c24c77-f102-4aed-8314-b04aad5f6b3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:27:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-348b2284-512f-4195-80a5-b361c0033020 req-8953871d-d21b-4da6-bc41-6c85c2f3b3f9 service nova] Lock "49c24c77-f102-4aed-8314-b04aad5f6b3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:27:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-348b2284-512f-4195-80a5-b361c0033020 req-8953871d-d21b-4da6-bc41-6c85c2f3b3f9 service nova] Lock "49c24c77-f102-4aed-8314-b04aad5f6b3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:27:38 user nova-compute[72586]: DEBUG nova.compute.manager [req-348b2284-512f-4195-80a5-b361c0033020 req-8953871d-d21b-4da6-bc41-6c85c2f3b3f9 service nova] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] No waiting events found dispatching network-vif-plugged-99688c7a-3e71-49d8-9002-0075560858c9 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:27:38 user nova-compute[72586]: WARNING nova.compute.manager [req-348b2284-512f-4195-80a5-b361c0033020 req-8953871d-d21b-4da6-bc41-6c85c2f3b3f9 service nova] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Received unexpected event network-vif-plugged-99688c7a-3e71-49d8-9002-0075560858c9 for instance with vm_state active and task_state rebuild_spawning.
Aug 01 21:27:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:40 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Removed pending event for 49c24c77-f102-4aed-8314-b04aad5f6b3a due to event {{(pid=72586) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 21:27:40 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925260.741572, 49c24c77-f102-4aed-8314-b04aad5f6b3a => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:27:40 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] VM Resumed (Lifecycle Event)
Aug 01 21:27:40 user nova-compute[72586]: DEBUG nova.compute.manager [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Instance event wait completed in 0 seconds for  {{(pid=72586) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 21:27:40 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Guest created on hypervisor {{(pid=72586) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 21:27:40 user nova-compute[72586]: DEBUG nova.compute.manager [req-52c9fa2a-c337-46ca-847d-2f05ddda94b6 req-89356874-43a6-40ca-b7e5-fe68dcfe9567 service nova] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Received event network-vif-plugged-99688c7a-3e71-49d8-9002-0075560858c9 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:27:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-52c9fa2a-c337-46ca-847d-2f05ddda94b6 req-89356874-43a6-40ca-b7e5-fe68dcfe9567 service nova] Acquiring lock "49c24c77-f102-4aed-8314-b04aad5f6b3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:27:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-52c9fa2a-c337-46ca-847d-2f05ddda94b6 req-89356874-43a6-40ca-b7e5-fe68dcfe9567 service nova] Lock "49c24c77-f102-4aed-8314-b04aad5f6b3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:27:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-52c9fa2a-c337-46ca-847d-2f05ddda94b6 req-89356874-43a6-40ca-b7e5-fe68dcfe9567 service nova] Lock "49c24c77-f102-4aed-8314-b04aad5f6b3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:27:40 user nova-compute[72586]: DEBUG nova.compute.manager [req-52c9fa2a-c337-46ca-847d-2f05ddda94b6 req-89356874-43a6-40ca-b7e5-fe68dcfe9567 service nova] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] No waiting events found dispatching network-vif-plugged-99688c7a-3e71-49d8-9002-0075560858c9 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:27:40 user nova-compute[72586]: WARNING nova.compute.manager [req-52c9fa2a-c337-46ca-847d-2f05ddda94b6 req-89356874-43a6-40ca-b7e5-fe68dcfe9567 service nova] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Received unexpected event network-vif-plugged-99688c7a-3e71-49d8-9002-0075560858c9 for instance with vm_state active and task_state rebuild_spawning.
Aug 01 21:27:40 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Instance spawned successfully.
Aug 01 21:27:40 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:27:40 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 21:27:40 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:27:40 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Found default for hw_cdrom_bus of ide {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:27:40 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Found default for hw_disk_bus of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:27:40 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Found default for hw_input_bus of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:27:40 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Found default for hw_pointer_model of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:27:40 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Found default for hw_video_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:27:40 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Found default for hw_vif_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:27:40 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 01 21:27:40 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925260.7461731, 49c24c77-f102-4aed-8314-b04aad5f6b3a => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:27:40 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] VM Started (Lifecycle Event)
Aug 01 21:27:40 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:27:40 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:27:40 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 01 21:27:40 user nova-compute[72586]: DEBUG nova.compute.manager [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:27:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:27:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:27:40 user nova-compute[72586]: DEBUG nova.objects.instance [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72586) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Aug 01 21:27:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f107cab2-fd3b-4cf2-b4fd-20165519fa5c tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.107s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:27:42 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:44 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:52 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:27:52 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:52 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72586) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 21:27:52 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72586) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 21:27:52 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72586) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 21:27:52 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:55 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:57 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:58 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Acquiring lock "f6b0d907-2515-4a06-8b35-9ddd09ce42c3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:27:58 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "f6b0d907-2515-4a06-8b35-9ddd09ce42c3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:27:58 user nova-compute[72586]: DEBUG nova.compute.manager [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Starting instance... {{(pid=72586) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 21:27:58 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:27:58 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:27:59 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72586) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 21:27:59 user nova-compute[72586]: INFO nova.compute.claims [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Claim successful on node user
Aug 01 21:27:59 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:27:59 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:27:59 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:27:59 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.388s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:27:59 user nova-compute[72586]: DEBUG nova.compute.manager [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Start building networks asynchronously for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 21:27:59 user nova-compute[72586]: DEBUG nova.compute.manager [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Allocating IP information in the background. {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 21:27:59 user nova-compute[72586]: DEBUG nova.network.neutron [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] allocate_for_instance() {{(pid=72586) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 21:27:59 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 21:27:59 user nova-compute[72586]: DEBUG nova.compute.manager [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Start building block device mappings for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 21:27:59 user nova-compute[72586]: DEBUG nova.policy [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0f678ac8999a42c4a383ee8b2976b4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a1d82f39347119a9fb49fb8e8893f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72586) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 21:27:59 user nova-compute[72586]: DEBUG nova.compute.manager [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Start spawning the instance on the hypervisor. {{(pid=72586) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 21:27:59 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Creating instance directory {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 21:27:59 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Creating image(s)
Aug 01 21:27:59 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Acquiring lock "/opt/stack/data/nova/instances/f6b0d907-2515-4a06-8b35-9ddd09ce42c3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:27:59 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "/opt/stack/data/nova/instances/f6b0d907-2515-4a06-8b35-9ddd09ce42c3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:27:59 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "/opt/stack/data/nova/instances/f6b0d907-2515-4a06-8b35-9ddd09ce42c3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:27:59 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:59 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.150s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:59 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Acquiring lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:27:59 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:27:59 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:27:59 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.133s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:27:59 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/f6b0d907-2515-4a06-8b35-9ddd09ce42c3/disk 1073741824 {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:00 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:00 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/f6b0d907-2515-4a06-8b35-9ddd09ce42c3/disk 1073741824" returned: 0 in 0.322s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.461s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:28:00 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:00 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.133s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:00 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f6b0d907-2515-4a06-8b35-9ddd09ce42c3/disk. size=1073741824 {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 21:28:00 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b0d907-2515-4a06-8b35-9ddd09ce42c3/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:00 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b0d907-2515-4a06-8b35-9ddd09ce42c3/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:00 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Cannot resize image /opt/stack/data/nova/instances/f6b0d907-2515-4a06-8b35-9ddd09ce42c3/disk to a smaller size. {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 21:28:00 user nova-compute[72586]: DEBUG nova.objects.instance [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lazy-loading 'migration_context' on Instance uuid f6b0d907-2515-4a06-8b35-9ddd09ce42c3 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:28:00 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Created local disks {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 21:28:00 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Ensure instance console log exists: /opt/stack/data/nova/instances/f6b0d907-2515-4a06-8b35-9ddd09ce42c3/console.log {{(pid=72586) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 21:28:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:28:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:28:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:28:00 user nova-compute[72586]: DEBUG nova.network.neutron [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Successfully created port: 440ca7d3-e2b8-4edf-9339-bd8d247d5da2 {{(pid=72586) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 21:28:01 user nova-compute[72586]: DEBUG nova.network.neutron [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Successfully updated port: 440ca7d3-e2b8-4edf-9339-bd8d247d5da2 {{(pid=72586) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 21:28:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Acquiring lock "refresh_cache-f6b0d907-2515-4a06-8b35-9ddd09ce42c3" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:28:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Acquired lock "refresh_cache-f6b0d907-2515-4a06-8b35-9ddd09ce42c3" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:28:01 user nova-compute[72586]: DEBUG nova.network.neutron [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:28:01 user nova-compute[72586]: DEBUG nova.compute.manager [req-96a5bc22-f46c-468a-bd87-220cf3820dec req-348f7d75-1fac-43e1-a282-83f47465f1d0 service nova] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Received event network-changed-440ca7d3-e2b8-4edf-9339-bd8d247d5da2 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:28:01 user nova-compute[72586]: DEBUG nova.compute.manager [req-96a5bc22-f46c-468a-bd87-220cf3820dec req-348f7d75-1fac-43e1-a282-83f47465f1d0 service nova] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Refreshing instance network info cache due to event network-changed-440ca7d3-e2b8-4edf-9339-bd8d247d5da2. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:28:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-96a5bc22-f46c-468a-bd87-220cf3820dec req-348f7d75-1fac-43e1-a282-83f47465f1d0 service nova] Acquiring lock "refresh_cache-f6b0d907-2515-4a06-8b35-9ddd09ce42c3" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:28:01 user nova-compute[72586]: DEBUG nova.network.neutron [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Instance cache missing network info. {{(pid=72586) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 21:28:02 user nova-compute[72586]: DEBUG nova.network.neutron [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Updating instance_info_cache with network_info: [{"id": "440ca7d3-e2b8-4edf-9339-bd8d247d5da2", "address": "fa:16:3e:29:ff:63", "network": {"id": "d229a8de-7a2b-4dcd-a9ac-44a40349676e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-67691992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b1a1d82f39347119a9fb49fb8e8893f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap440ca7d3-e2", "ovs_interfaceid": "440ca7d3-e2b8-4edf-9339-bd8d247d5da2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:28:02 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Releasing lock "refresh_cache-f6b0d907-2515-4a06-8b35-9ddd09ce42c3" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:28:02 user nova-compute[72586]: DEBUG nova.compute.manager [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Instance network_info: |[{"id": "440ca7d3-e2b8-4edf-9339-bd8d247d5da2", "address": "fa:16:3e:29:ff:63", "network": {"id": "d229a8de-7a2b-4dcd-a9ac-44a40349676e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-67691992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b1a1d82f39347119a9fb49fb8e8893f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap440ca7d3-e2", "ovs_interfaceid": "440ca7d3-e2b8-4edf-9339-bd8d247d5da2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 21:28:02 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-96a5bc22-f46c-468a-bd87-220cf3820dec req-348f7d75-1fac-43e1-a282-83f47465f1d0 service nova] Acquired lock "refresh_cache-f6b0d907-2515-4a06-8b35-9ddd09ce42c3" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:28:02 user nova-compute[72586]: DEBUG nova.network.neutron [req-96a5bc22-f46c-468a-bd87-220cf3820dec req-348f7d75-1fac-43e1-a282-83f47465f1d0 service nova] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Refreshing network info cache for port 440ca7d3-e2b8-4edf-9339-bd8d247d5da2 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:28:02 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Start _get_guest_xml network_info=[{"id": "440ca7d3-e2b8-4edf-9339-bd8d247d5da2", "address": "fa:16:3e:29:ff:63", "network": {"id": "d229a8de-7a2b-4dcd-a9ac-44a40349676e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-67691992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b1a1d82f39347119a9fb49fb8e8893f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap440ca7d3-e2", "ovs_interfaceid": "440ca7d3-e2b8-4edf-9339-bd8d247d5da2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '0243d46b-6819-42a5-926f-42b71f0c97ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:28:02 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:28:02 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:28:02 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:28:02 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:28:02 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:02 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:28:02 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:28:02 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:28:02 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:28:02 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:28:02 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:28:02 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:28:02 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:28:02 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:28:02 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:28:02 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:28:02 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:28:02 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:28:02 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:28:02 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:27:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-688014459',display_name='tempest-ServerRescueNegativeTestJSON-server-688014459',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-688014459',id=23,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPKVtErVvQRkpUoC6JoyLuD25FsEWnNM1f53ch2eGXiYFeVUn5ceQanDKFKTGkUOLx9VSoczBggOQHVsTSmyYFizYDPlFPaBAzypHmYYYVCv8QrT9lMXmW/v7nzGDV6aQ==',key_name='tempest-keypair-266379112',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5b1a1d82f39347119a9fb49fb8e8893f',ramdisk_id='',reservation_id='r-kcmrdcc1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1258600061',owner_user_name='tempest-ServerRescueNegativeTestJSON-1258600061-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:28:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f678ac8999a42c4a383ee8b2976b4cc',uuid=f6b0d907-2515-4a06-8b35-9ddd09ce42c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "440ca7d3-e2b8-4edf-9339-bd8d247d5da2", "address": "fa:16:3e:29:ff:63", "network": {"id": "d229a8de-7a2b-4dcd-a9ac-44a40349676e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-67691992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b1a1d82f39347119a9fb49fb8e8893f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap440ca7d3-e2", "ovs_interfaceid": "440ca7d3-e2b8-4edf-9339-bd8d247d5da2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:28:02 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Converting VIF {"id": "440ca7d3-e2b8-4edf-9339-bd8d247d5da2", "address": "fa:16:3e:29:ff:63", "network": {"id": "d229a8de-7a2b-4dcd-a9ac-44a40349676e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-67691992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b1a1d82f39347119a9fb49fb8e8893f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap440ca7d3-e2", "ovs_interfaceid": "440ca7d3-e2b8-4edf-9339-bd8d247d5da2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:28:02 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:ff:63,bridge_name='br-int',has_traffic_filtering=True,id=440ca7d3-e2b8-4edf-9339-bd8d247d5da2,network=Network(d229a8de-7a2b-4dcd-a9ac-44a40349676e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap440ca7d3-e2') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:28:02 user nova-compute[72586]: DEBUG nova.objects.instance [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lazy-loading 'pci_devices' on Instance uuid f6b0d907-2515-4a06-8b35-9ddd09ce42c3 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:28:02 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:28:02 user nova-compute[72586]:   <uuid>f6b0d907-2515-4a06-8b35-9ddd09ce42c3</uuid>
Aug 01 21:28:02 user nova-compute[72586]:   <name>instance-00000017</name>
Aug 01 21:28:02 user nova-compute[72586]:   <memory>524288</memory>
Aug 01 21:28:02 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:28:02 user nova-compute[72586]:   <metadata>
Aug 01 21:28:02 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:28:02 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:28:02 user nova-compute[72586]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-688014459</nova:name>
Aug 01 21:28:02 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:28:02</nova:creationTime>
Aug 01 21:28:02 user nova-compute[72586]:       <nova:flavor name="m1.tiny">
Aug 01 21:28:02 user nova-compute[72586]:         <nova:memory>512</nova:memory>
Aug 01 21:28:02 user nova-compute[72586]:         <nova:disk>1</nova:disk>
Aug 01 21:28:02 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:28:02 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:28:02 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:28:02 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:28:02 user nova-compute[72586]:       <nova:owner>
Aug 01 21:28:02 user nova-compute[72586]:         <nova:user uuid="0f678ac8999a42c4a383ee8b2976b4cc">tempest-ServerRescueNegativeTestJSON-1258600061-project-member</nova:user>
Aug 01 21:28:02 user nova-compute[72586]:         <nova:project uuid="5b1a1d82f39347119a9fb49fb8e8893f">tempest-ServerRescueNegativeTestJSON-1258600061</nova:project>
Aug 01 21:28:02 user nova-compute[72586]:       </nova:owner>
Aug 01 21:28:02 user nova-compute[72586]:       <nova:root type="image" uuid="0243d46b-6819-42a5-926f-42b71f0c97ad"/>
Aug 01 21:28:02 user nova-compute[72586]:       <nova:ports>
Aug 01 21:28:02 user nova-compute[72586]:         <nova:port uuid="440ca7d3-e2b8-4edf-9339-bd8d247d5da2">
Aug 01 21:28:02 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 01 21:28:02 user nova-compute[72586]:         </nova:port>
Aug 01 21:28:02 user nova-compute[72586]:       </nova:ports>
Aug 01 21:28:02 user nova-compute[72586]:     </nova:instance>
Aug 01 21:28:02 user nova-compute[72586]:   </metadata>
Aug 01 21:28:02 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:28:02 user nova-compute[72586]:     <system>
Aug 01 21:28:02 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:28:02 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:28:02 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:28:02 user nova-compute[72586]:       <entry name="serial">f6b0d907-2515-4a06-8b35-9ddd09ce42c3</entry>
Aug 01 21:28:02 user nova-compute[72586]:       <entry name="uuid">f6b0d907-2515-4a06-8b35-9ddd09ce42c3</entry>
Aug 01 21:28:02 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:28:02 user nova-compute[72586]:     </system>
Aug 01 21:28:02 user nova-compute[72586]:   </sysinfo>
Aug 01 21:28:02 user nova-compute[72586]:   <os>
Aug 01 21:28:02 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:28:02 user nova-compute[72586]:     <boot dev="hd"/>
Aug 01 21:28:02 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:28:02 user nova-compute[72586]:   </os>
Aug 01 21:28:02 user nova-compute[72586]:   <features>
Aug 01 21:28:02 user nova-compute[72586]:     <acpi/>
Aug 01 21:28:02 user nova-compute[72586]:     <apic/>
Aug 01 21:28:02 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:28:02 user nova-compute[72586]:   </features>
Aug 01 21:28:02 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:28:02 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:28:02 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:28:02 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:28:02 user nova-compute[72586]:   </clock>
Aug 01 21:28:02 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:28:02 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:28:02 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:28:02 user nova-compute[72586]:   </cpu>
Aug 01 21:28:02 user nova-compute[72586]:   <devices>
Aug 01 21:28:02 user nova-compute[72586]:     <disk type="file" device="disk">
Aug 01 21:28:02 user nova-compute[72586]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 21:28:02 user nova-compute[72586]:       <source file="/opt/stack/data/nova/instances/f6b0d907-2515-4a06-8b35-9ddd09ce42c3/disk"/>
Aug 01 21:28:02 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:28:02 user nova-compute[72586]:     </disk>
Aug 01 21:28:02 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:28:02 user nova-compute[72586]:       <mac address="fa:16:3e:29:ff:63"/>
Aug 01 21:28:02 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:28:02 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:28:02 user nova-compute[72586]:       <target dev="tap440ca7d3-e2"/>
Aug 01 21:28:02 user nova-compute[72586]:     </interface>
Aug 01 21:28:02 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:28:02 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/f6b0d907-2515-4a06-8b35-9ddd09ce42c3/console.log" append="off"/>
Aug 01 21:28:02 user nova-compute[72586]:     </serial>
Aug 01 21:28:02 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:28:02 user nova-compute[72586]:     <video>
Aug 01 21:28:02 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:28:02 user nova-compute[72586]:     </video>
Aug 01 21:28:02 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:28:02 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:28:02 user nova-compute[72586]:     </rng>
Aug 01 21:28:02 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:28:02 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:28:02 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:28:02 user nova-compute[72586]:     </memballoon>
Aug 01 21:28:02 user nova-compute[72586]:   </devices>
Aug 01 21:28:02 user nova-compute[72586]: </domain>
Aug 01 21:28:02 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:28:02 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:27:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-688014459',display_name='tempest-ServerRescueNegativeTestJSON-server-688014459',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-688014459',id=23,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPKVtErVvQRkpUoC6JoyLuD25FsEWnNM1f53ch2eGXiYFeVUn5ceQanDKFKTGkUOLx9VSoczBggOQHVsTSmyYFizYDPlFPaBAzypHmYYYVCv8QrT9lMXmW/v7nzGDV6aQ==',key_name='tempest-keypair-266379112',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5b1a1d82f39347119a9fb49fb8e8893f',ramdisk_id='',reservation_id='r-kcmrdcc1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1258600061',owner_user_name='tempest-ServerRescueNegativeTestJSON-1258600061-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:28:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f678ac8999a42c4a383ee8b2976b4cc',uuid=f6b0d907-2515-4a06-8b35-9ddd09ce42c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "440ca7d3-e2b8-4edf-9339-bd8d247d5da2", "address": "fa:16:3e:29:ff:63", "network": {"id": "d229a8de-7a2b-4dcd-a9ac-44a40349676e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-67691992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b1a1d82f39347119a9fb49fb8e8893f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap440ca7d3-e2", "ovs_interfaceid": "440ca7d3-e2b8-4edf-9339-bd8d247d5da2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:28:02 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Converting VIF {"id": "440ca7d3-e2b8-4edf-9339-bd8d247d5da2", "address": "fa:16:3e:29:ff:63", "network": {"id": "d229a8de-7a2b-4dcd-a9ac-44a40349676e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-67691992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b1a1d82f39347119a9fb49fb8e8893f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap440ca7d3-e2", "ovs_interfaceid": "440ca7d3-e2b8-4edf-9339-bd8d247d5da2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:28:02 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:ff:63,bridge_name='br-int',has_traffic_filtering=True,id=440ca7d3-e2b8-4edf-9339-bd8d247d5da2,network=Network(d229a8de-7a2b-4dcd-a9ac-44a40349676e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap440ca7d3-e2') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:28:02 user nova-compute[72586]: DEBUG os_vif [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:ff:63,bridge_name='br-int',has_traffic_filtering=True,id=440ca7d3-e2b8-4edf-9339-bd8d247d5da2,network=Network(d229a8de-7a2b-4dcd-a9ac-44a40349676e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap440ca7d3-e2') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:28:02 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:02 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:28:02 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:28:02 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:02 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap440ca7d3-e2, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:28:02 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap440ca7d3-e2, col_values=(('external_ids', {'iface-id': '440ca7d3-e2b8-4edf-9339-bd8d247d5da2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:ff:63', 'vm-uuid': 'f6b0d907-2515-4a06-8b35-9ddd09ce42c3'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:28:02 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:02 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:28:02 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:02 user nova-compute[72586]: INFO os_vif [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:ff:63,bridge_name='br-int',has_traffic_filtering=True,id=440ca7d3-e2b8-4edf-9339-bd8d247d5da2,network=Network(d229a8de-7a2b-4dcd-a9ac-44a40349676e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap440ca7d3-e2')
Aug 01 21:28:02 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:28:02 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] No VIF found with MAC fa:16:3e:29:ff:63, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:28:02 user nova-compute[72586]: DEBUG nova.network.neutron [req-96a5bc22-f46c-468a-bd87-220cf3820dec req-348f7d75-1fac-43e1-a282-83f47465f1d0 service nova] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Updated VIF entry in instance network info cache for port 440ca7d3-e2b8-4edf-9339-bd8d247d5da2. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:28:02 user nova-compute[72586]: DEBUG nova.network.neutron [req-96a5bc22-f46c-468a-bd87-220cf3820dec req-348f7d75-1fac-43e1-a282-83f47465f1d0 service nova] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Updating instance_info_cache with network_info: [{"id": "440ca7d3-e2b8-4edf-9339-bd8d247d5da2", "address": "fa:16:3e:29:ff:63", "network": {"id": "d229a8de-7a2b-4dcd-a9ac-44a40349676e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-67691992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b1a1d82f39347119a9fb49fb8e8893f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap440ca7d3-e2", "ovs_interfaceid": "440ca7d3-e2b8-4edf-9339-bd8d247d5da2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:28:02 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-96a5bc22-f46c-468a-bd87-220cf3820dec req-348f7d75-1fac-43e1-a282-83f47465f1d0 service nova] Releasing lock "refresh_cache-f6b0d907-2515-4a06-8b35-9ddd09ce42c3" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:28:03 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:03 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:03 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:03 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:04 user nova-compute[72586]: DEBUG nova.compute.manager [req-7138d3d0-83c2-4504-b603-04bab44902d5 req-430ca125-ee79-414c-8d04-3490863c5a56 service nova] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Received event network-vif-plugged-440ca7d3-e2b8-4edf-9339-bd8d247d5da2 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:28:04 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-7138d3d0-83c2-4504-b603-04bab44902d5 req-430ca125-ee79-414c-8d04-3490863c5a56 service nova] Acquiring lock "f6b0d907-2515-4a06-8b35-9ddd09ce42c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:28:04 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-7138d3d0-83c2-4504-b603-04bab44902d5 req-430ca125-ee79-414c-8d04-3490863c5a56 service nova] Lock "f6b0d907-2515-4a06-8b35-9ddd09ce42c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:28:04 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-7138d3d0-83c2-4504-b603-04bab44902d5 req-430ca125-ee79-414c-8d04-3490863c5a56 service nova] Lock "f6b0d907-2515-4a06-8b35-9ddd09ce42c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:28:04 user nova-compute[72586]: DEBUG nova.compute.manager [req-7138d3d0-83c2-4504-b603-04bab44902d5 req-430ca125-ee79-414c-8d04-3490863c5a56 service nova] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] No waiting events found dispatching network-vif-plugged-440ca7d3-e2b8-4edf-9339-bd8d247d5da2 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:28:04 user nova-compute[72586]: WARNING nova.compute.manager [req-7138d3d0-83c2-4504-b603-04bab44902d5 req-430ca125-ee79-414c-8d04-3490863c5a56 service nova] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Received unexpected event network-vif-plugged-440ca7d3-e2b8-4edf-9339-bd8d247d5da2 for instance with vm_state building and task_state spawning.
Aug 01 21:28:04 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:04 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:05 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925285.9758563, f6b0d907-2515-4a06-8b35-9ddd09ce42c3 => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:28:05 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] VM Resumed (Lifecycle Event)
Aug 01 21:28:05 user nova-compute[72586]: DEBUG nova.compute.manager [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Instance event wait completed in 0 seconds for  {{(pid=72586) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 21:28:05 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Guest created on hypervisor {{(pid=72586) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 21:28:05 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Instance spawned successfully.
Aug 01 21:28:05 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 21:28:06 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:28:06 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Found default for hw_cdrom_bus of ide {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:28:06 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Found default for hw_disk_bus of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:28:06 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Found default for hw_input_bus of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:28:06 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Found default for hw_pointer_model of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:28:06 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Found default for hw_video_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:28:06 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Found default for hw_vif_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:28:06 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:28:06 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:28:06 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925285.9770658, f6b0d907-2515-4a06-8b35-9ddd09ce42c3 => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:28:06 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] VM Started (Lifecycle Event)
Aug 01 21:28:06 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:28:06 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:28:06 user nova-compute[72586]: DEBUG nova.compute.manager [req-693035e2-e88e-45a7-afbb-36d359976d7a req-cbb6a251-7202-4b77-ba11-6dba69833840 service nova] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Received event network-vif-plugged-440ca7d3-e2b8-4edf-9339-bd8d247d5da2 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:28:06 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-693035e2-e88e-45a7-afbb-36d359976d7a req-cbb6a251-7202-4b77-ba11-6dba69833840 service nova] Acquiring lock "f6b0d907-2515-4a06-8b35-9ddd09ce42c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:28:06 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-693035e2-e88e-45a7-afbb-36d359976d7a req-cbb6a251-7202-4b77-ba11-6dba69833840 service nova] Lock "f6b0d907-2515-4a06-8b35-9ddd09ce42c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:28:06 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-693035e2-e88e-45a7-afbb-36d359976d7a req-cbb6a251-7202-4b77-ba11-6dba69833840 service nova] Lock "f6b0d907-2515-4a06-8b35-9ddd09ce42c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:28:06 user nova-compute[72586]: DEBUG nova.compute.manager [req-693035e2-e88e-45a7-afbb-36d359976d7a req-cbb6a251-7202-4b77-ba11-6dba69833840 service nova] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] No waiting events found dispatching network-vif-plugged-440ca7d3-e2b8-4edf-9339-bd8d247d5da2 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:28:06 user nova-compute[72586]: WARNING nova.compute.manager [req-693035e2-e88e-45a7-afbb-36d359976d7a req-cbb6a251-7202-4b77-ba11-6dba69833840 service nova] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Received unexpected event network-vif-plugged-440ca7d3-e2b8-4edf-9339-bd8d247d5da2 for instance with vm_state building and task_state spawning.
Aug 01 21:28:06 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:28:06 user nova-compute[72586]: INFO nova.compute.manager [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Took 6.52 seconds to spawn the instance on the hypervisor.
Aug 01 21:28:06 user nova-compute[72586]: DEBUG nova.compute.manager [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:28:06 user nova-compute[72586]: INFO nova.compute.manager [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Took 7.23 seconds to build instance.
Aug 01 21:28:06 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-4dec3428-51a5-481c-9574-3036bc476934 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "f6b0d907-2515-4a06-8b35-9ddd09ce42c3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.330s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:28:07 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:07 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:09 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:09 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-2bcd9d1c-bd1a-43ff-9086-1711cfe935c4 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Acquiring lock "d51eb56c-bce2-4593-abc3-878c358c9a74" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:28:09 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-2bcd9d1c-bd1a-43ff-9086-1711cfe935c4 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Lock "d51eb56c-bce2-4593-abc3-878c358c9a74" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:28:09 user nova-compute[72586]: DEBUG nova.objects.instance [None req-2bcd9d1c-bd1a-43ff-9086-1711cfe935c4 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Lazy-loading 'flavor' on Instance uuid d51eb56c-bce2-4593-abc3-878c358c9a74 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:28:09 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-2bcd9d1c-bd1a-43ff-9086-1711cfe935c4 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Lock "d51eb56c-bce2-4593-abc3-878c358c9a74" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:28:09 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-2bcd9d1c-bd1a-43ff-9086-1711cfe935c4 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Acquiring lock "d51eb56c-bce2-4593-abc3-878c358c9a74" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:28:09 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-2bcd9d1c-bd1a-43ff-9086-1711cfe935c4 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Lock "d51eb56c-bce2-4593-abc3-878c358c9a74" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:28:09 user nova-compute[72586]: INFO nova.compute.manager [None req-2bcd9d1c-bd1a-43ff-9086-1711cfe935c4 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Attaching volume 1aafe36a-8c91-4a47-9328-9ea0529e83d4 to /dev/vdb
Aug 01 21:28:09 user nova-compute[72586]: DEBUG os_brick.utils [None req-2bcd9d1c-bd1a-43ff-9086-1711cfe935c4 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:28:09 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:09 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:09 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[652d8987-436c-4934-9c9c-4f5ef1773db2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4bc202fb9cb\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:09 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:09 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:09 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fba4d8b-2c3e-440e-b6e6-20c5e75d7e6c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:09 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Acquiring lock "dadba691-ab8a-4e25-864f-3211ef71872f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:28:09 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Lock "dadba691-ab8a-4e25-864f-3211ef71872f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:28:09 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:09 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:09 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[7661765c-e3b0-4da5-9082-92b8b9fe641c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:09 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d145a05-80fa-4760-9b8f-caf019685299]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:09 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-2bcd9d1c-bd1a-43ff-9086-1711cfe935c4 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Running cmd (subprocess): nvme version {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:09 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-2bcd9d1c-bd1a-43ff-9086-1711cfe935c4 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] 'nvme version' failed. Not Retrying. {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:28:09 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2bcd9d1c-bd1a-43ff-9086-1711cfe935c4 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] nvme not present on system {{(pid=72586) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 21:28:09 user nova-compute[72586]: DEBUG nova.compute.manager [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] Starting instance... {{(pid=72586) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 21:28:09 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:09 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:28:09 user nova-compute[72586]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 21:28:09 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0153d43b-025b-4c19-8c00-d3305682d454]: (4, '') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:09 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-2bcd9d1c-bd1a-43ff-9086-1711cfe935c4 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72586) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 21:28:09 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-2bcd9d1c-bd1a-43ff-9086-1711cfe935c4 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 21:28:09 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-2bcd9d1c-bd1a-43ff-9086-1711cfe935c4 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] LIGHTOS: no hostnqn found. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 21:28:09 user nova-compute[72586]: DEBUG os_brick.utils [None req-2bcd9d1c-bd1a-43ff-9086-1711cfe935c4 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4bc202fb9cb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:28:09 user nova-compute[72586]: DEBUG nova.virt.block_device [None req-2bcd9d1c-bd1a-43ff-9086-1711cfe935c4 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Updating existing volume attachment record: 12b001f1-eb0d-4cbe-bd87-28e87868f305 {{(pid=72586) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 21:28:09 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:28:09 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:28:09 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72586) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 21:28:09 user nova-compute[72586]: INFO nova.compute.claims [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] Claim successful on node user
Aug 01 21:28:10 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:28:10 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:28:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.503s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:28:10 user nova-compute[72586]: DEBUG nova.compute.manager [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] Start building networks asynchronously for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 21:28:10 user nova-compute[72586]: DEBUG nova.compute.manager [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] Allocating IP information in the background. {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 21:28:10 user nova-compute[72586]: DEBUG nova.network.neutron [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] allocate_for_instance() {{(pid=72586) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 21:28:10 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 21:28:10 user nova-compute[72586]: DEBUG nova.compute.manager [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] Start building block device mappings for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 21:28:10 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:10 user nova-compute[72586]: DEBUG nova.compute.manager [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] Start spawning the instance on the hypervisor. {{(pid=72586) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 21:28:10 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] Creating instance directory {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 21:28:10 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] Creating image(s)
Aug 01 21:28:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Acquiring lock "/opt/stack/data/nova/instances/dadba691-ab8a-4e25-864f-3211ef71872f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:28:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Lock "/opt/stack/data/nova/instances/dadba691-ab8a-4e25-864f-3211ef71872f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:28:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Lock "/opt/stack/data/nova/instances/dadba691-ab8a-4e25-864f-3211ef71872f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:28:10 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:10 user nova-compute[72586]: DEBUG nova.policy [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5038f09f5e404c28bca02fc1ecb485b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724b3e26f64c47b8bb521981a4c5ff94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72586) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 21:28:10 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.146s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Acquiring lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:28:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:28:10 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:11 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.154s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:11 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/dadba691-ab8a-4e25-864f-3211ef71872f/disk 1073741824 {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:11 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/dadba691-ab8a-4e25-864f-3211ef71872f/disk 1073741824" returned: 0 in 0.060s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:11 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:28:11 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:11 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.143s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:11 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dadba691-ab8a-4e25-864f-3211ef71872f/disk. size=1073741824 {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 21:28:11 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadba691-ab8a-4e25-864f-3211ef71872f/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:11 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadba691-ab8a-4e25-864f-3211ef71872f/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:11 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Cannot resize image /opt/stack/data/nova/instances/dadba691-ab8a-4e25-864f-3211ef71872f/disk to a smaller size. {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 21:28:11 user nova-compute[72586]: DEBUG nova.objects.instance [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Lazy-loading 'migration_context' on Instance uuid dadba691-ab8a-4e25-864f-3211ef71872f {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:28:11 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] Created local disks {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 21:28:11 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] Ensure instance console log exists: /opt/stack/data/nova/instances/dadba691-ab8a-4e25-864f-3211ef71872f/console.log {{(pid=72586) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 21:28:11 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:28:11 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:28:11 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:28:11 user nova-compute[72586]: DEBUG nova.network.neutron [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] Successfully created port: 843d4e65-1f9e-44d6-a5b6-fba488393eea {{(pid=72586) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 21:28:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:12 user nova-compute[72586]: DEBUG nova.network.neutron [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] Successfully updated port: 843d4e65-1f9e-44d6-a5b6-fba488393eea {{(pid=72586) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 21:28:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Acquiring lock "refresh_cache-dadba691-ab8a-4e25-864f-3211ef71872f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:28:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Acquired lock "refresh_cache-dadba691-ab8a-4e25-864f-3211ef71872f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:28:12 user nova-compute[72586]: DEBUG nova.network.neutron [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:28:12 user nova-compute[72586]: DEBUG nova.compute.manager [req-d23cdb1a-b9b3-4ec7-bfe1-0af3672c1d46 req-61876806-617b-4df4-9e4c-f94b35021aaf service nova] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] Received event network-changed-843d4e65-1f9e-44d6-a5b6-fba488393eea {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:28:12 user nova-compute[72586]: DEBUG nova.compute.manager [req-d23cdb1a-b9b3-4ec7-bfe1-0af3672c1d46 req-61876806-617b-4df4-9e4c-f94b35021aaf service nova] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] Refreshing instance network info cache due to event network-changed-843d4e65-1f9e-44d6-a5b6-fba488393eea. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:28:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d23cdb1a-b9b3-4ec7-bfe1-0af3672c1d46 req-61876806-617b-4df4-9e4c-f94b35021aaf service nova] Acquiring lock "refresh_cache-dadba691-ab8a-4e25-864f-3211ef71872f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:28:12 user nova-compute[72586]: DEBUG nova.network.neutron [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] Instance cache missing network info. {{(pid=72586) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 21:28:12 user nova-compute[72586]: DEBUG nova.network.neutron [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] Updating instance_info_cache with network_info: [{"id": "843d4e65-1f9e-44d6-a5b6-fba488393eea", "address": "fa:16:3e:21:84:10", "network": {"id": "6aa30f19-4fe9-497b-a1cd-9279113f1153", "bridge": "br-int", "label": "tempest-VolumesActionsTest-513072853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "724b3e26f64c47b8bb521981a4c5ff94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap843d4e65-1f", "ovs_interfaceid": "843d4e65-1f9e-44d6-a5b6-fba488393eea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:28:13 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Releasing lock "refresh_cache-dadba691-ab8a-4e25-864f-3211ef71872f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:28:13 user nova-compute[72586]: DEBUG nova.compute.manager [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] Instance network_info: |[{"id": "843d4e65-1f9e-44d6-a5b6-fba488393eea", "address": "fa:16:3e:21:84:10", "network": {"id": "6aa30f19-4fe9-497b-a1cd-9279113f1153", "bridge": "br-int", "label": "tempest-VolumesActionsTest-513072853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "724b3e26f64c47b8bb521981a4c5ff94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap843d4e65-1f", "ovs_interfaceid": "843d4e65-1f9e-44d6-a5b6-fba488393eea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 21:28:13 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d23cdb1a-b9b3-4ec7-bfe1-0af3672c1d46 req-61876806-617b-4df4-9e4c-f94b35021aaf service nova] Acquired lock "refresh_cache-dadba691-ab8a-4e25-864f-3211ef71872f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:28:13 user nova-compute[72586]: DEBUG nova.network.neutron [req-d23cdb1a-b9b3-4ec7-bfe1-0af3672c1d46 req-61876806-617b-4df4-9e4c-f94b35021aaf service nova] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] Refreshing network info cache for port 843d4e65-1f9e-44d6-a5b6-fba488393eea {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:28:13 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] Start _get_guest_xml network_info=[{"id": "843d4e65-1f9e-44d6-a5b6-fba488393eea", "address": "fa:16:3e:21:84:10", "network": {"id": "6aa30f19-4fe9-497b-a1cd-9279113f1153", "bridge": "br-int", "label": "tempest-VolumesActionsTest-513072853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "724b3e26f64c47b8bb521981a4c5ff94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap843d4e65-1f", "ovs_interfaceid": "843d4e65-1f9e-44d6-a5b6-fba488393eea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '0243d46b-6819-42a5-926f-42b71f0c97ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:28:13 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:28:13 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:28:13 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:28:13 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:28:13 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:28:13 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:28:13 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:28:13 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:28:13 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:28:13 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:28:13 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:28:13 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:28:13 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:28:13 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:28:13 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:28:13 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:28:13 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:28:13 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:28:13 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:28:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-957025856',display_name='tempest-VolumesActionsTest-instance-957025856',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-957025856',id=24,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='724b3e26f64c47b8bb521981a4c5ff94',ramdisk_id='',reservation_id='r-ifzhznlr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-647755296',owner_user_name='tempest-VolumesActionsTest-647755296-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:28:11Z,user_data=None,user_id='5038f09f5e404c28bca02fc1ecb485b3',uuid=dadba691-ab8a-4e25-864f-3211ef71872f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "843d4e65-1f9e-44d6-a5b6-fba488393eea", "address": "fa:16:3e:21:84:10", "network": {"id": "6aa30f19-4fe9-497b-a1cd-9279113f1153", "bridge": "br-int", "label": "tempest-VolumesActionsTest-513072853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "724b3e26f64c47b8bb521981a4c5ff94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap843d4e65-1f", "ovs_interfaceid": "843d4e65-1f9e-44d6-a5b6-fba488393eea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:28:13 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Converting VIF {"id": "843d4e65-1f9e-44d6-a5b6-fba488393eea", "address": "fa:16:3e:21:84:10", "network": {"id": "6aa30f19-4fe9-497b-a1cd-9279113f1153", "bridge": "br-int", "label": "tempest-VolumesActionsTest-513072853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "724b3e26f64c47b8bb521981a4c5ff94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap843d4e65-1f", "ovs_interfaceid": "843d4e65-1f9e-44d6-a5b6-fba488393eea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:28:13 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:84:10,bridge_name='br-int',has_traffic_filtering=True,id=843d4e65-1f9e-44d6-a5b6-fba488393eea,network=Network(6aa30f19-4fe9-497b-a1cd-9279113f1153),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap843d4e65-1f') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:28:13 user nova-compute[72586]: DEBUG nova.objects.instance [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Lazy-loading 'pci_devices' on Instance uuid dadba691-ab8a-4e25-864f-3211ef71872f {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:28:13 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:28:13 user nova-compute[72586]:   <uuid>dadba691-ab8a-4e25-864f-3211ef71872f</uuid>
Aug 01 21:28:13 user nova-compute[72586]:   <name>instance-00000018</name>
Aug 01 21:28:13 user nova-compute[72586]:   <memory>524288</memory>
Aug 01 21:28:13 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:28:13 user nova-compute[72586]:   <metadata>
Aug 01 21:28:13 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:28:13 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:28:13 user nova-compute[72586]:       <nova:name>tempest-VolumesActionsTest-instance-957025856</nova:name>
Aug 01 21:28:13 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:28:13</nova:creationTime>
Aug 01 21:28:13 user nova-compute[72586]:       <nova:flavor name="m1.tiny">
Aug 01 21:28:13 user nova-compute[72586]:         <nova:memory>512</nova:memory>
Aug 01 21:28:13 user nova-compute[72586]:         <nova:disk>1</nova:disk>
Aug 01 21:28:13 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:28:13 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:28:13 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:28:13 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:28:13 user nova-compute[72586]:       <nova:owner>
Aug 01 21:28:13 user nova-compute[72586]:         <nova:user uuid="5038f09f5e404c28bca02fc1ecb485b3">tempest-VolumesActionsTest-647755296-project-member</nova:user>
Aug 01 21:28:13 user nova-compute[72586]:         <nova:project uuid="724b3e26f64c47b8bb521981a4c5ff94">tempest-VolumesActionsTest-647755296</nova:project>
Aug 01 21:28:13 user nova-compute[72586]:       </nova:owner>
Aug 01 21:28:13 user nova-compute[72586]:       <nova:root type="image" uuid="0243d46b-6819-42a5-926f-42b71f0c97ad"/>
Aug 01 21:28:13 user nova-compute[72586]:       <nova:ports>
Aug 01 21:28:13 user nova-compute[72586]:         <nova:port uuid="843d4e65-1f9e-44d6-a5b6-fba488393eea">
Aug 01 21:28:13 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 01 21:28:13 user nova-compute[72586]:         </nova:port>
Aug 01 21:28:13 user nova-compute[72586]:       </nova:ports>
Aug 01 21:28:13 user nova-compute[72586]:     </nova:instance>
Aug 01 21:28:13 user nova-compute[72586]:   </metadata>
Aug 01 21:28:13 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:28:13 user nova-compute[72586]:     <system>
Aug 01 21:28:13 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:28:13 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:28:13 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:28:13 user nova-compute[72586]:       <entry name="serial">dadba691-ab8a-4e25-864f-3211ef71872f</entry>
Aug 01 21:28:13 user nova-compute[72586]:       <entry name="uuid">dadba691-ab8a-4e25-864f-3211ef71872f</entry>
Aug 01 21:28:13 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:28:13 user nova-compute[72586]:     </system>
Aug 01 21:28:13 user nova-compute[72586]:   </sysinfo>
Aug 01 21:28:13 user nova-compute[72586]:   <os>
Aug 01 21:28:13 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:28:13 user nova-compute[72586]:     <boot dev="hd"/>
Aug 01 21:28:13 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:28:13 user nova-compute[72586]:   </os>
Aug 01 21:28:13 user nova-compute[72586]:   <features>
Aug 01 21:28:13 user nova-compute[72586]:     <acpi/>
Aug 01 21:28:13 user nova-compute[72586]:     <apic/>
Aug 01 21:28:13 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:28:13 user nova-compute[72586]:   </features>
Aug 01 21:28:13 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:28:13 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:28:13 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:28:13 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:28:13 user nova-compute[72586]:   </clock>
Aug 01 21:28:13 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:28:13 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:28:13 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:28:13 user nova-compute[72586]:   </cpu>
Aug 01 21:28:13 user nova-compute[72586]:   <devices>
Aug 01 21:28:13 user nova-compute[72586]:     <disk type="file" device="disk">
Aug 01 21:28:13 user nova-compute[72586]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 21:28:13 user nova-compute[72586]:       <source file="/opt/stack/data/nova/instances/dadba691-ab8a-4e25-864f-3211ef71872f/disk"/>
Aug 01 21:28:13 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:28:13 user nova-compute[72586]:     </disk>
Aug 01 21:28:13 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:28:13 user nova-compute[72586]:       <mac address="fa:16:3e:21:84:10"/>
Aug 01 21:28:13 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:28:13 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:28:13 user nova-compute[72586]:       <target dev="tap843d4e65-1f"/>
Aug 01 21:28:13 user nova-compute[72586]:     </interface>
Aug 01 21:28:13 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:28:13 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/dadba691-ab8a-4e25-864f-3211ef71872f/console.log" append="off"/>
Aug 01 21:28:13 user nova-compute[72586]:     </serial>
Aug 01 21:28:13 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:28:13 user nova-compute[72586]:     <video>
Aug 01 21:28:13 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:28:13 user nova-compute[72586]:     </video>
Aug 01 21:28:13 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:28:13 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:28:13 user nova-compute[72586]:     </rng>
Aug 01 21:28:13 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:28:13 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:28:13 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:28:13 user nova-compute[72586]:     </memballoon>
Aug 01 21:28:13 user nova-compute[72586]:   </devices>
Aug 01 21:28:13 user nova-compute[72586]: </domain>
Aug 01 21:28:13 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:28:13 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:28:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-957025856',display_name='tempest-VolumesActionsTest-instance-957025856',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-957025856',id=24,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='724b3e26f64c47b8bb521981a4c5ff94',ramdisk_id='',reservation_id='r-ifzhznlr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-647755296',owner_user_name='tempest-VolumesActionsTest-647755296-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:28:11Z,user_data=None,user_id='5038f09f5e404c28bca02fc1ecb485b3',uuid=dadba691-ab8a-4e25-864f-3211ef71872f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "843d4e65-1f9e-44d6-a5b6-fba488393eea", "address": "fa:16:3e:21:84:10", "network": {"id": "6aa30f19-4fe9-497b-a1cd-9279113f1153", "bridge": "br-int", "label": "tempest-VolumesActionsTest-513072853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "724b3e26f64c47b8bb521981a4c5ff94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap843d4e65-1f", "ovs_interfaceid": "843d4e65-1f9e-44d6-a5b6-fba488393eea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:28:13 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Converting VIF {"id": "843d4e65-1f9e-44d6-a5b6-fba488393eea", "address": "fa:16:3e:21:84:10", "network": {"id": "6aa30f19-4fe9-497b-a1cd-9279113f1153", "bridge": "br-int", "label": "tempest-VolumesActionsTest-513072853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "724b3e26f64c47b8bb521981a4c5ff94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap843d4e65-1f", "ovs_interfaceid": "843d4e65-1f9e-44d6-a5b6-fba488393eea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:28:13 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:84:10,bridge_name='br-int',has_traffic_filtering=True,id=843d4e65-1f9e-44d6-a5b6-fba488393eea,network=Network(6aa30f19-4fe9-497b-a1cd-9279113f1153),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap843d4e65-1f') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:28:13 user nova-compute[72586]: DEBUG os_vif [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:84:10,bridge_name='br-int',has_traffic_filtering=True,id=843d4e65-1f9e-44d6-a5b6-fba488393eea,network=Network(6aa30f19-4fe9-497b-a1cd-9279113f1153),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap843d4e65-1f') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:28:13 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:13 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:28:13 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:28:13 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:13 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap843d4e65-1f, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:28:13 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap843d4e65-1f, col_values=(('external_ids', {'iface-id': '843d4e65-1f9e-44d6-a5b6-fba488393eea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:84:10', 'vm-uuid': 'dadba691-ab8a-4e25-864f-3211ef71872f'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:28:13 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:13 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:28:13 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:13 user nova-compute[72586]: INFO os_vif [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:84:10,bridge_name='br-int',has_traffic_filtering=True,id=843d4e65-1f9e-44d6-a5b6-fba488393eea,network=Network(6aa30f19-4fe9-497b-a1cd-9279113f1153),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap843d4e65-1f')
Aug 01 21:28:13 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:28:13 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] No VIF found with MAC fa:16:3e:21:84:10, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:28:13 user nova-compute[72586]: DEBUG nova.network.neutron [req-d23cdb1a-b9b3-4ec7-bfe1-0af3672c1d46 req-61876806-617b-4df4-9e4c-f94b35021aaf service nova] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] Updated VIF entry in instance network info cache for port 843d4e65-1f9e-44d6-a5b6-fba488393eea. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:28:13 user nova-compute[72586]: DEBUG nova.network.neutron [req-d23cdb1a-b9b3-4ec7-bfe1-0af3672c1d46 req-61876806-617b-4df4-9e4c-f94b35021aaf service nova] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] Updating instance_info_cache with network_info: [{"id": "843d4e65-1f9e-44d6-a5b6-fba488393eea", "address": "fa:16:3e:21:84:10", "network": {"id": "6aa30f19-4fe9-497b-a1cd-9279113f1153", "bridge": "br-int", "label": "tempest-VolumesActionsTest-513072853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "724b3e26f64c47b8bb521981a4c5ff94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap843d4e65-1f", "ovs_interfaceid": "843d4e65-1f9e-44d6-a5b6-fba488393eea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:28:13 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d23cdb1a-b9b3-4ec7-bfe1-0af3672c1d46 req-61876806-617b-4df4-9e4c-f94b35021aaf service nova] Releasing lock "refresh_cache-dadba691-ab8a-4e25-864f-3211ef71872f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:28:14 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:14 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:14 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:14 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:14 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:15 user nova-compute[72586]: DEBUG nova.compute.manager [req-8f9c3951-9bac-45dc-a6d0-7fafb9eca183 req-a3141c6f-0550-4397-ad17-3d58cacacc62 service nova] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] Received event network-vif-plugged-843d4e65-1f9e-44d6-a5b6-fba488393eea {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:28:15 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-8f9c3951-9bac-45dc-a6d0-7fafb9eca183 req-a3141c6f-0550-4397-ad17-3d58cacacc62 service nova] Acquiring lock "dadba691-ab8a-4e25-864f-3211ef71872f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:28:15 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-8f9c3951-9bac-45dc-a6d0-7fafb9eca183 req-a3141c6f-0550-4397-ad17-3d58cacacc62 service nova] Lock "dadba691-ab8a-4e25-864f-3211ef71872f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:28:15 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-8f9c3951-9bac-45dc-a6d0-7fafb9eca183 req-a3141c6f-0550-4397-ad17-3d58cacacc62 service nova] Lock "dadba691-ab8a-4e25-864f-3211ef71872f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:28:15 user nova-compute[72586]: DEBUG nova.compute.manager [req-8f9c3951-9bac-45dc-a6d0-7fafb9eca183 req-a3141c6f-0550-4397-ad17-3d58cacacc62 service nova] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] No waiting events found dispatching network-vif-plugged-843d4e65-1f9e-44d6-a5b6-fba488393eea {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:28:15 user nova-compute[72586]: WARNING nova.compute.manager [req-8f9c3951-9bac-45dc-a6d0-7fafb9eca183 req-a3141c6f-0550-4397-ad17-3d58cacacc62 service nova] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] Received unexpected event network-vif-plugged-843d4e65-1f9e-44d6-a5b6-fba488393eea for instance with vm_state building and task_state spawning.
Aug 01 21:28:15 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:15 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:15 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:15 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:16 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Acquiring lock "09571c9f-bf42-475a-afac-0e3947168d7e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:28:16 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Lock "09571c9f-bf42-475a-afac-0e3947168d7e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:28:16 user nova-compute[72586]: DEBUG nova.compute.manager [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Starting instance... {{(pid=72586) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 21:28:16 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:28:16 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:28:16 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72586) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 21:28:16 user nova-compute[72586]: INFO nova.compute.claims [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Claim successful on node user
Aug 01 21:28:16 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925296.9414113, dadba691-ab8a-4e25-864f-3211ef71872f => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:28:16 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] VM Resumed (Lifecycle Event)
Aug 01 21:28:16 user nova-compute[72586]: DEBUG nova.compute.manager [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] Instance event wait completed in 0 seconds for  {{(pid=72586) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 21:28:16 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] Guest created on hypervisor {{(pid=72586) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 21:28:16 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] Instance spawned successfully.
Aug 01 21:28:16 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 21:28:16 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:28:16 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:28:16 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] Found default for hw_cdrom_bus of ide {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:28:16 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] Found default for hw_disk_bus of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:28:16 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] Found default for hw_input_bus of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:28:16 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] Found default for hw_pointer_model of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:28:16 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] Found default for hw_video_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:28:16 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] Found default for hw_vif_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:28:16 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:28:16 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925296.9461186, dadba691-ab8a-4e25-864f-3211ef71872f => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:28:16 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] VM Started (Lifecycle Event)
Aug 01 21:28:17 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:28:17 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:28:17 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:28:17 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:28:17 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.525s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:28:17 user nova-compute[72586]: DEBUG nova.compute.manager [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Start building networks asynchronously for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 21:28:17 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:28:17 user nova-compute[72586]: INFO nova.compute.manager [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] Took 6.38 seconds to spawn the instance on the hypervisor.
Aug 01 21:28:17 user nova-compute[72586]: DEBUG nova.compute.manager [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:28:17 user nova-compute[72586]: DEBUG nova.compute.manager [req-e9bfe55e-f583-4db0-a097-8b34f5810dfc req-82f0c997-c6f5-457a-b0a4-462a0a4ea6a4 service nova] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] Received event network-vif-plugged-843d4e65-1f9e-44d6-a5b6-fba488393eea {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:28:17 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-e9bfe55e-f583-4db0-a097-8b34f5810dfc req-82f0c997-c6f5-457a-b0a4-462a0a4ea6a4 service nova] Acquiring lock "dadba691-ab8a-4e25-864f-3211ef71872f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:28:17 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-e9bfe55e-f583-4db0-a097-8b34f5810dfc req-82f0c997-c6f5-457a-b0a4-462a0a4ea6a4 service nova] Lock "dadba691-ab8a-4e25-864f-3211ef71872f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:28:17 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-e9bfe55e-f583-4db0-a097-8b34f5810dfc req-82f0c997-c6f5-457a-b0a4-462a0a4ea6a4 service nova] Lock "dadba691-ab8a-4e25-864f-3211ef71872f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:28:17 user nova-compute[72586]: DEBUG nova.compute.manager [req-e9bfe55e-f583-4db0-a097-8b34f5810dfc req-82f0c997-c6f5-457a-b0a4-462a0a4ea6a4 service nova] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] No waiting events found dispatching network-vif-plugged-843d4e65-1f9e-44d6-a5b6-fba488393eea {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:28:17 user nova-compute[72586]: WARNING nova.compute.manager [req-e9bfe55e-f583-4db0-a097-8b34f5810dfc req-82f0c997-c6f5-457a-b0a4-462a0a4ea6a4 service nova] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] Received unexpected event network-vif-plugged-843d4e65-1f9e-44d6-a5b6-fba488393eea for instance with vm_state building and task_state spawning.
Aug 01 21:28:17 user nova-compute[72586]: DEBUG nova.compute.manager [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Allocating IP information in the background. {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 21:28:17 user nova-compute[72586]: DEBUG nova.network.neutron [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] allocate_for_instance() {{(pid=72586) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 21:28:17 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 21:28:17 user nova-compute[72586]: INFO nova.compute.manager [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] Took 7.33 seconds to build instance.
Aug 01 21:28:17 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-09b269c0-8edb-4a64-8743-38b6845fdccc tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Lock "dadba691-ab8a-4e25-864f-3211ef71872f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.500s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:28:17 user nova-compute[72586]: DEBUG nova.compute.manager [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Start building block device mappings for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 21:28:17 user nova-compute[72586]: DEBUG nova.policy [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'afdf04a7e03d41e8ad25485939b3e14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cedafac8150441a086c3197698ba58e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72586) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 21:28:17 user nova-compute[72586]: DEBUG nova.compute.manager [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Start spawning the instance on the hypervisor. {{(pid=72586) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 21:28:17 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Creating instance directory {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 21:28:17 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Creating image(s)
Aug 01 21:28:17 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Acquiring lock "/opt/stack/data/nova/instances/09571c9f-bf42-475a-afac-0e3947168d7e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:28:17 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Lock "/opt/stack/data/nova/instances/09571c9f-bf42-475a-afac-0e3947168d7e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:28:17 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Lock "/opt/stack/data/nova/instances/09571c9f-bf42-475a-afac-0e3947168d7e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:28:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.158s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:17 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Acquiring lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:28:17 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:28:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.147s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/09571c9f-bf42-475a-afac-0e3947168d7e/disk 1073741824 {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/09571c9f-bf42-475a-afac-0e3947168d7e/disk 1073741824" returned: 0 in 0.096s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:17 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:28:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.151s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:17 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Checking if we can resize image /opt/stack/data/nova/instances/09571c9f-bf42-475a-afac-0e3947168d7e/disk. size=1073741824 {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 21:28:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09571c9f-bf42-475a-afac-0e3947168d7e/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09571c9f-bf42-475a-afac-0e3947168d7e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:18 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Cannot resize image /opt/stack/data/nova/instances/09571c9f-bf42-475a-afac-0e3947168d7e/disk to a smaller size. {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 21:28:18 user nova-compute[72586]: DEBUG nova.objects.instance [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Lazy-loading 'migration_context' on Instance uuid 09571c9f-bf42-475a-afac-0e3947168d7e {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:28:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:18 user nova-compute[72586]: DEBUG nova.network.neutron [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Successfully created port: 72b0f9c6-102b-4a73-bdb2-9f4f4181e81e {{(pid=72586) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 21:28:18 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Created local disks {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 21:28:18 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Ensure instance console log exists: /opt/stack/data/nova/instances/09571c9f-bf42-475a-afac-0e3947168d7e/console.log {{(pid=72586) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 21:28:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:28:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:28:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:28:18 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bcd9d1c-bd1a-43ff-9086-1711cfe935c4 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Calling os-brick to attach iSCSI Volume {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 21:28:18 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bcd9d1c-bd1a-43ff-9086-1711cfe935c4 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vwWkRqrV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:28:18 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-2bcd9d1c-bd1a-43ff-9086-1711cfe935c4 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:28:18 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-2bcd9d1c-bd1a-43ff-9086-1711cfe935c4 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:28:18 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-2bcd9d1c-bd1a-43ff-9086-1711cfe935c4 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:28:18 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-2bcd9d1c-bd1a-43ff-9086-1711cfe935c4 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:28:18 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-2bcd9d1c-bd1a-43ff-9086-1711cfe935c4 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:28:18 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-2bcd9d1c-bd1a-43ff-9086-1711cfe935c4 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:28:18 user nova-compute[72586]: INFO os_brick.initiator.connectors.iscsi [None req-2bcd9d1c-bd1a-43ff-9086-1711cfe935c4 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 21:28:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 -p 172.16.0.220:3260 {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:18 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d20a2d2b-c486-4830-8aef-e085b58e04f5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:18 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bcd9d1c-bd1a-43ff-9086-1711cfe935c4 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 21:28:18 user nova-compute[72586]:  {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:28:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 -p 172.16.0.220:3260 --interface default --op new {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:18 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f623ab8-4be9-42bf-880b-6babfefb7409]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4] added\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:18 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bcd9d1c-bd1a-43ff-9086-1711cfe935c4 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4] added
Aug 01 21:28:18 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:28:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:18 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a037944-787a-4295-abee-b81f9492f3ff]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:18 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bcd9d1c-bd1a-43ff-9086-1711cfe935c4 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:28:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:18 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bee95c7-41ae-4719-964c-f69a8078e4d5]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:18 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bcd9d1c-bd1a-43ff-9086-1711cfe935c4 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:28:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vwWkRqrV {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vwWkRqrV" returned: 0 in 0.027s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:18 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[2186a48a-c0f2-4f8f-93b5-e3b2019f48d7]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:18 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bcd9d1c-bd1a-43ff-9086-1711cfe935c4 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vwWkRqrV'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:28:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:18 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ccc3599-7128-40c3-b2de-e281683ee64e]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:18 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bcd9d1c-bd1a-43ff-9086-1711cfe935c4 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:28:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:18 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1aa9831-4837-4bfc-9ec2-25ec6a8f25af]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:18 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bcd9d1c-bd1a-43ff-9086-1711cfe935c4 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)
Aug 01 21:28:18 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:28:18 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bcd9d1c-bd1a-43ff-9086-1711cfe935c4 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)
Aug 01 21:28:18 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:28:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 -p 172.16.0.220:3260 --login {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:18 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c711120-5a29-4c51-a108-6b75473a522c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:18 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bcd9d1c-bd1a-43ff-9086-1711cfe935c4 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4, portal: 172.16.0.220,3260]
Aug 01 21:28:18 user nova-compute[72586]: Login to [iface: default, target: iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4, portal: 172.16.0.220,3260] successful.
Aug 01 21:28:18 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:28:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:18 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5aaf84-c43e-44f3-b702-a09a2a034a12]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:18 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bcd9d1c-bd1a-43ff-9086-1711cfe935c4 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:28:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:18 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3e7273-ec95-4587-a063-921871f5aa3c]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:18 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bcd9d1c-bd1a-43ff-9086-1711cfe935c4 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)
Aug 01 21:28:18 user nova-compute[72586]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)
Aug 01 21:28:18 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:28:18 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bcd9d1c-bd1a-43ff-9086-1711cfe935c4 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)
Aug 01 21:28:18 user nova-compute[72586]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)
Aug 01 21:28:18 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:28:18 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-2bcd9d1c-bd1a-43ff-9086-1711cfe935c4 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:28:18 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bcd9d1c-bd1a-43ff-9086-1711cfe935c4 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Connected to 172.16.0.220:3260 {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 21:28:18 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-2bcd9d1c-bd1a-43ff-9086-1711cfe935c4 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] HCTL ('34', '-', '-', 0) found on session 21 with lun 0 {{(pid=72586) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 21:28:18 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-2bcd9d1c-bd1a-43ff-9086-1711cfe935c4 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72586) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 21:28:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:18 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3b920e-a3b6-4e2f-a6dd-a4fc5360ca02]: (4, ('- - 0', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:18 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-2bcd9d1c-bd1a-43ff-9086-1711cfe935c4 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: None {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:28:19 user nova-compute[72586]: DEBUG nova.network.neutron [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Successfully updated port: 72b0f9c6-102b-4a73-bdb2-9f4f4181e81e {{(pid=72586) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 21:28:19 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Acquiring lock "refresh_cache-09571c9f-bf42-475a-afac-0e3947168d7e" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:28:19 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Acquired lock "refresh_cache-09571c9f-bf42-475a-afac-0e3947168d7e" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:28:19 user nova-compute[72586]: DEBUG nova.network.neutron [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:28:19 user nova-compute[72586]: DEBUG nova.compute.manager [req-ce8fd01e-a9c5-4496-bed9-84ee9351b034 req-7f896ee3-0527-4599-bcbb-93d63c99ec4e service nova] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Received event network-changed-72b0f9c6-102b-4a73-bdb2-9f4f4181e81e {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:28:19 user nova-compute[72586]: DEBUG nova.compute.manager [req-ce8fd01e-a9c5-4496-bed9-84ee9351b034 req-7f896ee3-0527-4599-bcbb-93d63c99ec4e service nova] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Refreshing instance network info cache due to event network-changed-72b0f9c6-102b-4a73-bdb2-9f4f4181e81e. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:28:19 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ce8fd01e-a9c5-4496-bed9-84ee9351b034 req-7f896ee3-0527-4599-bcbb-93d63c99ec4e service nova] Acquiring lock "refresh_cache-09571c9f-bf42-475a-afac-0e3947168d7e" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:28:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:19 user nova-compute[72586]: DEBUG nova.network.neutron [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Instance cache missing network info. {{(pid=72586) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 21:28:19 user nova-compute[72586]: DEBUG nova.network.neutron [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Updating instance_info_cache with network_info: [{"id": "72b0f9c6-102b-4a73-bdb2-9f4f4181e81e", "address": "fa:16:3e:18:89:0a", "network": {"id": "3da39b49-6be1-40be-93db-5bd61034e9a7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1015949721-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cedafac8150441a086c3197698ba58e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72b0f9c6-10", "ovs_interfaceid": "72b0f9c6-102b-4a73-bdb2-9f4f4181e81e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:28:19 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Releasing lock "refresh_cache-09571c9f-bf42-475a-afac-0e3947168d7e" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:28:19 user nova-compute[72586]: DEBUG nova.compute.manager [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Instance network_info: |[{"id": "72b0f9c6-102b-4a73-bdb2-9f4f4181e81e", "address": "fa:16:3e:18:89:0a", "network": {"id": "3da39b49-6be1-40be-93db-5bd61034e9a7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1015949721-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cedafac8150441a086c3197698ba58e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72b0f9c6-10", "ovs_interfaceid": "72b0f9c6-102b-4a73-bdb2-9f4f4181e81e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 21:28:19 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ce8fd01e-a9c5-4496-bed9-84ee9351b034 req-7f896ee3-0527-4599-bcbb-93d63c99ec4e service nova] Acquired lock "refresh_cache-09571c9f-bf42-475a-afac-0e3947168d7e" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:28:19 user nova-compute[72586]: DEBUG nova.network.neutron [req-ce8fd01e-a9c5-4496-bed9-84ee9351b034 req-7f896ee3-0527-4599-bcbb-93d63c99ec4e service nova] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Refreshing network info cache for port 72b0f9c6-102b-4a73-bdb2-9f4f4181e81e {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:28:19 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Start _get_guest_xml network_info=[{"id": "72b0f9c6-102b-4a73-bdb2-9f4f4181e81e", "address": "fa:16:3e:18:89:0a", "network": {"id": "3da39b49-6be1-40be-93db-5bd61034e9a7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1015949721-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cedafac8150441a086c3197698ba58e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72b0f9c6-10", "ovs_interfaceid": "72b0f9c6-102b-4a73-bdb2-9f4f4181e81e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '0243d46b-6819-42a5-926f-42b71f0c97ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:28:19 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:28:19 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:28:19 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:28:19 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:28:19 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:28:19 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:28:19 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:28:19 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:28:19 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:28:19 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:28:19 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:28:19 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:28:19 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:28:19 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:28:19 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:28:19 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:28:19 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:28:19 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:28:19 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:28:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-138821445',display_name='tempest-TestServerVolumeAttachmentScenario-server-138821445',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-138821445',id=25,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJhPkgMLOdiRFcpMS72PXhkhMY8B5BqYZFAfIfUitXNymXOApyKhG/5NCed+3F0X8Tu+aI+DLUuBOONpfIIenvmYUcLylyZHzeH9Mdt/v/Mvp2iXdTIz5whSCB8pzqUc4A==',key_name='tempest-keypair-1727093272',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cedafac8150441a086c3197698ba58e5',ramdisk_id='',reservation_id='r-4bfoq4r5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-609353703',owner_user_name='tempest-TestServerVolumeAttachmentScenario-609353703-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:28:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='afdf04a7e03d41e8ad25485939b3e14a',uuid=09571c9f-bf42-475a-afac-0e3947168d7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72b0f9c6-102b-4a73-bdb2-9f4f4181e81e", "address": "fa:16:3e:18:89:0a", "network": {"id": "3da39b49-6be1-40be-93db-5bd61034e9a7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1015949721-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cedafac8150441a086c3197698ba58e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72b0f9c6-10", "ovs_interfaceid": "72b0f9c6-102b-4a73-bdb2-9f4f4181e81e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:28:19 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Converting VIF {"id": "72b0f9c6-102b-4a73-bdb2-9f4f4181e81e", "address": "fa:16:3e:18:89:0a", "network": {"id": "3da39b49-6be1-40be-93db-5bd61034e9a7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1015949721-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cedafac8150441a086c3197698ba58e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72b0f9c6-10", "ovs_interfaceid": "72b0f9c6-102b-4a73-bdb2-9f4f4181e81e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:28:19 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:89:0a,bridge_name='br-int',has_traffic_filtering=True,id=72b0f9c6-102b-4a73-bdb2-9f4f4181e81e,network=Network(3da39b49-6be1-40be-93db-5bd61034e9a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72b0f9c6-10') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:28:19 user nova-compute[72586]: DEBUG nova.objects.instance [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Lazy-loading 'pci_devices' on Instance uuid 09571c9f-bf42-475a-afac-0e3947168d7e {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:28:19 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:28:19 user nova-compute[72586]:   <uuid>09571c9f-bf42-475a-afac-0e3947168d7e</uuid>
Aug 01 21:28:19 user nova-compute[72586]:   <name>instance-00000019</name>
Aug 01 21:28:19 user nova-compute[72586]:   <memory>524288</memory>
Aug 01 21:28:19 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:28:19 user nova-compute[72586]:   <metadata>
Aug 01 21:28:19 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:28:19 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:28:19 user nova-compute[72586]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-138821445</nova:name>
Aug 01 21:28:19 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:28:19</nova:creationTime>
Aug 01 21:28:19 user nova-compute[72586]:       <nova:flavor name="m1.tiny">
Aug 01 21:28:19 user nova-compute[72586]:         <nova:memory>512</nova:memory>
Aug 01 21:28:19 user nova-compute[72586]:         <nova:disk>1</nova:disk>
Aug 01 21:28:19 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:28:19 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:28:19 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:28:19 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:28:19 user nova-compute[72586]:       <nova:owner>
Aug 01 21:28:19 user nova-compute[72586]:         <nova:user uuid="afdf04a7e03d41e8ad25485939b3e14a">tempest-TestServerVolumeAttachmentScenario-609353703-project-member</nova:user>
Aug 01 21:28:19 user nova-compute[72586]:         <nova:project uuid="cedafac8150441a086c3197698ba58e5">tempest-TestServerVolumeAttachmentScenario-609353703</nova:project>
Aug 01 21:28:19 user nova-compute[72586]:       </nova:owner>
Aug 01 21:28:19 user nova-compute[72586]:       <nova:root type="image" uuid="0243d46b-6819-42a5-926f-42b71f0c97ad"/>
Aug 01 21:28:19 user nova-compute[72586]:       <nova:ports>
Aug 01 21:28:19 user nova-compute[72586]:         <nova:port uuid="72b0f9c6-102b-4a73-bdb2-9f4f4181e81e">
Aug 01 21:28:19 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 01 21:28:19 user nova-compute[72586]:         </nova:port>
Aug 01 21:28:19 user nova-compute[72586]:       </nova:ports>
Aug 01 21:28:19 user nova-compute[72586]:     </nova:instance>
Aug 01 21:28:19 user nova-compute[72586]:   </metadata>
Aug 01 21:28:19 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:28:19 user nova-compute[72586]:     <system>
Aug 01 21:28:19 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:28:19 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:28:19 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:28:19 user nova-compute[72586]:       <entry name="serial">09571c9f-bf42-475a-afac-0e3947168d7e</entry>
Aug 01 21:28:19 user nova-compute[72586]:       <entry name="uuid">09571c9f-bf42-475a-afac-0e3947168d7e</entry>
Aug 01 21:28:19 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:28:19 user nova-compute[72586]:     </system>
Aug 01 21:28:19 user nova-compute[72586]:   </sysinfo>
Aug 01 21:28:19 user nova-compute[72586]:   <os>
Aug 01 21:28:19 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:28:19 user nova-compute[72586]:     <boot dev="hd"/>
Aug 01 21:28:19 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:28:19 user nova-compute[72586]:   </os>
Aug 01 21:28:19 user nova-compute[72586]:   <features>
Aug 01 21:28:19 user nova-compute[72586]:     <acpi/>
Aug 01 21:28:19 user nova-compute[72586]:     <apic/>
Aug 01 21:28:19 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:28:19 user nova-compute[72586]:   </features>
Aug 01 21:28:19 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:28:19 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:28:19 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:28:19 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:28:19 user nova-compute[72586]:   </clock>
Aug 01 21:28:19 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:28:19 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:28:19 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:28:19 user nova-compute[72586]:   </cpu>
Aug 01 21:28:19 user nova-compute[72586]:   <devices>
Aug 01 21:28:19 user nova-compute[72586]:     <disk type="file" device="disk">
Aug 01 21:28:19 user nova-compute[72586]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 21:28:19 user nova-compute[72586]:       <source file="/opt/stack/data/nova/instances/09571c9f-bf42-475a-afac-0e3947168d7e/disk"/>
Aug 01 21:28:19 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:28:19 user nova-compute[72586]:     </disk>
Aug 01 21:28:19 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:28:19 user nova-compute[72586]:       <mac address="fa:16:3e:18:89:0a"/>
Aug 01 21:28:19 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:28:19 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:28:19 user nova-compute[72586]:       <target dev="tap72b0f9c6-10"/>
Aug 01 21:28:19 user nova-compute[72586]:     </interface>
Aug 01 21:28:19 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:28:19 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/09571c9f-bf42-475a-afac-0e3947168d7e/console.log" append="off"/>
Aug 01 21:28:19 user nova-compute[72586]:     </serial>
Aug 01 21:28:19 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:28:19 user nova-compute[72586]:     <video>
Aug 01 21:28:19 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:28:19 user nova-compute[72586]:     </video>
Aug 01 21:28:19 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:28:19 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:28:19 user nova-compute[72586]:     </rng>
Aug 01 21:28:19 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:28:19 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:28:19 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:28:19 user nova-compute[72586]:     </memballoon>
Aug 01 21:28:19 user nova-compute[72586]:   </devices>
Aug 01 21:28:19 user nova-compute[72586]: </domain>
Aug 01 21:28:19 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:28:19 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:28:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-138821445',display_name='tempest-TestServerVolumeAttachmentScenario-server-138821445',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-138821445',id=25,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJhPkgMLOdiRFcpMS72PXhkhMY8B5BqYZFAfIfUitXNymXOApyKhG/5NCed+3F0X8Tu+aI+DLUuBOONpfIIenvmYUcLylyZHzeH9Mdt/v/Mvp2iXdTIz5whSCB8pzqUc4A==',key_name='tempest-keypair-1727093272',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cedafac8150441a086c3197698ba58e5',ramdisk_id='',reservation_id='r-4bfoq4r5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-609353703',owner_user_name='tempest-TestServerVolumeAttachmentScenario-609353703-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:28:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='afdf04a7e03d41e8ad25485939b3e14a',uuid=09571c9f-bf42-475a-afac-0e3947168d7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72b0f9c6-102b-4a73-bdb2-9f4f4181e81e", "address": "fa:16:3e:18:89:0a", "network": {"id": "3da39b49-6be1-40be-93db-5bd61034e9a7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1015949721-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cedafac8150441a086c3197698ba58e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72b0f9c6-10", "ovs_interfaceid": "72b0f9c6-102b-4a73-bdb2-9f4f4181e81e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:28:19 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Converting VIF {"id": "72b0f9c6-102b-4a73-bdb2-9f4f4181e81e", "address": "fa:16:3e:18:89:0a", "network": {"id": "3da39b49-6be1-40be-93db-5bd61034e9a7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1015949721-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cedafac8150441a086c3197698ba58e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72b0f9c6-10", "ovs_interfaceid": "72b0f9c6-102b-4a73-bdb2-9f4f4181e81e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:28:19 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:89:0a,bridge_name='br-int',has_traffic_filtering=True,id=72b0f9c6-102b-4a73-bdb2-9f4f4181e81e,network=Network(3da39b49-6be1-40be-93db-5bd61034e9a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72b0f9c6-10') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:28:19 user nova-compute[72586]: DEBUG os_vif [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:89:0a,bridge_name='br-int',has_traffic_filtering=True,id=72b0f9c6-102b-4a73-bdb2-9f4f4181e81e,network=Network(3da39b49-6be1-40be-93db-5bd61034e9a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72b0f9c6-10') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:28:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:28:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:28:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap72b0f9c6-10, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:28:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap72b0f9c6-10, col_values=(('external_ids', {'iface-id': '72b0f9c6-102b-4a73-bdb2-9f4f4181e81e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:89:0a', 'vm-uuid': '09571c9f-bf42-475a-afac-0e3947168d7e'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:28:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:28:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:19 user nova-compute[72586]: INFO os_vif [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:89:0a,bridge_name='br-int',has_traffic_filtering=True,id=72b0f9c6-102b-4a73-bdb2-9f4f4181e81e,network=Network(3da39b49-6be1-40be-93db-5bd61034e9a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72b0f9c6-10')
Aug 01 21:28:19 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:28:19 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] No VIF found with MAC fa:16:3e:18:89:0a, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:28:19 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-2bcd9d1c-bd1a-43ff-9086-1711cfe935c4 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:28:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bcd9d1c-bd1a-43ff-9086-1711cfe935c4 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vwWkRqrV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 21:28:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-2bcd9d1c-bd1a-43ff-9086-1711cfe935c4 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:28:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bcd9d1c-bd1a-43ff-9086-1711cfe935c4 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23865323263303565', 'path': '/dev/sdc'} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:28:19 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bcd9d1c-bd1a-43ff-9086-1711cfe935c4 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865323263303565', 'path': '/dev/sdc'} {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 21:28:19 user nova-compute[72586]: DEBUG nova.objects.instance [None req-2bcd9d1c-bd1a-43ff-9086-1711cfe935c4 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Lazy-loading 'flavor' on Instance uuid d51eb56c-bce2-4593-abc3-878c358c9a74 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:28:19 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-2bcd9d1c-bd1a-43ff-9086-1711cfe935c4 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 21:28:19 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:28:19 user nova-compute[72586]:   <source dev="/dev/sdc"/>
Aug 01 21:28:19 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:28:19 user nova-compute[72586]:   <serial>1aafe36a-8c91-4a47-9328-9ea0529e83d4</serial>
Aug 01 21:28:19 user nova-compute[72586]: </disk>
Aug 01 21:28:19 user nova-compute[72586]:  {{(pid=72586) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 21:28:20 user nova-compute[72586]: DEBUG nova.network.neutron [req-ce8fd01e-a9c5-4496-bed9-84ee9351b034 req-7f896ee3-0527-4599-bcbb-93d63c99ec4e service nova] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Updated VIF entry in instance network info cache for port 72b0f9c6-102b-4a73-bdb2-9f4f4181e81e. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:28:20 user nova-compute[72586]: DEBUG nova.network.neutron [req-ce8fd01e-a9c5-4496-bed9-84ee9351b034 req-7f896ee3-0527-4599-bcbb-93d63c99ec4e service nova] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Updating instance_info_cache with network_info: [{"id": "72b0f9c6-102b-4a73-bdb2-9f4f4181e81e", "address": "fa:16:3e:18:89:0a", "network": {"id": "3da39b49-6be1-40be-93db-5bd61034e9a7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1015949721-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cedafac8150441a086c3197698ba58e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72b0f9c6-10", "ovs_interfaceid": "72b0f9c6-102b-4a73-bdb2-9f4f4181e81e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:28:20 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ce8fd01e-a9c5-4496-bed9-84ee9351b034 req-7f896ee3-0527-4599-bcbb-93d63c99ec4e service nova] Releasing lock "refresh_cache-09571c9f-bf42-475a-afac-0e3947168d7e" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:28:20 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-2bcd9d1c-bd1a-43ff-9086-1711cfe935c4 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:28:20 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-2bcd9d1c-bd1a-43ff-9086-1711cfe935c4 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:28:20 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-2bcd9d1c-bd1a-43ff-9086-1711cfe935c4 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] No VIF found with MAC fa:16:3e:f2:07:05, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:28:20 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-2bcd9d1c-bd1a-43ff-9086-1711cfe935c4 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Lock "d51eb56c-bce2-4593-abc3-878c358c9a74" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.313s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:28:20 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:28:21 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:21 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:21 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:21 user nova-compute[72586]: DEBUG nova.compute.manager [req-a8463243-95d7-4310-857e-f3ab99e0f982 req-a60df2f8-4246-433f-be98-5918f18aaedf service nova] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Received event network-vif-plugged-72b0f9c6-102b-4a73-bdb2-9f4f4181e81e {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:28:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-a8463243-95d7-4310-857e-f3ab99e0f982 req-a60df2f8-4246-433f-be98-5918f18aaedf service nova] Acquiring lock "09571c9f-bf42-475a-afac-0e3947168d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:28:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-a8463243-95d7-4310-857e-f3ab99e0f982 req-a60df2f8-4246-433f-be98-5918f18aaedf service nova] Lock "09571c9f-bf42-475a-afac-0e3947168d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:28:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-a8463243-95d7-4310-857e-f3ab99e0f982 req-a60df2f8-4246-433f-be98-5918f18aaedf service nova] Lock "09571c9f-bf42-475a-afac-0e3947168d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:28:21 user nova-compute[72586]: DEBUG nova.compute.manager [req-a8463243-95d7-4310-857e-f3ab99e0f982 req-a60df2f8-4246-433f-be98-5918f18aaedf service nova] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] No waiting events found dispatching network-vif-plugged-72b0f9c6-102b-4a73-bdb2-9f4f4181e81e {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:28:21 user nova-compute[72586]: WARNING nova.compute.manager [req-a8463243-95d7-4310-857e-f3ab99e0f982 req-a60df2f8-4246-433f-be98-5918f18aaedf service nova] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Received unexpected event network-vif-plugged-72b0f9c6-102b-4a73-bdb2-9f4f4181e81e for instance with vm_state building and task_state spawning.
Aug 01 21:28:21 user nova-compute[72586]: INFO nova.compute.manager [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Rescuing
Aug 01 21:28:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Acquiring lock "refresh_cache-d51eb56c-bce2-4593-abc3-878c358c9a74" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:28:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Acquired lock "refresh_cache-d51eb56c-bce2-4593-abc3-878c358c9a74" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:28:21 user nova-compute[72586]: DEBUG nova.network.neutron [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:28:22 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:22 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:22 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:22 user nova-compute[72586]: DEBUG nova.compute.manager [req-7a0e2d9c-4b82-4960-ab29-4d42a51eb5a8 req-43e26423-33d2-43dd-ad6b-e704bfc1e6bd service nova] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Received event network-changed-c9c37169-5d08-49e3-9fdf-705b9bbe1d2f {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:28:22 user nova-compute[72586]: DEBUG nova.compute.manager [req-7a0e2d9c-4b82-4960-ab29-4d42a51eb5a8 req-43e26423-33d2-43dd-ad6b-e704bfc1e6bd service nova] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Refreshing instance network info cache due to event network-changed-c9c37169-5d08-49e3-9fdf-705b9bbe1d2f. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:28:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-7a0e2d9c-4b82-4960-ab29-4d42a51eb5a8 req-43e26423-33d2-43dd-ad6b-e704bfc1e6bd service nova] Acquiring lock "refresh_cache-f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:28:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-7a0e2d9c-4b82-4960-ab29-4d42a51eb5a8 req-43e26423-33d2-43dd-ad6b-e704bfc1e6bd service nova] Acquired lock "refresh_cache-f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:28:22 user nova-compute[72586]: DEBUG nova.network.neutron [req-7a0e2d9c-4b82-4960-ab29-4d42a51eb5a8 req-43e26423-33d2-43dd-ad6b-e704bfc1e6bd service nova] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Refreshing network info cache for port c9c37169-5d08-49e3-9fdf-705b9bbe1d2f {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:28:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-645b72c4-c436-4ba8-aae5-7be93cbad689 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Acquiring lock "c3798403-855b-45e4-af48-ba6b62570dba" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:28:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-645b72c4-c436-4ba8-aae5-7be93cbad689 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Lock "c3798403-855b-45e4-af48-ba6b62570dba" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:28:22 user nova-compute[72586]: DEBUG nova.objects.instance [None req-645b72c4-c436-4ba8-aae5-7be93cbad689 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Lazy-loading 'flavor' on Instance uuid c3798403-855b-45e4-af48-ba6b62570dba {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:28:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-645b72c4-c436-4ba8-aae5-7be93cbad689 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Lock "c3798403-855b-45e4-af48-ba6b62570dba" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:28:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-645b72c4-c436-4ba8-aae5-7be93cbad689 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Acquiring lock "c3798403-855b-45e4-af48-ba6b62570dba" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:28:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-645b72c4-c436-4ba8-aae5-7be93cbad689 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Lock "c3798403-855b-45e4-af48-ba6b62570dba" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:28:22 user nova-compute[72586]: INFO nova.compute.manager [None req-645b72c4-c436-4ba8-aae5-7be93cbad689 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Attaching volume 4927c194-c7b3-4b35-b484-30b4bc8744ea to /dev/vdb
Aug 01 21:28:22 user nova-compute[72586]: DEBUG os_brick.utils [None req-645b72c4-c436-4ba8-aae5-7be93cbad689 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:28:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:22 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ecde27-b9e2-4eec-bfa4-c2afb8990b89]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4bc202fb9cb\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:22 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[468d9f25-088f-443d-bce2-f58c50282b74]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:22 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:28:22 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:28:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:22 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[56eb286c-b1f1-4aca-9135-5a69d586dc55]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:28:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:28:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:28:22 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Auditing locally available compute resources for user (node: user) {{(pid=72586) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 21:28:22 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f92bd4-50ea-46ba-8b8d-4bf19762581b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-645b72c4-c436-4ba8-aae5-7be93cbad689 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Running cmd (subprocess): nvme version {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-645b72c4-c436-4ba8-aae5-7be93cbad689 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] 'nvme version' failed. Not Retrying. {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:28:22 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.nvmeof [None req-645b72c4-c436-4ba8-aae5-7be93cbad689 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] nvme not present on system {{(pid=72586) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 21:28:22 user nova-compute[72586]: DEBUG nova.network.neutron [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Updating instance_info_cache with network_info: [{"id": "0cdd112b-f316-4cf2-b3e5-82897e241453", "address": "fa:16:3e:f2:07:05", "network": {"id": "b40254e1-7668-4ef6-b133-681304d57290", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1667586785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f911c1cbc98a4d93b73090da5f655812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cdd112b-f3", "ovs_interfaceid": "0cdd112b-f316-4cf2-b3e5-82897e241453", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:28:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:28:22 user nova-compute[72586]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 21:28:22 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3f63d5-a1b2-4418-a96d-8dc03e37c821]: (4, '') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:22 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-645b72c4-c436-4ba8-aae5-7be93cbad689 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72586) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 21:28:22 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-645b72c4-c436-4ba8-aae5-7be93cbad689 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 21:28:22 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-645b72c4-c436-4ba8-aae5-7be93cbad689 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] LIGHTOS: no hostnqn found. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 21:28:22 user nova-compute[72586]: DEBUG os_brick.utils [None req-645b72c4-c436-4ba8-aae5-7be93cbad689 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4bc202fb9cb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:28:22 user nova-compute[72586]: DEBUG nova.virt.block_device [None req-645b72c4-c436-4ba8-aae5-7be93cbad689 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Updating existing volume attachment record: 5c7e7b89-3f04-451c-9935-166ab3a4d585 {{(pid=72586) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 21:28:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Releasing lock "refresh_cache-d51eb56c-bce2-4593-abc3-878c358c9a74" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:28:23 user nova-compute[72586]: DEBUG nova.network.neutron [req-7a0e2d9c-4b82-4960-ab29-4d42a51eb5a8 req-43e26423-33d2-43dd-ad6b-e704bfc1e6bd service nova] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Updated VIF entry in instance network info cache for port c9c37169-5d08-49e3-9fdf-705b9bbe1d2f. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:28:23 user nova-compute[72586]: DEBUG nova.network.neutron [req-7a0e2d9c-4b82-4960-ab29-4d42a51eb5a8 req-43e26423-33d2-43dd-ad6b-e704bfc1e6bd service nova] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Updating instance_info_cache with network_info: [{"id": "c9c37169-5d08-49e3-9fdf-705b9bbe1d2f", "address": "fa:16:3e:ac:44:36", "network": {"id": "9ac81b44-4ebf-4780-8146-bebeb56a36b8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1925422576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6493ab8139843b191e013e61f12c877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9c37169-5d", "ovs_interfaceid": "c9c37169-5d08-49e3-9fdf-705b9bbe1d2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:28:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-7a0e2d9c-4b82-4960-ab29-4d42a51eb5a8 req-43e26423-33d2-43dd-ad6b-e704bfc1e6bd service nova] Releasing lock "refresh_cache-f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:28:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:23 user nova-compute[72586]: DEBUG nova.compute.manager [req-7de4f9e7-9119-4dc0-b71d-40cf366acb85 req-deb49fe2-b928-45b5-8ee7-736f800ad290 service nova] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Received event network-vif-plugged-72b0f9c6-102b-4a73-bdb2-9f4f4181e81e {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:28:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-7de4f9e7-9119-4dc0-b71d-40cf366acb85 req-deb49fe2-b928-45b5-8ee7-736f800ad290 service nova] Acquiring lock "09571c9f-bf42-475a-afac-0e3947168d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:28:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-7de4f9e7-9119-4dc0-b71d-40cf366acb85 req-deb49fe2-b928-45b5-8ee7-736f800ad290 service nova] Lock "09571c9f-bf42-475a-afac-0e3947168d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:28:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-7de4f9e7-9119-4dc0-b71d-40cf366acb85 req-deb49fe2-b928-45b5-8ee7-736f800ad290 service nova] Lock "09571c9f-bf42-475a-afac-0e3947168d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:28:23 user nova-compute[72586]: DEBUG nova.compute.manager [req-7de4f9e7-9119-4dc0-b71d-40cf366acb85 req-deb49fe2-b928-45b5-8ee7-736f800ad290 service nova] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] No waiting events found dispatching network-vif-plugged-72b0f9c6-102b-4a73-bdb2-9f4f4181e81e {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:28:23 user nova-compute[72586]: WARNING nova.compute.manager [req-7de4f9e7-9119-4dc0-b71d-40cf366acb85 req-deb49fe2-b928-45b5-8ee7-736f800ad290 service nova] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Received unexpected event network-vif-plugged-72b0f9c6-102b-4a73-bdb2-9f4f4181e81e for instance with vm_state building and task_state spawning.
Aug 01 21:28:23 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Instance destroyed successfully.
Aug 01 21:28:23 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Attempting a stable device rescue
Aug 01 21:28:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=72586) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 01 21:28:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Instance directory exists: not creating {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 01 21:28:23 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Creating image(s)
Aug 01 21:28:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Acquiring lock "/opt/stack/data/nova/instances/d51eb56c-bce2-4593-abc3-878c358c9a74/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:28:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Lock "/opt/stack/data/nova/instances/d51eb56c-bce2-4593-abc3-878c358c9a74/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:28:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Lock "/opt/stack/data/nova/instances/d51eb56c-bce2-4593-abc3-878c358c9a74/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:28:23 user nova-compute[72586]: DEBUG nova.objects.instance [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Lazy-loading 'trusted_certs' on Instance uuid d51eb56c-bce2-4593-abc3-878c358c9a74 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:28:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Acquiring lock "035f4a080c60286e064e7502ecc933d55f1d246e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:28:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Lock "035f4a080c60286e064e7502ecc933d55f1d246e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:28:24 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925304.0126, 09571c9f-bf42-475a-afac-0e3947168d7e => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:28:24 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] VM Resumed (Lifecycle Event)
Aug 01 21:28:24 user nova-compute[72586]: DEBUG nova.compute.manager [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Instance event wait completed in 0 seconds for  {{(pid=72586) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 21:28:24 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Guest created on hypervisor {{(pid=72586) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 21:28:24 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Instance spawned successfully.
Aug 01 21:28:24 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 21:28:24 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:28:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:24 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:28:24 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Found default for hw_cdrom_bus of ide {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:28:24 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Found default for hw_disk_bus of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:28:24 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Found default for hw_input_bus of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:28:24 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Found default for hw_pointer_model of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:28:24 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Found default for hw_video_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:28:24 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Found default for hw_vif_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:28:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/035f4a080c60286e064e7502ecc933d55f1d246e.part --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:25 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:28:25 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925304.0135481, 09571c9f-bf42-475a-afac-0e3947168d7e => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:28:25 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] VM Started (Lifecycle Event)
Aug 01 21:28:25 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:25 user nova-compute[72586]: INFO nova.compute.manager [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Took 7.76 seconds to spawn the instance on the hypervisor.
Aug 01 21:28:25 user nova-compute[72586]: DEBUG nova.compute.manager [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:28:25 user nova-compute[72586]: DEBUG nova.compute.manager [req-c918509e-546b-427c-8b27-4896b17111db req-790c4c78-031b-4413-a742-f6335ae48869 service nova] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Received event network-vif-unplugged-0cdd112b-f316-4cf2-b3e5-82897e241453 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:28:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-c918509e-546b-427c-8b27-4896b17111db req-790c4c78-031b-4413-a742-f6335ae48869 service nova] Acquiring lock "d51eb56c-bce2-4593-abc3-878c358c9a74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:28:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-c918509e-546b-427c-8b27-4896b17111db req-790c4c78-031b-4413-a742-f6335ae48869 service nova] Lock "d51eb56c-bce2-4593-abc3-878c358c9a74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:28:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-c918509e-546b-427c-8b27-4896b17111db req-790c4c78-031b-4413-a742-f6335ae48869 service nova] Lock "d51eb56c-bce2-4593-abc3-878c358c9a74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:28:25 user nova-compute[72586]: DEBUG nova.compute.manager [req-c918509e-546b-427c-8b27-4896b17111db req-790c4c78-031b-4413-a742-f6335ae48869 service nova] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] No waiting events found dispatching network-vif-unplugged-0cdd112b-f316-4cf2-b3e5-82897e241453 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:28:25 user nova-compute[72586]: WARNING nova.compute.manager [req-c918509e-546b-427c-8b27-4896b17111db req-790c4c78-031b-4413-a742-f6335ae48869 service nova] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Received unexpected event network-vif-unplugged-0cdd112b-f316-4cf2-b3e5-82897e241453 for instance with vm_state active and task_state rescuing.
Aug 01 21:28:25 user nova-compute[72586]: DEBUG nova.compute.manager [req-c918509e-546b-427c-8b27-4896b17111db req-790c4c78-031b-4413-a742-f6335ae48869 service nova] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Received event network-vif-plugged-0cdd112b-f316-4cf2-b3e5-82897e241453 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:28:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-c918509e-546b-427c-8b27-4896b17111db req-790c4c78-031b-4413-a742-f6335ae48869 service nova] Acquiring lock "d51eb56c-bce2-4593-abc3-878c358c9a74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:28:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-c918509e-546b-427c-8b27-4896b17111db req-790c4c78-031b-4413-a742-f6335ae48869 service nova] Lock "d51eb56c-bce2-4593-abc3-878c358c9a74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:28:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-c918509e-546b-427c-8b27-4896b17111db req-790c4c78-031b-4413-a742-f6335ae48869 service nova] Lock "d51eb56c-bce2-4593-abc3-878c358c9a74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:28:25 user nova-compute[72586]: DEBUG nova.compute.manager [req-c918509e-546b-427c-8b27-4896b17111db req-790c4c78-031b-4413-a742-f6335ae48869 service nova] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] No waiting events found dispatching network-vif-plugged-0cdd112b-f316-4cf2-b3e5-82897e241453 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:28:25 user nova-compute[72586]: WARNING nova.compute.manager [req-c918509e-546b-427c-8b27-4896b17111db req-790c4c78-031b-4413-a742-f6335ae48869 service nova] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Received unexpected event network-vif-plugged-0cdd112b-f316-4cf2-b3e5-82897e241453 for instance with vm_state active and task_state rescuing.
Aug 01 21:28:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk --force-share --output=json" returned: 0 in 1.098s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:25 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:28:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:25 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:28:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/035f4a080c60286e064e7502ecc933d55f1d246e.part --force-share --output=json" returned: 0 in 0.164s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:25 user nova-compute[72586]: DEBUG nova.virt.images [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] 1735b6b4-a64c-46c5-adaf-5e7657ec5ef4 was qcow2, converting to raw {{(pid=72586) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 21:28:25 user nova-compute[72586]: DEBUG nova.privsep.utils [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72586) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 21:28:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/035f4a080c60286e064e7502ecc933d55f1d246e.part /opt/stack/data/nova/instances/_base/035f4a080c60286e064e7502ecc933d55f1d246e.converted {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:25 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:28:25 user nova-compute[72586]: INFO nova.compute.manager [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Took 8.77 seconds to build instance.
Aug 01 21:28:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-07d89dc6-5881-4048-bcf3-d7b78bb67fc6 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Lock "09571c9f-bf42-475a-afac-0e3947168d7e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.925s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:28:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/035f4a080c60286e064e7502ecc933d55f1d246e.part /opt/stack/data/nova/instances/_base/035f4a080c60286e064e7502ecc933d55f1d246e.converted" returned: 0 in 0.318s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/035f4a080c60286e064e7502ecc933d55f1d246e.converted --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c352ce2-5d08-424a-928f-2fd1cf58e491/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/035f4a080c60286e064e7502ecc933d55f1d246e.converted --force-share --output=json" returned: 0 in 0.150s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Lock "035f4a080c60286e064e7502ecc933d55f1d246e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.726s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:28:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Acquiring lock "035f4a080c60286e064e7502ecc933d55f1d246e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:28:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Lock "035f4a080c60286e064e7502ecc933d55f1d246e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:28:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/035f4a080c60286e064e7502ecc933d55f1d246e --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c352ce2-5d08-424a-928f-2fd1cf58e491/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c352ce2-5d08-424a-928f-2fd1cf58e491/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/035f4a080c60286e064e7502ecc933d55f1d246e --force-share --output=json" returned: 0 in 0.150s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/035f4a080c60286e064e7502ecc933d55f1d246e,backing_fmt=raw /opt/stack/data/nova/instances/d51eb56c-bce2-4593-abc3-878c358c9a74/disk.rescue {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/035f4a080c60286e064e7502ecc933d55f1d246e,backing_fmt=raw /opt/stack/data/nova/instances/d51eb56c-bce2-4593-abc3-878c358c9a74/disk.rescue" returned: 0 in 0.080s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Lock "035f4a080c60286e064e7502ecc933d55f1d246e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:28:25 user nova-compute[72586]: DEBUG nova.objects.instance [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Lazy-loading 'migration_context' on Instance uuid d51eb56c-bce2-4593-abc3-878c358c9a74 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:28:25 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Created local disks {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Start _get_guest_xml network_info=[{"id": "0cdd112b-f316-4cf2-b3e5-82897e241453", "address": "fa:16:3e:f2:07:05", "network": {"id": "b40254e1-7668-4ef6-b133-681304d57290", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1667586785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1667586785-network", "vif_mac": "fa:16:3e:f2:07:05"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f911c1cbc98a4d93b73090da5f655812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cdd112b-f3", "ovs_interfaceid": "0cdd112b-f316-4cf2-b3e5-82897e241453", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '1735b6b4-a64c-46c5-adaf-5e7657ec5ef4', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '0243d46b-6819-42a5-926f-42b71f0c97ad'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vwWkRqrV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'd51eb56c-bce2-4593-abc3-878c358c9a74', 'attached_at': '', 'detached_at': '', 'volume_id': '1aafe36a-8c91-4a47-9328-9ea0529e83d4', 'serial': '1aafe36a-8c91-4a47-9328-9ea0529e83d4'}, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '12b001f1-eb0d-4cbe-bd87-28e87868f305', 'delete_on_termination': False, 'volume_type': None} {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG nova.objects.instance [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Lazy-loading 'resources' on Instance uuid d51eb56c-bce2-4593-abc3-878c358c9a74 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c352ce2-5d08-424a-928f-2fd1cf58e491/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG nova.objects.instance [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Lazy-loading 'numa_topology' on Instance uuid d51eb56c-bce2-4593-abc3-878c358c9a74 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadba691-ab8a-4e25-864f-3211ef71872f/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:26 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:28:26 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:28:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG nova.objects.instance [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Lazy-loading 'vcpu_model' on Instance uuid d51eb56c-bce2-4593-abc3-878c358c9a74 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Calling os-brick to attach iSCSI Volume {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vwWkRqrV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:28:26 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:28:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:28:26 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:28:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:28:26 user nova-compute[72586]: INFO os_brick.initiator.connectors.iscsi [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 21:28:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 -p 172.16.0.220:3260 {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2b8a96-91fc-4d25-a639-29ce1f96785e]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = vwWkRqrV\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 01 21:28:26 user nova-compute[72586]: node.name = iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4
Aug 01 21:28:26 user nova-compute[72586]: node.tpgt = -1
Aug 01 21:28:26 user nova-compute[72586]: node.startup = automatic
Aug 01 21:28:26 user nova-compute[72586]: node.leading_login = No
Aug 01 21:28:26 user nova-compute[72586]: iface.iscsi_ifacename = default
Aug 01 21:28:26 user nova-compute[72586]: iface.net_ifacename = <empty>
Aug 01 21:28:26 user nova-compute[72586]: iface.ipaddress = <empty>
Aug 01 21:28:26 user nova-compute[72586]: iface.prefix_len = 0
Aug 01 21:28:26 user nova-compute[72586]: iface.hwaddress = <empty>
Aug 01 21:28:26 user nova-compute[72586]: iface.transport_name = tcp
Aug 01 21:28:26 user nova-compute[72586]: iface.initiatorname = <empty>
Aug 01 21:28:26 user nova-compute[72586]: iface.state = <empty>
Aug 01 21:28:26 user nova-compute[72586]: iface.vlan_id = 0
Aug 01 21:28:26 user nova-compute[72586]: iface.vlan_priority = 0
Aug 01 21:28:26 user nova-compute[72586]: iface.vlan_state = <empty>
Aug 01 21:28:26 user nova-compute[72586]: iface.iface_num = 0
Aug 01 21:28:26 user nova-compute[72586]: iface.mtu = 0
Aug 01 21:28:26 user nova-compute[72586]: iface.port = 0
Aug 01 21:28:26 user nova-compute[72586]: iface.bootproto = <empty>
Aug 01 21:28:26 user nova-compute[72586]: iface.subnet_mask = <empty>
Aug 01 21:28:26 user nova-compute[72586]: iface.gateway = <empty>
Aug 01 21:28:26 user nova-compute[72586]: iface.dhcp_alt_client_id_state = <empty>
Aug 01 21:28:26 user nova-compute[72586]: iface.dhcp_alt_client_id = <empty>
Aug 01 21:28:26 user nova-compute[72586]: iface.dhcp_dns = <empty>
Aug 01 21:28:26 user nova-compute[72586]: iface.dhcp_learn_iqn = <empty>
Aug 01 21:28:26 user nova-compute[72586]: iface.dhcp_req_vendor_id_state = <empty>
Aug 01 21:28:26 user nova-compute[72586]: iface.dhcp_vendor_id_state = <empty>
Aug 01 21:28:26 user nova-compute[72586]: iface.dhcp_vendor_id = <empty>
Aug 01 21:28:26 user nova-compute[72586]: iface.dhcp_slp_da = <empty>
Aug 01 21:28:26 user nova-compute[72586]: iface.fragmentation = <empty>
Aug 01 21:28:26 user nova-compute[72586]: iface.gratuitous_arp = <empty>
Aug 01 21:28:26 user nova-compute[72586]: iface.incoming_forwarding = <empty>
Aug 01 21:28:26 user nova-compute[72586]: iface.tos_state = <empty>
Aug 01 21:28:26 user nova-compute[72586]: iface.tos = 0
Aug 01 21:28:26 user nova-compute[72586]: iface.ttl = 0
Aug 01 21:28:26 user nova-compute[72586]: iface.delayed_ack = <empty>
Aug 01 21:28:26 user nova-compute[72586]: iface.tcp_nagle = <empty>
Aug 01 21:28:26 user nova-compute[72586]: iface.tcp_wsf_state = <empty>
Aug 01 21:28:26 user nova-compute[72586]: iface.tcp_wsf = 0
Aug 01 21:28:26 user nova-compute[72586]: iface.tcp_timer_scale = 0
Aug 01 21:28:26 user nova-compute[72586]: iface.tcp_timestamp = <empty>
Aug 01 21:28:26 user nova-compute[72586]: iface.redirect = <empty>
Aug 01 21:28:26 user nova-compute[72586]: iface.def_task_mgmt_timeout = 0
Aug 01 21:28:26 user nova-compute[72586]: iface.header_digest = <empty>
Aug 01 21:28:26 user nova-compute[72586]: iface.data_digest = <empty>
Aug 01 21:28:26 user nova-compute[72586]: iface.immediate_data = <empty>
Aug 01 21:28:26 user nova-compute[72586]: iface.initial_r2t = <empty>
Aug 01 21:28:26 user nova-compute[72586]: iface.data_seq_inorder = <empty>
Aug 01 21:28:26 user nova-compute[72586]: iface.data_pdu_inorder = <empty>
Aug 01 21:28:26 user nova-compute[72586]: iface.erl = 0
Aug 01 21:28:26 user nova-compute[72586]: iface.max_receive_data_len = 0
Aug 01 21:28:26 user nova-compute[72586]: iface.first_burst_len = 0
Aug 01 21:28:26 user nova-compute[72586]: iface.max_outstanding_r2t = 0
Aug 01 21:28:26 user nova-compute[72586]: iface.max_burst_len = 0
Aug 01 21:28:26 user nova-compute[72586]: iface.chap_auth = <empty>
Aug 01 21:28:26 user nova-compute[72586]: iface.bidi_chap = <empty>
Aug 01 21:28:26 user nova-compute[72586]: iface.strict_login_compliance = <empty>
Aug 01 21:28:26 user nova-compute[72586]: iface.discovery_auth = <empty>
Aug 01 21:28:26 user nova-compute[72586]: iface.discovery_logout = <empty>
Aug 01 21:28:26 user nova-compute[72586]: node.discovery_address = <empty>
Aug 01 21:28:26 user nova-compute[72586]: node.discovery_port = 0
Aug 01 21:28:26 user nova-compute[72586]: node.discovery_type = static
Aug 01 21:28:26 user nova-compute[72586]: node.session.initial_cmdsn = 0
Aug 01 21:28:26 user nova-compute[72586]: node.session.initial_login_retry_max = 8
Aug 01 21:28:26 user nova-compute[72586]: node.session.xmit_thread_priority = -20
Aug 01 21:28:26 user nova-compute[72586]: node.session.cmds_max = 128
Aug 01 21:28:26 user nova-compute[72586]: node.session.queue_depth = 32
Aug 01 21:28:26 user nova-compute[72586]: node.session.nr_sessions = 1
Aug 01 21:28:26 user nova-compute[72586]: node.session.auth.authmethod = CHAP
Aug 01 21:28:26 user nova-compute[72586]: node.session.auth.username = vwWkRqrV
Aug 01 21:28:26 user nova-compute[72586]: node.session.auth.password = ***
Aug 01 21:28:26 user nova-compute[72586]: node.session.auth.username_in = <empty>
Aug 01 21:28:26 user nova-compute[72586]: node.session.auth.password_in = <empty>
Aug 01 21:28:26 user nova-compute[72586]: node.session.auth.chap_algs = MD5
Aug 01 21:28:26 user nova-compute[72586]: node.session.timeo.replacement_timeout = 120
Aug 01 21:28:26 user nova-compute[72586]: node.session.err_timeo.abort_timeout = 15
Aug 01 21:28:26 user nova-compute[72586]: node.session.err_timeo.lu_reset_timeout = 30
Aug 01 21:28:26 user nova-compute[72586]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 01 21:28:26 user nova-compute[72586]: node.session.err_timeo.host_reset_timeout = 60
Aug 01 21:28:26 user nova-compute[72586]: node.session.iscsi.FastAbort = Yes
Aug 01 21:28:26 user nova-compute[72586]: node.session.iscsi.InitialR2T = No
Aug 01 21:28:26 user nova-compute[72586]: node.session.iscsi.ImmediateData = Yes
Aug 01 21:28:26 user nova-compute[72586]: node.session.iscsi.FirstBurstLength = 262144
Aug 01 21:28:26 user nova-compute[72586]: node.session.iscsi.MaxBurstLength = 16776192
Aug 01 21:28:26 user nova-compute[72586]: node.session.iscsi.DefaultTime2Retain = 0
Aug 01 21:28:26 user nova-compute[72586]: node.session.iscsi.DefaultTime2Wait = 2
Aug 01 21:28:26 user nova-compute[72586]: node.session.iscsi.MaxConnections = 1
Aug 01 21:28:26 user nova-compute[72586]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 01 21:28:26 user nova-compute[72586]: node.session.iscsi.ERL = 0
Aug 01 21:28:26 user nova-compute[72586]: node.session.scan = manual
Aug 01 21:28:26 user nova-compute[72586]: node.session.reopen_max = 0
Aug 01 21:28:26 user nova-compute[72586]: node.conn[0].address = 172.16.0.220
Aug 01 21:28:26 user nova-compute[72586]: node.conn[0].port = 3260
Aug 01 21:28:26 user nova-compute[72586]: node.conn[0].startup = manual
Aug 01 21:28:26 user nova-compute[72586]: node.conn[0].tcp.window_size = 524288
Aug 01 21:28:26 user nova-compute[72586]: node.conn[0].tcp.type_of_service = 0
Aug 01 21:28:26 user nova-compute[72586]: node.conn[0].timeo.logout_timeout = 15
Aug 01 21:28:26 user nova-compute[72586]: node.conn[0].timeo.login_timeout = 15
Aug 01 21:28:26 user nova-compute[72586]: node.conn[0].timeo.auth_timeout = 45
Aug 01 21:28:26 user nova-compute[72586]: node.conn[0].timeo.noop_out_interval = 5
Aug 01 21:28:26 user nova-compute[72586]: node.conn[0].timeo.noop_out_timeout = 5
Aug 01 21:28:26 user nova-compute[72586]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 01 21:28:26 user nova-compute[72586]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 01 21:28:26 user nova-compute[72586]: node.conn[0].iscsi.HeaderDigest = None
Aug 01 21:28:26 user nova-compute[72586]: node.conn[0].iscsi.DataDigest = None
Aug 01 21:28:26 user nova-compute[72586]: node.conn[0].iscsi.IFMarker = No
Aug 01 21:28:26 user nova-compute[72586]: node.conn[0].iscsi.OFMarker = No
Aug 01 21:28:26 user nova-compute[72586]: # END RECORD
Aug 01 21:28:26 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadba691-ab8a-4e25-864f-3211ef71872f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadba691-ab8a-4e25-864f-3211ef71872f/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[c900e0b5-c0a6-4a6e-8fc0-5db116d806f1]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7f83f4-95d0-4c7d-bcf0-06b8fa20cace]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vwWkRqrV {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vwWkRqrV" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf772bbe-ef2a-403b-8036-9b421c09c756]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vwWkRqrV'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[328b3f90-ee21-4824-bb32-79b45d5b563d]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ea0fba-c7e7-4714-9055-0dbf5ee8ac6a]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)
Aug 01 21:28:26 user nova-compute[72586]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)
Aug 01 21:28:26 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)
Aug 01 21:28:26 user nova-compute[72586]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)
Aug 01 21:28:26 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.157s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Connected to 172.16.0.220:3260 {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] HCTL ('34', '0', '0', 0) found on session 21 with lun 0 {{(pid=72586) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=72586) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadba691-ab8a-4e25-864f-3211ef71872f/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.014s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66589e2-dda6-48ae-ad42-a4d8efd8dde8]: (4, ('0 0 0', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Searching for a device in session 21 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vwWkRqrV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.183s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] <== connect_volume: return (184ms) {'type': 'block', 'scsi_wwn': '23865323263303565', 'path': '/dev/sdc'} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865323263303565', 'path': '/dev/sdc'} {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:24:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2052800267',display_name='tempest-ServerStableDeviceRescueTest-server-2052800267',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2052800267',id=16,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOAvh66e+pEUdqXK4j6Bev4qsj5Kw07j5qNS+OqbzC0rxd8JE0DAFrfEkFQTMqQTO8zjMSitipbfpifLdeH7ftdHAX9wDP0Yye10y43OrSHeNISMfjmF8SQTQ58PdQpW2A==',key_name='tempest-keypair-2114790470',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:24:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f911c1cbc98a4d93b73090da5f655812',ramdisk_id='',reservation_id='r-ls9h6vet',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1118462212',owner_user_name='tempest-ServerStableDeviceRescueTest-1118462212-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:26:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d22bbcdb21c5414b805fadba9cd1ce70',uuid=d51eb56c-bce2-4593-abc3-878c358c9a74,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0cdd112b-f316-4cf2-b3e5-82897e241453", "address": "fa:16:3e:f2:07:05", "network": {"id": "b40254e1-7668-4ef6-b133-681304d57290", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1667586785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1667586785-network", "vif_mac": "fa:16:3e:f2:07:05"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f911c1cbc98a4d93b73090da5f655812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cdd112b-f3", "ovs_interfaceid": "0cdd112b-f316-4cf2-b3e5-82897e241453", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Converting VIF {"id": "0cdd112b-f316-4cf2-b3e5-82897e241453", "address": "fa:16:3e:f2:07:05", "network": {"id": "b40254e1-7668-4ef6-b133-681304d57290", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1667586785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1667586785-network", "vif_mac": "fa:16:3e:f2:07:05"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f911c1cbc98a4d93b73090da5f655812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cdd112b-f3", "ovs_interfaceid": "0cdd112b-f316-4cf2-b3e5-82897e241453", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f2:07:05,bridge_name='br-int',has_traffic_filtering=True,id=0cdd112b-f316-4cf2-b3e5-82897e241453,network=Network(b40254e1-7668-4ef6-b133-681304d57290),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cdd112b-f3') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG nova.objects.instance [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Lazy-loading 'pci_devices' on Instance uuid d51eb56c-bce2-4593-abc3-878c358c9a74 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:28:26 user nova-compute[72586]:   <uuid>d51eb56c-bce2-4593-abc3-878c358c9a74</uuid>
Aug 01 21:28:26 user nova-compute[72586]:   <name>instance-00000010</name>
Aug 01 21:28:26 user nova-compute[72586]:   <memory>524288</memory>
Aug 01 21:28:26 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:28:26 user nova-compute[72586]:   <metadata>
Aug 01 21:28:26 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:28:26 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:28:26 user nova-compute[72586]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-2052800267</nova:name>
Aug 01 21:28:26 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:28:26</nova:creationTime>
Aug 01 21:28:26 user nova-compute[72586]:       <nova:flavor name="m1.tiny">
Aug 01 21:28:26 user nova-compute[72586]:         <nova:memory>512</nova:memory>
Aug 01 21:28:26 user nova-compute[72586]:         <nova:disk>1</nova:disk>
Aug 01 21:28:26 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:28:26 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:28:26 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:28:26 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:28:26 user nova-compute[72586]:       <nova:owner>
Aug 01 21:28:26 user nova-compute[72586]:         <nova:user uuid="d22bbcdb21c5414b805fadba9cd1ce70">tempest-ServerStableDeviceRescueTest-1118462212-project-member</nova:user>
Aug 01 21:28:26 user nova-compute[72586]:         <nova:project uuid="f911c1cbc98a4d93b73090da5f655812">tempest-ServerStableDeviceRescueTest-1118462212</nova:project>
Aug 01 21:28:26 user nova-compute[72586]:       </nova:owner>
Aug 01 21:28:26 user nova-compute[72586]:       <nova:root type="image" uuid="0243d46b-6819-42a5-926f-42b71f0c97ad"/>
Aug 01 21:28:26 user nova-compute[72586]:       <nova:ports>
Aug 01 21:28:26 user nova-compute[72586]:         <nova:port uuid="0cdd112b-f316-4cf2-b3e5-82897e241453">
Aug 01 21:28:26 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 01 21:28:26 user nova-compute[72586]:         </nova:port>
Aug 01 21:28:26 user nova-compute[72586]:       </nova:ports>
Aug 01 21:28:26 user nova-compute[72586]:     </nova:instance>
Aug 01 21:28:26 user nova-compute[72586]:   </metadata>
Aug 01 21:28:26 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:28:26 user nova-compute[72586]:     <system>
Aug 01 21:28:26 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:28:26 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:28:26 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:28:26 user nova-compute[72586]:       <entry name="serial">d51eb56c-bce2-4593-abc3-878c358c9a74</entry>
Aug 01 21:28:26 user nova-compute[72586]:       <entry name="uuid">d51eb56c-bce2-4593-abc3-878c358c9a74</entry>
Aug 01 21:28:26 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:28:26 user nova-compute[72586]:     </system>
Aug 01 21:28:26 user nova-compute[72586]:   </sysinfo>
Aug 01 21:28:26 user nova-compute[72586]:   <os>
Aug 01 21:28:26 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:28:26 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:28:26 user nova-compute[72586]:   </os>
Aug 01 21:28:26 user nova-compute[72586]:   <features>
Aug 01 21:28:26 user nova-compute[72586]:     <acpi/>
Aug 01 21:28:26 user nova-compute[72586]:     <apic/>
Aug 01 21:28:26 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:28:26 user nova-compute[72586]:   </features>
Aug 01 21:28:26 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:28:26 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:28:26 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:28:26 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:28:26 user nova-compute[72586]:   </clock>
Aug 01 21:28:26 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:28:26 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:28:26 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:28:26 user nova-compute[72586]:   </cpu>
Aug 01 21:28:26 user nova-compute[72586]:   <devices>
Aug 01 21:28:26 user nova-compute[72586]:     <disk type="file" device="disk">
Aug 01 21:28:26 user nova-compute[72586]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 21:28:26 user nova-compute[72586]:       <source file="/opt/stack/data/nova/instances/d51eb56c-bce2-4593-abc3-878c358c9a74/disk"/>
Aug 01 21:28:26 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:28:26 user nova-compute[72586]:     </disk>
Aug 01 21:28:26 user nova-compute[72586]:     <disk type="block" device="disk">
Aug 01 21:28:26 user nova-compute[72586]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:28:26 user nova-compute[72586]:       <source dev="/dev/sdc"/>
Aug 01 21:28:26 user nova-compute[72586]:       <target dev="vdb" bus="virtio"/>
Aug 01 21:28:26 user nova-compute[72586]:       <serial>1aafe36a-8c91-4a47-9328-9ea0529e83d4</serial>
Aug 01 21:28:26 user nova-compute[72586]:     </disk>
Aug 01 21:28:26 user nova-compute[72586]:     <disk type="file" device="disk">
Aug 01 21:28:26 user nova-compute[72586]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 21:28:26 user nova-compute[72586]:       <source file="/opt/stack/data/nova/instances/d51eb56c-bce2-4593-abc3-878c358c9a74/disk.rescue"/>
Aug 01 21:28:26 user nova-compute[72586]:       <target dev="vdc" bus="virtio"/>
Aug 01 21:28:26 user nova-compute[72586]:       <boot order="1"/>
Aug 01 21:28:26 user nova-compute[72586]:     </disk>
Aug 01 21:28:26 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:28:26 user nova-compute[72586]:       <mac address="fa:16:3e:f2:07:05"/>
Aug 01 21:28:26 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:28:26 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:28:26 user nova-compute[72586]:       <target dev="tap0cdd112b-f3"/>
Aug 01 21:28:26 user nova-compute[72586]:     </interface>
Aug 01 21:28:26 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:28:26 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/d51eb56c-bce2-4593-abc3-878c358c9a74/console.log" append="off"/>
Aug 01 21:28:26 user nova-compute[72586]:     </serial>
Aug 01 21:28:26 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:28:26 user nova-compute[72586]:     <video>
Aug 01 21:28:26 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:28:26 user nova-compute[72586]:     </video>
Aug 01 21:28:26 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:28:26 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:28:26 user nova-compute[72586]:     </rng>
Aug 01 21:28:26 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:28:26 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:28:26 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:28:26 user nova-compute[72586]:     </memballoon>
Aug 01 21:28:26 user nova-compute[72586]:   </devices>
Aug 01 21:28:26 user nova-compute[72586]: </domain>
Aug 01 21:28:26 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:28:26 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Instance destroyed successfully.
Aug 01 21:28:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] No VIF found with MAC fa:16:3e:f2:07:05, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-da0dbcdd-918d-46aa-b503-9d5ee2ef052b tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Acquiring lock "f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:28:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-da0dbcdd-918d-46aa-b503-9d5ee2ef052b tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lock "f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:28:27 user nova-compute[72586]: DEBUG nova.objects.instance [None req-da0dbcdd-918d-46aa-b503-9d5ee2ef052b tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lazy-loading 'flavor' on Instance uuid f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:28:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-da0dbcdd-918d-46aa-b503-9d5ee2ef052b tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lock "f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:28:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-da0dbcdd-918d-46aa-b503-9d5ee2ef052b tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Acquiring lock "f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:28:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-da0dbcdd-918d-46aa-b503-9d5ee2ef052b tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lock "f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:28:27 user nova-compute[72586]: INFO nova.compute.manager [None req-da0dbcdd-918d-46aa-b503-9d5ee2ef052b tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Attaching volume 0a30bc64-6acf-4711-b1c2-f3f6e9835274 to /dev/vdb
Aug 01 21:28:27 user nova-compute[72586]: DEBUG os_brick.utils [None req-da0dbcdd-918d-46aa-b503-9d5ee2ef052b tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:28:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:27 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[a694abea-2fd0-48d2-aad9-b68ac891a730]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4bc202fb9cb\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:27 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c35b84c-069a-4e07-97d0-05187b76303d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:27 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa20c7e3-4936-488d-8f64-ff2cc30aefff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:27 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e4eea7-4dab-428b-9ab0-d48a37c87061]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-da0dbcdd-918d-46aa-b503-9d5ee2ef052b tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Running cmd (subprocess): nvme version {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-da0dbcdd-918d-46aa-b503-9d5ee2ef052b tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] 'nvme version' failed. Not Retrying. {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:28:27 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.nvmeof [None req-da0dbcdd-918d-46aa-b503-9d5ee2ef052b tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] nvme not present on system {{(pid=72586) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 21:28:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:28:28 user nova-compute[72586]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 21:28:28 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0345fc9-7424-4372-9d94-162d39c6eb45]: (4, '') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:28 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:28 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-da0dbcdd-918d-46aa-b503-9d5ee2ef052b tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72586) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 21:28:28 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-da0dbcdd-918d-46aa-b503-9d5ee2ef052b tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 21:28:28 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-da0dbcdd-918d-46aa-b503-9d5ee2ef052b tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] LIGHTOS: no hostnqn found. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 21:28:28 user nova-compute[72586]: DEBUG os_brick.utils [None req-da0dbcdd-918d-46aa-b503-9d5ee2ef052b tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] <== get_connector_properties: return (195ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4bc202fb9cb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:28:28 user nova-compute[72586]: DEBUG nova.virt.block_device [None req-da0dbcdd-918d-46aa-b503-9d5ee2ef052b tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Updating existing volume attachment record: 7162e706-3621-472c-8ee1-735aeadd1296 {{(pid=72586) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 21:28:28 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51eb56c-bce2-4593-abc3-878c358c9a74/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:28 user nova-compute[72586]: DEBUG nova.compute.manager [req-5d9911ae-5445-4b90-a23c-b626b10c6b01 req-cd77cefc-dbf4-49b0-82e6-070495d1343a service nova] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Received event network-vif-plugged-0cdd112b-f316-4cf2-b3e5-82897e241453 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:28:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-5d9911ae-5445-4b90-a23c-b626b10c6b01 req-cd77cefc-dbf4-49b0-82e6-070495d1343a service nova] Acquiring lock "d51eb56c-bce2-4593-abc3-878c358c9a74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:28:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-5d9911ae-5445-4b90-a23c-b626b10c6b01 req-cd77cefc-dbf4-49b0-82e6-070495d1343a service nova] Lock "d51eb56c-bce2-4593-abc3-878c358c9a74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:28:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-5d9911ae-5445-4b90-a23c-b626b10c6b01 req-cd77cefc-dbf4-49b0-82e6-070495d1343a service nova] Lock "d51eb56c-bce2-4593-abc3-878c358c9a74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:28:28 user nova-compute[72586]: DEBUG nova.compute.manager [req-5d9911ae-5445-4b90-a23c-b626b10c6b01 req-cd77cefc-dbf4-49b0-82e6-070495d1343a service nova] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] No waiting events found dispatching network-vif-plugged-0cdd112b-f316-4cf2-b3e5-82897e241453 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:28:28 user nova-compute[72586]: WARNING nova.compute.manager [req-5d9911ae-5445-4b90-a23c-b626b10c6b01 req-cd77cefc-dbf4-49b0-82e6-070495d1343a service nova] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Received unexpected event network-vif-plugged-0cdd112b-f316-4cf2-b3e5-82897e241453 for instance with vm_state active and task_state rescuing.
Aug 01 21:28:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51eb56c-bce2-4593-abc3-878c358c9a74/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51eb56c-bce2-4593-abc3-878c358c9a74/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:28 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:28 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51eb56c-bce2-4593-abc3-878c358c9a74/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:28 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:28:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51eb56c-bce2-4593-abc3-878c358c9a74/disk.rescue --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51eb56c-bce2-4593-abc3-878c358c9a74/disk.rescue --force-share --output=json" returned: 0 in 0.158s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51eb56c-bce2-4593-abc3-878c358c9a74/disk.rescue --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:29 user nova-compute[72586]: DEBUG nova.compute.manager [req-97caf550-3aec-41a4-bc54-8a6c8fa8cbcf req-b923149a-01fb-440c-808e-55ca6fbb8f3d service nova] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Received event network-changed-8a59a718-b5fe-41d2-b057-971717d0dee6 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:28:29 user nova-compute[72586]: DEBUG nova.compute.manager [req-97caf550-3aec-41a4-bc54-8a6c8fa8cbcf req-b923149a-01fb-440c-808e-55ca6fbb8f3d service nova] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Refreshing instance network info cache due to event network-changed-8a59a718-b5fe-41d2-b057-971717d0dee6. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:28:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-97caf550-3aec-41a4-bc54-8a6c8fa8cbcf req-b923149a-01fb-440c-808e-55ca6fbb8f3d service nova] Acquiring lock "refresh_cache-8c352ce2-5d08-424a-928f-2fd1cf58e491" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:28:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-97caf550-3aec-41a4-bc54-8a6c8fa8cbcf req-b923149a-01fb-440c-808e-55ca6fbb8f3d service nova] Acquired lock "refresh_cache-8c352ce2-5d08-424a-928f-2fd1cf58e491" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:28:29 user nova-compute[72586]: DEBUG nova.network.neutron [req-97caf550-3aec-41a4-bc54-8a6c8fa8cbcf req-b923149a-01fb-440c-808e-55ca6fbb8f3d service nova] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Refreshing network info cache for port 8a59a718-b5fe-41d2-b057-971717d0dee6 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:28:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51eb56c-bce2-4593-abc3-878c358c9a74/disk.rescue --force-share --output=json" returned: 0 in 0.160s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b0d907-2515-4a06-8b35-9ddd09ce42c3/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b0d907-2515-4a06-8b35-9ddd09ce42c3/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b0d907-2515-4a06-8b35-9ddd09ce42c3/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0ee303db-ce45-498f-b24f-5ae619674f3a tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Acquiring lock "8c352ce2-5d08-424a-928f-2fd1cf58e491" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:28:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0ee303db-ce45-498f-b24f-5ae619674f3a tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lock "8c352ce2-5d08-424a-928f-2fd1cf58e491" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:28:29 user nova-compute[72586]: DEBUG nova.objects.instance [None req-0ee303db-ce45-498f-b24f-5ae619674f3a tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lazy-loading 'flavor' on Instance uuid 8c352ce2-5d08-424a-928f-2fd1cf58e491 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:28:29 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-0ee303db-ce45-498f-b24f-5ae619674f3a tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Ignoring supplied device name: /dev/vdb
Aug 01 21:28:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0ee303db-ce45-498f-b24f-5ae619674f3a tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lock "8c352ce2-5d08-424a-928f-2fd1cf58e491" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.092s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:28:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b0d907-2515-4a06-8b35-9ddd09ce42c3/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0ee303db-ce45-498f-b24f-5ae619674f3a tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Acquiring lock "8c352ce2-5d08-424a-928f-2fd1cf58e491" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:28:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0ee303db-ce45-498f-b24f-5ae619674f3a tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lock "8c352ce2-5d08-424a-928f-2fd1cf58e491" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:28:29 user nova-compute[72586]: INFO nova.compute.manager [None req-0ee303db-ce45-498f-b24f-5ae619674f3a tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Attaching volume b72b465b-3243-4afe-ae10-f908bc65e059 to /dev/vdb
Aug 01 21:28:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:29 user nova-compute[72586]: DEBUG os_brick.utils [None req-0ee303db-ce45-498f-b24f-5ae619674f3a tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:28:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:29 user nova-compute[72586]: DEBUG nova.network.neutron [req-97caf550-3aec-41a4-bc54-8a6c8fa8cbcf req-b923149a-01fb-440c-808e-55ca6fbb8f3d service nova] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Updated VIF entry in instance network info cache for port 8a59a718-b5fe-41d2-b057-971717d0dee6. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:28:29 user nova-compute[72586]: DEBUG nova.network.neutron [req-97caf550-3aec-41a4-bc54-8a6c8fa8cbcf req-b923149a-01fb-440c-808e-55ca6fbb8f3d service nova] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Updating instance_info_cache with network_info: [{"id": "8a59a718-b5fe-41d2-b057-971717d0dee6", "address": "fa:16:3e:52:0d:35", "network": {"id": "8e60d949-6c06-4e40-b792-d6f516b967d7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-603740209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfd51ad6ca4045699c8d72f9382f1c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a59a718-b5", "ovs_interfaceid": "8a59a718-b5fe-41d2-b057-971717d0dee6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:28:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:29 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1877cf-6caf-45a1-8fb1-a7b93d767091]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4bc202fb9cb\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:29 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[43476171-7f5a-4885-85bb-6ce68be8d668]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-97caf550-3aec-41a4-bc54-8a6c8fa8cbcf req-b923149a-01fb-440c-808e-55ca6fbb8f3d service nova] Releasing lock "refresh_cache-8c352ce2-5d08-424a-928f-2fd1cf58e491" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:28:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:30 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[906eaecd-eeea-45a5-a136-41e7d4be55e3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:30 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee72a63-a66f-4901-8100-9862bf4e1234]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-0ee303db-ce45-498f-b24f-5ae619674f3a tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Running cmd (subprocess): nvme version {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-0ee303db-ce45-498f-b24f-5ae619674f3a tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] 'nvme version' failed. Not Retrying. {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:28:30 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0ee303db-ce45-498f-b24f-5ae619674f3a tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] nvme not present on system {{(pid=72586) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 21:28:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:30 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:28:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9b8f9c5-0129-429d-beb6-26d4c9cc085d/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:28:30 user nova-compute[72586]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 21:28:30 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[da151a2e-aaef-4178-825e-202f41b7ec7c]: (4, '') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:30 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:30 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-0ee303db-ce45-498f-b24f-5ae619674f3a tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72586) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 21:28:30 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-0ee303db-ce45-498f-b24f-5ae619674f3a tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 21:28:30 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-0ee303db-ce45-498f-b24f-5ae619674f3a tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] LIGHTOS: no hostnqn found. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 21:28:30 user nova-compute[72586]: DEBUG os_brick.utils [None req-0ee303db-ce45-498f-b24f-5ae619674f3a tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] <== get_connector_properties: return (219ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4bc202fb9cb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:28:30 user nova-compute[72586]: DEBUG nova.virt.block_device [None req-0ee303db-ce45-498f-b24f-5ae619674f3a tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Updating existing volume attachment record: 9c8b1ce8-c7e2-4dd0-a3a2-b1c41b127ca3 {{(pid=72586) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 21:28:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9b8f9c5-0129-429d-beb6-26d4c9cc085d/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9b8f9c5-0129-429d-beb6-26d4c9cc085d/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9b8f9c5-0129-429d-beb6-26d4c9cc085d/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.rescue --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:30 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Removed pending event for d51eb56c-bce2-4593-abc3-878c358c9a74 due to event {{(pid=72586) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 21:28:30 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925310.6185098, d51eb56c-bce2-4593-abc3-878c358c9a74 => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:28:30 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] VM Resumed (Lifecycle Event)
Aug 01 21:28:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.rescue --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:30 user nova-compute[72586]: DEBUG nova.compute.manager [None req-232906b7-8696-42a2-8554-506953597f06 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:28:30 user nova-compute[72586]: DEBUG nova.compute.manager [req-66df2f03-11b7-41ea-81df-502022fe9e0d req-9629199d-83cd-4276-b445-c2e714cb4259 service nova] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Received event network-vif-plugged-0cdd112b-f316-4cf2-b3e5-82897e241453 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:28:30 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-66df2f03-11b7-41ea-81df-502022fe9e0d req-9629199d-83cd-4276-b445-c2e714cb4259 service nova] Acquiring lock "d51eb56c-bce2-4593-abc3-878c358c9a74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:28:30 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-66df2f03-11b7-41ea-81df-502022fe9e0d req-9629199d-83cd-4276-b445-c2e714cb4259 service nova] Lock "d51eb56c-bce2-4593-abc3-878c358c9a74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:28:30 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-66df2f03-11b7-41ea-81df-502022fe9e0d req-9629199d-83cd-4276-b445-c2e714cb4259 service nova] Lock "d51eb56c-bce2-4593-abc3-878c358c9a74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:28:30 user nova-compute[72586]: DEBUG nova.compute.manager [req-66df2f03-11b7-41ea-81df-502022fe9e0d req-9629199d-83cd-4276-b445-c2e714cb4259 service nova] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] No waiting events found dispatching network-vif-plugged-0cdd112b-f316-4cf2-b3e5-82897e241453 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:28:30 user nova-compute[72586]: WARNING nova.compute.manager [req-66df2f03-11b7-41ea-81df-502022fe9e0d req-9629199d-83cd-4276-b445-c2e714cb4259 service nova] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Received unexpected event network-vif-plugged-0cdd112b-f316-4cf2-b3e5-82897e241453 for instance with vm_state active and task_state rescuing.
Aug 01 21:28:30 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:28:30 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:28:30 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 01 21:28:30 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925310.640137, d51eb56c-bce2-4593-abc3-878c358c9a74 => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:28:30 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] VM Started (Lifecycle Event)
Aug 01 21:28:30 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:28:30 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:28:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09571c9f-bf42-475a-afac-0e3947168d7e/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09571c9f-bf42-475a-afac-0e3947168d7e/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09571c9f-bf42-475a-afac-0e3947168d7e/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09571c9f-bf42-475a-afac-0e3947168d7e/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-645b72c4-c436-4ba8-aae5-7be93cbad689 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Calling os-brick to attach iSCSI Volume {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-645b72c4-c436-4ba8-aae5-7be93cbad689 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tYAvmCpL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:28:32 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-645b72c4-c436-4ba8-aae5-7be93cbad689 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:28:32 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-645b72c4-c436-4ba8-aae5-7be93cbad689 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-645b72c4-c436-4ba8-aae5-7be93cbad689 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:28:32 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-645b72c4-c436-4ba8-aae5-7be93cbad689 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:28:32 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-645b72c4-c436-4ba8-aae5-7be93cbad689 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-645b72c4-c436-4ba8-aae5-7be93cbad689 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:28:32 user nova-compute[72586]: INFO os_brick.initiator.connectors.iscsi [None req-645b72c4-c436-4ba8-aae5-7be93cbad689 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 21:28:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea -p 172.16.0.220:3260 {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:32 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:28:32 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:28:32 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Hypervisor/Node resource view: name=user free_ram=7127MB free_disk=25.442108154296875GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72586) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[340e9f57-8bb9-4e04-9fdf-eaf18e56bf1e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-645b72c4-c436-4ba8-aae5-7be93cbad689 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 21:28:32 user nova-compute[72586]:  {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea -p 172.16.0.220:3260 --interface default --op new {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0f9856-1fc7-4ef7-9e77-2bce6bfadae3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea] added\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-645b72c4-c436-4ba8-aae5-7be93cbad689 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea] added
Aug 01 21:28:32 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dbda70e-a79a-44ae-9c65-9cf92003a0ae]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-645b72c4-c436-4ba8-aae5-7be93cbad689 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b715d0-a5e0-44b4-8c5a-3071441406a6]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-645b72c4-c436-4ba8-aae5-7be93cbad689 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tYAvmCpL {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tYAvmCpL" returned: 0 in 0.029s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cfabea0-e4b5-4c1e-85da-9cf67cc29a87]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-645b72c4-c436-4ba8-aae5-7be93cbad689 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tYAvmCpL'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[83012817-bec6-4471-9b11-b98b5888f079]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-645b72c4-c436-4ba8-aae5-7be93cbad689 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 042f0031-1e4d-41d0-8bfa-36001675cfe3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 413c3426-18ad-4a5c-af04-e0e7fc90f050 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 49c24c77-f102-4aed-8314-b04aad5f6b3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance d51eb56c-bce2-4593-abc3-878c358c9a74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance c3798403-855b-45e4-af48-ba6b62570dba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 8c352ce2-5d08-424a-928f-2fd1cf58e491 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance f9b8f9c5-0129-429d-beb6-26d4c9cc085d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance af2de810-b22f-4fa9-835c-c673abd145db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance f6b0d907-2515-4a06-8b35-9ddd09ce42c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance dadba691-ab8a-4e25-864f-3211ef71872f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 09571c9f-bf42-475a-afac-0e3947168d7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[43211424-b1ed-47ad-8b73-8a8a12bd7821]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-645b72c4-c436-4ba8-aae5-7be93cbad689 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)
Aug 01 21:28:32 user nova-compute[72586]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)
Aug 01 21:28:32 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-645b72c4-c436-4ba8-aae5-7be93cbad689 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)
Aug 01 21:28:32 user nova-compute[72586]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)
Aug 01 21:28:32 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea -p 172.16.0.220:3260 --login {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce74469-b9d5-44a4-9543-ba4e85533b97]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-645b72c4-c436-4ba8-aae5-7be93cbad689 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea, portal: 172.16.0.220,3260]
Aug 01 21:28:32 user nova-compute[72586]: Login to [iface: default, target: iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea, portal: 172.16.0.220,3260] successful.
Aug 01 21:28:32 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[c268e4ad-a5f4-455c-8865-e03438462b61]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-645b72c4-c436-4ba8-aae5-7be93cbad689 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17c1ad3-4fd0-44cd-bf69-29a2e6dab222]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-645b72c4-c436-4ba8-aae5-7be93cbad689 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)
Aug 01 21:28:32 user nova-compute[72586]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)
Aug 01 21:28:32 user nova-compute[72586]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:28:32 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-645b72c4-c436-4ba8-aae5-7be93cbad689 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)
Aug 01 21:28:32 user nova-compute[72586]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)
Aug 01 21:28:32 user nova-compute[72586]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:28:32 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-645b72c4-c436-4ba8-aae5-7be93cbad689 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-645b72c4-c436-4ba8-aae5-7be93cbad689 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Connected to 172.16.0.220:3260 {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-645b72c4-c436-4ba8-aae5-7be93cbad689 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] HCTL ('35', '-', '-', 0) found on session 22 with lun 0 {{(pid=72586) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-645b72c4-c436-4ba8-aae5-7be93cbad689 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72586) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f829883-b013-45bf-be7a-d4b626e3e5fe]: (4, ('- - 0', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-645b72c4-c436-4ba8-aae5-7be93cbad689 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Searching for a device in session 22 and hctl ['35', '*', '*', 0] yield: None {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:28:32 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:28:33 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:28:33 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Compute_service record updated for user:user {{(pid=72586) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 21:28:33 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.797s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:28:33 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-645b72c4-c436-4ba8-aae5-7be93cbad689 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Searching for a device in session 22 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:28:33 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-645b72c4-c436-4ba8-aae5-7be93cbad689 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tYAvmCpL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 21:28:33 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-645b72c4-c436-4ba8-aae5-7be93cbad689 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.376s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:28:33 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-645b72c4-c436-4ba8-aae5-7be93cbad689 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '23765333266316265', 'path': '/dev/sdd'} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:28:33 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-645b72c4-c436-4ba8-aae5-7be93cbad689 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765333266316265', 'path': '/dev/sdd'} {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 21:28:33 user nova-compute[72586]: DEBUG nova.objects.instance [None req-645b72c4-c436-4ba8-aae5-7be93cbad689 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Lazy-loading 'flavor' on Instance uuid c3798403-855b-45e4-af48-ba6b62570dba {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:28:33 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-645b72c4-c436-4ba8-aae5-7be93cbad689 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 21:28:33 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:28:33 user nova-compute[72586]:   <source dev="/dev/sdd"/>
Aug 01 21:28:33 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:28:33 user nova-compute[72586]:   <serial>4927c194-c7b3-4b35-b484-30b4bc8744ea</serial>
Aug 01 21:28:33 user nova-compute[72586]: </disk>
Aug 01 21:28:33 user nova-compute[72586]:  {{(pid=72586) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 21:28:34 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-645b72c4-c436-4ba8-aae5-7be93cbad689 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:28:34 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-645b72c4-c436-4ba8-aae5-7be93cbad689 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:28:34 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-645b72c4-c436-4ba8-aae5-7be93cbad689 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] No VIF found with MAC fa:16:3e:a4:40:ed, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:28:34 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:34 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-645b72c4-c436-4ba8-aae5-7be93cbad689 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Lock "c3798403-855b-45e4-af48-ba6b62570dba" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.560s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:28:35 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:28:35 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:28:35 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Starting heal instance info cache {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 21:28:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "refresh_cache-413c3426-18ad-4a5c-af04-e0e7fc90f050" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:28:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquired lock "refresh_cache-413c3426-18ad-4a5c-af04-e0e7fc90f050" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:28:35 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Forcefully refreshing network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 21:28:35 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:35 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Updating instance_info_cache with network_info: [{"id": "38381409-a508-45f7-ad5c-53e84d2d5adb", "address": "fa:16:3e:73:a7:41", "network": {"id": "d229a8de-7a2b-4dcd-a9ac-44a40349676e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-67691992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b1a1d82f39347119a9fb49fb8e8893f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38381409-a5", "ovs_interfaceid": "38381409-a508-45f7-ad5c-53e84d2d5adb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:28:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Releasing lock "refresh_cache-413c3426-18ad-4a5c-af04-e0e7fc90f050" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:28:35 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Updated the network info_cache for instance {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 21:28:35 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:28:35 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:28:35 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:28:35 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:28:35 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72586) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 21:28:36 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da0dbcdd-918d-46aa-b503-9d5ee2ef052b tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Calling os-brick to attach iSCSI Volume {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 21:28:36 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-da0dbcdd-918d-46aa-b503-9d5ee2ef052b tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0a30bc64-6acf-4711-b1c2-f3f6e9835274'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qQlPVaOS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:28:36 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-da0dbcdd-918d-46aa-b503-9d5ee2ef052b tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:28:36 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-da0dbcdd-918d-46aa-b503-9d5ee2ef052b tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:28:36 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-da0dbcdd-918d-46aa-b503-9d5ee2ef052b tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:28:36 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-da0dbcdd-918d-46aa-b503-9d5ee2ef052b tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:28:36 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-da0dbcdd-918d-46aa-b503-9d5ee2ef052b tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a30bc64-6acf-4711-b1c2-f3f6e9835274" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:28:36 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-da0dbcdd-918d-46aa-b503-9d5ee2ef052b tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a30bc64-6acf-4711-b1c2-f3f6e9835274" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:28:36 user nova-compute[72586]: INFO os_brick.initiator.connectors.iscsi [None req-da0dbcdd-918d-46aa-b503-9d5ee2ef052b tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 21:28:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a30bc64-6acf-4711-b1c2-f3f6e9835274 -p 172.16.0.220:3260 {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a30bc64-6acf-4711-b1c2-f3f6e9835274 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:36 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1446e7f5-212e-455a-b36c-662c1fafec50]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:36 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-da0dbcdd-918d-46aa-b503-9d5ee2ef052b tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 21:28:36 user nova-compute[72586]:  {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:28:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a30bc64-6acf-4711-b1c2-f3f6e9835274 -p 172.16.0.220:3260 --interface default --op new {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a30bc64-6acf-4711-b1c2-f3f6e9835274 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:36 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[127cd1ac-3ffe-4941-85b1-671db2a4bd3d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a30bc64-6acf-4711-b1c2-f3f6e9835274] added\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:36 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-da0dbcdd-918d-46aa-b503-9d5ee2ef052b tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a30bc64-6acf-4711-b1c2-f3f6e9835274] added
Aug 01 21:28:36 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:28:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a30bc64-6acf-4711-b1c2-f3f6e9835274 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a30bc64-6acf-4711-b1c2-f3f6e9835274 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:36 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08a1df6-b76c-47d3-906c-583740111f57]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:36 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-da0dbcdd-918d-46aa-b503-9d5ee2ef052b tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:28:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a30bc64-6acf-4711-b1c2-f3f6e9835274 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a30bc64-6acf-4711-b1c2-f3f6e9835274 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:36 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1493a9-21eb-4ea2-8d83-3fdf5dde3c86]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:36 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-da0dbcdd-918d-46aa-b503-9d5ee2ef052b tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:28:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a30bc64-6acf-4711-b1c2-f3f6e9835274 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qQlPVaOS {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a30bc64-6acf-4711-b1c2-f3f6e9835274 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qQlPVaOS" returned: 0 in 0.024s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:36 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52c5bf8-56e5-4a00-a875-783d91f68822]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:36 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-da0dbcdd-918d-46aa-b503-9d5ee2ef052b tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qQlPVaOS'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:28:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a30bc64-6acf-4711-b1c2-f3f6e9835274 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:36 user nova-compute[72586]: DEBUG nova.compute.manager [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Stashing vm_state: active {{(pid=72586) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 01 21:28:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a30bc64-6acf-4711-b1c2-f3f6e9835274 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:37 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3373aad-a378-4b4d-87de-320c24d8d1c3]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:37 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-da0dbcdd-918d-46aa-b503-9d5ee2ef052b tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:28:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:37 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61cf57b-ae88-470f-92cd-94177f14be15]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:37 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-da0dbcdd-918d-46aa-b503-9d5ee2ef052b tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)
Aug 01 21:28:37 user nova-compute[72586]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)
Aug 01 21:28:37 user nova-compute[72586]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:28:37 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:28:37 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-da0dbcdd-918d-46aa-b503-9d5ee2ef052b tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)
Aug 01 21:28:37 user nova-compute[72586]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)
Aug 01 21:28:37 user nova-compute[72586]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:28:37 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:28:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a30bc64-6acf-4711-b1c2-f3f6e9835274 -p 172.16.0.220:3260 --login {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a30bc64-6acf-4711-b1c2-f3f6e9835274 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:37 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc8d340-f787-4959-8e8f-6079532029e8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a30bc64-6acf-4711-b1c2-f3f6e9835274, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0a30bc64-6acf-4711-b1c2-f3f6e9835274, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:37 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-da0dbcdd-918d-46aa-b503-9d5ee2ef052b tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a30bc64-6acf-4711-b1c2-f3f6e9835274, portal: 172.16.0.220,3260]
Aug 01 21:28:37 user nova-compute[72586]: Login to [iface: default, target: iqn.2010-10.org.openstack:0a30bc64-6acf-4711-b1c2-f3f6e9835274, portal: 172.16.0.220,3260] successful.
Aug 01 21:28:37 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:28:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a30bc64-6acf-4711-b1c2-f3f6e9835274 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a30bc64-6acf-4711-b1c2-f3f6e9835274 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:37 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8e40cc-aac7-4c7d-a230-9579c8df9f70]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:37 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-da0dbcdd-918d-46aa-b503-9d5ee2ef052b tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:28:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:37 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[df788e95-8383-4f12-a2e2-fbf4c4794b9d]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a30bc64-6acf-4711-b1c2-f3f6e9835274 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:37 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-da0dbcdd-918d-46aa-b503-9d5ee2ef052b tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)
Aug 01 21:28:37 user nova-compute[72586]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)
Aug 01 21:28:37 user nova-compute[72586]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:28:37 user nova-compute[72586]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a30bc64-6acf-4711-b1c2-f3f6e9835274 (non-flash)
Aug 01 21:28:37 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:28:37 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-da0dbcdd-918d-46aa-b503-9d5ee2ef052b tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)
Aug 01 21:28:37 user nova-compute[72586]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)
Aug 01 21:28:37 user nova-compute[72586]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:28:37 user nova-compute[72586]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a30bc64-6acf-4711-b1c2-f3f6e9835274 (non-flash)
Aug 01 21:28:37 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:28:37 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-da0dbcdd-918d-46aa-b503-9d5ee2ef052b tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a30bc64-6acf-4711-b1c2-f3f6e9835274" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:28:37 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-da0dbcdd-918d-46aa-b503-9d5ee2ef052b tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Connected to 172.16.0.220:3260 {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 21:28:37 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-da0dbcdd-918d-46aa-b503-9d5ee2ef052b tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] HCTL ('36', '-', '-', 0) found on session 23 with lun 0 {{(pid=72586) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 21:28:37 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-da0dbcdd-918d-46aa-b503-9d5ee2ef052b tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72586) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 21:28:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:37 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb92e51d-c508-4b5c-8303-1669ba331903]: (4, ('- - 0', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:37 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-da0dbcdd-918d-46aa-b503-9d5ee2ef052b tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Searching for a device in session 23 and hctl ['36', '*', '*', 0] yield: None {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:28:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:28:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:28:37 user nova-compute[72586]: DEBUG nova.objects.instance [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Lazy-loading 'pci_requests' on Instance uuid c3798403-855b-45e4-af48-ba6b62570dba {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:28:37 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72586) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 21:28:37 user nova-compute[72586]: INFO nova.compute.claims [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Claim successful on node user
Aug 01 21:28:37 user nova-compute[72586]: DEBUG nova.objects.instance [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Lazy-loading 'resources' on Instance uuid c3798403-855b-45e4-af48-ba6b62570dba {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:28:37 user nova-compute[72586]: DEBUG nova.objects.instance [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Lazy-loading 'pci_devices' on Instance uuid c3798403-855b-45e4-af48-ba6b62570dba {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:28:37 user nova-compute[72586]: INFO nova.compute.resource_tracker [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Updating resource usage from migration bedc08a7-a4ac-435e-91db-43271e345055
Aug 01 21:28:37 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:28:37 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:28:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.604s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:28:37 user nova-compute[72586]: INFO nova.compute.manager [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Migrating
Aug 01 21:28:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:28:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Acquired lock "compute-rpcapi-router" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:28:37 user nova-compute[72586]: INFO nova.compute.rpcapi [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 01 21:28:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Releasing lock "compute-rpcapi-router" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:28:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Acquiring lock "refresh_cache-c3798403-855b-45e4-af48-ba6b62570dba" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:28:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Acquired lock "refresh_cache-c3798403-855b-45e4-af48-ba6b62570dba" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:28:37 user nova-compute[72586]: DEBUG nova.network.neutron [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:28:38 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-da0dbcdd-918d-46aa-b503-9d5ee2ef052b tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Searching for a device in session 23 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:28:38 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-da0dbcdd-918d-46aa-b503-9d5ee2ef052b tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qQlPVaOS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 21:28:38 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-da0dbcdd-918d-46aa-b503-9d5ee2ef052b tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:28:38 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-da0dbcdd-918d-46aa-b503-9d5ee2ef052b tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '26266633239633537', 'path': '/dev/sde'} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:28:38 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da0dbcdd-918d-46aa-b503-9d5ee2ef052b tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266633239633537', 'path': '/dev/sde'} {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 21:28:38 user nova-compute[72586]: DEBUG nova.objects.instance [None req-da0dbcdd-918d-46aa-b503-9d5ee2ef052b tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lazy-loading 'flavor' on Instance uuid f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:28:38 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-da0dbcdd-918d-46aa-b503-9d5ee2ef052b tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 21:28:38 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:28:38 user nova-compute[72586]:   <source dev="/dev/sde"/>
Aug 01 21:28:38 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:28:38 user nova-compute[72586]:   <serial>0a30bc64-6acf-4711-b1c2-f3f6e9835274</serial>
Aug 01 21:28:38 user nova-compute[72586]: </disk>
Aug 01 21:28:38 user nova-compute[72586]:  {{(pid=72586) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 21:28:38 user nova-compute[72586]: DEBUG nova.network.neutron [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Updating instance_info_cache with network_info: [{"id": "68b636e3-234f-49e5-b0fb-9f99fffab5c5", "address": "fa:16:3e:a4:40:ed", "network": {"id": "42af123b-86fc-427d-b74a-a2e30c38720c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1787263710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c49158afdb04ea48c05f32782106197", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b636e3-23", "ovs_interfaceid": "68b636e3-234f-49e5-b0fb-9f99fffab5c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:28:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Releasing lock "refresh_cache-c3798403-855b-45e4-af48-ba6b62570dba" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:28:38 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Starting migrate_disk_and_power_off {{(pid=72586) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 01 21:28:38 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:38 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:38 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:38 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:38 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:38 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-da0dbcdd-918d-46aa-b503-9d5ee2ef052b tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:28:38 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-da0dbcdd-918d-46aa-b503-9d5ee2ef052b tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:28:38 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-da0dbcdd-918d-46aa-b503-9d5ee2ef052b tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] No VIF found with MAC fa:16:3e:ac:44:36, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:28:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-da0dbcdd-918d-46aa-b503-9d5ee2ef052b tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lock "f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.172s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:28:38 user nova-compute[72586]: DEBUG nova.compute.manager [req-b9c3bd02-ce2c-4469-95e9-b66c08ddbe9d req-6b36bef5-3439-495b-ad95-067ba0b49369 service nova] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Received event network-vif-unplugged-68b636e3-234f-49e5-b0fb-9f99fffab5c5 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:28:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-b9c3bd02-ce2c-4469-95e9-b66c08ddbe9d req-6b36bef5-3439-495b-ad95-067ba0b49369 service nova] Acquiring lock "c3798403-855b-45e4-af48-ba6b62570dba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:28:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-b9c3bd02-ce2c-4469-95e9-b66c08ddbe9d req-6b36bef5-3439-495b-ad95-067ba0b49369 service nova] Lock "c3798403-855b-45e4-af48-ba6b62570dba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:28:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-b9c3bd02-ce2c-4469-95e9-b66c08ddbe9d req-6b36bef5-3439-495b-ad95-067ba0b49369 service nova] Lock "c3798403-855b-45e4-af48-ba6b62570dba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:28:38 user nova-compute[72586]: DEBUG nova.compute.manager [req-b9c3bd02-ce2c-4469-95e9-b66c08ddbe9d req-6b36bef5-3439-495b-ad95-067ba0b49369 service nova] [instance: c3798403-855b-45e4-af48-ba6b62570dba] No waiting events found dispatching network-vif-unplugged-68b636e3-234f-49e5-b0fb-9f99fffab5c5 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:28:38 user nova-compute[72586]: WARNING nova.compute.manager [req-b9c3bd02-ce2c-4469-95e9-b66c08ddbe9d req-6b36bef5-3439-495b-ad95-067ba0b49369 service nova] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Received unexpected event network-vif-unplugged-68b636e3-234f-49e5-b0fb-9f99fffab5c5 for instance with vm_state active and task_state resize_migrating.
Aug 01 21:28:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:39 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Instance destroyed successfully.
Aug 01 21:28:39 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:24:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-124717694',display_name='tempest-ServerActionsTestOtherB-server-124717694',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-124717694',id=17,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgvcOBvmaWJhEwOkJkVCtNJ+42NFJ7Wme/nrROdsaAYDVV1668xM0wdadU29PtL+UEfr1KV8jRhHGVoqdqnxjGi6czPksct12PqH1D7Zn6OKGhhWdLcIzx9a1L98V8jxQ==',key_name='tempest-keypair-177851533',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:24:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0c49158afdb04ea48c05f32782106197',ramdisk_id='',reservation_id='r-6rqr0y9w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1788994838',owner_user_name='tempest-ServerActionsTestOtherB-1788994838-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:28:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='353f3e5b8859476b8213462a8a3d00b4',uuid=c3798403-855b-45e4-af48-ba6b62570dba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "68b636e3-234f-49e5-b0fb-9f99fffab5c5", "address": "fa:16:3e:a4:40:ed", "network": {"id": "42af123b-86fc-427d-b74a-a2e30c38720c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1787263710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1787263710-network", "vif_mac": "fa:16:3e:a4:40:ed"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c49158afdb04ea48c05f32782106197", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b636e3-23", "ovs_interfaceid": "68b636e3-234f-49e5-b0fb-9f99fffab5c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Converting VIF {"id": "68b636e3-234f-49e5-b0fb-9f99fffab5c5", "address": "fa:16:3e:a4:40:ed", "network": {"id": "42af123b-86fc-427d-b74a-a2e30c38720c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1787263710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1787263710-network", "vif_mac": "fa:16:3e:a4:40:ed"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c49158afdb04ea48c05f32782106197", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b636e3-23", "ovs_interfaceid": "68b636e3-234f-49e5-b0fb-9f99fffab5c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:40:ed,bridge_name='br-int',has_traffic_filtering=True,id=68b636e3-234f-49e5-b0fb-9f99fffab5c5,network=Network(42af123b-86fc-427d-b74a-a2e30c38720c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68b636e3-23') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG os_vif [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:40:ed,bridge_name='br-int',has_traffic_filtering=True,id=68b636e3-234f-49e5-b0fb-9f99fffab5c5,network=Network(42af123b-86fc-427d-b74a-a2e30c38720c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68b636e3-23') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap68b636e3-23, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:28:39 user nova-compute[72586]: INFO os_vif [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:40:ed,bridge_name='br-int',has_traffic_filtering=True,id=68b636e3-234f-49e5-b0fb-9f99fffab5c5,network=Network(42af123b-86fc-427d-b74a-a2e30c38720c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68b636e3-23')
Aug 01 21:28:39 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] calling os-brick to detach iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, {'target_iqns': ['iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tYAvmCpL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:28:39 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:28:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea', 0)] {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc844941-4f59-4208-885d-f34b86bf7bce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a30bc64-6acf-4711-b1c2-f3f6e9835274\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6270015-ff80-4dc4-94dd-9a5ba217434f]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a30bc64-6acf-4711-b1c2-f3f6e9835274 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)
Aug 01 21:28:39 user nova-compute[72586]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)
Aug 01 21:28:39 user nova-compute[72586]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:28:39 user nova-compute[72586]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a30bc64-6acf-4711-b1c2-f3f6e9835274 (non-flash)
Aug 01 21:28:39 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)
Aug 01 21:28:39 user nova-compute[72586]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)
Aug 01 21:28:39 user nova-compute[72586]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:28:39 user nova-compute[72586]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a30bc64-6acf-4711-b1c2-f3f6e9835274 (non-flash)
Aug 01 21:28:39 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ed0273370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea'): ({'sdd'}, set())}) {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Removing single pathed devices sdd {{(pid=72586) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c71149-ec4e-4a26-881b-74c47a83a340]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[8581019e-26a8-483f-8fab-d9f5860106dd]: (4, ('ok\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Flushing IO for device /dev/sdd {{(pid=72586) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ee303db-ce45-498f-b24f-5ae619674f3a tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Calling os-brick to attach iSCSI Volume {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ee303db-ce45-498f-b24f-5ae619674f3a tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b72b465b-3243-4afe-ae10-f908bc65e059'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BrSaCTwK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:28:39 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-0ee303db-ce45-498f-b24f-5ae619674f3a tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:28:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-0ee303db-ce45-498f-b24f-5ae619674f3a tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0280b9d0-fa44-495c-a5fe-b89c2a2bc117]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72586) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6aec62e-a060-463f-8a0b-9dac866929c2]: (4, ('1', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] SCSI volumes sdd have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea')] {{(pid=72586) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e07d46f-7470-46ae-94e6-53c92fd4e94b]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea -p 172.16.0.220:3260 --logout {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[893284cd-1dad-4052-8729-c5dda3b4d9a4]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea, portal: 172.16.0.220,3260]
Aug 01 21:28:39 user nova-compute[72586]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea, portal: 172.16.0.220,3260] successful.
Aug 01 21:28:39 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea -p 172.16.0.220:3260 --op delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6043ca-0965-4b71-83cc-d1df315c3a4f]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] <== disconnect_volume: return (325ms) None {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Disconnected iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-0ee303db-ce45-498f-b24f-5ae619674f3a tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.217s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:28:39 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-0ee303db-ce45-498f-b24f-5ae619674f3a tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:28:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-0ee303db-ce45-498f-b24f-5ae619674f3a tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b72b465b-3243-4afe-ae10-f908bc65e059" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-0ee303db-ce45-498f-b24f-5ae619674f3a tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b72b465b-3243-4afe-ae10-f908bc65e059" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:28:39 user nova-compute[72586]: INFO os_brick.initiator.connectors.iscsi [None req-0ee303db-ce45-498f-b24f-5ae619674f3a tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 21:28:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b72b465b-3243-4afe-ae10-f908bc65e059 -p 172.16.0.220:3260 {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b72b465b-3243-4afe-ae10-f908bc65e059 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc134d4-39b2-499a-aad9-32b0eaf1bd68]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ee303db-ce45-498f-b24f-5ae619674f3a tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 21:28:39 user nova-compute[72586]:  {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b72b465b-3243-4afe-ae10-f908bc65e059 -p 172.16.0.220:3260 --interface default --op new {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b72b465b-3243-4afe-ae10-f908bc65e059 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d20e8b-fcce-4930-a57b-7b6c2dc595a7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b72b465b-3243-4afe-ae10-f908bc65e059] added\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ee303db-ce45-498f-b24f-5ae619674f3a tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b72b465b-3243-4afe-ae10-f908bc65e059] added
Aug 01 21:28:39 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b72b465b-3243-4afe-ae10-f908bc65e059 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b72b465b-3243-4afe-ae10-f908bc65e059 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a8874c-6ebe-4283-9e2b-016a64b5568c]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ee303db-ce45-498f-b24f-5ae619674f3a tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b72b465b-3243-4afe-ae10-f908bc65e059 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b72b465b-3243-4afe-ae10-f908bc65e059 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[af60655a-997e-48ba-b232-3249791e406f]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ee303db-ce45-498f-b24f-5ae619674f3a tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b72b465b-3243-4afe-ae10-f908bc65e059 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BrSaCTwK {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b72b465b-3243-4afe-ae10-f908bc65e059 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BrSaCTwK" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3d36d2-7d4e-49f9-82ff-7fba43218e96]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ee303db-ce45-498f-b24f-5ae619674f3a tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BrSaCTwK'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b72b465b-3243-4afe-ae10-f908bc65e059 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b72b465b-3243-4afe-ae10-f908bc65e059 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d567cc6-d036-4a0b-909a-88f01624bc71]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ee303db-ce45-498f-b24f-5ae619674f3a tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34aea3a-d4c1-4e39-8688-8b7c46ebc1dd]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a30bc64-6acf-4711-b1c2-f3f6e9835274 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ee303db-ce45-498f-b24f-5ae619674f3a tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)
Aug 01 21:28:39 user nova-compute[72586]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)
Aug 01 21:28:39 user nova-compute[72586]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a30bc64-6acf-4711-b1c2-f3f6e9835274 (non-flash)
Aug 01 21:28:39 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ee303db-ce45-498f-b24f-5ae619674f3a tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)
Aug 01 21:28:39 user nova-compute[72586]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)
Aug 01 21:28:39 user nova-compute[72586]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a30bc64-6acf-4711-b1c2-f3f6e9835274 (non-flash)
Aug 01 21:28:39 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b72b465b-3243-4afe-ae10-f908bc65e059 -p 172.16.0.220:3260 --login {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:28:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba_resize/disk /opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba/disk {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b72b465b-3243-4afe-ae10-f908bc65e059 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:40 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd94b58-8b97-4a4a-acce-38ccd4f9075c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b72b465b-3243-4afe-ae10-f908bc65e059, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b72b465b-3243-4afe-ae10-f908bc65e059, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:40 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ee303db-ce45-498f-b24f-5ae619674f3a tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b72b465b-3243-4afe-ae10-f908bc65e059, portal: 172.16.0.220,3260]
Aug 01 21:28:40 user nova-compute[72586]: Login to [iface: default, target: iqn.2010-10.org.openstack:b72b465b-3243-4afe-ae10-f908bc65e059, portal: 172.16.0.220,3260] successful.
Aug 01 21:28:40 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:28:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b72b465b-3243-4afe-ae10-f908bc65e059 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b72b465b-3243-4afe-ae10-f908bc65e059 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:40 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[02555b2f-4138-46f7-afb9-e7e165be9d7a]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:40 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ee303db-ce45-498f-b24f-5ae619674f3a tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:28:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:40 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ae2293-edd1-4ba9-90a8-1f7e735e1676]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a30bc64-6acf-4711-b1c2-f3f6e9835274 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b72b465b-3243-4afe-ae10-f908bc65e059 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:40 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ee303db-ce45-498f-b24f-5ae619674f3a tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)
Aug 01 21:28:40 user nova-compute[72586]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)
Aug 01 21:28:40 user nova-compute[72586]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a30bc64-6acf-4711-b1c2-f3f6e9835274 (non-flash)
Aug 01 21:28:40 user nova-compute[72586]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b72b465b-3243-4afe-ae10-f908bc65e059 (non-flash)
Aug 01 21:28:40 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:28:40 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ee303db-ce45-498f-b24f-5ae619674f3a tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)
Aug 01 21:28:40 user nova-compute[72586]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)
Aug 01 21:28:40 user nova-compute[72586]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a30bc64-6acf-4711-b1c2-f3f6e9835274 (non-flash)
Aug 01 21:28:40 user nova-compute[72586]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b72b465b-3243-4afe-ae10-f908bc65e059 (non-flash)
Aug 01 21:28:40 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:28:40 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-0ee303db-ce45-498f-b24f-5ae619674f3a tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b72b465b-3243-4afe-ae10-f908bc65e059" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.416s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:28:40 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ee303db-ce45-498f-b24f-5ae619674f3a tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Connected to 172.16.0.220:3260 {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 21:28:40 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-0ee303db-ce45-498f-b24f-5ae619674f3a tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] HCTL ('35', '-', '-', 0) found on session 24 with lun 0 {{(pid=72586) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 21:28:40 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-0ee303db-ce45-498f-b24f-5ae619674f3a tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72586) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 21:28:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:40 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9db499-c272-4c4d-a96f-23d3ec21cc46]: (4, ('- - 0', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:40 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-0ee303db-ce45-498f-b24f-5ae619674f3a tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:28:40 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ee303db-ce45-498f-b24f-5ae619674f3a tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BrSaCTwK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 21:28:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] CMD "cp -r /opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba_resize/disk /opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba/disk" returned: 0 in 0.400s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba_resize/disk.info /opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba/disk.info {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] CMD "cp -r /opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba_resize/disk.info /opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba/disk.info" returned: 0 in 0.038s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:41 user nova-compute[72586]: DEBUG nova.compute.manager [req-dabd7620-b376-4a68-bcd4-b74c8b5b1f0f req-ec00cb0b-629d-4484-9376-f1e8dbc17585 service nova] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Received event network-vif-plugged-68b636e3-234f-49e5-b0fb-9f99fffab5c5 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:28:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-dabd7620-b376-4a68-bcd4-b74c8b5b1f0f req-ec00cb0b-629d-4484-9376-f1e8dbc17585 service nova] Acquiring lock "c3798403-855b-45e4-af48-ba6b62570dba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:28:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-dabd7620-b376-4a68-bcd4-b74c8b5b1f0f req-ec00cb0b-629d-4484-9376-f1e8dbc17585 service nova] Lock "c3798403-855b-45e4-af48-ba6b62570dba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:28:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-dabd7620-b376-4a68-bcd4-b74c8b5b1f0f req-ec00cb0b-629d-4484-9376-f1e8dbc17585 service nova] Lock "c3798403-855b-45e4-af48-ba6b62570dba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:28:41 user nova-compute[72586]: DEBUG nova.compute.manager [req-dabd7620-b376-4a68-bcd4-b74c8b5b1f0f req-ec00cb0b-629d-4484-9376-f1e8dbc17585 service nova] [instance: c3798403-855b-45e4-af48-ba6b62570dba] No waiting events found dispatching network-vif-plugged-68b636e3-234f-49e5-b0fb-9f99fffab5c5 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:28:41 user nova-compute[72586]: WARNING nova.compute.manager [req-dabd7620-b376-4a68-bcd4-b74c8b5b1f0f req-ec00cb0b-629d-4484-9376-f1e8dbc17585 service nova] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Received unexpected event network-vif-plugged-68b636e3-234f-49e5-b0fb-9f99fffab5c5 for instance with vm_state active and task_state resize_migrating.
Aug 01 21:28:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-0ee303db-ce45-498f-b24f-5ae619674f3a tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.465s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:28:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ee303db-ce45-498f-b24f-5ae619674f3a tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] <== connect_volume: return (1681ms) {'type': 'block', 'scsi_wwn': '23866656334303637', 'path': '/dev/sdd'} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:28:41 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ee303db-ce45-498f-b24f-5ae619674f3a tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866656334303637', 'path': '/dev/sdd'} {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 21:28:41 user nova-compute[72586]: DEBUG nova.objects.instance [None req-0ee303db-ce45-498f-b24f-5ae619674f3a tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lazy-loading 'flavor' on Instance uuid 8c352ce2-5d08-424a-928f-2fd1cf58e491 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:28:41 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-0ee303db-ce45-498f-b24f-5ae619674f3a tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 21:28:41 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:28:41 user nova-compute[72586]:   <source dev="/dev/sdd"/>
Aug 01 21:28:41 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:28:41 user nova-compute[72586]:   <serial>b72b465b-3243-4afe-ae10-f908bc65e059</serial>
Aug 01 21:28:41 user nova-compute[72586]: </disk>
Aug 01 21:28:41 user nova-compute[72586]:  {{(pid=72586) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 21:28:41 user nova-compute[72586]: DEBUG nova.network.neutron [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Port 68b636e3-234f-49e5-b0fb-9f99fffab5c5 binding to destination host user is already ACTIVE {{(pid=72586) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 01 21:28:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Acquiring lock "c3798403-855b-45e4-af48-ba6b62570dba-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:28:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Lock "c3798403-855b-45e4-af48-ba6b62570dba-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:28:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Lock "c3798403-855b-45e4-af48-ba6b62570dba-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:28:41 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-0ee303db-ce45-498f-b24f-5ae619674f3a tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:28:41 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-0ee303db-ce45-498f-b24f-5ae619674f3a tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:28:41 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-0ee303db-ce45-498f-b24f-5ae619674f3a tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] No VIF found with MAC fa:16:3e:52:0d:35, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:28:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Acquiring lock "refresh_cache-c3798403-855b-45e4-af48-ba6b62570dba" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:28:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Acquired lock "refresh_cache-c3798403-855b-45e4-af48-ba6b62570dba" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:28:41 user nova-compute[72586]: DEBUG nova.network.neutron [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:28:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0ee303db-ce45-498f-b24f-5ae619674f3a tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lock "8c352ce2-5d08-424a-928f-2fd1cf58e491" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.974s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:28:42 user nova-compute[72586]: DEBUG nova.network.neutron [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Updating instance_info_cache with network_info: [{"id": "68b636e3-234f-49e5-b0fb-9f99fffab5c5", "address": "fa:16:3e:a4:40:ed", "network": {"id": "42af123b-86fc-427d-b74a-a2e30c38720c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1787263710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c49158afdb04ea48c05f32782106197", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b636e3-23", "ovs_interfaceid": "68b636e3-234f-49e5-b0fb-9f99fffab5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:28:42 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Releasing lock "refresh_cache-c3798403-855b-45e4-af48-ba6b62570dba" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:28:42 user nova-compute[72586]: DEBUG os_brick.utils [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:28:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:42 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4d1e51-12b3-4b10-91f5-d0ad0b2bc506]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4bc202fb9cb\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:42 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b18c6d-c6b8-4fbe-8792-c3ec9fbe8125]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:42 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c14e326-9ff2-44cf-8b6d-cd57b2198022]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:42 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[392abe15-ce3f-489b-acb0-00333cce5db4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Running cmd (subprocess): nvme version {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] 'nvme version' failed. Not Retrying. {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:28:42 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] nvme not present on system {{(pid=72586) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 21:28:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:28:42 user nova-compute[72586]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 21:28:42 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b32cba-b151-46c7-83ba-a957f4a41ccb]: (4, '') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:42 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72586) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 21:28:42 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 21:28:42 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] LIGHTOS: no hostnqn found. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 21:28:42 user nova-compute[72586]: DEBUG os_brick.utils [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4bc202fb9cb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:28:44 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:44 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:49 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:49 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:50 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Starting finish_migration {{(pid=72586) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 01 21:28:50 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Instance directory exists: not creating {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 01 21:28:50 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Creating image(s)
Aug 01 21:28:50 user nova-compute[72586]: DEBUG nova.objects.instance [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Lazy-loading 'trusted_certs' on Instance uuid c3798403-855b-45e4-af48-ba6b62570dba {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:28:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.146s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:50 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba/disk. size=21474836480 {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 21:28:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba/disk 21474836480 {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba/disk 21474836480" returned: 0 in 0.198s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Did not create local disks {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Ensure instance console log exists: /opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba/console.log {{(pid=72586) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Start _get_guest_xml network_info=[{"id": "68b636e3-234f-49e5-b0fb-9f99fffab5c5", "address": "fa:16:3e:a4:40:ed", "network": {"id": "42af123b-86fc-427d-b74a-a2e30c38720c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1787263710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1787263710-network", "vif_mac": "fa:16:3e:a4:40:ed"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c49158afdb04ea48c05f32782106197", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b636e3-23", "ovs_interfaceid": "68b636e3-234f-49e5-b0fb-9f99fffab5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '0243d46b-6819-42a5-926f-42b71f0c97ad'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tYAvmCpL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'c3798403-855b-45e4-af48-ba6b62570dba', 'attached_at': '2023-08-01T21:28:50.000000', 'detached_at': '', 'volume_id': '4927c194-c7b3-4b35-b484-30b4bc8744ea', 'serial': '4927c194-c7b3-4b35-b484-30b4bc8744ea'}, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'e4d9eae4-28e8-4c49-affd-27583c722235', 'delete_on_termination': False, 'volume_type': None} {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:28:51 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:28:51 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:28:51 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG nova.objects.instance [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Lazy-loading 'vcpu_model' on Instance uuid c3798403-855b-45e4-af48-ba6b62570dba {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Calling os-brick to attach iSCSI Volume {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tYAvmCpL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:28:51 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:28:51 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:28:51 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:28:51 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:28:51 user nova-compute[72586]: INFO os_brick.initiator.connectors.iscsi [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 21:28:51 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea -p 172.16.0.220:3260 {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef978049-cd04-4338-8f75-c2fc16c5650d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 21:28:51 user nova-compute[72586]:  {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea -p 172.16.0.220:3260 --interface default --op new {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a7fd99-829f-4621-a4cb-5b1523b07d61]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea] added\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea] added
Aug 01 21:28:51 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e1bb3e-6e23-439e-80db-bdd8668014aa]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9f643c-e77c-448e-894a-7b77cf2276c3]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tYAvmCpL {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tYAvmCpL" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[840f2457-6bf0-4f47-9600-36b04f653f9d]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tYAvmCpL'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd32018-b38c-4ae2-b068-88b8eace1ee4]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c30c17-6b5a-4550-8cd2-a298ec63f74d]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a30bc64-6acf-4711-b1c2-f3f6e9835274 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b72b465b-3243-4afe-ae10-f908bc65e059 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)
Aug 01 21:28:51 user nova-compute[72586]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)
Aug 01 21:28:51 user nova-compute[72586]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a30bc64-6acf-4711-b1c2-f3f6e9835274 (non-flash)
Aug 01 21:28:51 user nova-compute[72586]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b72b465b-3243-4afe-ae10-f908bc65e059 (non-flash)
Aug 01 21:28:51 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)
Aug 01 21:28:51 user nova-compute[72586]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)
Aug 01 21:28:51 user nova-compute[72586]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a30bc64-6acf-4711-b1c2-f3f6e9835274 (non-flash)
Aug 01 21:28:51 user nova-compute[72586]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b72b465b-3243-4afe-ae10-f908bc65e059 (non-flash)
Aug 01 21:28:51 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea -p 172.16.0.220:3260 --login {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd8fad5c-b889-41b2-a93c-42d7976a3eca]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea, portal: 172.16.0.220,3260]
Aug 01 21:28:51 user nova-compute[72586]: Login to [iface: default, target: iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea, portal: 172.16.0.220,3260] successful.
Aug 01 21:28:51 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10efa82-6599-4478-acc8-ddfa5a06e6c6]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d05f771-4e08-4f49-b069-e193cd3a5f49]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a30bc64-6acf-4711-b1c2-f3f6e9835274 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b72b465b-3243-4afe-ae10-f908bc65e059 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)
Aug 01 21:28:51 user nova-compute[72586]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)
Aug 01 21:28:51 user nova-compute[72586]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a30bc64-6acf-4711-b1c2-f3f6e9835274 (non-flash)
Aug 01 21:28:51 user nova-compute[72586]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b72b465b-3243-4afe-ae10-f908bc65e059 (non-flash)
Aug 01 21:28:51 user nova-compute[72586]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:28:51 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)
Aug 01 21:28:51 user nova-compute[72586]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)
Aug 01 21:28:51 user nova-compute[72586]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a30bc64-6acf-4711-b1c2-f3f6e9835274 (non-flash)
Aug 01 21:28:51 user nova-compute[72586]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b72b465b-3243-4afe-ae10-f908bc65e059 (non-flash)
Aug 01 21:28:51 user nova-compute[72586]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:28:51 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Connected to 172.16.0.220:3260 {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] HCTL ('37', '-', '-', 0) found on session 25 with lun 0 {{(pid=72586) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72586) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b23ac3-74ef-42ed-b31f-5ffe1d93c8a8]: (4, ('- - 0', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Searching for a device in session 25 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:28:51 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tYAvmCpL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 21:28:52 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:28:52 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] <== connect_volume: return (1360ms) {'type': 'block', 'scsi_wwn': '23765333266316265', 'path': '/dev/sdf'} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:28:52 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765333266316265', 'path': '/dev/sdf'} {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 21:28:52 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:24:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-124717694',display_name='tempest-ServerActionsTestOtherB-server-124717694',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-124717694',id=17,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgvcOBvmaWJhEwOkJkVCtNJ+42NFJ7Wme/nrROdsaAYDVV1668xM0wdadU29PtL+UEfr1KV8jRhHGVoqdqnxjGi6czPksct12PqH1D7Zn6OKGhhWdLcIzx9a1L98V8jxQ==',key_name='tempest-keypair-177851533',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:24:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0c49158afdb04ea48c05f32782106197',ramdisk_id='',reservation_id='r-6rqr0y9w',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1788994838',owner_user_name='tempest-ServerActionsTestOtherB-1788994838-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:28:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='353f3e5b8859476b8213462a8a3d00b4',uuid=c3798403-855b-45e4-af48-ba6b62570dba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "68b636e3-234f-49e5-b0fb-9f99fffab5c5", "address": "fa:16:3e:a4:40:ed", "network": {"id": "42af123b-86fc-427d-b74a-a2e30c38720c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1787263710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1787263710-network", "vif_mac": "fa:16:3e:a4:40:ed"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c49158afdb04ea48c05f32782106197", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b636e3-23", "ovs_interfaceid": "68b636e3-234f-49e5-b0fb-9f99fffab5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:28:52 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Converting VIF {"id": "68b636e3-234f-49e5-b0fb-9f99fffab5c5", "address": "fa:16:3e:a4:40:ed", "network": {"id": "42af123b-86fc-427d-b74a-a2e30c38720c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1787263710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1787263710-network", "vif_mac": "fa:16:3e:a4:40:ed"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c49158afdb04ea48c05f32782106197", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b636e3-23", "ovs_interfaceid": "68b636e3-234f-49e5-b0fb-9f99fffab5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:28:52 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:40:ed,bridge_name='br-int',has_traffic_filtering=True,id=68b636e3-234f-49e5-b0fb-9f99fffab5c5,network=Network(42af123b-86fc-427d-b74a-a2e30c38720c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68b636e3-23') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:28:52 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:28:52 user nova-compute[72586]:   <uuid>c3798403-855b-45e4-af48-ba6b62570dba</uuid>
Aug 01 21:28:52 user nova-compute[72586]:   <name>instance-00000011</name>
Aug 01 21:28:52 user nova-compute[72586]:   <memory>2097152</memory>
Aug 01 21:28:52 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:28:52 user nova-compute[72586]:   <metadata>
Aug 01 21:28:52 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:28:52 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:28:52 user nova-compute[72586]:       <nova:name>tempest-ServerActionsTestOtherB-server-124717694</nova:name>
Aug 01 21:28:52 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:28:51</nova:creationTime>
Aug 01 21:28:52 user nova-compute[72586]:       <nova:flavor name="m1.small">
Aug 01 21:28:52 user nova-compute[72586]:         <nova:memory>2048</nova:memory>
Aug 01 21:28:52 user nova-compute[72586]:         <nova:disk>20</nova:disk>
Aug 01 21:28:52 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:28:52 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:28:52 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:28:52 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:28:52 user nova-compute[72586]:       <nova:owner>
Aug 01 21:28:52 user nova-compute[72586]:         <nova:user uuid="353f3e5b8859476b8213462a8a3d00b4">tempest-ServerActionsTestOtherB-1788994838-project-member</nova:user>
Aug 01 21:28:52 user nova-compute[72586]:         <nova:project uuid="0c49158afdb04ea48c05f32782106197">tempest-ServerActionsTestOtherB-1788994838</nova:project>
Aug 01 21:28:52 user nova-compute[72586]:       </nova:owner>
Aug 01 21:28:52 user nova-compute[72586]:       <nova:root type="image" uuid="0243d46b-6819-42a5-926f-42b71f0c97ad"/>
Aug 01 21:28:52 user nova-compute[72586]:       <nova:ports>
Aug 01 21:28:52 user nova-compute[72586]:         <nova:port uuid="68b636e3-234f-49e5-b0fb-9f99fffab5c5">
Aug 01 21:28:52 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 01 21:28:52 user nova-compute[72586]:         </nova:port>
Aug 01 21:28:52 user nova-compute[72586]:       </nova:ports>
Aug 01 21:28:52 user nova-compute[72586]:     </nova:instance>
Aug 01 21:28:52 user nova-compute[72586]:   </metadata>
Aug 01 21:28:52 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:28:52 user nova-compute[72586]:     <system>
Aug 01 21:28:52 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:28:52 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:28:52 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:28:52 user nova-compute[72586]:       <entry name="serial">c3798403-855b-45e4-af48-ba6b62570dba</entry>
Aug 01 21:28:52 user nova-compute[72586]:       <entry name="uuid">c3798403-855b-45e4-af48-ba6b62570dba</entry>
Aug 01 21:28:52 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:28:52 user nova-compute[72586]:     </system>
Aug 01 21:28:52 user nova-compute[72586]:   </sysinfo>
Aug 01 21:28:52 user nova-compute[72586]:   <os>
Aug 01 21:28:52 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:28:52 user nova-compute[72586]:     <boot dev="hd"/>
Aug 01 21:28:52 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:28:52 user nova-compute[72586]:   </os>
Aug 01 21:28:52 user nova-compute[72586]:   <features>
Aug 01 21:28:52 user nova-compute[72586]:     <acpi/>
Aug 01 21:28:52 user nova-compute[72586]:     <apic/>
Aug 01 21:28:52 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:28:52 user nova-compute[72586]:   </features>
Aug 01 21:28:52 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:28:52 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:28:52 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:28:52 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:28:52 user nova-compute[72586]:   </clock>
Aug 01 21:28:52 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:28:52 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:28:52 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:28:52 user nova-compute[72586]:   </cpu>
Aug 01 21:28:52 user nova-compute[72586]:   <devices>
Aug 01 21:28:52 user nova-compute[72586]:     <disk type="file" device="disk">
Aug 01 21:28:52 user nova-compute[72586]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 21:28:52 user nova-compute[72586]:       <source file="/opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba/disk"/>
Aug 01 21:28:52 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:28:52 user nova-compute[72586]:     </disk>
Aug 01 21:28:52 user nova-compute[72586]:     <disk type="block" device="disk">
Aug 01 21:28:52 user nova-compute[72586]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:28:52 user nova-compute[72586]:       <source dev="/dev/sdf"/>
Aug 01 21:28:52 user nova-compute[72586]:       <target dev="vdb" bus="virtio"/>
Aug 01 21:28:52 user nova-compute[72586]:       <serial>4927c194-c7b3-4b35-b484-30b4bc8744ea</serial>
Aug 01 21:28:52 user nova-compute[72586]:     </disk>
Aug 01 21:28:52 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:28:52 user nova-compute[72586]:       <mac address="fa:16:3e:a4:40:ed"/>
Aug 01 21:28:52 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:28:52 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:28:52 user nova-compute[72586]:       <target dev="tap68b636e3-23"/>
Aug 01 21:28:52 user nova-compute[72586]:     </interface>
Aug 01 21:28:52 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:28:52 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba/console.log" append="off"/>
Aug 01 21:28:52 user nova-compute[72586]:     </serial>
Aug 01 21:28:52 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:28:52 user nova-compute[72586]:     <video>
Aug 01 21:28:52 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:28:52 user nova-compute[72586]:     </video>
Aug 01 21:28:52 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:28:52 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:28:52 user nova-compute[72586]:     </rng>
Aug 01 21:28:52 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:28:52 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:28:52 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:28:52 user nova-compute[72586]:     </memballoon>
Aug 01 21:28:52 user nova-compute[72586]:   </devices>
Aug 01 21:28:52 user nova-compute[72586]: </domain>
Aug 01 21:28:52 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:28:52 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:24:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-124717694',display_name='tempest-ServerActionsTestOtherB-server-124717694',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-124717694',id=17,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgvcOBvmaWJhEwOkJkVCtNJ+42NFJ7Wme/nrROdsaAYDVV1668xM0wdadU29PtL+UEfr1KV8jRhHGVoqdqnxjGi6czPksct12PqH1D7Zn6OKGhhWdLcIzx9a1L98V8jxQ==',key_name='tempest-keypair-177851533',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:24:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0c49158afdb04ea48c05f32782106197',ramdisk_id='',reservation_id='r-6rqr0y9w',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1788994838',owner_user_name='tempest-ServerActionsTestOtherB-1788994838-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:28:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='353f3e5b8859476b8213462a8a3d00b4',uuid=c3798403-855b-45e4-af48-ba6b62570dba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "68b636e3-234f-49e5-b0fb-9f99fffab5c5", "address": "fa:16:3e:a4:40:ed", "network": {"id": "42af123b-86fc-427d-b74a-a2e30c38720c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1787263710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1787263710-network", "vif_mac": "fa:16:3e:a4:40:ed"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c49158afdb04ea48c05f32782106197", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b636e3-23", "ovs_interfaceid": "68b636e3-234f-49e5-b0fb-9f99fffab5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:28:52 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Converting VIF {"id": "68b636e3-234f-49e5-b0fb-9f99fffab5c5", "address": "fa:16:3e:a4:40:ed", "network": {"id": "42af123b-86fc-427d-b74a-a2e30c38720c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1787263710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1787263710-network", "vif_mac": "fa:16:3e:a4:40:ed"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c49158afdb04ea48c05f32782106197", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b636e3-23", "ovs_interfaceid": "68b636e3-234f-49e5-b0fb-9f99fffab5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:28:52 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:40:ed,bridge_name='br-int',has_traffic_filtering=True,id=68b636e3-234f-49e5-b0fb-9f99fffab5c5,network=Network(42af123b-86fc-427d-b74a-a2e30c38720c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68b636e3-23') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:28:52 user nova-compute[72586]: DEBUG os_vif [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:40:ed,bridge_name='br-int',has_traffic_filtering=True,id=68b636e3-234f-49e5-b0fb-9f99fffab5c5,network=Network(42af123b-86fc-427d-b74a-a2e30c38720c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68b636e3-23') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:28:52 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:52 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:28:52 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:28:52 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:52 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap68b636e3-23, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:28:52 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap68b636e3-23, col_values=(('external_ids', {'iface-id': '68b636e3-234f-49e5-b0fb-9f99fffab5c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:40:ed', 'vm-uuid': 'c3798403-855b-45e4-af48-ba6b62570dba'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:28:52 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:52 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:28:52 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:52 user nova-compute[72586]: INFO os_vif [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:40:ed,bridge_name='br-int',has_traffic_filtering=True,id=68b636e3-234f-49e5-b0fb-9f99fffab5c5,network=Network(42af123b-86fc-427d-b74a-a2e30c38720c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68b636e3-23')
Aug 01 21:28:52 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:28:52 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:28:52 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] No VIF found with MAC fa:16:3e:a4:40:ed, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:28:53 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:53 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:53 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:54 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:54 user nova-compute[72586]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690925319.2936032, c3798403-855b-45e4-af48-ba6b62570dba => Stopped> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:28:54 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: c3798403-855b-45e4-af48-ba6b62570dba] VM Stopped (Lifecycle Event)
Aug 01 21:28:54 user nova-compute[72586]: DEBUG nova.compute.manager [None req-ccd478b2-f470-4dd1-aef4-23908dad32f6 None None] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:28:54 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:54 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:54 user nova-compute[72586]: DEBUG nova.compute.manager [req-c8ca5eec-433e-405d-8312-d8157975e7d9 req-c0f80942-ac4e-4d8a-b322-fc9a1f6d13b0 service nova] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Received event network-vif-plugged-68b636e3-234f-49e5-b0fb-9f99fffab5c5 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:28:54 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-c8ca5eec-433e-405d-8312-d8157975e7d9 req-c0f80942-ac4e-4d8a-b322-fc9a1f6d13b0 service nova] Acquiring lock "c3798403-855b-45e4-af48-ba6b62570dba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:28:54 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-c8ca5eec-433e-405d-8312-d8157975e7d9 req-c0f80942-ac4e-4d8a-b322-fc9a1f6d13b0 service nova] Lock "c3798403-855b-45e4-af48-ba6b62570dba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:28:54 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-c8ca5eec-433e-405d-8312-d8157975e7d9 req-c0f80942-ac4e-4d8a-b322-fc9a1f6d13b0 service nova] Lock "c3798403-855b-45e4-af48-ba6b62570dba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:28:54 user nova-compute[72586]: DEBUG nova.compute.manager [req-c8ca5eec-433e-405d-8312-d8157975e7d9 req-c0f80942-ac4e-4d8a-b322-fc9a1f6d13b0 service nova] [instance: c3798403-855b-45e4-af48-ba6b62570dba] No waiting events found dispatching network-vif-plugged-68b636e3-234f-49e5-b0fb-9f99fffab5c5 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:28:54 user nova-compute[72586]: WARNING nova.compute.manager [req-c8ca5eec-433e-405d-8312-d8157975e7d9 req-c0f80942-ac4e-4d8a-b322-fc9a1f6d13b0 service nova] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Received unexpected event network-vif-plugged-68b636e3-234f-49e5-b0fb-9f99fffab5c5 for instance with vm_state active and task_state resize_finish.
Aug 01 21:28:54 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:56 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925336.3350377, c3798403-855b-45e4-af48-ba6b62570dba => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:28:56 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: c3798403-855b-45e4-af48-ba6b62570dba] VM Resumed (Lifecycle Event)
Aug 01 21:28:56 user nova-compute[72586]: DEBUG nova.compute.manager [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Instance event wait completed in 0 seconds for  {{(pid=72586) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 21:28:56 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Instance running successfully.
Aug 01 21:28:56 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:28:56 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Failed to set time: agent not configured {{(pid=72586) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 01 21:28:56 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c415dd10-762c-4ffe-9c15-f5845800fd8a tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] finish_migration finished successfully. {{(pid=72586) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 01 21:28:56 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:28:56 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: c3798403-855b-45e4-af48-ba6b62570dba] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 01 21:28:56 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925336.3365855, c3798403-855b-45e4-af48-ba6b62570dba => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:28:56 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: c3798403-855b-45e4-af48-ba6b62570dba] VM Started (Lifecycle Event)
Aug 01 21:28:56 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:28:56 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:28:56 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: c3798403-855b-45e4-af48-ba6b62570dba] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 01 21:28:56 user nova-compute[72586]: DEBUG nova.compute.manager [req-997845a4-a636-4c0b-80c9-f97842a2f402 req-aa0b2af2-c54e-4e89-828a-0127cd1d759e service nova] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Received event network-vif-plugged-68b636e3-234f-49e5-b0fb-9f99fffab5c5 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:28:56 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-997845a4-a636-4c0b-80c9-f97842a2f402 req-aa0b2af2-c54e-4e89-828a-0127cd1d759e service nova] Acquiring lock "c3798403-855b-45e4-af48-ba6b62570dba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:28:56 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-997845a4-a636-4c0b-80c9-f97842a2f402 req-aa0b2af2-c54e-4e89-828a-0127cd1d759e service nova] Lock "c3798403-855b-45e4-af48-ba6b62570dba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:28:56 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-997845a4-a636-4c0b-80c9-f97842a2f402 req-aa0b2af2-c54e-4e89-828a-0127cd1d759e service nova] Lock "c3798403-855b-45e4-af48-ba6b62570dba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:28:56 user nova-compute[72586]: DEBUG nova.compute.manager [req-997845a4-a636-4c0b-80c9-f97842a2f402 req-aa0b2af2-c54e-4e89-828a-0127cd1d759e service nova] [instance: c3798403-855b-45e4-af48-ba6b62570dba] No waiting events found dispatching network-vif-plugged-68b636e3-234f-49e5-b0fb-9f99fffab5c5 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:28:56 user nova-compute[72586]: WARNING nova.compute.manager [req-997845a4-a636-4c0b-80c9-f97842a2f402 req-aa0b2af2-c54e-4e89-828a-0127cd1d759e service nova] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Received unexpected event network-vif-plugged-68b636e3-234f-49e5-b0fb-9f99fffab5c5 for instance with vm_state resized and task_state None.
Aug 01 21:28:56 user nova-compute[72586]: DEBUG nova.compute.manager [req-997845a4-a636-4c0b-80c9-f97842a2f402 req-aa0b2af2-c54e-4e89-828a-0127cd1d759e service nova] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Received event network-changed-46cc59ac-efc1-40c1-8a70-b848a9980413 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:28:56 user nova-compute[72586]: DEBUG nova.compute.manager [req-997845a4-a636-4c0b-80c9-f97842a2f402 req-aa0b2af2-c54e-4e89-828a-0127cd1d759e service nova] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Refreshing instance network info cache due to event network-changed-46cc59ac-efc1-40c1-8a70-b848a9980413. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:28:56 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-997845a4-a636-4c0b-80c9-f97842a2f402 req-aa0b2af2-c54e-4e89-828a-0127cd1d759e service nova] Acquiring lock "refresh_cache-f9b8f9c5-0129-429d-beb6-26d4c9cc085d" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:28:56 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-997845a4-a636-4c0b-80c9-f97842a2f402 req-aa0b2af2-c54e-4e89-828a-0127cd1d759e service nova] Acquired lock "refresh_cache-f9b8f9c5-0129-429d-beb6-26d4c9cc085d" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:28:56 user nova-compute[72586]: DEBUG nova.network.neutron [req-997845a4-a636-4c0b-80c9-f97842a2f402 req-aa0b2af2-c54e-4e89-828a-0127cd1d759e service nova] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Refreshing network info cache for port 46cc59ac-efc1-40c1-8a70-b848a9980413 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:28:57 user nova-compute[72586]: DEBUG nova.network.neutron [req-997845a4-a636-4c0b-80c9-f97842a2f402 req-aa0b2af2-c54e-4e89-828a-0127cd1d759e service nova] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Updated VIF entry in instance network info cache for port 46cc59ac-efc1-40c1-8a70-b848a9980413. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:28:57 user nova-compute[72586]: DEBUG nova.network.neutron [req-997845a4-a636-4c0b-80c9-f97842a2f402 req-aa0b2af2-c54e-4e89-828a-0127cd1d759e service nova] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Updating instance_info_cache with network_info: [{"id": "46cc59ac-efc1-40c1-8a70-b848a9980413", "address": "fa:16:3e:6b:e7:10", "network": {"id": "a5da07bc-2f5d-461e-b31f-df624d9c6557", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948878141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae659e4ad43c44e2a8f6d48818bb796a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46cc59ac-ef", "ovs_interfaceid": "46cc59ac-efc1-40c1-8a70-b848a9980413", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:28:57 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-997845a4-a636-4c0b-80c9-f97842a2f402 req-aa0b2af2-c54e-4e89-828a-0127cd1d759e service nova] Releasing lock "refresh_cache-f9b8f9c5-0129-429d-beb6-26d4c9cc085d" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:28:57 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:58 user nova-compute[72586]: DEBUG nova.compute.manager [None req-890438c5-e769-4272-800d-5f91da73a18f tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:28:58 user nova-compute[72586]: INFO nova.compute.manager [None req-890438c5-e769-4272-800d-5f91da73a18f tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: af2de810-b22f-4fa9-835c-c673abd145db] instance snapshotting
Aug 01 21:28:58 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-890438c5-e769-4272-800d-5f91da73a18f tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Beginning live snapshot process
Aug 01 21:28:58 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-890438c5-e769-4272-800d-5f91da73a18f tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json -f qcow2 {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:59 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-890438c5-e769-4272-800d-5f91da73a18f tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json -f qcow2" returned: 0 in 0.168s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:59 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-890438c5-e769-4272-800d-5f91da73a18f tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json -f qcow2 {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:59 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-890438c5-e769-4272-800d-5f91da73a18f tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json -f qcow2" returned: 0 in 0.173s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:59 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-890438c5-e769-4272-800d-5f91da73a18f tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:59 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3ca4b67a-3eee-4e44-ba7e-b72cc7402783 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Acquiring lock "f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:28:59 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3ca4b67a-3eee-4e44-ba7e-b72cc7402783 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lock "f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:28:59 user nova-compute[72586]: INFO nova.compute.manager [None req-3ca4b67a-3eee-4e44-ba7e-b72cc7402783 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Detaching volume 0a30bc64-6acf-4711-b1c2-f3f6e9835274
Aug 01 21:28:59 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:28:59 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-890438c5-e769-4272-800d-5f91da73a18f tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.146s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:59 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-890438c5-e769-4272-800d-5f91da73a18f tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpkqasu65x/276b23c6f8d94eb19eafd9751a6d897a.delta 1073741824 {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:28:59 user nova-compute[72586]: INFO nova.virt.block_device [None req-3ca4b67a-3eee-4e44-ba7e-b72cc7402783 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Attempting to driver detach volume 0a30bc64-6acf-4711-b1c2-f3f6e9835274 from mountpoint /dev/vdb
Aug 01 21:28:59 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-890438c5-e769-4272-800d-5f91da73a18f tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpkqasu65x/276b23c6f8d94eb19eafd9751a6d897a.delta 1073741824" returned: 0 in 0.059s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:28:59 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-890438c5-e769-4272-800d-5f91da73a18f tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 01 21:28:59 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3ca4b67a-3eee-4e44-ba7e-b72cc7402783 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Attempting to detach device vdb from instance f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536 from the persistent domain config. {{(pid=72586) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 21:28:59 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-3ca4b67a-3eee-4e44-ba7e-b72cc7402783 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 21:28:59 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:28:59 user nova-compute[72586]:   <source dev="/dev/sde"/>
Aug 01 21:28:59 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:28:59 user nova-compute[72586]:   <serial>0a30bc64-6acf-4711-b1c2-f3f6e9835274</serial>
Aug 01 21:28:59 user nova-compute[72586]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 21:28:59 user nova-compute[72586]: </disk>
Aug 01 21:28:59 user nova-compute[72586]:  {{(pid=72586) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 21:28:59 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-3ca4b67a-3eee-4e44-ba7e-b72cc7402783 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Successfully detached device vdb from instance f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536 from the persistent domain config.
Aug 01 21:28:59 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3ca4b67a-3eee-4e44-ba7e-b72cc7402783 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536 from the live domain config. {{(pid=72586) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 21:28:59 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-3ca4b67a-3eee-4e44-ba7e-b72cc7402783 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 21:28:59 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:28:59 user nova-compute[72586]:   <source dev="/dev/sde"/>
Aug 01 21:28:59 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:28:59 user nova-compute[72586]:   <serial>0a30bc64-6acf-4711-b1c2-f3f6e9835274</serial>
Aug 01 21:28:59 user nova-compute[72586]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 21:28:59 user nova-compute[72586]: </disk>
Aug 01 21:28:59 user nova-compute[72586]:  {{(pid=72586) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 21:29:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0dde2cf6-f5a8-421b-b104-1e4d2875601c tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Acquiring lock "f9b8f9c5-0129-429d-beb6-26d4c9cc085d" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:29:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0dde2cf6-f5a8-421b-b104-1e4d2875601c tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "f9b8f9c5-0129-429d-beb6-26d4c9cc085d" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:29:00 user nova-compute[72586]: INFO nova.compute.manager [None req-0dde2cf6-f5a8-421b-b104-1e4d2875601c tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Shelving
Aug 01 21:29:00 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-890438c5-e769-4272-800d-5f91da73a18f tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] COPY block job progress, current cursor: 1310720 final cursor: 75497472 {{(pid=72586) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 21:29:00 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:29:00 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:29:00 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:29:00 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:29:00 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Received event <DeviceRemovedEvent: 1690925340.4707909, f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72586) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 21:29:00 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3ca4b67a-3eee-4e44-ba7e-b72cc7402783 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536 {{(pid=72586) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 21:29:00 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-3ca4b67a-3eee-4e44-ba7e-b72cc7402783 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Successfully detached device vdb from instance f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536 from the live domain config.
Aug 01 21:29:00 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ca4b67a-3eee-4e44-ba7e-b72cc7402783 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] calling os-brick to detach iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 21:29:00 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca4b67a-3eee-4e44-ba7e-b72cc7402783 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, {'target_iqns': ['iqn.2010-10.org.openstack:0a30bc64-6acf-4711-b1c2-f3f6e9835274'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qQlPVaOS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:29:00 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-3ca4b67a-3eee-4e44-ba7e-b72cc7402783 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:29:00 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-3ca4b67a-3eee-4e44-ba7e-b72cc7402783 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:29:00 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-3ca4b67a-3eee-4e44-ba7e-b72cc7402783 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:29:00 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca4b67a-3eee-4e44-ba7e-b72cc7402783 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a30bc64-6acf-4711-b1c2-f3f6e9835274', 0)] {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 21:29:00 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:00 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:29:00 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c9518a-6980-4c53-84bb-c10a8c5d16cc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a30bc64-6acf-4711-b1c2-f3f6e9835274\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b72b465b-3243-4afe-ae10-f908bc65e059\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:29:00 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:00 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:29:00 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[133132cf-7276-445e-958a-9a6b84c3fc57]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a30bc64-6acf-4711-b1c2-f3f6e9835274 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b72b465b-3243-4afe-ae10-f908bc65e059 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:29:00 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca4b67a-3eee-4e44-ba7e-b72cc7402783 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)
Aug 01 21:29:00 user nova-compute[72586]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)
Aug 01 21:29:00 user nova-compute[72586]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a30bc64-6acf-4711-b1c2-f3f6e9835274 (non-flash)
Aug 01 21:29:00 user nova-compute[72586]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b72b465b-3243-4afe-ae10-f908bc65e059 (non-flash)
Aug 01 21:29:00 user nova-compute[72586]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:29:00 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:29:00 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca4b67a-3eee-4e44-ba7e-b72cc7402783 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)
Aug 01 21:29:00 user nova-compute[72586]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)
Aug 01 21:29:00 user nova-compute[72586]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a30bc64-6acf-4711-b1c2-f3f6e9835274 (non-flash)
Aug 01 21:29:00 user nova-compute[72586]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b72b465b-3243-4afe-ae10-f908bc65e059 (non-flash)
Aug 01 21:29:00 user nova-compute[72586]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:29:00 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:29:00 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca4b67a-3eee-4e44-ba7e-b72cc7402783 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ee8274670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a30bc64-6acf-4711-b1c2-f3f6e9835274'): ({'sde'}, set())}) {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 21:29:00 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-3ca4b67a-3eee-4e44-ba7e-b72cc7402783 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Removing single pathed devices sde {{(pid=72586) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 21:29:00 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:00 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:29:00 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7d2307-884f-4770-889c-96faefa67e95]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:29:00 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:00 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:29:00 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[df366b96-ae21-443c-95c9-c0f064969f71]: (4, ('ok\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:29:00 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-3ca4b67a-3eee-4e44-ba7e-b72cc7402783 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Flushing IO for device /dev/sde {{(pid=72586) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 21:29:00 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:00 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:29:00 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[86bcadb1-b8b9-4bce-9f67-51527d2b2fd3]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:29:00 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-3ca4b67a-3eee-4e44-ba7e-b72cc7402783 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72586) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 21:29:00 user nova-compute[72586]: DEBUG nova.compute.manager [req-a581bf1d-f5ea-44ad-862e-5470abc546a5 req-f003a04a-5c4f-4ce1-8f7d-6709cd13249d service nova] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Received event network-vif-unplugged-46cc59ac-efc1-40c1-8a70-b848a9980413 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:29:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-a581bf1d-f5ea-44ad-862e-5470abc546a5 req-f003a04a-5c4f-4ce1-8f7d-6709cd13249d service nova] Acquiring lock "f9b8f9c5-0129-429d-beb6-26d4c9cc085d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:29:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-a581bf1d-f5ea-44ad-862e-5470abc546a5 req-f003a04a-5c4f-4ce1-8f7d-6709cd13249d service nova] Lock "f9b8f9c5-0129-429d-beb6-26d4c9cc085d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:29:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-a581bf1d-f5ea-44ad-862e-5470abc546a5 req-f003a04a-5c4f-4ce1-8f7d-6709cd13249d service nova] Lock "f9b8f9c5-0129-429d-beb6-26d4c9cc085d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:29:00 user nova-compute[72586]: DEBUG nova.compute.manager [req-a581bf1d-f5ea-44ad-862e-5470abc546a5 req-f003a04a-5c4f-4ce1-8f7d-6709cd13249d service nova] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] No waiting events found dispatching network-vif-unplugged-46cc59ac-efc1-40c1-8a70-b848a9980413 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:29:00 user nova-compute[72586]: WARNING nova.compute.manager [req-a581bf1d-f5ea-44ad-862e-5470abc546a5 req-f003a04a-5c4f-4ce1-8f7d-6709cd13249d service nova] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Received unexpected event network-vif-unplugged-46cc59ac-efc1-40c1-8a70-b848a9980413 for instance with vm_state active and task_state shelving.
Aug 01 21:29:00 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:00 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:29:00 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f3942b-2066-4717-a868-5b8636d68692]: (4, ('1', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:29:00 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-3ca4b67a-3eee-4e44-ba7e-b72cc7402783 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 21:29:00 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-3ca4b67a-3eee-4e44-ba7e-b72cc7402783 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] SCSI volumes sde have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 21:29:00 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca4b67a-3eee-4e44-ba7e-b72cc7402783 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a30bc64-6acf-4711-b1c2-f3f6e9835274')] {{(pid=72586) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 21:29:00 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a30bc64-6acf-4711-b1c2-f3f6e9835274 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:00 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a30bc64-6acf-4711-b1c2-f3f6e9835274 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:29:00 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c9b998-b147-488e-9a46-9c8af637610d]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:29:00 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca4b67a-3eee-4e44-ba7e-b72cc7402783 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:29:00 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-890438c5-e769-4272-800d-5f91da73a18f tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72586) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 21:29:00 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a30bc64-6acf-4711-b1c2-f3f6e9835274 -p 172.16.0.220:3260 --logout {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:00 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-890438c5-e769-4272-800d-5f91da73a18f tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 01 21:29:00 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a30bc64-6acf-4711-b1c2-f3f6e9835274 -p 172.16.0.220:3260 --logout" returned: 0 in 0.090s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:29:00 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb8f0f4-daa0-4576-8030-e9192539989d]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:0a30bc64-6acf-4711-b1c2-f3f6e9835274, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:0a30bc64-6acf-4711-b1c2-f3f6e9835274, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:29:00 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca4b67a-3eee-4e44-ba7e-b72cc7402783 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:0a30bc64-6acf-4711-b1c2-f3f6e9835274, portal: 172.16.0.220,3260]
Aug 01 21:29:00 user nova-compute[72586]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:0a30bc64-6acf-4711-b1c2-f3f6e9835274, portal: 172.16.0.220,3260] successful.
Aug 01 21:29:00 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:29:00 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a30bc64-6acf-4711-b1c2-f3f6e9835274 -p 172.16.0.220:3260 --op delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:00 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a30bc64-6acf-4711-b1c2-f3f6e9835274 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:29:00 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b10130f-5cd3-427d-905b-f6e91a8298bd]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:29:00 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca4b67a-3eee-4e44-ba7e-b72cc7402783 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:29:00 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-3ca4b67a-3eee-4e44-ba7e-b72cc7402783 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:29:00 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca4b67a-3eee-4e44-ba7e-b72cc7402783 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] <== disconnect_volume: return (341ms) None {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:29:00 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ca4b67a-3eee-4e44-ba7e-b72cc7402783 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Disconnected iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 21:29:01 user nova-compute[72586]: DEBUG nova.privsep.utils [None req-890438c5-e769-4272-800d-5f91da73a18f tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72586) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 21:29:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-890438c5-e769-4272-800d-5f91da73a18f tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpkqasu65x/276b23c6f8d94eb19eafd9751a6d897a.delta /opt/stack/data/nova/instances/snapshots/tmpkqasu65x/276b23c6f8d94eb19eafd9751a6d897a {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:01 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Instance destroyed successfully.
Aug 01 21:29:01 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-0dde2cf6-f5a8-421b-b104-1e4d2875601c tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Beginning cold snapshot process
Aug 01 21:29:01 user nova-compute[72586]: DEBUG nova.privsep.utils [None req-0dde2cf6-f5a8-421b-b104-1e4d2875601c tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72586) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 21:29:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-0dde2cf6-f5a8-421b-b104-1e4d2875601c tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/f9b8f9c5-0129-429d-beb6-26d4c9cc085d/disk /opt/stack/data/nova/instances/snapshots/tmpphc3dox0/29143f62c6914a828bd3a45ad735a2a3 {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-890438c5-e769-4272-800d-5f91da73a18f tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpkqasu65x/276b23c6f8d94eb19eafd9751a6d897a.delta /opt/stack/data/nova/instances/snapshots/tmpkqasu65x/276b23c6f8d94eb19eafd9751a6d897a" returned: 0 in 0.408s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:29:01 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-890438c5-e769-4272-800d-5f91da73a18f tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Snapshot extracted, beginning image upload
Aug 01 21:29:01 user nova-compute[72586]: DEBUG nova.objects.instance [None req-3ca4b67a-3eee-4e44-ba7e-b72cc7402783 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lazy-loading 'flavor' on Instance uuid f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:29:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3ca4b67a-3eee-4e44-ba7e-b72cc7402783 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lock "f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.519s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:29:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-0dde2cf6-f5a8-421b-b104-1e4d2875601c tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/f9b8f9c5-0129-429d-beb6-26d4c9cc085d/disk /opt/stack/data/nova/instances/snapshots/tmpphc3dox0/29143f62c6914a828bd3a45ad735a2a3" returned: 0 in 0.529s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:29:01 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-0dde2cf6-f5a8-421b-b104-1e4d2875601c tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Snapshot extracted, beginning image upload
Aug 01 21:29:02 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:29:02 user nova-compute[72586]: DEBUG nova.compute.manager [req-e78384b0-53cd-43d6-9c00-df86aaee7089 req-48ee0716-82ed-4115-8be1-a23cbeae2a36 service nova] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Received event network-vif-plugged-46cc59ac-efc1-40c1-8a70-b848a9980413 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:29:02 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-e78384b0-53cd-43d6-9c00-df86aaee7089 req-48ee0716-82ed-4115-8be1-a23cbeae2a36 service nova] Acquiring lock "f9b8f9c5-0129-429d-beb6-26d4c9cc085d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:29:02 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-e78384b0-53cd-43d6-9c00-df86aaee7089 req-48ee0716-82ed-4115-8be1-a23cbeae2a36 service nova] Lock "f9b8f9c5-0129-429d-beb6-26d4c9cc085d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:29:02 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-e78384b0-53cd-43d6-9c00-df86aaee7089 req-48ee0716-82ed-4115-8be1-a23cbeae2a36 service nova] Lock "f9b8f9c5-0129-429d-beb6-26d4c9cc085d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:29:02 user nova-compute[72586]: DEBUG nova.compute.manager [req-e78384b0-53cd-43d6-9c00-df86aaee7089 req-48ee0716-82ed-4115-8be1-a23cbeae2a36 service nova] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] No waiting events found dispatching network-vif-plugged-46cc59ac-efc1-40c1-8a70-b848a9980413 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:29:02 user nova-compute[72586]: WARNING nova.compute.manager [req-e78384b0-53cd-43d6-9c00-df86aaee7089 req-48ee0716-82ed-4115-8be1-a23cbeae2a36 service nova] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Received unexpected event network-vif-plugged-46cc59ac-efc1-40c1-8a70-b848a9980413 for instance with vm_state active and task_state shelving_image_uploading.
Aug 01 21:29:04 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:29:04 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-890438c5-e769-4272-800d-5f91da73a18f tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Snapshot image upload complete
Aug 01 21:29:04 user nova-compute[72586]: INFO nova.compute.manager [None req-890438c5-e769-4272-800d-5f91da73a18f tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Took 5.87 seconds to snapshot the instance on the hypervisor.
Aug 01 21:29:04 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-0dde2cf6-f5a8-421b-b104-1e4d2875601c tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Snapshot image upload complete
Aug 01 21:29:04 user nova-compute[72586]: DEBUG nova.compute.manager [None req-0dde2cf6-f5a8-421b-b104-1e4d2875601c tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:29:04 user nova-compute[72586]: INFO nova.compute.manager [None req-0dde2cf6-f5a8-421b-b104-1e4d2875601c tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Shelve offloading
Aug 01 21:29:04 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Instance destroyed successfully.
Aug 01 21:29:04 user nova-compute[72586]: DEBUG nova.compute.manager [None req-0dde2cf6-f5a8-421b-b104-1e4d2875601c tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:29:04 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0dde2cf6-f5a8-421b-b104-1e4d2875601c tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Acquiring lock "refresh_cache-f9b8f9c5-0129-429d-beb6-26d4c9cc085d" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:29:04 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0dde2cf6-f5a8-421b-b104-1e4d2875601c tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Acquired lock "refresh_cache-f9b8f9c5-0129-429d-beb6-26d4c9cc085d" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:29:04 user nova-compute[72586]: DEBUG nova.network.neutron [None req-0dde2cf6-f5a8-421b-b104-1e4d2875601c tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:29:05 user nova-compute[72586]: DEBUG nova.network.neutron [None req-0dde2cf6-f5a8-421b-b104-1e4d2875601c tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Updating instance_info_cache with network_info: [{"id": "46cc59ac-efc1-40c1-8a70-b848a9980413", "address": "fa:16:3e:6b:e7:10", "network": {"id": "a5da07bc-2f5d-461e-b31f-df624d9c6557", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948878141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae659e4ad43c44e2a8f6d48818bb796a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46cc59ac-ef", "ovs_interfaceid": "46cc59ac-efc1-40c1-8a70-b848a9980413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:29:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0dde2cf6-f5a8-421b-b104-1e4d2875601c tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Releasing lock "refresh_cache-f9b8f9c5-0129-429d-beb6-26d4c9cc085d" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:29:06 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Instance destroyed successfully.
Aug 01 21:29:06 user nova-compute[72586]: DEBUG nova.objects.instance [None req-0dde2cf6-f5a8-421b-b104-1e4d2875601c tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lazy-loading 'resources' on Instance uuid f9b8f9c5-0129-429d-beb6-26d4c9cc085d {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:29:06 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-0dde2cf6-f5a8-421b-b104-1e4d2875601c tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:27:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-752033639',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-752033639',id=21,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK+9xUA7KLirmjYXQN9xELNaip42kAK1K7NxqLVfWWWYEllpiSswXBraxjyOXQGON5DFb+0ISh6DPQXFXhdjXqTtRm5876SEIwEXMmgsj++30+zSSmVyL8OhHncTWDSK7g==',key_name='tempest-keypair-105460435',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:27:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ae659e4ad43c44e2a8f6d48818bb796a',ramdisk_id='',reservation_id='r-odyjetm7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1935542868',owner_user_name='tempest-AttachVolumeShelveTestJSON-1935542868-project-member',shelved_at='2023-08-01T21:29:04.869172',shelved_host='user',shelved_image_id='2871d1b3-83f8-471a-9afd-df51257b65b8'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:29:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1a0d71c79c04216b9bf278f650aeb77',uuid=f9b8f9c5-0129-429d-beb6-26d4c9cc085d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "46cc59ac-efc1-40c1-8a70-b848a9980413", "address": "fa:16:3e:6b:e7:10", "network": {"id": "a5da07bc-2f5d-461e-b31f-df624d9c6557", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948878141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae659e4ad43c44e2a8f6d48818bb796a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46cc59ac-ef", "ovs_interfaceid": "46cc59ac-efc1-40c1-8a70-b848a9980413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:29:06 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-0dde2cf6-f5a8-421b-b104-1e4d2875601c tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Converting VIF {"id": "46cc59ac-efc1-40c1-8a70-b848a9980413", "address": "fa:16:3e:6b:e7:10", "network": {"id": "a5da07bc-2f5d-461e-b31f-df624d9c6557", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948878141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae659e4ad43c44e2a8f6d48818bb796a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46cc59ac-ef", "ovs_interfaceid": "46cc59ac-efc1-40c1-8a70-b848a9980413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:29:06 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-0dde2cf6-f5a8-421b-b104-1e4d2875601c tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:e7:10,bridge_name='br-int',has_traffic_filtering=True,id=46cc59ac-efc1-40c1-8a70-b848a9980413,network=Network(a5da07bc-2f5d-461e-b31f-df624d9c6557),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46cc59ac-ef') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:29:06 user nova-compute[72586]: DEBUG os_vif [None req-0dde2cf6-f5a8-421b-b104-1e4d2875601c tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:e7:10,bridge_name='br-int',has_traffic_filtering=True,id=46cc59ac-efc1-40c1-8a70-b848a9980413,network=Network(a5da07bc-2f5d-461e-b31f-df624d9c6557),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46cc59ac-ef') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:29:06 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:29:06 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap46cc59ac-ef, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:29:06 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:29:06 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:29:06 user nova-compute[72586]: INFO os_vif [None req-0dde2cf6-f5a8-421b-b104-1e4d2875601c tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:e7:10,bridge_name='br-int',has_traffic_filtering=True,id=46cc59ac-efc1-40c1-8a70-b848a9980413,network=Network(a5da07bc-2f5d-461e-b31f-df624d9c6557),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46cc59ac-ef')
Aug 01 21:29:06 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-0dde2cf6-f5a8-421b-b104-1e4d2875601c tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Deleting instance files /opt/stack/data/nova/instances/f9b8f9c5-0129-429d-beb6-26d4c9cc085d_del
Aug 01 21:29:06 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-0dde2cf6-f5a8-421b-b104-1e4d2875601c tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Deletion of /opt/stack/data/nova/instances/f9b8f9c5-0129-429d-beb6-26d4c9cc085d_del complete
Aug 01 21:29:06 user nova-compute[72586]: DEBUG nova.compute.manager [req-45271c56-8e95-4851-abaa-961ccc98c112 req-121e6ac8-f900-4a33-bd9f-a940b2448007 service nova] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Received event network-changed-46cc59ac-efc1-40c1-8a70-b848a9980413 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:29:06 user nova-compute[72586]: DEBUG nova.compute.manager [req-45271c56-8e95-4851-abaa-961ccc98c112 req-121e6ac8-f900-4a33-bd9f-a940b2448007 service nova] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Refreshing instance network info cache due to event network-changed-46cc59ac-efc1-40c1-8a70-b848a9980413. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:29:06 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-45271c56-8e95-4851-abaa-961ccc98c112 req-121e6ac8-f900-4a33-bd9f-a940b2448007 service nova] Acquiring lock "refresh_cache-f9b8f9c5-0129-429d-beb6-26d4c9cc085d" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:29:06 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-45271c56-8e95-4851-abaa-961ccc98c112 req-121e6ac8-f900-4a33-bd9f-a940b2448007 service nova] Acquired lock "refresh_cache-f9b8f9c5-0129-429d-beb6-26d4c9cc085d" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:29:06 user nova-compute[72586]: DEBUG nova.network.neutron [req-45271c56-8e95-4851-abaa-961ccc98c112 req-121e6ac8-f900-4a33-bd9f-a940b2448007 service nova] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Refreshing network info cache for port 46cc59ac-efc1-40c1-8a70-b848a9980413 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:29:06 user nova-compute[72586]: INFO nova.scheduler.client.report [None req-0dde2cf6-f5a8-421b-b104-1e4d2875601c tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Deleted allocations for instance f9b8f9c5-0129-429d-beb6-26d4c9cc085d
Aug 01 21:29:06 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0dde2cf6-f5a8-421b-b104-1e4d2875601c tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:29:06 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0dde2cf6-f5a8-421b-b104-1e4d2875601c tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:29:06 user nova-compute[72586]: DEBUG nova.objects.instance [None req-0dde2cf6-f5a8-421b-b104-1e4d2875601c tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lazy-loading 'numa_topology' on Instance uuid f9b8f9c5-0129-429d-beb6-26d4c9cc085d {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:29:06 user nova-compute[72586]: DEBUG nova.network.neutron [req-45271c56-8e95-4851-abaa-961ccc98c112 req-121e6ac8-f900-4a33-bd9f-a940b2448007 service nova] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Updated VIF entry in instance network info cache for port 46cc59ac-efc1-40c1-8a70-b848a9980413. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:29:06 user nova-compute[72586]: DEBUG nova.network.neutron [req-45271c56-8e95-4851-abaa-961ccc98c112 req-121e6ac8-f900-4a33-bd9f-a940b2448007 service nova] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Updating instance_info_cache with network_info: [{"id": "46cc59ac-efc1-40c1-8a70-b848a9980413", "address": "fa:16:3e:6b:e7:10", "network": {"id": "a5da07bc-2f5d-461e-b31f-df624d9c6557", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-948878141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae659e4ad43c44e2a8f6d48818bb796a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap46cc59ac-ef", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:29:06 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-45271c56-8e95-4851-abaa-961ccc98c112 req-121e6ac8-f900-4a33-bd9f-a940b2448007 service nova] Releasing lock "refresh_cache-f9b8f9c5-0129-429d-beb6-26d4c9cc085d" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:29:06 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-0dde2cf6-f5a8-421b-b104-1e4d2875601c tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:29:06 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-0dde2cf6-f5a8-421b-b104-1e4d2875601c tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:29:06 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0dde2cf6-f5a8-421b-b104-1e4d2875601c tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.376s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:29:06 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0dde2cf6-f5a8-421b-b104-1e4d2875601c tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "f9b8f9c5-0129-429d-beb6-26d4c9cc085d" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.615s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:29:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-004a26bf-1041-4ebd-bdfe-aa3dbbd95755 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Acquiring lock "8c352ce2-5d08-424a-928f-2fd1cf58e491" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:29:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-004a26bf-1041-4ebd-bdfe-aa3dbbd95755 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lock "8c352ce2-5d08-424a-928f-2fd1cf58e491" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:29:10 user nova-compute[72586]: INFO nova.compute.manager [None req-004a26bf-1041-4ebd-bdfe-aa3dbbd95755 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Detaching volume b72b465b-3243-4afe-ae10-f908bc65e059
Aug 01 21:29:10 user nova-compute[72586]: INFO nova.virt.block_device [None req-004a26bf-1041-4ebd-bdfe-aa3dbbd95755 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Attempting to driver detach volume b72b465b-3243-4afe-ae10-f908bc65e059 from mountpoint /dev/vdb
Aug 01 21:29:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-7a5b283e-0051-4fd9-8a7f-770a584cd898 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Acquiring lock "8c352ce2-5d08-424a-928f-2fd1cf58e491" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:29:10 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-004a26bf-1041-4ebd-bdfe-aa3dbbd95755 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Attempting to detach device vdb from instance 8c352ce2-5d08-424a-928f-2fd1cf58e491 from the persistent domain config. {{(pid=72586) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 21:29:10 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-004a26bf-1041-4ebd-bdfe-aa3dbbd95755 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 21:29:10 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:29:10 user nova-compute[72586]:   <source dev="/dev/sdd"/>
Aug 01 21:29:10 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:29:10 user nova-compute[72586]:   <serial>b72b465b-3243-4afe-ae10-f908bc65e059</serial>
Aug 01 21:29:10 user nova-compute[72586]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 21:29:10 user nova-compute[72586]: </disk>
Aug 01 21:29:10 user nova-compute[72586]:  {{(pid=72586) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 21:29:10 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-004a26bf-1041-4ebd-bdfe-aa3dbbd95755 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Successfully detached device vdb from instance 8c352ce2-5d08-424a-928f-2fd1cf58e491 from the persistent domain config.
Aug 01 21:29:10 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-004a26bf-1041-4ebd-bdfe-aa3dbbd95755 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8c352ce2-5d08-424a-928f-2fd1cf58e491 from the live domain config. {{(pid=72586) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 21:29:10 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-004a26bf-1041-4ebd-bdfe-aa3dbbd95755 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 21:29:10 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:29:10 user nova-compute[72586]:   <source dev="/dev/sdd"/>
Aug 01 21:29:10 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:29:10 user nova-compute[72586]:   <serial>b72b465b-3243-4afe-ae10-f908bc65e059</serial>
Aug 01 21:29:10 user nova-compute[72586]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 21:29:10 user nova-compute[72586]: </disk>
Aug 01 21:29:10 user nova-compute[72586]:  {{(pid=72586) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 21:29:11 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Received event <DeviceRemovedEvent: 1690925351.158962, 8c352ce2-5d08-424a-928f-2fd1cf58e491 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72586) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 21:29:11 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-004a26bf-1041-4ebd-bdfe-aa3dbbd95755 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8c352ce2-5d08-424a-928f-2fd1cf58e491 {{(pid=72586) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 21:29:11 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-004a26bf-1041-4ebd-bdfe-aa3dbbd95755 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Successfully detached device vdb from instance 8c352ce2-5d08-424a-928f-2fd1cf58e491 from the live domain config.
Aug 01 21:29:11 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-004a26bf-1041-4ebd-bdfe-aa3dbbd95755 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] calling os-brick to detach iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 21:29:11 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-004a26bf-1041-4ebd-bdfe-aa3dbbd95755 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, {'target_iqns': ['iqn.2010-10.org.openstack:b72b465b-3243-4afe-ae10-f908bc65e059'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BrSaCTwK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:29:11 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-004a26bf-1041-4ebd-bdfe-aa3dbbd95755 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:29:11 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-004a26bf-1041-4ebd-bdfe-aa3dbbd95755 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:29:11 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-004a26bf-1041-4ebd-bdfe-aa3dbbd95755 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:29:11 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-004a26bf-1041-4ebd-bdfe-aa3dbbd95755 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b72b465b-3243-4afe-ae10-f908bc65e059', 0)] {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 21:29:11 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:11 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:29:11 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:29:11 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[88004f96-c8aa-452c-82bc-7064701983ca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b72b465b-3243-4afe-ae10-f908bc65e059\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:29:11 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:11 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:29:11 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7c4757-a8b3-4921-8325-2776f537e9d5]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b72b465b-3243-4afe-ae10-f908bc65e059 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:29:11 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-004a26bf-1041-4ebd-bdfe-aa3dbbd95755 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)
Aug 01 21:29:11 user nova-compute[72586]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)
Aug 01 21:29:11 user nova-compute[72586]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b72b465b-3243-4afe-ae10-f908bc65e059 (non-flash)
Aug 01 21:29:11 user nova-compute[72586]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:29:11 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:29:11 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-004a26bf-1041-4ebd-bdfe-aa3dbbd95755 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)
Aug 01 21:29:11 user nova-compute[72586]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)
Aug 01 21:29:11 user nova-compute[72586]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b72b465b-3243-4afe-ae10-f908bc65e059 (non-flash)
Aug 01 21:29:11 user nova-compute[72586]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:29:11 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:29:11 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-004a26bf-1041-4ebd-bdfe-aa3dbbd95755 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ef6faf250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b72b465b-3243-4afe-ae10-f908bc65e059'): ({'sdd'}, set())}) {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 21:29:11 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-004a26bf-1041-4ebd-bdfe-aa3dbbd95755 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Removing single pathed devices sdd {{(pid=72586) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 21:29:11 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:11 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:29:11 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e104037-56c7-4384-aa28-dbdaf214b0b5]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:29:11 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:11 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:29:11 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[112410a4-6e32-43fd-98c2-f581bdd73a9e]: (4, ('ok\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:29:11 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-004a26bf-1041-4ebd-bdfe-aa3dbbd95755 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Flushing IO for device /dev/sdd {{(pid=72586) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 21:29:11 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:11 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:29:11 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2405d2-22b2-4105-ba90-608ffd0e1cbb]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:29:11 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-004a26bf-1041-4ebd-bdfe-aa3dbbd95755 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72586) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 21:29:11 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:11 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:29:11 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f83725-5ad7-4b3f-bf74-a4d13c53de06]: (4, ('1', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:29:11 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-004a26bf-1041-4ebd-bdfe-aa3dbbd95755 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 21:29:11 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-004a26bf-1041-4ebd-bdfe-aa3dbbd95755 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] SCSI volumes sdd have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 21:29:11 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-004a26bf-1041-4ebd-bdfe-aa3dbbd95755 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b72b465b-3243-4afe-ae10-f908bc65e059')] {{(pid=72586) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 21:29:11 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b72b465b-3243-4afe-ae10-f908bc65e059 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:11 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b72b465b-3243-4afe-ae10-f908bc65e059 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:29:11 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[65cac930-609a-43ae-a91f-83a27baa8334]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:29:11 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-004a26bf-1041-4ebd-bdfe-aa3dbbd95755 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:29:11 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b72b465b-3243-4afe-ae10-f908bc65e059 -p 172.16.0.220:3260 --logout {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:11 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b72b465b-3243-4afe-ae10-f908bc65e059 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:29:11 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65980da-1598-4e51-bc47-b38fbb268f7f]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:b72b465b-3243-4afe-ae10-f908bc65e059, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:b72b465b-3243-4afe-ae10-f908bc65e059, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:29:11 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-004a26bf-1041-4ebd-bdfe-aa3dbbd95755 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:b72b465b-3243-4afe-ae10-f908bc65e059, portal: 172.16.0.220,3260]
Aug 01 21:29:11 user nova-compute[72586]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:b72b465b-3243-4afe-ae10-f908bc65e059, portal: 172.16.0.220,3260] successful.
Aug 01 21:29:11 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:29:11 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b72b465b-3243-4afe-ae10-f908bc65e059 -p 172.16.0.220:3260 --op delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:11 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b72b465b-3243-4afe-ae10-f908bc65e059 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:29:11 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e606cb-df8c-45ee-97da-dbb66c451abd]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:29:11 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-004a26bf-1041-4ebd-bdfe-aa3dbbd95755 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:29:11 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-004a26bf-1041-4ebd-bdfe-aa3dbbd95755 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.394s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:29:11 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-004a26bf-1041-4ebd-bdfe-aa3dbbd95755 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] <== disconnect_volume: return (396ms) None {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:29:11 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-004a26bf-1041-4ebd-bdfe-aa3dbbd95755 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Disconnected iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 21:29:12 user nova-compute[72586]: DEBUG nova.objects.instance [None req-004a26bf-1041-4ebd-bdfe-aa3dbbd95755 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lazy-loading 'flavor' on Instance uuid 8c352ce2-5d08-424a-928f-2fd1cf58e491 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:29:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-004a26bf-1041-4ebd-bdfe-aa3dbbd95755 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lock "8c352ce2-5d08-424a-928f-2fd1cf58e491" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.706s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:29:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-7a5b283e-0051-4fd9-8a7f-770a584cd898 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lock "8c352ce2-5d08-424a-928f-2fd1cf58e491" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.619s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:29:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-7a5b283e-0051-4fd9-8a7f-770a584cd898 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Acquiring lock "8c352ce2-5d08-424a-928f-2fd1cf58e491-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:29:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-7a5b283e-0051-4fd9-8a7f-770a584cd898 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lock "8c352ce2-5d08-424a-928f-2fd1cf58e491-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:29:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-7a5b283e-0051-4fd9-8a7f-770a584cd898 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lock "8c352ce2-5d08-424a-928f-2fd1cf58e491-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:29:12 user nova-compute[72586]: INFO nova.compute.manager [None req-7a5b283e-0051-4fd9-8a7f-770a584cd898 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Terminating instance
Aug 01 21:29:12 user nova-compute[72586]: DEBUG nova.compute.manager [None req-7a5b283e-0051-4fd9-8a7f-770a584cd898 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Start destroying the instance on the hypervisor. {{(pid=72586) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 21:29:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:29:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:29:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:29:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:29:12 user nova-compute[72586]: DEBUG nova.compute.manager [req-a77b3a0b-f8bc-4b50-b718-098161581ee4 req-beaf68a9-fa3d-4b2f-abe7-23a8efbe9ed8 service nova] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Received event network-vif-unplugged-8a59a718-b5fe-41d2-b057-971717d0dee6 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:29:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-a77b3a0b-f8bc-4b50-b718-098161581ee4 req-beaf68a9-fa3d-4b2f-abe7-23a8efbe9ed8 service nova] Acquiring lock "8c352ce2-5d08-424a-928f-2fd1cf58e491-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:29:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-a77b3a0b-f8bc-4b50-b718-098161581ee4 req-beaf68a9-fa3d-4b2f-abe7-23a8efbe9ed8 service nova] Lock "8c352ce2-5d08-424a-928f-2fd1cf58e491-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:29:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-a77b3a0b-f8bc-4b50-b718-098161581ee4 req-beaf68a9-fa3d-4b2f-abe7-23a8efbe9ed8 service nova] Lock "8c352ce2-5d08-424a-928f-2fd1cf58e491-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:29:12 user nova-compute[72586]: DEBUG nova.compute.manager [req-a77b3a0b-f8bc-4b50-b718-098161581ee4 req-beaf68a9-fa3d-4b2f-abe7-23a8efbe9ed8 service nova] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] No waiting events found dispatching network-vif-unplugged-8a59a718-b5fe-41d2-b057-971717d0dee6 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:29:12 user nova-compute[72586]: DEBUG nova.compute.manager [req-a77b3a0b-f8bc-4b50-b718-098161581ee4 req-beaf68a9-fa3d-4b2f-abe7-23a8efbe9ed8 service nova] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Received event network-vif-unplugged-8a59a718-b5fe-41d2-b057-971717d0dee6 for instance with task_state deleting. {{(pid=72586) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 21:29:13 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Instance destroyed successfully.
Aug 01 21:29:13 user nova-compute[72586]: DEBUG nova.objects.instance [None req-7a5b283e-0051-4fd9-8a7f-770a584cd898 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lazy-loading 'resources' on Instance uuid 8c352ce2-5d08-424a-928f-2fd1cf58e491 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:29:13 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-7a5b283e-0051-4fd9-8a7f-770a584cd898 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:26:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-909752833',display_name='tempest-VolumesSnapshotTestJSON-instance-909752833',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-909752833',id=20,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLREhLSRdrG8Gzq2uPhj+STphVmaGtK1Gu+RePBMZJqEPe7FMNXvS6iSQbBh7Z5nBK0bIXLDduFnNyt7UAlwtcP9tT/55rygAQrEwG9sK53JbxFoiiewxxlu/VBobtzY7g==',key_name='tempest-keypair-1179261345',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:26:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dfd51ad6ca4045699c8d72f9382f1c62',ramdisk_id='',reservation_id='r-eqqzd3wr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1613093006',owner_user_name='tempest-VolumesSnapshotTestJSON-1613093006-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:26:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e8daa888b0c4b8fa6e42cab3058bd4c',uuid=8c352ce2-5d08-424a-928f-2fd1cf58e491,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a59a718-b5fe-41d2-b057-971717d0dee6", "address": "fa:16:3e:52:0d:35", "network": {"id": "8e60d949-6c06-4e40-b792-d6f516b967d7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-603740209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfd51ad6ca4045699c8d72f9382f1c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a59a718-b5", "ovs_interfaceid": "8a59a718-b5fe-41d2-b057-971717d0dee6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:29:13 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-7a5b283e-0051-4fd9-8a7f-770a584cd898 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Converting VIF {"id": "8a59a718-b5fe-41d2-b057-971717d0dee6", "address": "fa:16:3e:52:0d:35", "network": {"id": "8e60d949-6c06-4e40-b792-d6f516b967d7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-603740209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfd51ad6ca4045699c8d72f9382f1c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a59a718-b5", "ovs_interfaceid": "8a59a718-b5fe-41d2-b057-971717d0dee6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:29:13 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-7a5b283e-0051-4fd9-8a7f-770a584cd898 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:52:0d:35,bridge_name='br-int',has_traffic_filtering=True,id=8a59a718-b5fe-41d2-b057-971717d0dee6,network=Network(8e60d949-6c06-4e40-b792-d6f516b967d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a59a718-b5') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:29:13 user nova-compute[72586]: DEBUG os_vif [None req-7a5b283e-0051-4fd9-8a7f-770a584cd898 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:0d:35,bridge_name='br-int',has_traffic_filtering=True,id=8a59a718-b5fe-41d2-b057-971717d0dee6,network=Network(8e60d949-6c06-4e40-b792-d6f516b967d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a59a718-b5') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:29:13 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:29:13 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a59a718-b5, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:29:13 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:29:13 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:29:13 user nova-compute[72586]: INFO os_vif [None req-7a5b283e-0051-4fd9-8a7f-770a584cd898 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:0d:35,bridge_name='br-int',has_traffic_filtering=True,id=8a59a718-b5fe-41d2-b057-971717d0dee6,network=Network(8e60d949-6c06-4e40-b792-d6f516b967d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a59a718-b5')
Aug 01 21:29:13 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a5b283e-0051-4fd9-8a7f-770a584cd898 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] calling os-brick to detach iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 21:29:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a5b283e-0051-4fd9-8a7f-770a584cd898 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, {'target_iqns': ['iqn.2010-10.org.openstack:b72b465b-3243-4afe-ae10-f908bc65e059'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BrSaCTwK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:29:13 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-7a5b283e-0051-4fd9-8a7f-770a584cd898 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:29:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-7a5b283e-0051-4fd9-8a7f-770a584cd898 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:29:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-7a5b283e-0051-4fd9-8a7f-770a584cd898 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:29:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a5b283e-0051-4fd9-8a7f-770a584cd898 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b72b465b-3243-4afe-ae10-f908bc65e059', 0)] {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 21:29:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:29:13 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[140f63b0-9aa8-4598-bf03-c2fa878723ec]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:29:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:29:13 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1862f6dd-226f-4973-8bdd-a225e935d50b]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:29:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a5b283e-0051-4fd9-8a7f-770a584cd898 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)
Aug 01 21:29:13 user nova-compute[72586]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)
Aug 01 21:29:13 user nova-compute[72586]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:29:13 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:29:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a5b283e-0051-4fd9-8a7f-770a584cd898 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)
Aug 01 21:29:13 user nova-compute[72586]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)
Aug 01 21:29:13 user nova-compute[72586]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:29:13 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:29:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a5b283e-0051-4fd9-8a7f-770a584cd898 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ed03ad1b0>, {}) {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 21:29:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a5b283e-0051-4fd9-8a7f-770a584cd898 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Disconnecting from: [] {{(pid=72586) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 21:29:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-7a5b283e-0051-4fd9-8a7f-770a584cd898 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.052s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:29:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a5b283e-0051-4fd9-8a7f-770a584cd898 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] <== disconnect_volume: return (53ms) None {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:29:13 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a5b283e-0051-4fd9-8a7f-770a584cd898 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Disconnected iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 21:29:13 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-7a5b283e-0051-4fd9-8a7f-770a584cd898 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Deleting instance files /opt/stack/data/nova/instances/8c352ce2-5d08-424a-928f-2fd1cf58e491_del
Aug 01 21:29:13 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-7a5b283e-0051-4fd9-8a7f-770a584cd898 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Deletion of /opt/stack/data/nova/instances/8c352ce2-5d08-424a-928f-2fd1cf58e491_del complete
Aug 01 21:29:13 user nova-compute[72586]: INFO nova.compute.manager [None req-7a5b283e-0051-4fd9-8a7f-770a584cd898 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 01 21:29:13 user nova-compute[72586]: DEBUG oslo.service.loopingcall [None req-7a5b283e-0051-4fd9-8a7f-770a584cd898 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72586) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 21:29:13 user nova-compute[72586]: DEBUG nova.compute.manager [-] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Deallocating network for instance {{(pid=72586) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 21:29:13 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] deallocate_for_instance() {{(pid=72586) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 21:29:14 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:29:14 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:29:14 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Took 1.32 seconds to deallocate network for instance.
Aug 01 21:29:14 user nova-compute[72586]: DEBUG nova.compute.manager [req-8641085f-e851-4548-9d11-727587f8e6e5 req-718053e4-18a4-4cc7-9e7c-9ba912e58064 service nova] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Received event network-vif-deleted-8a59a718-b5fe-41d2-b057-971717d0dee6 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:29:14 user nova-compute[72586]: WARNING nova.volume.cinder [None req-7a5b283e-0051-4fd9-8a7f-770a584cd898 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Attachment 9c8b1ce8-c7e2-4dd0-a3a2-b1c41b127ca3 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 9c8b1ce8-c7e2-4dd0-a3a2-b1c41b127ca3. (HTTP 404) (Request-ID: req-56d75489-deea-4df6-aeff-c02273c9381b)
Aug 01 21:29:14 user nova-compute[72586]: INFO nova.compute.manager [None req-7a5b283e-0051-4fd9-8a7f-770a584cd898 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Took 0.02 seconds to detach 1 volumes for instance.
Aug 01 21:29:14 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-7a5b283e-0051-4fd9-8a7f-770a584cd898 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:29:14 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-7a5b283e-0051-4fd9-8a7f-770a584cd898 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:29:14 user nova-compute[72586]: DEBUG nova.compute.manager [req-1ae1b71c-b8e5-4dca-916f-e385eefaa829 req-b8915313-bfb1-4a65-8c5d-96875c388ed3 service nova] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Received event network-vif-plugged-8a59a718-b5fe-41d2-b057-971717d0dee6 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:29:14 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-1ae1b71c-b8e5-4dca-916f-e385eefaa829 req-b8915313-bfb1-4a65-8c5d-96875c388ed3 service nova] Acquiring lock "8c352ce2-5d08-424a-928f-2fd1cf58e491-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:29:14 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-1ae1b71c-b8e5-4dca-916f-e385eefaa829 req-b8915313-bfb1-4a65-8c5d-96875c388ed3 service nova] Lock "8c352ce2-5d08-424a-928f-2fd1cf58e491-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:29:14 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-1ae1b71c-b8e5-4dca-916f-e385eefaa829 req-b8915313-bfb1-4a65-8c5d-96875c388ed3 service nova] Lock "8c352ce2-5d08-424a-928f-2fd1cf58e491-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:29:14 user nova-compute[72586]: DEBUG nova.compute.manager [req-1ae1b71c-b8e5-4dca-916f-e385eefaa829 req-b8915313-bfb1-4a65-8c5d-96875c388ed3 service nova] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] No waiting events found dispatching network-vif-plugged-8a59a718-b5fe-41d2-b057-971717d0dee6 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:29:14 user nova-compute[72586]: WARNING nova.compute.manager [req-1ae1b71c-b8e5-4dca-916f-e385eefaa829 req-b8915313-bfb1-4a65-8c5d-96875c388ed3 service nova] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Received unexpected event network-vif-plugged-8a59a718-b5fe-41d2-b057-971717d0dee6 for instance with vm_state deleted and task_state None.
Aug 01 21:29:14 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-7a5b283e-0051-4fd9-8a7f-770a584cd898 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:29:14 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-7a5b283e-0051-4fd9-8a7f-770a584cd898 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:29:14 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-7a5b283e-0051-4fd9-8a7f-770a584cd898 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.328s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:29:15 user nova-compute[72586]: INFO nova.scheduler.client.report [None req-7a5b283e-0051-4fd9-8a7f-770a584cd898 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Deleted allocations for instance 8c352ce2-5d08-424a-928f-2fd1cf58e491
Aug 01 21:29:15 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-7a5b283e-0051-4fd9-8a7f-770a584cd898 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lock "8c352ce2-5d08-424a-928f-2fd1cf58e491" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.760s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:29:16 user nova-compute[72586]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690925341.0471218, f9b8f9c5-0129-429d-beb6-26d4c9cc085d => Stopped> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:29:16 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] VM Stopped (Lifecycle Event)
Aug 01 21:29:16 user nova-compute[72586]: DEBUG nova.compute.manager [None req-ea106fe2-7c8a-4003-830e-15a8bbdde288 None None] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:29:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:29:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:29:22 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:29:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:29:24 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:29:24 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:29:24 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:29:24 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:29:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:29:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:29:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:29:25 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Auditing locally available compute resources for user (node: user) {{(pid=72586) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 21:29:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:29:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:29:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:29:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:29:25 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:29:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadba691-ab8a-4e25-864f-3211ef71872f/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadba691-ab8a-4e25-864f-3211ef71872f/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:29:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadba691-ab8a-4e25-864f-3211ef71872f/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadba691-ab8a-4e25-864f-3211ef71872f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:29:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:29:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:29:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:29:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:29:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51eb56c-bce2-4593-abc3-878c358c9a74/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51eb56c-bce2-4593-abc3-878c358c9a74/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:29:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51eb56c-bce2-4593-abc3-878c358c9a74/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51eb56c-bce2-4593-abc3-878c358c9a74/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:29:27 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:29:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51eb56c-bce2-4593-abc3-878c358c9a74/disk.rescue --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51eb56c-bce2-4593-abc3-878c358c9a74/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:29:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51eb56c-bce2-4593-abc3-878c358c9a74/disk.rescue --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51eb56c-bce2-4593-abc3-878c358c9a74/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:29:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b0d907-2515-4a06-8b35-9ddd09ce42c3/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b0d907-2515-4a06-8b35-9ddd09ce42c3/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:29:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b0d907-2515-4a06-8b35-9ddd09ce42c3/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b0d907-2515-4a06-8b35-9ddd09ce42c3/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:29:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:29:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:29:27 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:29:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.rescue --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:28 user nova-compute[72586]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690925353.0666425, 8c352ce2-5d08-424a-928f-2fd1cf58e491 => Stopped> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:29:28 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] VM Stopped (Lifecycle Event)
Aug 01 21:29:28 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5c602d1a-dc63-4729-89bc-f6802de5c8ca None None] [instance: 8c352ce2-5d08-424a-928f-2fd1cf58e491] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:29:28 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:29:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:29:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.rescue --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:29:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:29:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:29:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09571c9f-bf42-475a-afac-0e3947168d7e/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09571c9f-bf42-475a-afac-0e3947168d7e/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:29:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09571c9f-bf42-475a-afac-0e3947168d7e/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09571c9f-bf42-475a-afac-0e3947168d7e/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:29:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:29:29 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:29:29 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:29:29 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Hypervisor/Node resource view: name=user free_ram=7105MB free_disk=25.206111907958984GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72586) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 21:29:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:29:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:29:29 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Applying migration context for instance c3798403-855b-45e4-af48-ba6b62570dba as it has an incoming, in-progress migration bedc08a7-a4ac-435e-91db-43271e345055. Migration status is finished {{(pid=72586) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 01 21:29:29 user nova-compute[72586]: INFO nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Updating resource usage from migration bedc08a7-a4ac-435e-91db-43271e345055
Aug 01 21:29:29 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 042f0031-1e4d-41d0-8bfa-36001675cfe3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:29:29 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 413c3426-18ad-4a5c-af04-e0e7fc90f050 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:29:29 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 49c24c77-f102-4aed-8314-b04aad5f6b3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:29:29 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance d51eb56c-bce2-4593-abc3-878c358c9a74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:29:29 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:29:29 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance af2de810-b22f-4fa9-835c-c673abd145db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:29:29 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance f6b0d907-2515-4a06-8b35-9ddd09ce42c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:29:29 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance dadba691-ab8a-4e25-864f-3211ef71872f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:29:29 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 09571c9f-bf42-475a-afac-0e3947168d7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:29:29 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Migration bedc08a7-a4ac-435e-91db-43271e345055 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 01 21:29:29 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance c3798403-855b-45e4-af48-ba6b62570dba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:29:29 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 21:29:29 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 21:29:29 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:29:29 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:29:29 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Compute_service record updated for user:user {{(pid=72586) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 21:29:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.505s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:29:30 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:29:30 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Starting heal instance info cache {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 21:29:31 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "refresh_cache-49c24c77-f102-4aed-8314-b04aad5f6b3a" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:29:31 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquired lock "refresh_cache-49c24c77-f102-4aed-8314-b04aad5f6b3a" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:29:31 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Forcefully refreshing network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 21:29:31 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Updating instance_info_cache with network_info: [{"id": "99688c7a-3e71-49d8-9002-0075560858c9", "address": "fa:16:3e:8a:03:a7", "network": {"id": "aab9a541-2149-4c65-b60e-80a1daca6632", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1355256264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19af48ffce7e4703b6d978bc3563680e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99688c7a-3e", "ovs_interfaceid": "99688c7a-3e71-49d8-9002-0075560858c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:29:31 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Releasing lock "refresh_cache-49c24c77-f102-4aed-8314-b04aad5f6b3a" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:29:31 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Updated the network info_cache for instance {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 21:29:31 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:29:31 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:29:31 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:29:31 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:29:31 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72586) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 21:29:33 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:29:34 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:29:38 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:29:43 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:29:48 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:29:48 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:29:48 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72586) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 21:29:48 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72586) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 21:29:48 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72586) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 21:29:48 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:29:50 user nova-compute[72586]: DEBUG nova.compute.manager [req-f5988357-fc19-4649-8602-713f913f0ff7 req-bba6181a-9432-4a8d-b483-3ac9981112df service nova] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Received event network-changed-440ca7d3-e2b8-4edf-9339-bd8d247d5da2 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:29:50 user nova-compute[72586]: DEBUG nova.compute.manager [req-f5988357-fc19-4649-8602-713f913f0ff7 req-bba6181a-9432-4a8d-b483-3ac9981112df service nova] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Refreshing instance network info cache due to event network-changed-440ca7d3-e2b8-4edf-9339-bd8d247d5da2. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:29:50 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-f5988357-fc19-4649-8602-713f913f0ff7 req-bba6181a-9432-4a8d-b483-3ac9981112df service nova] Acquiring lock "refresh_cache-f6b0d907-2515-4a06-8b35-9ddd09ce42c3" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:29:50 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-f5988357-fc19-4649-8602-713f913f0ff7 req-bba6181a-9432-4a8d-b483-3ac9981112df service nova] Acquired lock "refresh_cache-f6b0d907-2515-4a06-8b35-9ddd09ce42c3" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:29:50 user nova-compute[72586]: DEBUG nova.network.neutron [req-f5988357-fc19-4649-8602-713f913f0ff7 req-bba6181a-9432-4a8d-b483-3ac9981112df service nova] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Refreshing network info cache for port 440ca7d3-e2b8-4edf-9339-bd8d247d5da2 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:29:50 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3f5943d5-485a-4e42-b1a8-e155aa91b2e3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Acquiring lock "f6b0d907-2515-4a06-8b35-9ddd09ce42c3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:29:50 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3f5943d5-485a-4e42-b1a8-e155aa91b2e3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "f6b0d907-2515-4a06-8b35-9ddd09ce42c3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:29:50 user nova-compute[72586]: DEBUG nova.objects.instance [None req-3f5943d5-485a-4e42-b1a8-e155aa91b2e3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lazy-loading 'flavor' on Instance uuid f6b0d907-2515-4a06-8b35-9ddd09ce42c3 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:29:50 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3f5943d5-485a-4e42-b1a8-e155aa91b2e3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "f6b0d907-2515-4a06-8b35-9ddd09ce42c3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:29:50 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3f5943d5-485a-4e42-b1a8-e155aa91b2e3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Acquiring lock "f6b0d907-2515-4a06-8b35-9ddd09ce42c3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:29:50 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3f5943d5-485a-4e42-b1a8-e155aa91b2e3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "f6b0d907-2515-4a06-8b35-9ddd09ce42c3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:29:50 user nova-compute[72586]: INFO nova.compute.manager [None req-3f5943d5-485a-4e42-b1a8-e155aa91b2e3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Attaching volume 0f09b89d-693e-44b6-902b-f51e81d20b36 to /dev/vdb
Aug 01 21:29:50 user nova-compute[72586]: DEBUG os_brick.utils [None req-3f5943d5-485a-4e42-b1a8-e155aa91b2e3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:29:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:29:50 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[98fa3ae8-22ee-4e15-b224-c03cf0a6c1c4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4bc202fb9cb\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:29:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:50 user nova-compute[72586]: DEBUG nova.network.neutron [req-f5988357-fc19-4649-8602-713f913f0ff7 req-bba6181a-9432-4a8d-b483-3ac9981112df service nova] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Updated VIF entry in instance network info cache for port 440ca7d3-e2b8-4edf-9339-bd8d247d5da2. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:29:50 user nova-compute[72586]: DEBUG nova.network.neutron [req-f5988357-fc19-4649-8602-713f913f0ff7 req-bba6181a-9432-4a8d-b483-3ac9981112df service nova] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Updating instance_info_cache with network_info: [{"id": "440ca7d3-e2b8-4edf-9339-bd8d247d5da2", "address": "fa:16:3e:29:ff:63", "network": {"id": "d229a8de-7a2b-4dcd-a9ac-44a40349676e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-67691992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b1a1d82f39347119a9fb49fb8e8893f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap440ca7d3-e2", "ovs_interfaceid": "440ca7d3-e2b8-4edf-9339-bd8d247d5da2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:29:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:29:50 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1267cb-8f08-4ee7-bec8-338426078f62]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:29:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:50 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-f5988357-fc19-4649-8602-713f913f0ff7 req-bba6181a-9432-4a8d-b483-3ac9981112df service nova] Releasing lock "refresh_cache-f6b0d907-2515-4a06-8b35-9ddd09ce42c3" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:29:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:29:50 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ced7c1f-d779-44a7-a5bc-38a7fcf6d49f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:29:50 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3efe23-d481-4874-b8b9-08dd86ddb3b4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:29:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-3f5943d5-485a-4e42-b1a8-e155aa91b2e3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Running cmd (subprocess): nvme version {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-3f5943d5-485a-4e42-b1a8-e155aa91b2e3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] 'nvme version' failed. Not Retrying. {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:29:50 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3f5943d5-485a-4e42-b1a8-e155aa91b2e3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] nvme not present on system {{(pid=72586) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 21:29:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:29:50 user nova-compute[72586]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 21:29:50 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4feeee-d9fc-488d-9c73-df495c7717c9]: (4, '') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:29:50 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-3f5943d5-485a-4e42-b1a8-e155aa91b2e3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72586) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 21:29:50 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-3f5943d5-485a-4e42-b1a8-e155aa91b2e3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 21:29:50 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-3f5943d5-485a-4e42-b1a8-e155aa91b2e3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] LIGHTOS: no hostnqn found. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 21:29:50 user nova-compute[72586]: DEBUG os_brick.utils [None req-3f5943d5-485a-4e42-b1a8-e155aa91b2e3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4bc202fb9cb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:29:50 user nova-compute[72586]: DEBUG nova.virt.block_device [None req-3f5943d5-485a-4e42-b1a8-e155aa91b2e3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Updating existing volume attachment record: 3d82fb2b-bbbe-41d2-b45e-627aa64e9159 {{(pid=72586) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 21:29:53 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:29:53 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-05fcff29-dd35-4a00-9e07-5e48e49453dc tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Acquiring lock "f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:29:53 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-05fcff29-dd35-4a00-9e07-5e48e49453dc tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lock "f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:29:53 user nova-compute[72586]: DEBUG nova.objects.instance [None req-05fcff29-dd35-4a00-9e07-5e48e49453dc tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lazy-loading 'flavor' on Instance uuid f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:29:53 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-05fcff29-dd35-4a00-9e07-5e48e49453dc tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lock "f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:29:53 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-05fcff29-dd35-4a00-9e07-5e48e49453dc tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Acquiring lock "f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:29:53 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-05fcff29-dd35-4a00-9e07-5e48e49453dc tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lock "f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:29:53 user nova-compute[72586]: INFO nova.compute.manager [None req-05fcff29-dd35-4a00-9e07-5e48e49453dc tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Attaching volume 8bde7cdf-ea31-422a-b4b7-b0d07eee208a to /dev/vdb
Aug 01 21:29:53 user nova-compute[72586]: DEBUG os_brick.utils [None req-05fcff29-dd35-4a00-9e07-5e48e49453dc tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:29:53 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:53 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:29:53 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c7f094-c4b1-4cf6-981b-fa2dce862c74]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4bc202fb9cb\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:29:53 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:53 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:29:53 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9263af-02db-4286-81e2-389d14127178]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:29:53 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:53 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:29:53 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aeb5967-a249-4a95-83aa-3c59f4d9eecb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:29:53 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a2d1ef-f8ab-458d-b0be-0a2a30029e2a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:29:53 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-05fcff29-dd35-4a00-9e07-5e48e49453dc tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Running cmd (subprocess): nvme version {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:53 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-05fcff29-dd35-4a00-9e07-5e48e49453dc tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] 'nvme version' failed. Not Retrying. {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:29:53 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.nvmeof [None req-05fcff29-dd35-4a00-9e07-5e48e49453dc tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] nvme not present on system {{(pid=72586) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 21:29:53 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:53 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:29:53 user nova-compute[72586]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 21:29:53 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8cd8980-a684-4e93-8c39-4fda3eb87b64]: (4, '') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:29:53 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-05fcff29-dd35-4a00-9e07-5e48e49453dc tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72586) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 21:29:53 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-05fcff29-dd35-4a00-9e07-5e48e49453dc tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 21:29:53 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-05fcff29-dd35-4a00-9e07-5e48e49453dc tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] LIGHTOS: no hostnqn found. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 21:29:53 user nova-compute[72586]: DEBUG os_brick.utils [None req-05fcff29-dd35-4a00-9e07-5e48e49453dc tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4bc202fb9cb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:29:53 user nova-compute[72586]: DEBUG nova.virt.block_device [None req-05fcff29-dd35-4a00-9e07-5e48e49453dc tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Updating existing volume attachment record: 682cc38e-933c-4165-8bb3-31975305e698 {{(pid=72586) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 21:29:54 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:29:58 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:29:58 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f5943d5-485a-4e42-b1a8-e155aa91b2e3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Calling os-brick to attach iSCSI Volume {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 21:29:58 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f5943d5-485a-4e42-b1a8-e155aa91b2e3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iLyYtsdO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:29:58 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-3f5943d5-485a-4e42-b1a8-e155aa91b2e3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:29:58 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-3f5943d5-485a-4e42-b1a8-e155aa91b2e3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:29:58 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-3f5943d5-485a-4e42-b1a8-e155aa91b2e3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:29:58 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-3f5943d5-485a-4e42-b1a8-e155aa91b2e3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:29:58 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-3f5943d5-485a-4e42-b1a8-e155aa91b2e3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:29:58 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-3f5943d5-485a-4e42-b1a8-e155aa91b2e3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:29:58 user nova-compute[72586]: INFO os_brick.initiator.connectors.iscsi [None req-3f5943d5-485a-4e42-b1a8-e155aa91b2e3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 21:29:58 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 -p 172.16.0.220:3260 {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:58 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:29:58 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ddc50b-0b87-4245-9e58-0eb7d3732d66]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:29:58 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f5943d5-485a-4e42-b1a8-e155aa91b2e3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 21:29:58 user nova-compute[72586]:  {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:29:58 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 -p 172.16.0.220:3260 --interface default --op new {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:58 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:29:58 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5205e6-75e2-43b1-894b-6cc871441b9c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36] added\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:29:58 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f5943d5-485a-4e42-b1a8-e155aa91b2e3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36] added
Aug 01 21:29:58 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:29:58 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:58 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:29:58 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[28233c76-5355-4b23-be61-874fd3cf61e3]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:29:58 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f5943d5-485a-4e42-b1a8-e155aa91b2e3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:29:58 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:58 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:29:58 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[245ab5c7-8402-46fb-95c8-4dc01d1e40c9]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:29:58 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f5943d5-485a-4e42-b1a8-e155aa91b2e3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:29:58 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iLyYtsdO {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:58 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iLyYtsdO" returned: 0 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:29:58 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d1fdb1-a944-4fff-b19c-e2a75ee52a0f]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:29:58 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f5943d5-485a-4e42-b1a8-e155aa91b2e3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iLyYtsdO'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:29:58 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:58 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:29:58 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f152a85d-4b22-4e0e-b82c-59e6fe670f57]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:29:58 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f5943d5-485a-4e42-b1a8-e155aa91b2e3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:29:58 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:58 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:29:58 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c93e9b2-5d73-4117-b644-9e41b45442c8]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:29:58 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f5943d5-485a-4e42-b1a8-e155aa91b2e3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)
Aug 01 21:29:58 user nova-compute[72586]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)
Aug 01 21:29:58 user nova-compute[72586]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:29:58 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:29:58 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f5943d5-485a-4e42-b1a8-e155aa91b2e3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)
Aug 01 21:29:58 user nova-compute[72586]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)
Aug 01 21:29:58 user nova-compute[72586]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:29:58 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:29:58 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 -p 172.16.0.220:3260 --login {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:58 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:29:58 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1784f00c-6b03-4878-b583-a1f0d273ceb9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:29:58 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f5943d5-485a-4e42-b1a8-e155aa91b2e3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36, portal: 172.16.0.220,3260]
Aug 01 21:29:58 user nova-compute[72586]: Login to [iface: default, target: iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36, portal: 172.16.0.220,3260] successful.
Aug 01 21:29:58 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:29:58 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:58 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:29:58 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[490e2c75-6613-4e38-ba28-7abe6d01ddc5]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:29:58 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f5943d5-485a-4e42-b1a8-e155aa91b2e3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:29:58 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:58 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:29:58 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb19cee-6864-4344-b75d-66502af6e039]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:29:58 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f5943d5-485a-4e42-b1a8-e155aa91b2e3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)
Aug 01 21:29:58 user nova-compute[72586]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)
Aug 01 21:29:58 user nova-compute[72586]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:29:58 user nova-compute[72586]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)
Aug 01 21:29:58 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:29:58 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f5943d5-485a-4e42-b1a8-e155aa91b2e3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)
Aug 01 21:29:58 user nova-compute[72586]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)
Aug 01 21:29:58 user nova-compute[72586]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:29:58 user nova-compute[72586]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)
Aug 01 21:29:58 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:29:58 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-3f5943d5-485a-4e42-b1a8-e155aa91b2e3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:29:58 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f5943d5-485a-4e42-b1a8-e155aa91b2e3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Connected to 172.16.0.220:3260 {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 21:29:58 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-3f5943d5-485a-4e42-b1a8-e155aa91b2e3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] HCTL ('35', '-', '-', 0) found on session 26 with lun 0 {{(pid=72586) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 21:29:58 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-3f5943d5-485a-4e42-b1a8-e155aa91b2e3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72586) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 21:29:58 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:29:58 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:29:58 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b7ff1c-9f9e-4b4e-adcc-4d9010690353]: (4, ('- - 0', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:29:58 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-3f5943d5-485a-4e42-b1a8-e155aa91b2e3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:29:58 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f5943d5-485a-4e42-b1a8-e155aa91b2e3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iLyYtsdO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 21:29:59 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:29:59 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-3f5943d5-485a-4e42-b1a8-e155aa91b2e3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:29:59 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f5943d5-485a-4e42-b1a8-e155aa91b2e3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '23564643664333036', 'path': '/dev/sdd'} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:29:59 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f5943d5-485a-4e42-b1a8-e155aa91b2e3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564643664333036', 'path': '/dev/sdd'} {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 21:29:59 user nova-compute[72586]: DEBUG nova.objects.instance [None req-3f5943d5-485a-4e42-b1a8-e155aa91b2e3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lazy-loading 'flavor' on Instance uuid f6b0d907-2515-4a06-8b35-9ddd09ce42c3 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:29:59 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-3f5943d5-485a-4e42-b1a8-e155aa91b2e3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 21:29:59 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:29:59 user nova-compute[72586]:   <source dev="/dev/sdd"/>
Aug 01 21:29:59 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:29:59 user nova-compute[72586]:   <serial>0f09b89d-693e-44b6-902b-f51e81d20b36</serial>
Aug 01 21:29:59 user nova-compute[72586]: </disk>
Aug 01 21:29:59 user nova-compute[72586]:  {{(pid=72586) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 21:29:59 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3f5943d5-485a-4e42-b1a8-e155aa91b2e3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:29:59 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3f5943d5-485a-4e42-b1a8-e155aa91b2e3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:29:59 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3f5943d5-485a-4e42-b1a8-e155aa91b2e3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] No VIF found with MAC fa:16:3e:29:ff:63, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:30:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3f5943d5-485a-4e42-b1a8-e155aa91b2e3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "f6b0d907-2515-4a06-8b35-9ddd09ce42c3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.547s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:30:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-7543150f-92d7-4656-8887-e3e806dea3e7 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Acquiring lock "dadba691-ab8a-4e25-864f-3211ef71872f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:30:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-7543150f-92d7-4656-8887-e3e806dea3e7 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Lock "dadba691-ab8a-4e25-864f-3211ef71872f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:30:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-7543150f-92d7-4656-8887-e3e806dea3e7 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Acquiring lock "dadba691-ab8a-4e25-864f-3211ef71872f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:30:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-7543150f-92d7-4656-8887-e3e806dea3e7 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Lock "dadba691-ab8a-4e25-864f-3211ef71872f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:30:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-7543150f-92d7-4656-8887-e3e806dea3e7 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Lock "dadba691-ab8a-4e25-864f-3211ef71872f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:30:00 user nova-compute[72586]: INFO nova.compute.manager [None req-7543150f-92d7-4656-8887-e3e806dea3e7 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] Terminating instance
Aug 01 21:30:00 user nova-compute[72586]: DEBUG nova.compute.manager [None req-7543150f-92d7-4656-8887-e3e806dea3e7 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] Start destroying the instance on the hypervisor. {{(pid=72586) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 21:30:00 user nova-compute[72586]: INFO nova.compute.manager [None req-d40aff19-4368-4afc-835a-804b115146da tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Rescuing
Aug 01 21:30:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-d40aff19-4368-4afc-835a-804b115146da tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Acquiring lock "refresh_cache-f6b0d907-2515-4a06-8b35-9ddd09ce42c3" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:30:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-d40aff19-4368-4afc-835a-804b115146da tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Acquired lock "refresh_cache-f6b0d907-2515-4a06-8b35-9ddd09ce42c3" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:30:00 user nova-compute[72586]: DEBUG nova.network.neutron [None req-d40aff19-4368-4afc-835a-804b115146da tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:30:00 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:00 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:00 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:00 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:00 user nova-compute[72586]: DEBUG nova.compute.manager [req-8625fa8e-be25-4721-bf50-18311a568a6e req-e1225d6c-9d09-4e67-ad8b-2d2394ee35b3 service nova] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] Received event network-vif-unplugged-843d4e65-1f9e-44d6-a5b6-fba488393eea {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:30:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-8625fa8e-be25-4721-bf50-18311a568a6e req-e1225d6c-9d09-4e67-ad8b-2d2394ee35b3 service nova] Acquiring lock "dadba691-ab8a-4e25-864f-3211ef71872f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:30:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-8625fa8e-be25-4721-bf50-18311a568a6e req-e1225d6c-9d09-4e67-ad8b-2d2394ee35b3 service nova] Lock "dadba691-ab8a-4e25-864f-3211ef71872f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:30:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-8625fa8e-be25-4721-bf50-18311a568a6e req-e1225d6c-9d09-4e67-ad8b-2d2394ee35b3 service nova] Lock "dadba691-ab8a-4e25-864f-3211ef71872f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:30:00 user nova-compute[72586]: DEBUG nova.compute.manager [req-8625fa8e-be25-4721-bf50-18311a568a6e req-e1225d6c-9d09-4e67-ad8b-2d2394ee35b3 service nova] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] No waiting events found dispatching network-vif-unplugged-843d4e65-1f9e-44d6-a5b6-fba488393eea {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:30:00 user nova-compute[72586]: DEBUG nova.compute.manager [req-8625fa8e-be25-4721-bf50-18311a568a6e req-e1225d6c-9d09-4e67-ad8b-2d2394ee35b3 service nova] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] Received event network-vif-unplugged-843d4e65-1f9e-44d6-a5b6-fba488393eea for instance with task_state deleting. {{(pid=72586) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 21:30:00 user nova-compute[72586]: DEBUG nova.network.neutron [None req-d40aff19-4368-4afc-835a-804b115146da tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Updating instance_info_cache with network_info: [{"id": "440ca7d3-e2b8-4edf-9339-bd8d247d5da2", "address": "fa:16:3e:29:ff:63", "network": {"id": "d229a8de-7a2b-4dcd-a9ac-44a40349676e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-67691992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b1a1d82f39347119a9fb49fb8e8893f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap440ca7d3-e2", "ovs_interfaceid": "440ca7d3-e2b8-4edf-9339-bd8d247d5da2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:30:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-d40aff19-4368-4afc-835a-804b115146da tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Releasing lock "refresh_cache-f6b0d907-2515-4a06-8b35-9ddd09ce42c3" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:01 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] Instance destroyed successfully.
Aug 01 21:30:01 user nova-compute[72586]: DEBUG nova.objects.instance [None req-7543150f-92d7-4656-8887-e3e806dea3e7 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Lazy-loading 'resources' on Instance uuid dadba691-ab8a-4e25-864f-3211ef71872f {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-7543150f-92d7-4656-8887-e3e806dea3e7 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:28:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-957025856',display_name='tempest-VolumesActionsTest-instance-957025856',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-957025856',id=24,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:28:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='724b3e26f64c47b8bb521981a4c5ff94',ramdisk_id='',reservation_id='r-ifzhznlr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-647755296',owner_user_name='tempest-VolumesActionsTest-647755296-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:28:17Z,user_data=None,user_id='5038f09f5e404c28bca02fc1ecb485b3',uuid=dadba691-ab8a-4e25-864f-3211ef71872f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "843d4e65-1f9e-44d6-a5b6-fba488393eea", "address": "fa:16:3e:21:84:10", "network": {"id": "6aa30f19-4fe9-497b-a1cd-9279113f1153", "bridge": "br-int", "label": "tempest-VolumesActionsTest-513072853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "724b3e26f64c47b8bb521981a4c5ff94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap843d4e65-1f", "ovs_interfaceid": "843d4e65-1f9e-44d6-a5b6-fba488393eea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-7543150f-92d7-4656-8887-e3e806dea3e7 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Converting VIF {"id": "843d4e65-1f9e-44d6-a5b6-fba488393eea", "address": "fa:16:3e:21:84:10", "network": {"id": "6aa30f19-4fe9-497b-a1cd-9279113f1153", "bridge": "br-int", "label": "tempest-VolumesActionsTest-513072853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "724b3e26f64c47b8bb521981a4c5ff94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap843d4e65-1f", "ovs_interfaceid": "843d4e65-1f9e-44d6-a5b6-fba488393eea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-7543150f-92d7-4656-8887-e3e806dea3e7 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:84:10,bridge_name='br-int',has_traffic_filtering=True,id=843d4e65-1f9e-44d6-a5b6-fba488393eea,network=Network(6aa30f19-4fe9-497b-a1cd-9279113f1153),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap843d4e65-1f') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG os_vif [None req-7543150f-92d7-4656-8887-e3e806dea3e7 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:84:10,bridge_name='br-int',has_traffic_filtering=True,id=843d4e65-1f9e-44d6-a5b6-fba488393eea,network=Network(6aa30f19-4fe9-497b-a1cd-9279113f1153),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap843d4e65-1f') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap843d4e65-1f, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:01 user nova-compute[72586]: INFO os_vif [None req-7543150f-92d7-4656-8887-e3e806dea3e7 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:84:10,bridge_name='br-int',has_traffic_filtering=True,id=843d4e65-1f9e-44d6-a5b6-fba488393eea,network=Network(6aa30f19-4fe9-497b-a1cd-9279113f1153),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap843d4e65-1f')
Aug 01 21:30:01 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-7543150f-92d7-4656-8887-e3e806dea3e7 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] Deleting instance files /opt/stack/data/nova/instances/dadba691-ab8a-4e25-864f-3211ef71872f_del
Aug 01 21:30:01 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-7543150f-92d7-4656-8887-e3e806dea3e7 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] Deletion of /opt/stack/data/nova/instances/dadba691-ab8a-4e25-864f-3211ef71872f_del complete
Aug 01 21:30:01 user nova-compute[72586]: DEBUG nova.compute.manager [req-dd329c83-033a-482b-9e30-5289a040e1c2 req-393051df-cd50-45bc-9e2b-e62f5cbb85fb service nova] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Received event network-vif-unplugged-440ca7d3-e2b8-4edf-9339-bd8d247d5da2 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-dd329c83-033a-482b-9e30-5289a040e1c2 req-393051df-cd50-45bc-9e2b-e62f5cbb85fb service nova] Acquiring lock "f6b0d907-2515-4a06-8b35-9ddd09ce42c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-dd329c83-033a-482b-9e30-5289a040e1c2 req-393051df-cd50-45bc-9e2b-e62f5cbb85fb service nova] Lock "f6b0d907-2515-4a06-8b35-9ddd09ce42c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-dd329c83-033a-482b-9e30-5289a040e1c2 req-393051df-cd50-45bc-9e2b-e62f5cbb85fb service nova] Lock "f6b0d907-2515-4a06-8b35-9ddd09ce42c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG nova.compute.manager [req-dd329c83-033a-482b-9e30-5289a040e1c2 req-393051df-cd50-45bc-9e2b-e62f5cbb85fb service nova] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] No waiting events found dispatching network-vif-unplugged-440ca7d3-e2b8-4edf-9339-bd8d247d5da2 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:30:01 user nova-compute[72586]: WARNING nova.compute.manager [req-dd329c83-033a-482b-9e30-5289a040e1c2 req-393051df-cd50-45bc-9e2b-e62f5cbb85fb service nova] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Received unexpected event network-vif-unplugged-440ca7d3-e2b8-4edf-9339-bd8d247d5da2 for instance with vm_state active and task_state rescuing.
Aug 01 21:30:01 user nova-compute[72586]: INFO nova.compute.manager [None req-7543150f-92d7-4656-8887-e3e806dea3e7 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 01 21:30:01 user nova-compute[72586]: DEBUG oslo.service.loopingcall [None req-7543150f-92d7-4656-8887-e3e806dea3e7 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72586) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG nova.compute.manager [-] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] Deallocating network for instance {{(pid=72586) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] deallocate_for_instance() {{(pid=72586) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05fcff29-dd35-4a00-9e07-5e48e49453dc tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Calling os-brick to attach iSCSI Volume {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-05fcff29-dd35-4a00-9e07-5e48e49453dc tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8bde7cdf-ea31-422a-b4b7-b0d07eee208a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gneqBfLC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:30:01 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-05fcff29-dd35-4a00-9e07-5e48e49453dc tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:30:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-05fcff29-dd35-4a00-9e07-5e48e49453dc tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-05fcff29-dd35-4a00-9e07-5e48e49453dc tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:30:01 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-05fcff29-dd35-4a00-9e07-5e48e49453dc tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:30:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-05fcff29-dd35-4a00-9e07-5e48e49453dc tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8bde7cdf-ea31-422a-b4b7-b0d07eee208a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-05fcff29-dd35-4a00-9e07-5e48e49453dc tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8bde7cdf-ea31-422a-b4b7-b0d07eee208a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:30:01 user nova-compute[72586]: INFO os_brick.initiator.connectors.iscsi [None req-05fcff29-dd35-4a00-9e07-5e48e49453dc tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 21:30:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bde7cdf-ea31-422a-b4b7-b0d07eee208a -p 172.16.0.220:3260 {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bde7cdf-ea31-422a-b4b7-b0d07eee208a -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[81efb3fa-a286-421e-8bf6-56d69268c35d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-05fcff29-dd35-4a00-9e07-5e48e49453dc tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 21:30:01 user nova-compute[72586]:  {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bde7cdf-ea31-422a-b4b7-b0d07eee208a -p 172.16.0.220:3260 --interface default --op new {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bde7cdf-ea31-422a-b4b7-b0d07eee208a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[14377d39-9429-4b2b-a16d-e573ef2cb343]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8bde7cdf-ea31-422a-b4b7-b0d07eee208a] added\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-05fcff29-dd35-4a00-9e07-5e48e49453dc tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8bde7cdf-ea31-422a-b4b7-b0d07eee208a] added
Aug 01 21:30:01 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bde7cdf-ea31-422a-b4b7-b0d07eee208a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bde7cdf-ea31-422a-b4b7-b0d07eee208a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f31303-4190-4e05-832d-4d0e48555bda]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-05fcff29-dd35-4a00-9e07-5e48e49453dc tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bde7cdf-ea31-422a-b4b7-b0d07eee208a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bde7cdf-ea31-422a-b4b7-b0d07eee208a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[6183f186-8e85-4f0a-b2ec-f7518a9866d1]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-05fcff29-dd35-4a00-9e07-5e48e49453dc tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bde7cdf-ea31-422a-b4b7-b0d07eee208a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gneqBfLC {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bde7cdf-ea31-422a-b4b7-b0d07eee208a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gneqBfLC" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[6881fc7e-fc19-4ac3-9d66-ce777168720a]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-05fcff29-dd35-4a00-9e07-5e48e49453dc tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gneqBfLC'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bde7cdf-ea31-422a-b4b7-b0d07eee208a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bde7cdf-ea31-422a-b4b7-b0d07eee208a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc38359-fd93-4399-abd6-09f0a6fe9e83]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-05fcff29-dd35-4a00-9e07-5e48e49453dc tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2093ee-db05-40ca-8631-c62ecd65d85f]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-05fcff29-dd35-4a00-9e07-5e48e49453dc tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)
Aug 01 21:30:01 user nova-compute[72586]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)
Aug 01 21:30:01 user nova-compute[72586]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:30:01 user nova-compute[72586]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)
Aug 01 21:30:01 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-05fcff29-dd35-4a00-9e07-5e48e49453dc tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)
Aug 01 21:30:01 user nova-compute[72586]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)
Aug 01 21:30:01 user nova-compute[72586]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:30:01 user nova-compute[72586]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)
Aug 01 21:30:01 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bde7cdf-ea31-422a-b4b7-b0d07eee208a -p 172.16.0.220:3260 --login {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bde7cdf-ea31-422a-b4b7-b0d07eee208a -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae9fb0b-f710-4ee1-a649-0e2ee4112c05]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8bde7cdf-ea31-422a-b4b7-b0d07eee208a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8bde7cdf-ea31-422a-b4b7-b0d07eee208a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-05fcff29-dd35-4a00-9e07-5e48e49453dc tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8bde7cdf-ea31-422a-b4b7-b0d07eee208a, portal: 172.16.0.220,3260]
Aug 01 21:30:01 user nova-compute[72586]: Login to [iface: default, target: iqn.2010-10.org.openstack:8bde7cdf-ea31-422a-b4b7-b0d07eee208a, portal: 172.16.0.220,3260] successful.
Aug 01 21:30:01 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bde7cdf-ea31-422a-b4b7-b0d07eee208a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bde7cdf-ea31-422a-b4b7-b0d07eee208a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d4f46b-4ffc-44dc-b23b-1c44514667bd]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-05fcff29-dd35-4a00-9e07-5e48e49453dc tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9abd1d7e-4320-41cf-9183-28c75ad40b3e]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bde7cdf-ea31-422a-b4b7-b0d07eee208a (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-05fcff29-dd35-4a00-9e07-5e48e49453dc tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)
Aug 01 21:30:01 user nova-compute[72586]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)
Aug 01 21:30:01 user nova-compute[72586]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:30:01 user nova-compute[72586]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)
Aug 01 21:30:01 user nova-compute[72586]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bde7cdf-ea31-422a-b4b7-b0d07eee208a (non-flash)
Aug 01 21:30:01 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-05fcff29-dd35-4a00-9e07-5e48e49453dc tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)
Aug 01 21:30:01 user nova-compute[72586]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)
Aug 01 21:30:01 user nova-compute[72586]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:30:01 user nova-compute[72586]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)
Aug 01 21:30:01 user nova-compute[72586]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bde7cdf-ea31-422a-b4b7-b0d07eee208a (non-flash)
Aug 01 21:30:01 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-05fcff29-dd35-4a00-9e07-5e48e49453dc tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8bde7cdf-ea31-422a-b4b7-b0d07eee208a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-05fcff29-dd35-4a00-9e07-5e48e49453dc tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Connected to 172.16.0.220:3260 {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-05fcff29-dd35-4a00-9e07-5e48e49453dc tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] HCTL ('36', '-', '-', 0) found on session 27 with lun 0 {{(pid=72586) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-05fcff29-dd35-4a00-9e07-5e48e49453dc tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72586) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[656f6113-353b-45a7-b54a-c516e47be8c8]: (4, ('- - 0', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-05fcff29-dd35-4a00-9e07-5e48e49453dc tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: None {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:30:01 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Instance destroyed successfully.
Aug 01 21:30:01 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-d40aff19-4368-4afc-835a-804b115146da tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Attempting rescue
Aug 01 21:30:01 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-d40aff19-4368-4afc-835a-804b115146da tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72586) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-d40aff19-4368-4afc-835a-804b115146da tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Instance directory exists: not creating {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 01 21:30:01 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-d40aff19-4368-4afc-835a-804b115146da tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Creating image(s)
Aug 01 21:30:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-d40aff19-4368-4afc-835a-804b115146da tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Acquiring lock "/opt/stack/data/nova/instances/f6b0d907-2515-4a06-8b35-9ddd09ce42c3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-d40aff19-4368-4afc-835a-804b115146da tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "/opt/stack/data/nova/instances/f6b0d907-2515-4a06-8b35-9ddd09ce42c3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-d40aff19-4368-4afc-835a-804b115146da tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "/opt/stack/data/nova/instances/f6b0d907-2515-4a06-8b35-9ddd09ce42c3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG nova.objects.instance [None req-d40aff19-4368-4afc-835a-804b115146da tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lazy-loading 'trusted_certs' on Instance uuid f6b0d907-2515-4a06-8b35-9ddd09ce42c3 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-d40aff19-4368-4afc-835a-804b115146da tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Acquiring lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-d40aff19-4368-4afc-835a-804b115146da tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:30:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-d40aff19-4368-4afc-835a-804b115146da tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:02 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-d40aff19-4368-4afc-835a-804b115146da tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.237s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:02 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-d40aff19-4368-4afc-835a-804b115146da tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/f6b0d907-2515-4a06-8b35-9ddd09ce42c3/disk.rescue {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:02 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-d40aff19-4368-4afc-835a-804b115146da tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/f6b0d907-2515-4a06-8b35-9ddd09ce42c3/disk.rescue" returned: 0 in 0.069s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:02 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-d40aff19-4368-4afc-835a-804b115146da tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.314s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:30:02 user nova-compute[72586]: DEBUG nova.objects.instance [None req-d40aff19-4368-4afc-835a-804b115146da tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lazy-loading 'migration_context' on Instance uuid f6b0d907-2515-4a06-8b35-9ddd09ce42c3 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:30:02 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:30:02 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-d40aff19-4368-4afc-835a-804b115146da tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Created local disks {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 21:30:02 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-d40aff19-4368-4afc-835a-804b115146da tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Start _get_guest_xml network_info=[{"id": "440ca7d3-e2b8-4edf-9339-bd8d247d5da2", "address": "fa:16:3e:29:ff:63", "network": {"id": "d229a8de-7a2b-4dcd-a9ac-44a40349676e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-67691992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-67691992-network", "vif_mac": "fa:16:3e:29:ff:63"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b1a1d82f39347119a9fb49fb8e8893f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap440ca7d3-e2", "ovs_interfaceid": "440ca7d3-e2b8-4edf-9339-bd8d247d5da2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '0243d46b-6819-42a5-926f-42b71f0c97ad', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:30:02 user nova-compute[72586]: DEBUG nova.objects.instance [None req-d40aff19-4368-4afc-835a-804b115146da tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lazy-loading 'resources' on Instance uuid f6b0d907-2515-4a06-8b35-9ddd09ce42c3 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:30:02 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] Took 0.88 seconds to deallocate network for instance.
Aug 01 21:30:02 user nova-compute[72586]: DEBUG nova.objects.instance [None req-d40aff19-4368-4afc-835a-804b115146da tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lazy-loading 'numa_topology' on Instance uuid f6b0d907-2515-4a06-8b35-9ddd09ce42c3 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:30:02 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-d40aff19-4368-4afc-835a-804b115146da tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:30:02 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-d40aff19-4368-4afc-835a-804b115146da tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:30:02 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-d40aff19-4368-4afc-835a-804b115146da tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:30:02 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-d40aff19-4368-4afc-835a-804b115146da tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:30:02 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-d40aff19-4368-4afc-835a-804b115146da tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:30:02 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-d40aff19-4368-4afc-835a-804b115146da tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:30:02 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-d40aff19-4368-4afc-835a-804b115146da tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:30:02 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-d40aff19-4368-4afc-835a-804b115146da tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:30:02 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-d40aff19-4368-4afc-835a-804b115146da tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:30:02 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-d40aff19-4368-4afc-835a-804b115146da tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:30:02 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-d40aff19-4368-4afc-835a-804b115146da tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:30:02 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-d40aff19-4368-4afc-835a-804b115146da tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:30:02 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-d40aff19-4368-4afc-835a-804b115146da tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:30:02 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-d40aff19-4368-4afc-835a-804b115146da tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:30:02 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-d40aff19-4368-4afc-835a-804b115146da tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:30:02 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-d40aff19-4368-4afc-835a-804b115146da tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:30:02 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-d40aff19-4368-4afc-835a-804b115146da tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:30:02 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-d40aff19-4368-4afc-835a-804b115146da tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:30:02 user nova-compute[72586]: DEBUG nova.objects.instance [None req-d40aff19-4368-4afc-835a-804b115146da tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lazy-loading 'vcpu_model' on Instance uuid f6b0d907-2515-4a06-8b35-9ddd09ce42c3 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:30:02 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-d40aff19-4368-4afc-835a-804b115146da tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:27:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-688014459',display_name='tempest-ServerRescueNegativeTestJSON-server-688014459',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-688014459',id=23,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPKVtErVvQRkpUoC6JoyLuD25FsEWnNM1f53ch2eGXiYFeVUn5ceQanDKFKTGkUOLx9VSoczBggOQHVsTSmyYFizYDPlFPaBAzypHmYYYVCv8QrT9lMXmW/v7nzGDV6aQ==',key_name='tempest-keypair-266379112',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:28:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5b1a1d82f39347119a9fb49fb8e8893f',ramdisk_id='',reservation_id='r-kcmrdcc1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1258600061',owner_user_name='tempest-ServerRescueNegativeTestJSON-1258600061-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:28:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f678ac8999a42c4a383ee8b2976b4cc',uuid=f6b0d907-2515-4a06-8b35-9ddd09ce42c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "440ca7d3-e2b8-4edf-9339-bd8d247d5da2", "address": "fa:16:3e:29:ff:63", "network": {"id": "d229a8de-7a2b-4dcd-a9ac-44a40349676e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-67691992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-67691992-network", "vif_mac": "fa:16:3e:29:ff:63"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b1a1d82f39347119a9fb49fb8e8893f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap440ca7d3-e2", "ovs_interfaceid": "440ca7d3-e2b8-4edf-9339-bd8d247d5da2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:30:02 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-d40aff19-4368-4afc-835a-804b115146da tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Converting VIF {"id": "440ca7d3-e2b8-4edf-9339-bd8d247d5da2", "address": "fa:16:3e:29:ff:63", "network": {"id": "d229a8de-7a2b-4dcd-a9ac-44a40349676e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-67691992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-67691992-network", "vif_mac": "fa:16:3e:29:ff:63"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b1a1d82f39347119a9fb49fb8e8893f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap440ca7d3-e2", "ovs_interfaceid": "440ca7d3-e2b8-4edf-9339-bd8d247d5da2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:30:02 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-d40aff19-4368-4afc-835a-804b115146da tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:29:ff:63,bridge_name='br-int',has_traffic_filtering=True,id=440ca7d3-e2b8-4edf-9339-bd8d247d5da2,network=Network(d229a8de-7a2b-4dcd-a9ac-44a40349676e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap440ca7d3-e2') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:30:02 user nova-compute[72586]: DEBUG nova.objects.instance [None req-d40aff19-4368-4afc-835a-804b115146da tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lazy-loading 'pci_devices' on Instance uuid f6b0d907-2515-4a06-8b35-9ddd09ce42c3 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:30:02 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-7543150f-92d7-4656-8887-e3e806dea3e7 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:30:02 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-7543150f-92d7-4656-8887-e3e806dea3e7 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:30:02 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-d40aff19-4368-4afc-835a-804b115146da tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:30:02 user nova-compute[72586]:   <uuid>f6b0d907-2515-4a06-8b35-9ddd09ce42c3</uuid>
Aug 01 21:30:02 user nova-compute[72586]:   <name>instance-00000017</name>
Aug 01 21:30:02 user nova-compute[72586]:   <memory>524288</memory>
Aug 01 21:30:02 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:30:02 user nova-compute[72586]:   <metadata>
Aug 01 21:30:02 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:30:02 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:30:02 user nova-compute[72586]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-688014459</nova:name>
Aug 01 21:30:02 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:30:02</nova:creationTime>
Aug 01 21:30:02 user nova-compute[72586]:       <nova:flavor name="m1.tiny">
Aug 01 21:30:02 user nova-compute[72586]:         <nova:memory>512</nova:memory>
Aug 01 21:30:02 user nova-compute[72586]:         <nova:disk>1</nova:disk>
Aug 01 21:30:02 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:30:02 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:30:02 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:30:02 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:30:02 user nova-compute[72586]:       <nova:owner>
Aug 01 21:30:02 user nova-compute[72586]:         <nova:user uuid="0f678ac8999a42c4a383ee8b2976b4cc">tempest-ServerRescueNegativeTestJSON-1258600061-project-member</nova:user>
Aug 01 21:30:02 user nova-compute[72586]:         <nova:project uuid="5b1a1d82f39347119a9fb49fb8e8893f">tempest-ServerRescueNegativeTestJSON-1258600061</nova:project>
Aug 01 21:30:02 user nova-compute[72586]:       </nova:owner>
Aug 01 21:30:02 user nova-compute[72586]:       <nova:root type="image" uuid="0243d46b-6819-42a5-926f-42b71f0c97ad"/>
Aug 01 21:30:02 user nova-compute[72586]:       <nova:ports>
Aug 01 21:30:02 user nova-compute[72586]:         <nova:port uuid="440ca7d3-e2b8-4edf-9339-bd8d247d5da2">
Aug 01 21:30:02 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 01 21:30:02 user nova-compute[72586]:         </nova:port>
Aug 01 21:30:02 user nova-compute[72586]:       </nova:ports>
Aug 01 21:30:02 user nova-compute[72586]:     </nova:instance>
Aug 01 21:30:02 user nova-compute[72586]:   </metadata>
Aug 01 21:30:02 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:30:02 user nova-compute[72586]:     <system>
Aug 01 21:30:02 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:30:02 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:30:02 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:30:02 user nova-compute[72586]:       <entry name="serial">f6b0d907-2515-4a06-8b35-9ddd09ce42c3</entry>
Aug 01 21:30:02 user nova-compute[72586]:       <entry name="uuid">f6b0d907-2515-4a06-8b35-9ddd09ce42c3</entry>
Aug 01 21:30:02 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:30:02 user nova-compute[72586]:     </system>
Aug 01 21:30:02 user nova-compute[72586]:   </sysinfo>
Aug 01 21:30:02 user nova-compute[72586]:   <os>
Aug 01 21:30:02 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:30:02 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:30:02 user nova-compute[72586]:   </os>
Aug 01 21:30:02 user nova-compute[72586]:   <features>
Aug 01 21:30:02 user nova-compute[72586]:     <acpi/>
Aug 01 21:30:02 user nova-compute[72586]:     <apic/>
Aug 01 21:30:02 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:30:02 user nova-compute[72586]:   </features>
Aug 01 21:30:02 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:30:02 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:30:02 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:30:02 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:30:02 user nova-compute[72586]:   </clock>
Aug 01 21:30:02 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:30:02 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:30:02 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:30:02 user nova-compute[72586]:   </cpu>
Aug 01 21:30:02 user nova-compute[72586]:   <devices>
Aug 01 21:30:02 user nova-compute[72586]:     <disk type="file" device="disk">
Aug 01 21:30:02 user nova-compute[72586]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 21:30:02 user nova-compute[72586]:       <source file="/opt/stack/data/nova/instances/f6b0d907-2515-4a06-8b35-9ddd09ce42c3/disk.rescue"/>
Aug 01 21:30:02 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:30:02 user nova-compute[72586]:     </disk>
Aug 01 21:30:02 user nova-compute[72586]:     <disk type="file" device="disk">
Aug 01 21:30:02 user nova-compute[72586]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 21:30:02 user nova-compute[72586]:       <source file="/opt/stack/data/nova/instances/f6b0d907-2515-4a06-8b35-9ddd09ce42c3/disk"/>
Aug 01 21:30:02 user nova-compute[72586]:       <target dev="vdb" bus="virtio"/>
Aug 01 21:30:02 user nova-compute[72586]:     </disk>
Aug 01 21:30:02 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:30:02 user nova-compute[72586]:       <mac address="fa:16:3e:29:ff:63"/>
Aug 01 21:30:02 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:30:02 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:30:02 user nova-compute[72586]:       <target dev="tap440ca7d3-e2"/>
Aug 01 21:30:02 user nova-compute[72586]:     </interface>
Aug 01 21:30:02 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:30:02 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/f6b0d907-2515-4a06-8b35-9ddd09ce42c3/console.log" append="off"/>
Aug 01 21:30:02 user nova-compute[72586]:     </serial>
Aug 01 21:30:02 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:30:02 user nova-compute[72586]:     <video>
Aug 01 21:30:02 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:30:02 user nova-compute[72586]:     </video>
Aug 01 21:30:02 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:30:02 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:30:02 user nova-compute[72586]:     </rng>
Aug 01 21:30:02 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:30:02 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:30:02 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:30:02 user nova-compute[72586]:     </memballoon>
Aug 01 21:30:02 user nova-compute[72586]:   </devices>
Aug 01 21:30:02 user nova-compute[72586]: </domain>
Aug 01 21:30:02 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:30:02 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Instance destroyed successfully.
Aug 01 21:30:02 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-d40aff19-4368-4afc-835a-804b115146da tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:30:02 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-d40aff19-4368-4afc-835a-804b115146da tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:30:02 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-d40aff19-4368-4afc-835a-804b115146da tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] No VIF found with MAC fa:16:3e:29:ff:63, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:30:02 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-7543150f-92d7-4656-8887-e3e806dea3e7 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:30:02 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-7543150f-92d7-4656-8887-e3e806dea3e7 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:30:02 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-05fcff29-dd35-4a00-9e07-5e48e49453dc tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:30:02 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-05fcff29-dd35-4a00-9e07-5e48e49453dc tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gneqBfLC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 21:30:02 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-05fcff29-dd35-4a00-9e07-5e48e49453dc tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:30:02 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-05fcff29-dd35-4a00-9e07-5e48e49453dc tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '23165613438656261', 'path': '/dev/sde'} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:30:02 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05fcff29-dd35-4a00-9e07-5e48e49453dc tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165613438656261', 'path': '/dev/sde'} {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 21:30:02 user nova-compute[72586]: DEBUG nova.objects.instance [None req-05fcff29-dd35-4a00-9e07-5e48e49453dc tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lazy-loading 'flavor' on Instance uuid f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:30:02 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-7543150f-92d7-4656-8887-e3e806dea3e7 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.449s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:30:02 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-05fcff29-dd35-4a00-9e07-5e48e49453dc tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 21:30:02 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:30:02 user nova-compute[72586]:   <source dev="/dev/sde"/>
Aug 01 21:30:02 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:30:02 user nova-compute[72586]:   <serial>8bde7cdf-ea31-422a-b4b7-b0d07eee208a</serial>
Aug 01 21:30:02 user nova-compute[72586]: </disk>
Aug 01 21:30:02 user nova-compute[72586]:  {{(pid=72586) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 21:30:02 user nova-compute[72586]: INFO nova.scheduler.client.report [None req-7543150f-92d7-4656-8887-e3e806dea3e7 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Deleted allocations for instance dadba691-ab8a-4e25-864f-3211ef71872f
Aug 01 21:30:02 user nova-compute[72586]: DEBUG nova.compute.manager [req-44b0e9b7-f6b0-4c87-b8e2-cd3391e6b71d req-5bbbf181-fda4-44f2-a949-ed70413e261b service nova] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] Received event network-vif-plugged-843d4e65-1f9e-44d6-a5b6-fba488393eea {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:30:02 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-44b0e9b7-f6b0-4c87-b8e2-cd3391e6b71d req-5bbbf181-fda4-44f2-a949-ed70413e261b service nova] Acquiring lock "dadba691-ab8a-4e25-864f-3211ef71872f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:30:02 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-44b0e9b7-f6b0-4c87-b8e2-cd3391e6b71d req-5bbbf181-fda4-44f2-a949-ed70413e261b service nova] Lock "dadba691-ab8a-4e25-864f-3211ef71872f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:30:02 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-44b0e9b7-f6b0-4c87-b8e2-cd3391e6b71d req-5bbbf181-fda4-44f2-a949-ed70413e261b service nova] Lock "dadba691-ab8a-4e25-864f-3211ef71872f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:30:02 user nova-compute[72586]: DEBUG nova.compute.manager [req-44b0e9b7-f6b0-4c87-b8e2-cd3391e6b71d req-5bbbf181-fda4-44f2-a949-ed70413e261b service nova] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] No waiting events found dispatching network-vif-plugged-843d4e65-1f9e-44d6-a5b6-fba488393eea {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:30:02 user nova-compute[72586]: WARNING nova.compute.manager [req-44b0e9b7-f6b0-4c87-b8e2-cd3391e6b71d req-5bbbf181-fda4-44f2-a949-ed70413e261b service nova] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] Received unexpected event network-vif-plugged-843d4e65-1f9e-44d6-a5b6-fba488393eea for instance with vm_state deleted and task_state None.
Aug 01 21:30:02 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-7543150f-92d7-4656-8887-e3e806dea3e7 tempest-VolumesActionsTest-647755296 tempest-VolumesActionsTest-647755296-project-member] Lock "dadba691-ab8a-4e25-864f-3211ef71872f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.603s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:30:03 user nova-compute[72586]: DEBUG nova.compute.manager [req-ab725e77-de2a-4c1a-8291-fb41804f52f9 req-91caece8-d32d-42af-9980-f6bad5c22d0d service nova] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Received event network-vif-plugged-440ca7d3-e2b8-4edf-9339-bd8d247d5da2 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:30:03 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ab725e77-de2a-4c1a-8291-fb41804f52f9 req-91caece8-d32d-42af-9980-f6bad5c22d0d service nova] Acquiring lock "f6b0d907-2515-4a06-8b35-9ddd09ce42c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:30:03 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ab725e77-de2a-4c1a-8291-fb41804f52f9 req-91caece8-d32d-42af-9980-f6bad5c22d0d service nova] Lock "f6b0d907-2515-4a06-8b35-9ddd09ce42c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:30:03 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ab725e77-de2a-4c1a-8291-fb41804f52f9 req-91caece8-d32d-42af-9980-f6bad5c22d0d service nova] Lock "f6b0d907-2515-4a06-8b35-9ddd09ce42c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:30:03 user nova-compute[72586]: DEBUG nova.compute.manager [req-ab725e77-de2a-4c1a-8291-fb41804f52f9 req-91caece8-d32d-42af-9980-f6bad5c22d0d service nova] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] No waiting events found dispatching network-vif-plugged-440ca7d3-e2b8-4edf-9339-bd8d247d5da2 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:30:03 user nova-compute[72586]: WARNING nova.compute.manager [req-ab725e77-de2a-4c1a-8291-fb41804f52f9 req-91caece8-d32d-42af-9980-f6bad5c22d0d service nova] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Received unexpected event network-vif-plugged-440ca7d3-e2b8-4edf-9339-bd8d247d5da2 for instance with vm_state active and task_state rescuing.
Aug 01 21:30:03 user nova-compute[72586]: DEBUG nova.compute.manager [req-ab725e77-de2a-4c1a-8291-fb41804f52f9 req-91caece8-d32d-42af-9980-f6bad5c22d0d service nova] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] Received event network-vif-deleted-843d4e65-1f9e-44d6-a5b6-fba488393eea {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:30:03 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-05fcff29-dd35-4a00-9e07-5e48e49453dc tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:30:03 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-05fcff29-dd35-4a00-9e07-5e48e49453dc tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:30:03 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-05fcff29-dd35-4a00-9e07-5e48e49453dc tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] No VIF found with MAC fa:16:3e:ac:44:36, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:30:04 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-05fcff29-dd35-4a00-9e07-5e48e49453dc tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lock "f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.670s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:30:04 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:04 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:04 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:04 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:04 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:04 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:05 user nova-compute[72586]: DEBUG nova.compute.manager [req-75fc8fd2-24ae-4427-9381-736a3cac9fde req-3a508a51-a30b-45e8-953f-bdc08324ac9a service nova] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Received event network-vif-plugged-440ca7d3-e2b8-4edf-9339-bd8d247d5da2 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:30:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-75fc8fd2-24ae-4427-9381-736a3cac9fde req-3a508a51-a30b-45e8-953f-bdc08324ac9a service nova] Acquiring lock "f6b0d907-2515-4a06-8b35-9ddd09ce42c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:30:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-75fc8fd2-24ae-4427-9381-736a3cac9fde req-3a508a51-a30b-45e8-953f-bdc08324ac9a service nova] Lock "f6b0d907-2515-4a06-8b35-9ddd09ce42c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:30:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-75fc8fd2-24ae-4427-9381-736a3cac9fde req-3a508a51-a30b-45e8-953f-bdc08324ac9a service nova] Lock "f6b0d907-2515-4a06-8b35-9ddd09ce42c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:30:05 user nova-compute[72586]: DEBUG nova.compute.manager [req-75fc8fd2-24ae-4427-9381-736a3cac9fde req-3a508a51-a30b-45e8-953f-bdc08324ac9a service nova] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] No waiting events found dispatching network-vif-plugged-440ca7d3-e2b8-4edf-9339-bd8d247d5da2 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:30:05 user nova-compute[72586]: WARNING nova.compute.manager [req-75fc8fd2-24ae-4427-9381-736a3cac9fde req-3a508a51-a30b-45e8-953f-bdc08324ac9a service nova] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Received unexpected event network-vif-plugged-440ca7d3-e2b8-4edf-9339-bd8d247d5da2 for instance with vm_state active and task_state rescuing.
Aug 01 21:30:05 user nova-compute[72586]: DEBUG nova.compute.manager [req-75fc8fd2-24ae-4427-9381-736a3cac9fde req-3a508a51-a30b-45e8-953f-bdc08324ac9a service nova] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Received event network-vif-plugged-440ca7d3-e2b8-4edf-9339-bd8d247d5da2 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:30:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-75fc8fd2-24ae-4427-9381-736a3cac9fde req-3a508a51-a30b-45e8-953f-bdc08324ac9a service nova] Acquiring lock "f6b0d907-2515-4a06-8b35-9ddd09ce42c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:30:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-75fc8fd2-24ae-4427-9381-736a3cac9fde req-3a508a51-a30b-45e8-953f-bdc08324ac9a service nova] Lock "f6b0d907-2515-4a06-8b35-9ddd09ce42c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:30:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-75fc8fd2-24ae-4427-9381-736a3cac9fde req-3a508a51-a30b-45e8-953f-bdc08324ac9a service nova] Lock "f6b0d907-2515-4a06-8b35-9ddd09ce42c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:30:05 user nova-compute[72586]: DEBUG nova.compute.manager [req-75fc8fd2-24ae-4427-9381-736a3cac9fde req-3a508a51-a30b-45e8-953f-bdc08324ac9a service nova] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] No waiting events found dispatching network-vif-plugged-440ca7d3-e2b8-4edf-9339-bd8d247d5da2 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:30:05 user nova-compute[72586]: WARNING nova.compute.manager [req-75fc8fd2-24ae-4427-9381-736a3cac9fde req-3a508a51-a30b-45e8-953f-bdc08324ac9a service nova] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Received unexpected event network-vif-plugged-440ca7d3-e2b8-4edf-9339-bd8d247d5da2 for instance with vm_state active and task_state rescuing.
Aug 01 21:30:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1fd6f529-526d-44bc-9c5b-26669fe0277e tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Acquiring lock "f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:30:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1fd6f529-526d-44bc-9c5b-26669fe0277e tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lock "f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:30:05 user nova-compute[72586]: INFO nova.compute.manager [None req-1fd6f529-526d-44bc-9c5b-26669fe0277e tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Detaching volume 8bde7cdf-ea31-422a-b4b7-b0d07eee208a
Aug 01 21:30:05 user nova-compute[72586]: INFO nova.virt.block_device [None req-1fd6f529-526d-44bc-9c5b-26669fe0277e tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Attempting to driver detach volume 8bde7cdf-ea31-422a-b4b7-b0d07eee208a from mountpoint /dev/vdb
Aug 01 21:30:05 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-1fd6f529-526d-44bc-9c5b-26669fe0277e tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Attempting to detach device vdb from instance f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536 from the persistent domain config. {{(pid=72586) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 21:30:05 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-1fd6f529-526d-44bc-9c5b-26669fe0277e tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 21:30:05 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:30:05 user nova-compute[72586]:   <source dev="/dev/sde"/>
Aug 01 21:30:05 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:30:05 user nova-compute[72586]:   <serial>8bde7cdf-ea31-422a-b4b7-b0d07eee208a</serial>
Aug 01 21:30:05 user nova-compute[72586]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 21:30:05 user nova-compute[72586]: </disk>
Aug 01 21:30:05 user nova-compute[72586]:  {{(pid=72586) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 21:30:05 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-1fd6f529-526d-44bc-9c5b-26669fe0277e tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Successfully detached device vdb from instance f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536 from the persistent domain config.
Aug 01 21:30:05 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-1fd6f529-526d-44bc-9c5b-26669fe0277e tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536 from the live domain config. {{(pid=72586) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 21:30:05 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-1fd6f529-526d-44bc-9c5b-26669fe0277e tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 21:30:05 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:30:05 user nova-compute[72586]:   <source dev="/dev/sde"/>
Aug 01 21:30:05 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:30:05 user nova-compute[72586]:   <serial>8bde7cdf-ea31-422a-b4b7-b0d07eee208a</serial>
Aug 01 21:30:05 user nova-compute[72586]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 21:30:05 user nova-compute[72586]: </disk>
Aug 01 21:30:05 user nova-compute[72586]:  {{(pid=72586) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 21:30:06 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:06 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Received event <DeviceRemovedEvent: 1690925406.3703854, f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72586) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 21:30:06 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-1fd6f529-526d-44bc-9c5b-26669fe0277e tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536 {{(pid=72586) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 21:30:06 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-1fd6f529-526d-44bc-9c5b-26669fe0277e tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Successfully detached device vdb from instance f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536 from the live domain config.
Aug 01 21:30:06 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fd6f529-526d-44bc-9c5b-26669fe0277e tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] calling os-brick to detach iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 21:30:06 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd6f529-526d-44bc-9c5b-26669fe0277e tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, {'target_iqns': ['iqn.2010-10.org.openstack:8bde7cdf-ea31-422a-b4b7-b0d07eee208a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gneqBfLC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:30:06 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-1fd6f529-526d-44bc-9c5b-26669fe0277e tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:30:06 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-1fd6f529-526d-44bc-9c5b-26669fe0277e tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:30:06 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-1fd6f529-526d-44bc-9c5b-26669fe0277e tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:30:06 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd6f529-526d-44bc-9c5b-26669fe0277e tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8bde7cdf-ea31-422a-b4b7-b0d07eee208a', 0)] {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 21:30:06 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:06 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:06 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3abd63-2e50-4a47-9463-bed52041c145]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8bde7cdf-ea31-422a-b4b7-b0d07eee208a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:06 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Acquiring lock "161fab9d-a7d1-4ea0-b4b9-2afc54040eef" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:30:06 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "161fab9d-a7d1-4ea0-b4b9-2afc54040eef" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:30:06 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Removed pending event for f6b0d907-2515-4a06-8b35-9ddd09ce42c3 due to event {{(pid=72586) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 21:30:06 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925406.4122381, f6b0d907-2515-4a06-8b35-9ddd09ce42c3 => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:30:06 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] VM Resumed (Lifecycle Event)
Aug 01 21:30:06 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:06 user nova-compute[72586]: DEBUG nova.compute.manager [None req-d40aff19-4368-4afc-835a-804b115146da tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:30:06 user nova-compute[72586]: DEBUG nova.compute.manager [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Starting instance... {{(pid=72586) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 21:30:06 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:30:06 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:30:06 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:06 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3fbe112-1d16-404c-884c-47c2ebcdc949]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bde7cdf-ea31-422a-b4b7-b0d07eee208a (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:06 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd6f529-526d-44bc-9c5b-26669fe0277e tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)
Aug 01 21:30:06 user nova-compute[72586]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)
Aug 01 21:30:06 user nova-compute[72586]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:30:06 user nova-compute[72586]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)
Aug 01 21:30:06 user nova-compute[72586]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bde7cdf-ea31-422a-b4b7-b0d07eee208a (non-flash)
Aug 01 21:30:06 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:30:06 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd6f529-526d-44bc-9c5b-26669fe0277e tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)
Aug 01 21:30:06 user nova-compute[72586]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)
Aug 01 21:30:06 user nova-compute[72586]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:30:06 user nova-compute[72586]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)
Aug 01 21:30:06 user nova-compute[72586]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bde7cdf-ea31-422a-b4b7-b0d07eee208a (non-flash)
Aug 01 21:30:06 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:30:06 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd6f529-526d-44bc-9c5b-26669fe0277e tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ed03ac9d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8bde7cdf-ea31-422a-b4b7-b0d07eee208a'): ({'sde'}, set())}) {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 21:30:06 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-1fd6f529-526d-44bc-9c5b-26669fe0277e tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Removing single pathed devices sde {{(pid=72586) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 21:30:06 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:06 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 01 21:30:06 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925406.4138975, f6b0d907-2515-4a06-8b35-9ddd09ce42c3 => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:30:06 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] VM Started (Lifecycle Event)
Aug 01 21:30:06 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:06 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4252ffb-0569-4a0d-905a-375e9aa61424]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:06 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:06 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:06 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e731fe-0919-42f1-a48d-817463acca30]: (4, ('ok\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:06 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:30:06 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-1fd6f529-526d-44bc-9c5b-26669fe0277e tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Flushing IO for device /dev/sde {{(pid=72586) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 21:30:06 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:06 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:30:06 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:06 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[72fe9ec1-069e-456a-965f-575a776e5d43]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:06 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-1fd6f529-526d-44bc-9c5b-26669fe0277e tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72586) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 21:30:06 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:06 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:30:06 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:30:06 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72586) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 21:30:06 user nova-compute[72586]: INFO nova.compute.claims [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Claim successful on node user
Aug 01 21:30:06 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.035s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:06 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0306c4-fa99-42b4-addc-c69fafd19b49]: (4, ('1', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:06 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-1fd6f529-526d-44bc-9c5b-26669fe0277e tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 21:30:06 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-1fd6f529-526d-44bc-9c5b-26669fe0277e tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] SCSI volumes sde have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 21:30:06 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd6f529-526d-44bc-9c5b-26669fe0277e tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8bde7cdf-ea31-422a-b4b7-b0d07eee208a')] {{(pid=72586) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 21:30:06 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bde7cdf-ea31-422a-b4b7-b0d07eee208a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:06 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bde7cdf-ea31-422a-b4b7-b0d07eee208a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:06 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7ecc55-6da9-4919-b5bd-d2afcae1df99]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:06 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd6f529-526d-44bc-9c5b-26669fe0277e tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:30:06 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bde7cdf-ea31-422a-b4b7-b0d07eee208a -p 172.16.0.220:3260 --logout {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:06 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bde7cdf-ea31-422a-b4b7-b0d07eee208a -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:06 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d41dfbc4-4a64-4715-af50-b3b7630727d4]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:8bde7cdf-ea31-422a-b4b7-b0d07eee208a, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:8bde7cdf-ea31-422a-b4b7-b0d07eee208a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:06 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd6f529-526d-44bc-9c5b-26669fe0277e tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:8bde7cdf-ea31-422a-b4b7-b0d07eee208a, portal: 172.16.0.220,3260]
Aug 01 21:30:06 user nova-compute[72586]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:8bde7cdf-ea31-422a-b4b7-b0d07eee208a, portal: 172.16.0.220,3260] successful.
Aug 01 21:30:06 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:30:06 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bde7cdf-ea31-422a-b4b7-b0d07eee208a -p 172.16.0.220:3260 --op delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:06 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bde7cdf-ea31-422a-b4b7-b0d07eee208a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:06 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb018a9c-fbbd-438a-89be-e215ad1be373]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:06 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd6f529-526d-44bc-9c5b-26669fe0277e tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:30:06 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-1fd6f529-526d-44bc-9c5b-26669fe0277e tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:30:06 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd6f529-526d-44bc-9c5b-26669fe0277e tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] <== disconnect_volume: return (327ms) None {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:30:06 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fd6f529-526d-44bc-9c5b-26669fe0277e tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Disconnected iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 21:30:06 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:30:07 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:30:07 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.516s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:30:07 user nova-compute[72586]: DEBUG nova.compute.manager [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Start building networks asynchronously for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 21:30:07 user nova-compute[72586]: DEBUG nova.compute.manager [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Allocating IP information in the background. {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 21:30:07 user nova-compute[72586]: DEBUG nova.network.neutron [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] allocate_for_instance() {{(pid=72586) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 21:30:07 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 21:30:07 user nova-compute[72586]: DEBUG nova.compute.manager [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Start building block device mappings for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 21:30:07 user nova-compute[72586]: INFO nova.virt.block_device [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Booting with blank volume at /dev/vda
Aug 01 21:30:07 user nova-compute[72586]: DEBUG nova.policy [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a984642731b9413c97038f65052ab92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d847d04360420c80ea5608d5a2b15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72586) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 21:30:07 user nova-compute[72586]: DEBUG nova.objects.instance [None req-1fd6f529-526d-44bc-9c5b-26669fe0277e tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lazy-loading 'flavor' on Instance uuid f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:30:07 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1fd6f529-526d-44bc-9c5b-26669fe0277e tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lock "f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.915s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:30:07 user nova-compute[72586]: DEBUG nova.compute.manager [req-9867dcb2-1dec-4b0c-9ae2-9187e6859014 req-dbe881d2-84f1-4c2b-8b91-1fd53bcc9282 service nova] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Received event network-changed-72b0f9c6-102b-4a73-bdb2-9f4f4181e81e {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:30:07 user nova-compute[72586]: DEBUG nova.compute.manager [req-9867dcb2-1dec-4b0c-9ae2-9187e6859014 req-dbe881d2-84f1-4c2b-8b91-1fd53bcc9282 service nova] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Refreshing instance network info cache due to event network-changed-72b0f9c6-102b-4a73-bdb2-9f4f4181e81e. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:30:07 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-9867dcb2-1dec-4b0c-9ae2-9187e6859014 req-dbe881d2-84f1-4c2b-8b91-1fd53bcc9282 service nova] Acquiring lock "refresh_cache-09571c9f-bf42-475a-afac-0e3947168d7e" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:30:07 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-9867dcb2-1dec-4b0c-9ae2-9187e6859014 req-dbe881d2-84f1-4c2b-8b91-1fd53bcc9282 service nova] Acquired lock "refresh_cache-09571c9f-bf42-475a-afac-0e3947168d7e" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:30:07 user nova-compute[72586]: DEBUG nova.network.neutron [req-9867dcb2-1dec-4b0c-9ae2-9187e6859014 req-dbe881d2-84f1-4c2b-8b91-1fd53bcc9282 service nova] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Refreshing network info cache for port 72b0f9c6-102b-4a73-bdb2-9f4f4181e81e {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:30:08 user nova-compute[72586]: DEBUG nova.network.neutron [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Successfully created port: c082b11d-fb01-4def-98b8-6b2966ce364c {{(pid=72586) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 21:30:08 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-64603747-5c36-4a16-94c9-5d34f35a76e5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Acquiring lock "09571c9f-bf42-475a-afac-0e3947168d7e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:30:08 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-64603747-5c36-4a16-94c9-5d34f35a76e5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Lock "09571c9f-bf42-475a-afac-0e3947168d7e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:30:08 user nova-compute[72586]: DEBUG nova.objects.instance [None req-64603747-5c36-4a16-94c9-5d34f35a76e5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Lazy-loading 'flavor' on Instance uuid 09571c9f-bf42-475a-afac-0e3947168d7e {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:30:08 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-64603747-5c36-4a16-94c9-5d34f35a76e5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Lock "09571c9f-bf42-475a-afac-0e3947168d7e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:30:08 user nova-compute[72586]: DEBUG nova.network.neutron [req-9867dcb2-1dec-4b0c-9ae2-9187e6859014 req-dbe881d2-84f1-4c2b-8b91-1fd53bcc9282 service nova] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Updated VIF entry in instance network info cache for port 72b0f9c6-102b-4a73-bdb2-9f4f4181e81e. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:30:08 user nova-compute[72586]: DEBUG nova.network.neutron [req-9867dcb2-1dec-4b0c-9ae2-9187e6859014 req-dbe881d2-84f1-4c2b-8b91-1fd53bcc9282 service nova] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Updating instance_info_cache with network_info: [{"id": "72b0f9c6-102b-4a73-bdb2-9f4f4181e81e", "address": "fa:16:3e:18:89:0a", "network": {"id": "3da39b49-6be1-40be-93db-5bd61034e9a7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1015949721-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cedafac8150441a086c3197698ba58e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72b0f9c6-10", "ovs_interfaceid": "72b0f9c6-102b-4a73-bdb2-9f4f4181e81e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:30:08 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-64603747-5c36-4a16-94c9-5d34f35a76e5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Acquiring lock "09571c9f-bf42-475a-afac-0e3947168d7e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:30:08 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-64603747-5c36-4a16-94c9-5d34f35a76e5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Lock "09571c9f-bf42-475a-afac-0e3947168d7e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:30:08 user nova-compute[72586]: INFO nova.compute.manager [None req-64603747-5c36-4a16-94c9-5d34f35a76e5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Attaching volume 33373a5a-73b8-450c-80f1-743847fd50b6 to /dev/vdb
Aug 01 21:30:08 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-9867dcb2-1dec-4b0c-9ae2-9187e6859014 req-dbe881d2-84f1-4c2b-8b91-1fd53bcc9282 service nova] Releasing lock "refresh_cache-09571c9f-bf42-475a-afac-0e3947168d7e" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:30:09 user nova-compute[72586]: DEBUG os_brick.utils [None req-64603747-5c36-4a16-94c9-5d34f35a76e5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:30:09 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:09 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:09 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[adcb68b9-a250-4cb3-9c18-ab0ceaf936c2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4bc202fb9cb\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:09 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:09 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:09 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d770a5-eb15-4be8-b6d5-8c99aeaa7ddf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:09 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:09 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:09 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f699f6cf-dc6d-445c-8e07-03244992ab32]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:09 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a593bd-4778-44ae-b516-dcec60252e2f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:09 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-64603747-5c36-4a16-94c9-5d34f35a76e5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Running cmd (subprocess): nvme version {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:09 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-64603747-5c36-4a16-94c9-5d34f35a76e5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] 'nvme version' failed. Not Retrying. {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:30:09 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.nvmeof [None req-64603747-5c36-4a16-94c9-5d34f35a76e5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] nvme not present on system {{(pid=72586) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 21:30:09 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:09 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:30:09 user nova-compute[72586]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 21:30:09 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[92492c8a-db11-4a69-b991-ab4ceca25178]: (4, '') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:09 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-64603747-5c36-4a16-94c9-5d34f35a76e5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72586) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 21:30:09 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-64603747-5c36-4a16-94c9-5d34f35a76e5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 21:30:09 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-64603747-5c36-4a16-94c9-5d34f35a76e5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] LIGHTOS: no hostnqn found. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 21:30:09 user nova-compute[72586]: DEBUG os_brick.utils [None req-64603747-5c36-4a16-94c9-5d34f35a76e5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4bc202fb9cb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:30:09 user nova-compute[72586]: DEBUG nova.virt.block_device [None req-64603747-5c36-4a16-94c9-5d34f35a76e5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Updating existing volume attachment record: 49efd735-2c20-4e31-83ed-bc11208ac17d {{(pid=72586) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 21:30:09 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:09 user nova-compute[72586]: DEBUG nova.network.neutron [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Successfully updated port: c082b11d-fb01-4def-98b8-6b2966ce364c {{(pid=72586) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 21:30:09 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Acquiring lock "refresh_cache-161fab9d-a7d1-4ea0-b4b9-2afc54040eef" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:30:09 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Acquired lock "refresh_cache-161fab9d-a7d1-4ea0-b4b9-2afc54040eef" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:30:09 user nova-compute[72586]: DEBUG nova.network.neutron [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:30:09 user nova-compute[72586]: DEBUG nova.compute.manager [req-052fa8d8-616c-4aca-b02d-9cb3a310cb6d req-f3bd0633-3ddc-47b9-b5c9-06123bda6fea service nova] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Received event network-changed-c082b11d-fb01-4def-98b8-6b2966ce364c {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:30:09 user nova-compute[72586]: DEBUG nova.compute.manager [req-052fa8d8-616c-4aca-b02d-9cb3a310cb6d req-f3bd0633-3ddc-47b9-b5c9-06123bda6fea service nova] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Refreshing instance network info cache due to event network-changed-c082b11d-fb01-4def-98b8-6b2966ce364c. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:30:09 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-052fa8d8-616c-4aca-b02d-9cb3a310cb6d req-f3bd0633-3ddc-47b9-b5c9-06123bda6fea service nova] Acquiring lock "refresh_cache-161fab9d-a7d1-4ea0-b4b9-2afc54040eef" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:30:09 user nova-compute[72586]: DEBUG nova.network.neutron [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Instance cache missing network info. {{(pid=72586) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 21:30:10 user nova-compute[72586]: DEBUG nova.network.neutron [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Updating instance_info_cache with network_info: [{"id": "c082b11d-fb01-4def-98b8-6b2966ce364c", "address": "fa:16:3e:b6:24:7c", "network": {"id": "86940e5d-852b-48fc-9b0e-858305321349", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1967467603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d847d04360420c80ea5608d5a2b15a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc082b11d-fb", "ovs_interfaceid": "c082b11d-fb01-4def-98b8-6b2966ce364c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:30:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Releasing lock "refresh_cache-161fab9d-a7d1-4ea0-b4b9-2afc54040eef" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:30:10 user nova-compute[72586]: DEBUG nova.compute.manager [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Instance network_info: |[{"id": "c082b11d-fb01-4def-98b8-6b2966ce364c", "address": "fa:16:3e:b6:24:7c", "network": {"id": "86940e5d-852b-48fc-9b0e-858305321349", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1967467603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d847d04360420c80ea5608d5a2b15a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc082b11d-fb", "ovs_interfaceid": "c082b11d-fb01-4def-98b8-6b2966ce364c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 21:30:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-052fa8d8-616c-4aca-b02d-9cb3a310cb6d req-f3bd0633-3ddc-47b9-b5c9-06123bda6fea service nova] Acquired lock "refresh_cache-161fab9d-a7d1-4ea0-b4b9-2afc54040eef" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:30:10 user nova-compute[72586]: DEBUG nova.network.neutron [req-052fa8d8-616c-4aca-b02d-9cb3a310cb6d req-f3bd0633-3ddc-47b9-b5c9-06123bda6fea service nova] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Refreshing network info cache for port c082b11d-fb01-4def-98b8-6b2966ce364c {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:30:10 user nova-compute[72586]: DEBUG nova.network.neutron [req-052fa8d8-616c-4aca-b02d-9cb3a310cb6d req-f3bd0633-3ddc-47b9-b5c9-06123bda6fea service nova] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Updated VIF entry in instance network info cache for port c082b11d-fb01-4def-98b8-6b2966ce364c. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:30:10 user nova-compute[72586]: DEBUG nova.network.neutron [req-052fa8d8-616c-4aca-b02d-9cb3a310cb6d req-f3bd0633-3ddc-47b9-b5c9-06123bda6fea service nova] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Updating instance_info_cache with network_info: [{"id": "c082b11d-fb01-4def-98b8-6b2966ce364c", "address": "fa:16:3e:b6:24:7c", "network": {"id": "86940e5d-852b-48fc-9b0e-858305321349", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1967467603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d847d04360420c80ea5608d5a2b15a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc082b11d-fb", "ovs_interfaceid": "c082b11d-fb01-4def-98b8-6b2966ce364c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:30:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-052fa8d8-616c-4aca-b02d-9cb3a310cb6d req-f3bd0633-3ddc-47b9-b5c9-06123bda6fea service nova] Releasing lock "refresh_cache-161fab9d-a7d1-4ea0-b4b9-2afc54040eef" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:30:11 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:12 user nova-compute[72586]: DEBUG os_brick.utils [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:30:12 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:12 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:12 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d3edce-daeb-4625-aa2d-a44dcc742d2b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4bc202fb9cb\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:12 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:12 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:12 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1989b29f-2e80-4909-8e75-ddfadb3977f0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:12 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:12 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:12 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d138a78-c9a1-4b90-b781-543216beecd7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:12 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d9e461-8ba5-4663-9bbc-7fa5d1db7773]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:12 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Running cmd (subprocess): nvme version {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:12 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] 'nvme version' failed. Not Retrying. {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:30:12 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] nvme not present on system {{(pid=72586) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 21:30:12 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:12 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:30:12 user nova-compute[72586]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 21:30:12 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f148195-8a87-4a61-a976-2f5645e7cf14]: (4, '') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:12 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72586) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 21:30:12 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 21:30:12 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] LIGHTOS: no hostnqn found. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 21:30:12 user nova-compute[72586]: DEBUG os_brick.utils [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4bc202fb9cb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:30:12 user nova-compute[72586]: DEBUG nova.virt.block_device [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Updating existing volume attachment record: 7f4b3c7a-799d-4b19-94ae-897b9a6bee2a {{(pid=72586) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 21:30:12 user nova-compute[72586]: INFO nova.compute.manager [None req-d248965d-72f7-4999-9818-1d8adb99f5e8 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Unrescuing
Aug 01 21:30:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-d248965d-72f7-4999-9818-1d8adb99f5e8 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Acquiring lock "refresh_cache-d51eb56c-bce2-4593-abc3-878c358c9a74" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:30:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-d248965d-72f7-4999-9818-1d8adb99f5e8 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Acquired lock "refresh_cache-d51eb56c-bce2-4593-abc3-878c358c9a74" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:30:12 user nova-compute[72586]: DEBUG nova.network.neutron [None req-d248965d-72f7-4999-9818-1d8adb99f5e8 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:30:13 user nova-compute[72586]: DEBUG nova.network.neutron [None req-d248965d-72f7-4999-9818-1d8adb99f5e8 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Updating instance_info_cache with network_info: [{"id": "0cdd112b-f316-4cf2-b3e5-82897e241453", "address": "fa:16:3e:f2:07:05", "network": {"id": "b40254e1-7668-4ef6-b133-681304d57290", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1667586785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f911c1cbc98a4d93b73090da5f655812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cdd112b-f3", "ovs_interfaceid": "0cdd112b-f316-4cf2-b3e5-82897e241453", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:30:13 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-d248965d-72f7-4999-9818-1d8adb99f5e8 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Releasing lock "refresh_cache-d51eb56c-bce2-4593-abc3-878c358c9a74" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:30:13 user nova-compute[72586]: DEBUG nova.objects.instance [None req-d248965d-72f7-4999-9818-1d8adb99f5e8 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Lazy-loading 'flavor' on Instance uuid d51eb56c-bce2-4593-abc3-878c358c9a74 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:30:13 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:13 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:13 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:13 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:13 user nova-compute[72586]: DEBUG nova.compute.manager [req-cbea55df-ebea-4c04-8a47-19d752f00c2d req-ffc06293-a12b-4cae-9fd6-1621efbffc72 service nova] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Received event network-vif-unplugged-0cdd112b-f316-4cf2-b3e5-82897e241453 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:30:13 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-cbea55df-ebea-4c04-8a47-19d752f00c2d req-ffc06293-a12b-4cae-9fd6-1621efbffc72 service nova] Acquiring lock "d51eb56c-bce2-4593-abc3-878c358c9a74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:30:13 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-cbea55df-ebea-4c04-8a47-19d752f00c2d req-ffc06293-a12b-4cae-9fd6-1621efbffc72 service nova] Lock "d51eb56c-bce2-4593-abc3-878c358c9a74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:30:13 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-cbea55df-ebea-4c04-8a47-19d752f00c2d req-ffc06293-a12b-4cae-9fd6-1621efbffc72 service nova] Lock "d51eb56c-bce2-4593-abc3-878c358c9a74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:30:13 user nova-compute[72586]: DEBUG nova.compute.manager [req-cbea55df-ebea-4c04-8a47-19d752f00c2d req-ffc06293-a12b-4cae-9fd6-1621efbffc72 service nova] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] No waiting events found dispatching network-vif-unplugged-0cdd112b-f316-4cf2-b3e5-82897e241453 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:30:13 user nova-compute[72586]: WARNING nova.compute.manager [req-cbea55df-ebea-4c04-8a47-19d752f00c2d req-ffc06293-a12b-4cae-9fd6-1621efbffc72 service nova] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Received unexpected event network-vif-unplugged-0cdd112b-f316-4cf2-b3e5-82897e241453 for instance with vm_state rescued and task_state unrescuing.
Aug 01 21:30:14 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:14 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Instance destroyed successfully.
Aug 01 21:30:14 user nova-compute[72586]: DEBUG nova.compute.manager [req-3f7fc657-5ade-4939-8878-fea324090c2c req-640d1dbd-0aea-498b-a49a-d9a19908fce3 service nova] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Received event network-changed-0cdd112b-f316-4cf2-b3e5-82897e241453 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:30:14 user nova-compute[72586]: DEBUG nova.compute.manager [req-3f7fc657-5ade-4939-8878-fea324090c2c req-640d1dbd-0aea-498b-a49a-d9a19908fce3 service nova] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Refreshing instance network info cache due to event network-changed-0cdd112b-f316-4cf2-b3e5-82897e241453. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:30:14 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-3f7fc657-5ade-4939-8878-fea324090c2c req-640d1dbd-0aea-498b-a49a-d9a19908fce3 service nova] Acquiring lock "refresh_cache-d51eb56c-bce2-4593-abc3-878c358c9a74" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:30:14 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-3f7fc657-5ade-4939-8878-fea324090c2c req-640d1dbd-0aea-498b-a49a-d9a19908fce3 service nova] Acquired lock "refresh_cache-d51eb56c-bce2-4593-abc3-878c358c9a74" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:30:14 user nova-compute[72586]: DEBUG nova.network.neutron [req-3f7fc657-5ade-4939-8878-fea324090c2c req-640d1dbd-0aea-498b-a49a-d9a19908fce3 service nova] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Refreshing network info cache for port 0cdd112b-f316-4cf2-b3e5-82897e241453 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:30:15 user nova-compute[72586]: DEBUG nova.network.neutron [req-3f7fc657-5ade-4939-8878-fea324090c2c req-640d1dbd-0aea-498b-a49a-d9a19908fce3 service nova] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Updated VIF entry in instance network info cache for port 0cdd112b-f316-4cf2-b3e5-82897e241453. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:30:15 user nova-compute[72586]: DEBUG nova.network.neutron [req-3f7fc657-5ade-4939-8878-fea324090c2c req-640d1dbd-0aea-498b-a49a-d9a19908fce3 service nova] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Updating instance_info_cache with network_info: [{"id": "0cdd112b-f316-4cf2-b3e5-82897e241453", "address": "fa:16:3e:f2:07:05", "network": {"id": "b40254e1-7668-4ef6-b133-681304d57290", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1667586785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f911c1cbc98a4d93b73090da5f655812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cdd112b-f3", "ovs_interfaceid": "0cdd112b-f316-4cf2-b3e5-82897e241453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:30:15 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-3f7fc657-5ade-4939-8878-fea324090c2c req-640d1dbd-0aea-498b-a49a-d9a19908fce3 service nova] Releasing lock "refresh_cache-d51eb56c-bce2-4593-abc3-878c358c9a74" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:30:15 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:15 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:15 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:15 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:16 user nova-compute[72586]: DEBUG nova.compute.manager [req-aa3ee9bc-2aef-4458-84bb-d5d11d32139a req-52a789af-8f86-4a47-ae8e-dcbfa00f6510 service nova] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Received event network-vif-plugged-0cdd112b-f316-4cf2-b3e5-82897e241453 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:30:16 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-aa3ee9bc-2aef-4458-84bb-d5d11d32139a req-52a789af-8f86-4a47-ae8e-dcbfa00f6510 service nova] Acquiring lock "d51eb56c-bce2-4593-abc3-878c358c9a74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:30:16 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-aa3ee9bc-2aef-4458-84bb-d5d11d32139a req-52a789af-8f86-4a47-ae8e-dcbfa00f6510 service nova] Lock "d51eb56c-bce2-4593-abc3-878c358c9a74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:30:16 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-aa3ee9bc-2aef-4458-84bb-d5d11d32139a req-52a789af-8f86-4a47-ae8e-dcbfa00f6510 service nova] Lock "d51eb56c-bce2-4593-abc3-878c358c9a74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:30:16 user nova-compute[72586]: DEBUG nova.compute.manager [req-aa3ee9bc-2aef-4458-84bb-d5d11d32139a req-52a789af-8f86-4a47-ae8e-dcbfa00f6510 service nova] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] No waiting events found dispatching network-vif-plugged-0cdd112b-f316-4cf2-b3e5-82897e241453 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:30:16 user nova-compute[72586]: WARNING nova.compute.manager [req-aa3ee9bc-2aef-4458-84bb-d5d11d32139a req-52a789af-8f86-4a47-ae8e-dcbfa00f6510 service nova] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Received unexpected event network-vif-plugged-0cdd112b-f316-4cf2-b3e5-82897e241453 for instance with vm_state rescued and task_state unrescuing.
Aug 01 21:30:16 user nova-compute[72586]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690925401.221401, dadba691-ab8a-4e25-864f-3211ef71872f => Stopped> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:30:16 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] VM Stopped (Lifecycle Event)
Aug 01 21:30:16 user nova-compute[72586]: DEBUG nova.compute.manager [None req-66e0379f-7add-4368-a214-d8f4b709046e None None] [instance: dadba691-ab8a-4e25-864f-3211ef71872f] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:30:16 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:16 user nova-compute[72586]: DEBUG nova.compute.manager [req-e2ac0875-0ba9-4523-ad6c-51ac95f841c4 req-022e54f9-396b-4254-a663-0bd4b563ed0d service nova] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Received event network-changed-0cdd112b-f316-4cf2-b3e5-82897e241453 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:30:16 user nova-compute[72586]: DEBUG nova.compute.manager [req-e2ac0875-0ba9-4523-ad6c-51ac95f841c4 req-022e54f9-396b-4254-a663-0bd4b563ed0d service nova] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Refreshing instance network info cache due to event network-changed-0cdd112b-f316-4cf2-b3e5-82897e241453. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:30:16 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-e2ac0875-0ba9-4523-ad6c-51ac95f841c4 req-022e54f9-396b-4254-a663-0bd4b563ed0d service nova] Acquiring lock "refresh_cache-d51eb56c-bce2-4593-abc3-878c358c9a74" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:30:16 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-e2ac0875-0ba9-4523-ad6c-51ac95f841c4 req-022e54f9-396b-4254-a663-0bd4b563ed0d service nova] Acquired lock "refresh_cache-d51eb56c-bce2-4593-abc3-878c358c9a74" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:30:16 user nova-compute[72586]: DEBUG nova.network.neutron [req-e2ac0875-0ba9-4523-ad6c-51ac95f841c4 req-022e54f9-396b-4254-a663-0bd4b563ed0d service nova] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Refreshing network info cache for port 0cdd112b-f316-4cf2-b3e5-82897e241453 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:30:16 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:16 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:16 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:16 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:17 user nova-compute[72586]: DEBUG nova.network.neutron [req-e2ac0875-0ba9-4523-ad6c-51ac95f841c4 req-022e54f9-396b-4254-a663-0bd4b563ed0d service nova] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Updated VIF entry in instance network info cache for port 0cdd112b-f316-4cf2-b3e5-82897e241453. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:30:17 user nova-compute[72586]: DEBUG nova.network.neutron [req-e2ac0875-0ba9-4523-ad6c-51ac95f841c4 req-022e54f9-396b-4254-a663-0bd4b563ed0d service nova] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Updating instance_info_cache with network_info: [{"id": "0cdd112b-f316-4cf2-b3e5-82897e241453", "address": "fa:16:3e:f2:07:05", "network": {"id": "b40254e1-7668-4ef6-b133-681304d57290", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1667586785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f911c1cbc98a4d93b73090da5f655812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cdd112b-f3", "ovs_interfaceid": "0cdd112b-f316-4cf2-b3e5-82897e241453", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:30:17 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-e2ac0875-0ba9-4523-ad6c-51ac95f841c4 req-022e54f9-396b-4254-a663-0bd4b563ed0d service nova] Releasing lock "refresh_cache-d51eb56c-bce2-4593-abc3-878c358c9a74" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:30:17 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-aea44ce2-3bf0-47d6-81ed-8057ad74f3d3 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Acquiring lock "49c24c77-f102-4aed-8314-b04aad5f6b3a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:30:17 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-aea44ce2-3bf0-47d6-81ed-8057ad74f3d3 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "49c24c77-f102-4aed-8314-b04aad5f6b3a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:30:17 user nova-compute[72586]: INFO nova.compute.manager [None req-aea44ce2-3bf0-47d6-81ed-8057ad74f3d3 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Detaching volume f3a42014-9e54-46c8-a536-7df2939e9e48
Aug 01 21:30:17 user nova-compute[72586]: INFO nova.virt.block_device [None req-aea44ce2-3bf0-47d6-81ed-8057ad74f3d3 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Attempting to driver detach volume f3a42014-9e54-46c8-a536-7df2939e9e48 from mountpoint /dev/vdb
Aug 01 21:30:17 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-aea44ce2-3bf0-47d6-81ed-8057ad74f3d3 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Attempting to detach device vdb from instance 49c24c77-f102-4aed-8314-b04aad5f6b3a from the persistent domain config. {{(pid=72586) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 21:30:17 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-aea44ce2-3bf0-47d6-81ed-8057ad74f3d3 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 21:30:17 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:30:17 user nova-compute[72586]:   <source dev="/dev/sdb"/>
Aug 01 21:30:17 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:30:17 user nova-compute[72586]:   <serial>f3a42014-9e54-46c8-a536-7df2939e9e48</serial>
Aug 01 21:30:17 user nova-compute[72586]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 01 21:30:17 user nova-compute[72586]: </disk>
Aug 01 21:30:17 user nova-compute[72586]:  {{(pid=72586) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 21:30:17 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-aea44ce2-3bf0-47d6-81ed-8057ad74f3d3 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Successfully detached device vdb from instance 49c24c77-f102-4aed-8314-b04aad5f6b3a from the persistent domain config.
Aug 01 21:30:17 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-aea44ce2-3bf0-47d6-81ed-8057ad74f3d3 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 49c24c77-f102-4aed-8314-b04aad5f6b3a from the live domain config. {{(pid=72586) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 21:30:17 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-aea44ce2-3bf0-47d6-81ed-8057ad74f3d3 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 21:30:17 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:30:17 user nova-compute[72586]:   <source dev="/dev/sdb"/>
Aug 01 21:30:17 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:30:17 user nova-compute[72586]:   <serial>f3a42014-9e54-46c8-a536-7df2939e9e48</serial>
Aug 01 21:30:17 user nova-compute[72586]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 01 21:30:17 user nova-compute[72586]: </disk>
Aug 01 21:30:17 user nova-compute[72586]:  {{(pid=72586) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 21:30:17 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64603747-5c36-4a16-94c9-5d34f35a76e5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Calling os-brick to attach iSCSI Volume {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 21:30:17 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-64603747-5c36-4a16-94c9-5d34f35a76e5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PJFDejSI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:30:17 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-64603747-5c36-4a16-94c9-5d34f35a76e5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:30:17 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-64603747-5c36-4a16-94c9-5d34f35a76e5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:30:17 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-64603747-5c36-4a16-94c9-5d34f35a76e5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:30:17 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-64603747-5c36-4a16-94c9-5d34f35a76e5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:30:17 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-64603747-5c36-4a16-94c9-5d34f35a76e5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:30:17 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-64603747-5c36-4a16-94c9-5d34f35a76e5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:30:17 user nova-compute[72586]: INFO os_brick.initiator.connectors.iscsi [None req-64603747-5c36-4a16-94c9-5d34f35a76e5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 21:30:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 -p 172.16.0.220:3260 {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:17 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52da5dc-28c6-4d93-999d-2b1e7e8b1b11]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:17 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-64603747-5c36-4a16-94c9-5d34f35a76e5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 21:30:17 user nova-compute[72586]:  {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:30:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 -p 172.16.0.220:3260 --interface default --op new {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:17 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[780d27c2-f9a2-46e8-894a-35392456ed54]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6] added\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:17 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-64603747-5c36-4a16-94c9-5d34f35a76e5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6] added
Aug 01 21:30:17 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:30:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:17 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c072718-e894-4fa1-ada3-f66c59f7b4aa]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:17 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-64603747-5c36-4a16-94c9-5d34f35a76e5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:30:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:17 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77a4276-329d-4a9b-babe-28b87dc902d6]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:17 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-64603747-5c36-4a16-94c9-5d34f35a76e5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:30:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PJFDejSI {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PJFDejSI" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:17 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c14cdba-2c86-4d5d-964e-af92fe29f43d]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:17 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-64603747-5c36-4a16-94c9-5d34f35a76e5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PJFDejSI'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:30:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:17 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[127fa055-b92e-45c5-a03e-5bc4dac63982]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:18 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-64603747-5c36-4a16-94c9-5d34f35a76e5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:30:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:18 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11fbf45-2d8a-4dae-b953-17caff098e22]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:18 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-64603747-5c36-4a16-94c9-5d34f35a76e5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)
Aug 01 21:30:18 user nova-compute[72586]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)
Aug 01 21:30:18 user nova-compute[72586]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:30:18 user nova-compute[72586]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)
Aug 01 21:30:18 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:30:18 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-64603747-5c36-4a16-94c9-5d34f35a76e5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)
Aug 01 21:30:18 user nova-compute[72586]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)
Aug 01 21:30:18 user nova-compute[72586]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:30:18 user nova-compute[72586]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)
Aug 01 21:30:18 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:30:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 -p 172.16.0.220:3260 --login {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:18 user nova-compute[72586]: DEBUG nova.compute.manager [req-64630a6a-db30-4f33-b919-dfab76d660da req-cc46f05a-5f48-48b8-af2e-d216966bf01b service nova] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Received event network-vif-plugged-0cdd112b-f316-4cf2-b3e5-82897e241453 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:30:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-64630a6a-db30-4f33-b919-dfab76d660da req-cc46f05a-5f48-48b8-af2e-d216966bf01b service nova] Acquiring lock "d51eb56c-bce2-4593-abc3-878c358c9a74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:30:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-64630a6a-db30-4f33-b919-dfab76d660da req-cc46f05a-5f48-48b8-af2e-d216966bf01b service nova] Lock "d51eb56c-bce2-4593-abc3-878c358c9a74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:30:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-64630a6a-db30-4f33-b919-dfab76d660da req-cc46f05a-5f48-48b8-af2e-d216966bf01b service nova] Lock "d51eb56c-bce2-4593-abc3-878c358c9a74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:30:18 user nova-compute[72586]: DEBUG nova.compute.manager [req-64630a6a-db30-4f33-b919-dfab76d660da req-cc46f05a-5f48-48b8-af2e-d216966bf01b service nova] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] No waiting events found dispatching network-vif-plugged-0cdd112b-f316-4cf2-b3e5-82897e241453 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:30:18 user nova-compute[72586]: WARNING nova.compute.manager [req-64630a6a-db30-4f33-b919-dfab76d660da req-cc46f05a-5f48-48b8-af2e-d216966bf01b service nova] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Received unexpected event network-vif-plugged-0cdd112b-f316-4cf2-b3e5-82897e241453 for instance with vm_state rescued and task_state unrescuing.
Aug 01 21:30:18 user nova-compute[72586]: DEBUG nova.compute.manager [req-64630a6a-db30-4f33-b919-dfab76d660da req-cc46f05a-5f48-48b8-af2e-d216966bf01b service nova] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Received event network-vif-plugged-0cdd112b-f316-4cf2-b3e5-82897e241453 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:30:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-64630a6a-db30-4f33-b919-dfab76d660da req-cc46f05a-5f48-48b8-af2e-d216966bf01b service nova] Acquiring lock "d51eb56c-bce2-4593-abc3-878c358c9a74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:30:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-64630a6a-db30-4f33-b919-dfab76d660da req-cc46f05a-5f48-48b8-af2e-d216966bf01b service nova] Lock "d51eb56c-bce2-4593-abc3-878c358c9a74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:30:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-64630a6a-db30-4f33-b919-dfab76d660da req-cc46f05a-5f48-48b8-af2e-d216966bf01b service nova] Lock "d51eb56c-bce2-4593-abc3-878c358c9a74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:30:18 user nova-compute[72586]: DEBUG nova.compute.manager [req-64630a6a-db30-4f33-b919-dfab76d660da req-cc46f05a-5f48-48b8-af2e-d216966bf01b service nova] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] No waiting events found dispatching network-vif-plugged-0cdd112b-f316-4cf2-b3e5-82897e241453 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:30:18 user nova-compute[72586]: WARNING nova.compute.manager [req-64630a6a-db30-4f33-b919-dfab76d660da req-cc46f05a-5f48-48b8-af2e-d216966bf01b service nova] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Received unexpected event network-vif-plugged-0cdd112b-f316-4cf2-b3e5-82897e241453 for instance with vm_state rescued and task_state unrescuing.
Aug 01 21:30:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:18 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[582be253-a8e3-47a0-b508-528cc2388599]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:18 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-64603747-5c36-4a16-94c9-5d34f35a76e5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6, portal: 172.16.0.220,3260]
Aug 01 21:30:18 user nova-compute[72586]: Login to [iface: default, target: iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6, portal: 172.16.0.220,3260] successful.
Aug 01 21:30:18 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:30:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:18 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Received event <DeviceRemovedEvent: 1690925418.1151545, 49c24c77-f102-4aed-8314-b04aad5f6b3a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72586) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 21:30:18 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-aea44ce2-3bf0-47d6-81ed-8057ad74f3d3 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 49c24c77-f102-4aed-8314-b04aad5f6b3a {{(pid=72586) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 21:30:18 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-aea44ce2-3bf0-47d6-81ed-8057ad74f3d3 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Successfully detached device vdb from instance 49c24c77-f102-4aed-8314-b04aad5f6b3a from the live domain config.
Aug 01 21:30:18 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aea44ce2-3bf0-47d6-81ed-8057ad74f3d3 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] calling os-brick to detach iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 21:30:18 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea44ce2-3bf0-47d6-81ed-8057ad74f3d3 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, {'target_iqns': ['iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SHNWJcYf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:30:18 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-aea44ce2-3bf0-47d6-81ed-8057ad74f3d3 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:30:18 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-aea44ce2-3bf0-47d6-81ed-8057ad74f3d3 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:30:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:18 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5bc39ca-c668-446f-a1a6-8b7f2c67701d]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:18 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-64603747-5c36-4a16-94c9-5d34f35a76e5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:30:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:18 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d85067-61dd-418b-9c07-24f2ad1ec78c]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:18 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-64603747-5c36-4a16-94c9-5d34f35a76e5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)
Aug 01 21:30:18 user nova-compute[72586]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)
Aug 01 21:30:18 user nova-compute[72586]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:30:18 user nova-compute[72586]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)
Aug 01 21:30:18 user nova-compute[72586]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 (non-flash)
Aug 01 21:30:18 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:30:18 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-64603747-5c36-4a16-94c9-5d34f35a76e5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)
Aug 01 21:30:18 user nova-compute[72586]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)
Aug 01 21:30:18 user nova-compute[72586]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:30:18 user nova-compute[72586]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)
Aug 01 21:30:18 user nova-compute[72586]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 (non-flash)
Aug 01 21:30:18 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:30:18 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-64603747-5c36-4a16-94c9-5d34f35a76e5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:30:18 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-64603747-5c36-4a16-94c9-5d34f35a76e5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Connected to 172.16.0.220:3260 {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 21:30:18 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-64603747-5c36-4a16-94c9-5d34f35a76e5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] HCTL ('36', '-', '-', 0) found on session 28 with lun 0 {{(pid=72586) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 21:30:18 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-64603747-5c36-4a16-94c9-5d34f35a76e5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72586) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 21:30:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.027s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:18 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c4641c-44ae-4309-b4c1-4eeea95b06cb]: (4, ('- - 0', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:18 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-64603747-5c36-4a16-94c9-5d34f35a76e5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Searching for a device in session 28 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:30:18 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-64603747-5c36-4a16-94c9-5d34f35a76e5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PJFDejSI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 21:30:18 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Removed pending event for d51eb56c-bce2-4593-abc3-878c358c9a74 due to event {{(pid=72586) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 21:30:18 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925418.261041, d51eb56c-bce2-4593-abc3-878c358c9a74 => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:30:18 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] VM Resumed (Lifecycle Event)
Aug 01 21:30:18 user nova-compute[72586]: DEBUG nova.compute.manager [None req-d248965d-72f7-4999-9818-1d8adb99f5e8 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:30:18 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:30:18 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:30:18 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 01 21:30:18 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925418.2631392, d51eb56c-bce2-4593-abc3-878c358c9a74 => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:30:18 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] VM Started (Lifecycle Event)
Aug 01 21:30:18 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:30:18 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:30:18 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:30:18 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Cleaning up deleted instances with incomplete migration  {{(pid=72586) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 21:30:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-64603747-5c36-4a16-94c9-5d34f35a76e5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:30:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-64603747-5c36-4a16-94c9-5d34f35a76e5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '26236363531306462', 'path': '/dev/sde'} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:30:19 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64603747-5c36-4a16-94c9-5d34f35a76e5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236363531306462', 'path': '/dev/sde'} {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 21:30:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-aea44ce2-3bf0-47d6-81ed-8057ad74f3d3 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.078s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:30:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea44ce2-3bf0-47d6-81ed-8057ad74f3d3 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48', 0)] {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 21:30:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:19 user nova-compute[72586]: DEBUG nova.objects.instance [None req-64603747-5c36-4a16-94c9-5d34f35a76e5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Lazy-loading 'flavor' on Instance uuid 09571c9f-bf42-475a-afac-0e3947168d7e {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:30:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:19 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa1b3c6-511b-4083-ab63-d1737a9454d2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:19 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-64603747-5c36-4a16-94c9-5d34f35a76e5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 21:30:19 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:30:19 user nova-compute[72586]:   <source dev="/dev/sde"/>
Aug 01 21:30:19 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:30:19 user nova-compute[72586]:   <serial>33373a5a-73b8-450c-80f1-743847fd50b6</serial>
Aug 01 21:30:19 user nova-compute[72586]: </disk>
Aug 01 21:30:19 user nova-compute[72586]:  {{(pid=72586) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 21:30:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:19 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a1e50e-86f2-4ef2-bedc-a5bf2cb73d20]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea44ce2-3bf0-47d6-81ed-8057ad74f3d3 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)
Aug 01 21:30:19 user nova-compute[72586]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)
Aug 01 21:30:19 user nova-compute[72586]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:30:19 user nova-compute[72586]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)
Aug 01 21:30:19 user nova-compute[72586]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 (non-flash)
Aug 01 21:30:19 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:30:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea44ce2-3bf0-47d6-81ed-8057ad74f3d3 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 (non-flash)
Aug 01 21:30:19 user nova-compute[72586]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)
Aug 01 21:30:19 user nova-compute[72586]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:30:19 user nova-compute[72586]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)
Aug 01 21:30:19 user nova-compute[72586]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 (non-flash)
Aug 01 21:30:19 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:30:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea44ce2-3bf0-47d6-81ed-8057ad74f3d3 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ef1794040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48'): ({'sdb'}, set())}) {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 21:30:19 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-aea44ce2-3bf0-47d6-81ed-8057ad74f3d3 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Removing single pathed devices sdb {{(pid=72586) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 21:30:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:19 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75183a8-cd84-4872-a1fe-01d0696886a4]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:19 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3842b5-c9c0-4c57-9c22-bfd54d065c3f]: (4, ('ok\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:19 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-aea44ce2-3bf0-47d6-81ed-8057ad74f3d3 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Flushing IO for device /dev/sdb {{(pid=72586) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 21:30:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:19 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[be60a5a2-e2b0-46b5-9b85-db96b411320a]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:19 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-aea44ce2-3bf0-47d6-81ed-8057ad74f3d3 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72586) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 21:30:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:19 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[94301fd1-a10c-4987-a049-25cd581ad4ae]: (4, ('1', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:19 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-aea44ce2-3bf0-47d6-81ed-8057ad74f3d3 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 21:30:19 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-aea44ce2-3bf0-47d6-81ed-8057ad74f3d3 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] SCSI volumes sdb have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 21:30:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea44ce2-3bf0-47d6-81ed-8057ad74f3d3 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48')] {{(pid=72586) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 21:30:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:19 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e02144-64b7-407c-baea-bc3cd11ecd45]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea44ce2-3bf0-47d6-81ed-8057ad74f3d3 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:30:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 -p 172.16.0.220:3260 --logout {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:19 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[929b9251-152e-4e6d-bb8e-16c535fd0e30]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea44ce2-3bf0-47d6-81ed-8057ad74f3d3 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48, portal: 172.16.0.220,3260]
Aug 01 21:30:19 user nova-compute[72586]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48, portal: 172.16.0.220,3260] successful.
Aug 01 21:30:19 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:30:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 -p 172.16.0.220:3260 --op delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3a42014-9e54-46c8-a536-7df2939e9e48 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:19 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb40b03f-5ae0-4393-b2a9-c7cb26615121]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea44ce2-3bf0-47d6-81ed-8057ad74f3d3 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:30:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-aea44ce2-3bf0-47d6-81ed-8057ad74f3d3 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:30:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea44ce2-3bf0-47d6-81ed-8057ad74f3d3 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] <== disconnect_volume: return (1409ms) None {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:30:19 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aea44ce2-3bf0-47d6-81ed-8057ad74f3d3 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Disconnected iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 21:30:19 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-64603747-5c36-4a16-94c9-5d34f35a76e5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:30:19 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-64603747-5c36-4a16-94c9-5d34f35a76e5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:30:19 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-64603747-5c36-4a16-94c9-5d34f35a76e5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] No VIF found with MAC fa:16:3e:18:89:0a, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:30:19 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-64603747-5c36-4a16-94c9-5d34f35a76e5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Lock "09571c9f-bf42-475a-afac-0e3947168d7e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.966s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:30:20 user nova-compute[72586]: DEBUG nova.objects.instance [None req-aea44ce2-3bf0-47d6-81ed-8057ad74f3d3 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lazy-loading 'flavor' on Instance uuid 49c24c77-f102-4aed-8314-b04aad5f6b3a {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:30:20 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-aea44ce2-3bf0-47d6-81ed-8057ad74f3d3 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "49c24c77-f102-4aed-8314-b04aad5f6b3a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.991s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG nova.compute.manager [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Start spawning the instance on the hypervisor. {{(pid=72586) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Creating instance directory {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 21:30:21 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Creating image(s)
Aug 01 21:30:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Did not create local disks {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Ensure instance console log exists: /opt/stack/data/nova/instances/161fab9d-a7d1-4ea0-b4b9-2afc54040eef/console.log {{(pid=72586) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Start _get_guest_xml network_info=[{"id": "c082b11d-fb01-4def-98b8-6b2966ce364c", "address": "fa:16:3e:b6:24:7c", "network": {"id": "86940e5d-852b-48fc-9b0e-858305321349", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1967467603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d847d04360420c80ea5608d5a2b15a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc082b11d-fb", "ovs_interfaceid": "c082b11d-fb01-4def-98b8-6b2966ce364c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oqjwfXlR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '161fab9d-a7d1-4ea0-b4b9-2afc54040eef', 'attached_at': '', 'detached_at': '', 'volume_id': '0acebba2-aca8-4728-b4d6-0d836a537e33', 'serial': '0acebba2-aca8-4728-b4d6-0d836a537e33'}, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '7f4b3c7a-799d-4b19-94ae-897b9a6bee2a', 'delete_on_termination': False, 'volume_type': None} {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:30:21 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:30:21 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:30:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Calling os-brick to attach iSCSI Volume {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oqjwfXlR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:30:21 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:30:21 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:30:21 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:30:21 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:30:21 user nova-compute[72586]: INFO os_brick.initiator.connectors.iscsi [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 21:30:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 -p 172.16.0.220:3260 {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb0d1be-86a7-4f50-9e1c-240888350063]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 21:30:21 user nova-compute[72586]:  {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 -p 172.16.0.220:3260 --interface default --op new {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd24de9-c29d-4308-9354-750507634d8e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33] added\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33] added
Aug 01 21:30:21 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd7abac-fcbd-4c48-b4c9-ac1962ed4fe3]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da165fc-4521-4eae-914c-db13f4ccdeb0]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oqjwfXlR {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oqjwfXlR" returned: 0 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[3887be1f-7870-4c44-b032-2144da5d3c70]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oqjwfXlR'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f237fc5-a71a-4a4c-95f3-408837dc4e6e]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[51bfa0c7-6947-448e-b2ef-206aa56c16ef]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)
Aug 01 21:30:21 user nova-compute[72586]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:30:21 user nova-compute[72586]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)
Aug 01 21:30:21 user nova-compute[72586]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 (non-flash)
Aug 01 21:30:21 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)
Aug 01 21:30:21 user nova-compute[72586]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:30:21 user nova-compute[72586]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)
Aug 01 21:30:21 user nova-compute[72586]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 (non-flash)
Aug 01 21:30:21 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 -p 172.16.0.220:3260 --login {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e3979f-834a-4a00-a4e1-efa0551fc377]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33, portal: 172.16.0.220,3260]
Aug 01 21:30:21 user nova-compute[72586]: Login to [iface: default, target: iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33, portal: 172.16.0.220,3260] successful.
Aug 01 21:30:21 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[177ab500-5b82-4e6c-b0a6-604b3910c001]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4af3938-f54f-499d-904f-50571466a8a1]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)
Aug 01 21:30:21 user nova-compute[72586]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:30:21 user nova-compute[72586]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)
Aug 01 21:30:21 user nova-compute[72586]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 (non-flash)
Aug 01 21:30:21 user nova-compute[72586]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:30:21 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)
Aug 01 21:30:21 user nova-compute[72586]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:30:21 user nova-compute[72586]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)
Aug 01 21:30:21 user nova-compute[72586]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 (non-flash)
Aug 01 21:30:21 user nova-compute[72586]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:30:21 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Connected to 172.16.0.220:3260 {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] HCTL ('33', '-', '-', 0) found on session 29 with lun 0 {{(pid=72586) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72586) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 21:30:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:22 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6eb458e-1af2-4a60-81d7-6688b0ac4875]: (4, ('- - 0', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:22 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:30:22 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oqjwfXlR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 21:30:22 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:30:23 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:30:23 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '26466633335363564', 'path': '/dev/sdb'} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:30:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26466633335363564', 'path': '/dev/sdb'} {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 21:30:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:30:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1000542455',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1000542455',id=26,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88d847d04360420c80ea5608d5a2b15a',ramdisk_id='',reservation_id='r-khodwewo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1268085586',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:30:07Z,user_data=None,user_id='a984642731b9413c97038f65052ab92d',uuid=161fab9d-a7d1-4ea0-b4b9-2afc54040eef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c082b11d-fb01-4def-98b8-6b2966ce364c", "address": "fa:16:3e:b6:24:7c", "network": {"id": "86940e5d-852b-48fc-9b0e-858305321349", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1967467603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d847d04360420c80ea5608d5a2b15a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc082b11d-fb", "ovs_interfaceid": "c082b11d-fb01-4def-98b8-6b2966ce364c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:30:23 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Converting VIF {"id": "c082b11d-fb01-4def-98b8-6b2966ce364c", "address": "fa:16:3e:b6:24:7c", "network": {"id": "86940e5d-852b-48fc-9b0e-858305321349", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1967467603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d847d04360420c80ea5608d5a2b15a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc082b11d-fb", "ovs_interfaceid": "c082b11d-fb01-4def-98b8-6b2966ce364c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:30:23 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:24:7c,bridge_name='br-int',has_traffic_filtering=True,id=c082b11d-fb01-4def-98b8-6b2966ce364c,network=Network(86940e5d-852b-48fc-9b0e-858305321349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc082b11d-fb') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:30:23 user nova-compute[72586]: DEBUG nova.objects.instance [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lazy-loading 'pci_devices' on Instance uuid 161fab9d-a7d1-4ea0-b4b9-2afc54040eef {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:30:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:30:23 user nova-compute[72586]:   <uuid>161fab9d-a7d1-4ea0-b4b9-2afc54040eef</uuid>
Aug 01 21:30:23 user nova-compute[72586]:   <name>instance-0000001a</name>
Aug 01 21:30:23 user nova-compute[72586]:   <memory>524288</memory>
Aug 01 21:30:23 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:30:23 user nova-compute[72586]:   <metadata>
Aug 01 21:30:23 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:30:23 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:30:23 user nova-compute[72586]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1000542455</nova:name>
Aug 01 21:30:23 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:30:21</nova:creationTime>
Aug 01 21:30:23 user nova-compute[72586]:       <nova:flavor name="m1.tiny">
Aug 01 21:30:23 user nova-compute[72586]:         <nova:memory>512</nova:memory>
Aug 01 21:30:23 user nova-compute[72586]:         <nova:disk>1</nova:disk>
Aug 01 21:30:23 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:30:23 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:30:23 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:30:23 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:30:23 user nova-compute[72586]:       <nova:owner>
Aug 01 21:30:23 user nova-compute[72586]:         <nova:user uuid="a984642731b9413c97038f65052ab92d">tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member</nova:user>
Aug 01 21:30:23 user nova-compute[72586]:         <nova:project uuid="88d847d04360420c80ea5608d5a2b15a">tempest-ServerBootFromVolumeStableRescueTest-1268085586</nova:project>
Aug 01 21:30:23 user nova-compute[72586]:       </nova:owner>
Aug 01 21:30:23 user nova-compute[72586]:       <nova:root type="image" uuid="0243d46b-6819-42a5-926f-42b71f0c97ad"/>
Aug 01 21:30:23 user nova-compute[72586]:       <nova:ports>
Aug 01 21:30:23 user nova-compute[72586]:         <nova:port uuid="c082b11d-fb01-4def-98b8-6b2966ce364c">
Aug 01 21:30:23 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 01 21:30:23 user nova-compute[72586]:         </nova:port>
Aug 01 21:30:23 user nova-compute[72586]:       </nova:ports>
Aug 01 21:30:23 user nova-compute[72586]:     </nova:instance>
Aug 01 21:30:23 user nova-compute[72586]:   </metadata>
Aug 01 21:30:23 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:30:23 user nova-compute[72586]:     <system>
Aug 01 21:30:23 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:30:23 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:30:23 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:30:23 user nova-compute[72586]:       <entry name="serial">161fab9d-a7d1-4ea0-b4b9-2afc54040eef</entry>
Aug 01 21:30:23 user nova-compute[72586]:       <entry name="uuid">161fab9d-a7d1-4ea0-b4b9-2afc54040eef</entry>
Aug 01 21:30:23 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:30:23 user nova-compute[72586]:     </system>
Aug 01 21:30:23 user nova-compute[72586]:   </sysinfo>
Aug 01 21:30:23 user nova-compute[72586]:   <os>
Aug 01 21:30:23 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:30:23 user nova-compute[72586]:     <boot dev="hd"/>
Aug 01 21:30:23 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:30:23 user nova-compute[72586]:   </os>
Aug 01 21:30:23 user nova-compute[72586]:   <features>
Aug 01 21:30:23 user nova-compute[72586]:     <acpi/>
Aug 01 21:30:23 user nova-compute[72586]:     <apic/>
Aug 01 21:30:23 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:30:23 user nova-compute[72586]:   </features>
Aug 01 21:30:23 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:30:23 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:30:23 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:30:23 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:30:23 user nova-compute[72586]:   </clock>
Aug 01 21:30:23 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:30:23 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:30:23 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:30:23 user nova-compute[72586]:   </cpu>
Aug 01 21:30:23 user nova-compute[72586]:   <devices>
Aug 01 21:30:23 user nova-compute[72586]:     <disk type="block" device="disk">
Aug 01 21:30:23 user nova-compute[72586]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:30:23 user nova-compute[72586]:       <source dev="/dev/sdb"/>
Aug 01 21:30:23 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:30:23 user nova-compute[72586]:       <serial>0acebba2-aca8-4728-b4d6-0d836a537e33</serial>
Aug 01 21:30:23 user nova-compute[72586]:     </disk>
Aug 01 21:30:23 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:30:23 user nova-compute[72586]:       <mac address="fa:16:3e:b6:24:7c"/>
Aug 01 21:30:23 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:30:23 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:30:23 user nova-compute[72586]:       <target dev="tapc082b11d-fb"/>
Aug 01 21:30:23 user nova-compute[72586]:     </interface>
Aug 01 21:30:23 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:30:23 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/161fab9d-a7d1-4ea0-b4b9-2afc54040eef/console.log" append="off"/>
Aug 01 21:30:23 user nova-compute[72586]:     </serial>
Aug 01 21:30:23 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:30:23 user nova-compute[72586]:     <video>
Aug 01 21:30:23 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:30:23 user nova-compute[72586]:     </video>
Aug 01 21:30:23 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:30:23 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:30:23 user nova-compute[72586]:     </rng>
Aug 01 21:30:23 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:30:23 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:30:23 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:30:23 user nova-compute[72586]:     </memballoon>
Aug 01 21:30:23 user nova-compute[72586]:   </devices>
Aug 01 21:30:23 user nova-compute[72586]: </domain>
Aug 01 21:30:23 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:30:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:30:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1000542455',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1000542455',id=26,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88d847d04360420c80ea5608d5a2b15a',ramdisk_id='',reservation_id='r-khodwewo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1268085586',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:30:07Z,user_data=None,user_id='a984642731b9413c97038f65052ab92d',uuid=161fab9d-a7d1-4ea0-b4b9-2afc54040eef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c082b11d-fb01-4def-98b8-6b2966ce364c", "address": "fa:16:3e:b6:24:7c", "network": {"id": "86940e5d-852b-48fc-9b0e-858305321349", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1967467603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d847d04360420c80ea5608d5a2b15a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc082b11d-fb", "ovs_interfaceid": "c082b11d-fb01-4def-98b8-6b2966ce364c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:30:23 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Converting VIF {"id": "c082b11d-fb01-4def-98b8-6b2966ce364c", "address": "fa:16:3e:b6:24:7c", "network": {"id": "86940e5d-852b-48fc-9b0e-858305321349", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1967467603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d847d04360420c80ea5608d5a2b15a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc082b11d-fb", "ovs_interfaceid": "c082b11d-fb01-4def-98b8-6b2966ce364c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:30:23 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:24:7c,bridge_name='br-int',has_traffic_filtering=True,id=c082b11d-fb01-4def-98b8-6b2966ce364c,network=Network(86940e5d-852b-48fc-9b0e-858305321349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc082b11d-fb') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:30:23 user nova-compute[72586]: DEBUG os_vif [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:24:7c,bridge_name='br-int',has_traffic_filtering=True,id=c082b11d-fb01-4def-98b8-6b2966ce364c,network=Network(86940e5d-852b-48fc-9b0e-858305321349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc082b11d-fb') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:30:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:30:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:30:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc082b11d-fb, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:30:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc082b11d-fb, col_values=(('external_ids', {'iface-id': 'c082b11d-fb01-4def-98b8-6b2966ce364c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:24:7c', 'vm-uuid': '161fab9d-a7d1-4ea0-b4b9-2afc54040eef'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:30:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:30:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:23 user nova-compute[72586]: INFO os_vif [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:24:7c,bridge_name='br-int',has_traffic_filtering=True,id=c082b11d-fb01-4def-98b8-6b2966ce364c,network=Network(86940e5d-852b-48fc-9b0e-858305321349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc082b11d-fb')
Aug 01 21:30:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:30:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] No VIF found with MAC fa:16:3e:b6:24:7c, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:30:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1e277091-5dac-495d-8395-b97ffa256e64 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Acquiring lock "09571c9f-bf42-475a-afac-0e3947168d7e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:30:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1e277091-5dac-495d-8395-b97ffa256e64 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Lock "09571c9f-bf42-475a-afac-0e3947168d7e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:30:23 user nova-compute[72586]: DEBUG nova.objects.instance [None req-1e277091-5dac-495d-8395-b97ffa256e64 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Lazy-loading 'flavor' on Instance uuid 09571c9f-bf42-475a-afac-0e3947168d7e {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:30:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1e277091-5dac-495d-8395-b97ffa256e64 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Lock "09571c9f-bf42-475a-afac-0e3947168d7e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.149s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:30:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1e277091-5dac-495d-8395-b97ffa256e64 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Acquiring lock "09571c9f-bf42-475a-afac-0e3947168d7e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:30:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1e277091-5dac-495d-8395-b97ffa256e64 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Lock "09571c9f-bf42-475a-afac-0e3947168d7e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:30:24 user nova-compute[72586]: INFO nova.compute.manager [None req-1e277091-5dac-495d-8395-b97ffa256e64 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Attaching volume aa629379-4387-45d9-8175-351c9df0e0bb to /dev/vdc
Aug 01 21:30:24 user nova-compute[72586]: DEBUG os_brick.utils [None req-1e277091-5dac-495d-8395-b97ffa256e64 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:30:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:24 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:24 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52e7d73-a75d-4176-b9d2-ddf7ec32ca75]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4bc202fb9cb\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:24 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30eec6a-7bb0-4382-b218-24b1390ac78d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:24 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20a8aed-e733-4240-9005-7e923c9a7c3d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:24 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dccb68e-02c7-4ef4-af51-d9892b325431]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-1e277091-5dac-495d-8395-b97ffa256e64 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Running cmd (subprocess): nvme version {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-1e277091-5dac-495d-8395-b97ffa256e64 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] 'nvme version' failed. Not Retrying. {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:30:24 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1e277091-5dac-495d-8395-b97ffa256e64 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] nvme not present on system {{(pid=72586) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 21:30:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:30:24 user nova-compute[72586]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 21:30:24 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbbd33ec-7dc9-4e78-9fb1-35e5d7a07153]: (4, '') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:24 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-1e277091-5dac-495d-8395-b97ffa256e64 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72586) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 21:30:24 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-1e277091-5dac-495d-8395-b97ffa256e64 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 21:30:24 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-1e277091-5dac-495d-8395-b97ffa256e64 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] LIGHTOS: no hostnqn found. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 21:30:24 user nova-compute[72586]: DEBUG os_brick.utils [None req-1e277091-5dac-495d-8395-b97ffa256e64 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4bc202fb9cb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:30:24 user nova-compute[72586]: DEBUG nova.virt.block_device [None req-1e277091-5dac-495d-8395-b97ffa256e64 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Updating existing volume attachment record: c8987f15-bc19-4333-a082-15814da7e0a4 {{(pid=72586) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 21:30:24 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:24 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:24 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:24 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:24 user nova-compute[72586]: DEBUG nova.compute.manager [req-1c1d0b52-00cf-412a-94a1-a2b420d2fc41 req-0c913810-2710-4349-b20f-4744d15c1661 service nova] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Received event network-vif-plugged-c082b11d-fb01-4def-98b8-6b2966ce364c {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:30:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-1c1d0b52-00cf-412a-94a1-a2b420d2fc41 req-0c913810-2710-4349-b20f-4744d15c1661 service nova] Acquiring lock "161fab9d-a7d1-4ea0-b4b9-2afc54040eef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:30:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-1c1d0b52-00cf-412a-94a1-a2b420d2fc41 req-0c913810-2710-4349-b20f-4744d15c1661 service nova] Lock "161fab9d-a7d1-4ea0-b4b9-2afc54040eef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:30:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-1c1d0b52-00cf-412a-94a1-a2b420d2fc41 req-0c913810-2710-4349-b20f-4744d15c1661 service nova] Lock "161fab9d-a7d1-4ea0-b4b9-2afc54040eef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:30:24 user nova-compute[72586]: DEBUG nova.compute.manager [req-1c1d0b52-00cf-412a-94a1-a2b420d2fc41 req-0c913810-2710-4349-b20f-4744d15c1661 service nova] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] No waiting events found dispatching network-vif-plugged-c082b11d-fb01-4def-98b8-6b2966ce364c {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:30:24 user nova-compute[72586]: WARNING nova.compute.manager [req-1c1d0b52-00cf-412a-94a1-a2b420d2fc41 req-0c913810-2710-4349-b20f-4744d15c1661 service nova] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Received unexpected event network-vif-plugged-c082b11d-fb01-4def-98b8-6b2966ce364c for instance with vm_state building and task_state spawning.
Aug 01 21:30:24 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:30:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:30:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:30:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:30:24 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Auditing locally available compute resources for user (node: user) {{(pid=72586) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 21:30:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:25 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:30:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:25 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:30:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Acquiring lock "7ac93270-a352-4844-900f-cd3486658610" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:30:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lock "7ac93270-a352-4844-900f-cd3486658610" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:30:25 user nova-compute[72586]: DEBUG nova.compute.manager [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 7ac93270-a352-4844-900f-cd3486658610] Starting instance... {{(pid=72586) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 21:30:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:30:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:30:25 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72586) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 21:30:25 user nova-compute[72586]: INFO nova.compute.claims [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 7ac93270-a352-4844-900f-cd3486658610] Claim successful on node user
Aug 01 21:30:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51eb56c-bce2-4593-abc3-878c358c9a74/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51eb56c-bce2-4593-abc3-878c358c9a74/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51eb56c-bce2-4593-abc3-878c358c9a74/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:26 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:30:26 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:30:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.669s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:30:26 user nova-compute[72586]: DEBUG nova.compute.manager [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 7ac93270-a352-4844-900f-cd3486658610] Start building networks asynchronously for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 21:30:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51eb56c-bce2-4593-abc3-878c358c9a74/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:30:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b0d907-2515-4a06-8b35-9ddd09ce42c3/disk.rescue --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:26 user nova-compute[72586]: DEBUG nova.compute.manager [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 7ac93270-a352-4844-900f-cd3486658610] Allocating IP information in the background. {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 21:30:26 user nova-compute[72586]: DEBUG nova.network.neutron [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 7ac93270-a352-4844-900f-cd3486658610] allocate_for_instance() {{(pid=72586) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 21:30:26 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 7ac93270-a352-4844-900f-cd3486658610] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 21:30:26 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925426.7429624, 161fab9d-a7d1-4ea0-b4b9-2afc54040eef => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:30:26 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] VM Resumed (Lifecycle Event)
Aug 01 21:30:26 user nova-compute[72586]: DEBUG nova.compute.manager [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Instance event wait completed in 0 seconds for  {{(pid=72586) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 21:30:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Guest created on hypervisor {{(pid=72586) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 21:30:26 user nova-compute[72586]: DEBUG nova.compute.manager [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 7ac93270-a352-4844-900f-cd3486658610] Start building block device mappings for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 21:30:26 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Instance spawned successfully.
Aug 01 21:30:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 21:30:26 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:30:26 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:30:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Found default for hw_cdrom_bus of ide {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:30:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Found default for hw_disk_bus of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:30:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Found default for hw_input_bus of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:30:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Found default for hw_pointer_model of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:30:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Found default for hw_video_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:30:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Found default for hw_vif_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:30:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b0d907-2515-4a06-8b35-9ddd09ce42c3/disk.rescue --force-share --output=json" returned: 0 in 0.153s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b0d907-2515-4a06-8b35-9ddd09ce42c3/disk.rescue --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:26 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:30:26 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925426.7434359, 161fab9d-a7d1-4ea0-b4b9-2afc54040eef => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:30:26 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] VM Started (Lifecycle Event)
Aug 01 21:30:26 user nova-compute[72586]: INFO nova.compute.manager [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Took 5.26 seconds to spawn the instance on the hypervisor.
Aug 01 21:30:26 user nova-compute[72586]: DEBUG nova.compute.manager [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:30:26 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:30:26 user nova-compute[72586]: DEBUG nova.policy [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0e8daa888b0c4b8fa6e42cab3058bd4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd51ad6ca4045699c8d72f9382f1c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72586) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 21:30:26 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:30:26 user nova-compute[72586]: DEBUG nova.compute.manager [req-8a412961-0e16-4177-b64a-575dab236c0c req-c846a997-13a2-481c-93fe-aaf1eb30f175 service nova] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Received event network-vif-plugged-c082b11d-fb01-4def-98b8-6b2966ce364c {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:30:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-8a412961-0e16-4177-b64a-575dab236c0c req-c846a997-13a2-481c-93fe-aaf1eb30f175 service nova] Acquiring lock "161fab9d-a7d1-4ea0-b4b9-2afc54040eef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:30:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-8a412961-0e16-4177-b64a-575dab236c0c req-c846a997-13a2-481c-93fe-aaf1eb30f175 service nova] Lock "161fab9d-a7d1-4ea0-b4b9-2afc54040eef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:30:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-8a412961-0e16-4177-b64a-575dab236c0c req-c846a997-13a2-481c-93fe-aaf1eb30f175 service nova] Lock "161fab9d-a7d1-4ea0-b4b9-2afc54040eef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:30:26 user nova-compute[72586]: DEBUG nova.compute.manager [req-8a412961-0e16-4177-b64a-575dab236c0c req-c846a997-13a2-481c-93fe-aaf1eb30f175 service nova] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] No waiting events found dispatching network-vif-plugged-c082b11d-fb01-4def-98b8-6b2966ce364c {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:30:26 user nova-compute[72586]: WARNING nova.compute.manager [req-8a412961-0e16-4177-b64a-575dab236c0c req-c846a997-13a2-481c-93fe-aaf1eb30f175 service nova] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Received unexpected event network-vif-plugged-c082b11d-fb01-4def-98b8-6b2966ce364c for instance with vm_state building and task_state spawning.
Aug 01 21:30:26 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:30:26 user nova-compute[72586]: DEBUG nova.compute.manager [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 7ac93270-a352-4844-900f-cd3486658610] Start spawning the instance on the hypervisor. {{(pid=72586) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 21:30:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 7ac93270-a352-4844-900f-cd3486658610] Creating instance directory {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 21:30:26 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 7ac93270-a352-4844-900f-cd3486658610] Creating image(s)
Aug 01 21:30:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Acquiring lock "/opt/stack/data/nova/instances/7ac93270-a352-4844-900f-cd3486658610/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:30:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lock "/opt/stack/data/nova/instances/7ac93270-a352-4844-900f-cd3486658610/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:30:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lock "/opt/stack/data/nova/instances/7ac93270-a352-4844-900f-cd3486658610/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:30:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:27 user nova-compute[72586]: INFO nova.compute.manager [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Took 20.51 seconds to build instance.
Aug 01 21:30:27 user nova-compute[72586]: DEBUG nova.network.neutron [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Port 68b636e3-234f-49e5-b0fb-9f99fffab5c5 binding to destination host user is already ACTIVE {{(pid=72586) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 01 21:30:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Acquiring lock "refresh_cache-c3798403-855b-45e4-af48-ba6b62570dba" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:30:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Acquired lock "refresh_cache-c3798403-855b-45e4-af48-ba6b62570dba" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:30:27 user nova-compute[72586]: DEBUG nova.network.neutron [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:30:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b0d907-2515-4a06-8b35-9ddd09ce42c3/disk.rescue --force-share --output=json" returned: 0 in 0.221s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:27 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /opt/stack/data/nova/instances/f6b0d907-2515-4a06-8b35-9ddd09ce42c3/disk (vdb) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:30:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f01c5ace-f0ff-4e8a-9e8f-804bb764dbb1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "161fab9d-a7d1-4ea0-b4b9-2afc54040eef" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.621s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:30:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.153s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Acquiring lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:30:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:30:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.147s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/7ac93270-a352-4844-900f-cd3486658610/disk 1073741824 {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/7ac93270-a352-4844-900f-cd3486658610/disk 1073741824" returned: 0 in 0.071s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:30:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.rescue --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.139s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:27 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7ac93270-a352-4844-900f-cd3486658610/disk. size=1073741824 {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 21:30:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ac93270-a352-4844-900f-cd3486658610/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.rescue --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:27 user nova-compute[72586]: DEBUG nova.network.neutron [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Updating instance_info_cache with network_info: [{"id": "68b636e3-234f-49e5-b0fb-9f99fffab5c5", "address": "fa:16:3e:a4:40:ed", "network": {"id": "42af123b-86fc-427d-b74a-a2e30c38720c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1787263710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c49158afdb04ea48c05f32782106197", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b636e3-23", "ovs_interfaceid": "68b636e3-234f-49e5-b0fb-9f99fffab5c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:30:27 user nova-compute[72586]: DEBUG nova.network.neutron [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 7ac93270-a352-4844-900f-cd3486658610] Successfully created port: bbd2d76f-a2a0-4bc1-bf4a-a1d52cb94278 {{(pid=72586) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 21:30:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ac93270-a352-4844-900f-cd3486658610/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:27 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Cannot resize image /opt/stack/data/nova/instances/7ac93270-a352-4844-900f-cd3486658610/disk to a smaller size. {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 21:30:27 user nova-compute[72586]: DEBUG nova.objects.instance [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lazy-loading 'migration_context' on Instance uuid 7ac93270-a352-4844-900f-cd3486658610 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:30:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Releasing lock "refresh_cache-c3798403-855b-45e4-af48-ba6b62570dba" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:30:27 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 7ac93270-a352-4844-900f-cd3486658610] Created local disks {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 21:30:27 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 7ac93270-a352-4844-900f-cd3486658610] Ensure instance console log exists: /opt/stack/data/nova/instances/7ac93270-a352-4844-900f-cd3486658610/console.log {{(pid=72586) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 21:30:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:30:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:30:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:30:27 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Creating tmpfile /opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba/tmpqjvb3_x5 to verify with other compute node that the instance is on the same shared storage. {{(pid=72586) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 01 21:30:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:27 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:27 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:27 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09571c9f-bf42-475a-afac-0e3947168d7e/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:28 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:28 user nova-compute[72586]: DEBUG nova.compute.manager [req-bac0770d-32ec-4151-a9b8-a26b4f909cd2 req-438b0262-a6e1-46a8-9299-70206f35bda0 service nova] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Received event network-vif-unplugged-68b636e3-234f-49e5-b0fb-9f99fffab5c5 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:30:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-bac0770d-32ec-4151-a9b8-a26b4f909cd2 req-438b0262-a6e1-46a8-9299-70206f35bda0 service nova] Acquiring lock "c3798403-855b-45e4-af48-ba6b62570dba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:30:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-bac0770d-32ec-4151-a9b8-a26b4f909cd2 req-438b0262-a6e1-46a8-9299-70206f35bda0 service nova] Lock "c3798403-855b-45e4-af48-ba6b62570dba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:30:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-bac0770d-32ec-4151-a9b8-a26b4f909cd2 req-438b0262-a6e1-46a8-9299-70206f35bda0 service nova] Lock "c3798403-855b-45e4-af48-ba6b62570dba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:30:28 user nova-compute[72586]: DEBUG nova.compute.manager [req-bac0770d-32ec-4151-a9b8-a26b4f909cd2 req-438b0262-a6e1-46a8-9299-70206f35bda0 service nova] [instance: c3798403-855b-45e4-af48-ba6b62570dba] No waiting events found dispatching network-vif-unplugged-68b636e3-234f-49e5-b0fb-9f99fffab5c5 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:30:28 user nova-compute[72586]: WARNING nova.compute.manager [req-bac0770d-32ec-4151-a9b8-a26b4f909cd2 req-438b0262-a6e1-46a8-9299-70206f35bda0 service nova] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Received unexpected event network-vif-unplugged-68b636e3-234f-49e5-b0fb-9f99fffab5c5 for instance with vm_state resized and task_state resize_reverting.
Aug 01 21:30:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09571c9f-bf42-475a-afac-0e3947168d7e/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09571c9f-bf42-475a-afac-0e3947168d7e/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09571c9f-bf42-475a-afac-0e3947168d7e/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:28 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:30:28 user nova-compute[72586]: DEBUG nova.network.neutron [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 7ac93270-a352-4844-900f-cd3486658610] Successfully updated port: bbd2d76f-a2a0-4bc1-bf4a-a1d52cb94278 {{(pid=72586) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 21:30:28 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Instance destroyed successfully.
Aug 01 21:30:28 user nova-compute[72586]: DEBUG nova.objects.instance [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Lazy-loading 'resources' on Instance uuid c3798403-855b-45e4-af48-ba6b62570dba {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:30:28 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:30:28 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:30:28 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Hypervisor/Node resource view: name=user free_ram=7430MB free_disk=25.222248077392578GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72586) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 21:30:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:30:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:30:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Acquiring lock "refresh_cache-7ac93270-a352-4844-900f-cd3486658610" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:30:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Acquired lock "refresh_cache-7ac93270-a352-4844-900f-cd3486658610" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:30:28 user nova-compute[72586]: DEBUG nova.network.neutron [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 7ac93270-a352-4844-900f-cd3486658610] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:30:28 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:24:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-124717694',display_name='tempest-ServerActionsTestOtherB-server-124717694',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-124717694',id=17,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgvcOBvmaWJhEwOkJkVCtNJ+42NFJ7Wme/nrROdsaAYDVV1668xM0wdadU29PtL+UEfr1KV8jRhHGVoqdqnxjGi6czPksct12PqH1D7Zn6OKGhhWdLcIzx9a1L98V8jxQ==',key_name='tempest-keypair-177851533',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:28:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0c49158afdb04ea48c05f32782106197',ramdisk_id='',reservation_id='r-6rqr0y9w',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1788994838',owner_user_name='tempest-ServerActionsTestOtherB-1788994838-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:28:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='353f3e5b8859476b8213462a8a3d00b4',uuid=c3798403-855b-45e4-af48-ba6b62570dba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "68b636e3-234f-49e5-b0fb-9f99fffab5c5", "address": "fa:16:3e:a4:40:ed", "network": {"id": "42af123b-86fc-427d-b74a-a2e30c38720c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1787263710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c49158afdb04ea48c05f32782106197", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b636e3-23", "ovs_interfaceid": "68b636e3-234f-49e5-b0fb-9f99fffab5c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:30:28 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Converting VIF {"id": "68b636e3-234f-49e5-b0fb-9f99fffab5c5", "address": "fa:16:3e:a4:40:ed", "network": {"id": "42af123b-86fc-427d-b74a-a2e30c38720c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1787263710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c49158afdb04ea48c05f32782106197", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b636e3-23", "ovs_interfaceid": "68b636e3-234f-49e5-b0fb-9f99fffab5c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:30:28 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:40:ed,bridge_name='br-int',has_traffic_filtering=True,id=68b636e3-234f-49e5-b0fb-9f99fffab5c5,network=Network(42af123b-86fc-427d-b74a-a2e30c38720c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68b636e3-23') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:30:28 user nova-compute[72586]: DEBUG os_vif [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:40:ed,bridge_name='br-int',has_traffic_filtering=True,id=68b636e3-234f-49e5-b0fb-9f99fffab5c5,network=Network(42af123b-86fc-427d-b74a-a2e30c38720c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68b636e3-23') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap68b636e3-23, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:30:29 user nova-compute[72586]: INFO os_vif [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:40:ed,bridge_name='br-int',has_traffic_filtering=True,id=68b636e3-234f-49e5-b0fb-9f99fffab5c5,network=Network(42af123b-86fc-427d-b74a-a2e30c38720c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68b636e3-23')
Aug 01 21:30:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] calling os-brick to detach iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, {'target_iqns': ['iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tYAvmCpL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:30:29 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:30:29 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea', 0)] {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG nova.network.neutron [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 7ac93270-a352-4844-900f-cd3486658610] Instance cache missing network info. {{(pid=72586) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8fde31d-3f88-4a73-abfa-4f7124900908]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5190804-b3d9-48ce-a140-bb5da79f64a2]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)
Aug 01 21:30:29 user nova-compute[72586]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:30:29 user nova-compute[72586]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)
Aug 01 21:30:29 user nova-compute[72586]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 (non-flash)
Aug 01 21:30:29 user nova-compute[72586]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:30:29 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)
Aug 01 21:30:29 user nova-compute[72586]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:30:29 user nova-compute[72586]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)
Aug 01 21:30:29 user nova-compute[72586]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 (non-flash)
Aug 01 21:30:29 user nova-compute[72586]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:30:29 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ed03dab90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea'): ({'sdf'}, set())}) {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Removing single pathed devices sdf {{(pid=72586) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ca91a4-2d46-445b-b839-253d6b7db787]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb8cabd-cbfb-4a4e-a119-f0432cfa6e00]: (4, ('ok\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Flushing IO for device /dev/sdf {{(pid=72586) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Applying migration context for instance c3798403-855b-45e4-af48-ba6b62570dba as it has an incoming, in-progress migration bedc08a7-a4ac-435e-91db-43271e345055. Migration status is reverting {{(pid=72586) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 01 21:30:29 user nova-compute[72586]: INFO nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Updating resource usage from migration bedc08a7-a4ac-435e-91db-43271e345055
Aug 01 21:30:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0ecc65-de36-4ad9-b8f8-3cf3c50de0cd]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72586) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.044s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac4744a-b446-4087-9c9f-a2c2bba6785e]: (4, ('1', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] SCSI volumes sdf have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea')] {{(pid=72586) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[448c28a1-730b-427b-881b-da358f5bb430]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea -p 172.16.0.220:3260 --logout {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 042f0031-1e4d-41d0-8bfa-36001675cfe3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 413c3426-18ad-4a5c-af04-e0e7fc90f050 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 49c24c77-f102-4aed-8314-b04aad5f6b3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance d51eb56c-bce2-4593-abc3-878c358c9a74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance af2de810-b22f-4fa9-835c-c673abd145db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance f6b0d907-2515-4a06-8b35-9ddd09ce42c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 09571c9f-bf42-475a-afac-0e3947168d7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Migration bedc08a7-a4ac-435e-91db-43271e345055 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance c3798403-855b-45e4-af48-ba6b62570dba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 161fab9d-a7d1-4ea0-b4b9-2afc54040eef actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 7ac93270-a352-4844-900f-cd3486658610 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97e841b-55cf-4291-a3ad-6e2193225a99]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea, portal: 172.16.0.220,3260]
Aug 01 21:30:29 user nova-compute[72586]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea, portal: 172.16.0.220,3260] successful.
Aug 01 21:30:29 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea -p 172.16.0.220:3260 --op delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Refreshing inventories for resource provider ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1baec8a-e2a0-4e52-9da6-299fb12d6214]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] <== disconnect_volume: return (343ms) None {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Disconnected iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG nova.network.neutron [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 7ac93270-a352-4844-900f-cd3486658610] Updating instance_info_cache with network_info: [{"id": "bbd2d76f-a2a0-4bc1-bf4a-a1d52cb94278", "address": "fa:16:3e:c4:bc:0a", "network": {"id": "8e60d949-6c06-4e40-b792-d6f516b967d7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-603740209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfd51ad6ca4045699c8d72f9382f1c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbd2d76f-a2", "ovs_interfaceid": "bbd2d76f-a2a0-4bc1-bf4a-a1d52cb94278", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Updating ProviderTree inventory for provider ca6775c1-2a64-43f9-9467-372aa0457b1d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Updating inventory in ProviderTree for provider ca6775c1-2a64-43f9-9467-372aa0457b1d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Releasing lock "refresh_cache-7ac93270-a352-4844-900f-cd3486658610" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG nova.compute.manager [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 7ac93270-a352-4844-900f-cd3486658610] Instance network_info: |[{"id": "bbd2d76f-a2a0-4bc1-bf4a-a1d52cb94278", "address": "fa:16:3e:c4:bc:0a", "network": {"id": "8e60d949-6c06-4e40-b792-d6f516b967d7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-603740209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfd51ad6ca4045699c8d72f9382f1c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbd2d76f-a2", "ovs_interfaceid": "bbd2d76f-a2a0-4bc1-bf4a-a1d52cb94278", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 7ac93270-a352-4844-900f-cd3486658610] Start _get_guest_xml network_info=[{"id": "bbd2d76f-a2a0-4bc1-bf4a-a1d52cb94278", "address": "fa:16:3e:c4:bc:0a", "network": {"id": "8e60d949-6c06-4e40-b792-d6f516b967d7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-603740209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfd51ad6ca4045699c8d72f9382f1c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbd2d76f-a2", "ovs_interfaceid": "bbd2d76f-a2a0-4bc1-bf4a-a1d52cb94278", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '0243d46b-6819-42a5-926f-42b71f0c97ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:30:29 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:30:29 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:30:29 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Refreshing aggregate associations for resource provider ca6775c1-2a64-43f9-9467-372aa0457b1d, aggregates: None {{(pid=72586) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:30:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-557306936',display_name='tempest-VolumesSnapshotTestJSON-instance-557306936',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-557306936',id=27,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXaE8NDQD4DTECaOIn7hFaMX+ppKuYimp/IfObSqCrHQzD5dWyrkP1e7m98N142JFBJMuquKn4QJz9op0IHPL+vZCEZASqZsTKSyFRvjnPENe9BHedQx5OxIt33Dun0Dw==',key_name='tempest-keypair-66140608',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dfd51ad6ca4045699c8d72f9382f1c62',ramdisk_id='',reservation_id='r-mek89l6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1613093006',owner_user_name='tempest-VolumesSnapshotTestJSON-1613093006-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:30:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e8daa888b0c4b8fa6e42cab3058bd4c',uuid=7ac93270-a352-4844-900f-cd3486658610,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bbd2d76f-a2a0-4bc1-bf4a-a1d52cb94278", "address": "fa:16:3e:c4:bc:0a", "network": {"id": "8e60d949-6c06-4e40-b792-d6f516b967d7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-603740209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfd51ad6ca4045699c8d72f9382f1c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbd2d76f-a2", "ovs_interfaceid": "bbd2d76f-a2a0-4bc1-bf4a-a1d52cb94278", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Converting VIF {"id": "bbd2d76f-a2a0-4bc1-bf4a-a1d52cb94278", "address": "fa:16:3e:c4:bc:0a", "network": {"id": "8e60d949-6c06-4e40-b792-d6f516b967d7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-603740209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfd51ad6ca4045699c8d72f9382f1c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbd2d76f-a2", "ovs_interfaceid": "bbd2d76f-a2a0-4bc1-bf4a-a1d52cb94278", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:bc:0a,bridge_name='br-int',has_traffic_filtering=True,id=bbd2d76f-a2a0-4bc1-bf4a-a1d52cb94278,network=Network(8e60d949-6c06-4e40-b792-d6f516b967d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbd2d76f-a2') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG nova.objects.instance [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lazy-loading 'pci_devices' on Instance uuid 7ac93270-a352-4844-900f-cd3486658610 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Refreshing trait associations for resource provider ca6775c1-2a64-43f9-9467-372aa0457b1d, traits: COMPUTE_NODE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_TRUSTED_CERTS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AMI {{(pid=72586) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 7ac93270-a352-4844-900f-cd3486658610] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:30:29 user nova-compute[72586]:   <uuid>7ac93270-a352-4844-900f-cd3486658610</uuid>
Aug 01 21:30:29 user nova-compute[72586]:   <name>instance-0000001b</name>
Aug 01 21:30:29 user nova-compute[72586]:   <memory>524288</memory>
Aug 01 21:30:29 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:30:29 user nova-compute[72586]:   <metadata>
Aug 01 21:30:29 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:30:29 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:30:29 user nova-compute[72586]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-557306936</nova:name>
Aug 01 21:30:29 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:30:29</nova:creationTime>
Aug 01 21:30:29 user nova-compute[72586]:       <nova:flavor name="m1.tiny">
Aug 01 21:30:29 user nova-compute[72586]:         <nova:memory>512</nova:memory>
Aug 01 21:30:29 user nova-compute[72586]:         <nova:disk>1</nova:disk>
Aug 01 21:30:29 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:30:29 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:30:29 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:30:29 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:30:29 user nova-compute[72586]:       <nova:owner>
Aug 01 21:30:29 user nova-compute[72586]:         <nova:user uuid="0e8daa888b0c4b8fa6e42cab3058bd4c">tempest-VolumesSnapshotTestJSON-1613093006-project-member</nova:user>
Aug 01 21:30:29 user nova-compute[72586]:         <nova:project uuid="dfd51ad6ca4045699c8d72f9382f1c62">tempest-VolumesSnapshotTestJSON-1613093006</nova:project>
Aug 01 21:30:29 user nova-compute[72586]:       </nova:owner>
Aug 01 21:30:29 user nova-compute[72586]:       <nova:root type="image" uuid="0243d46b-6819-42a5-926f-42b71f0c97ad"/>
Aug 01 21:30:29 user nova-compute[72586]:       <nova:ports>
Aug 01 21:30:29 user nova-compute[72586]:         <nova:port uuid="bbd2d76f-a2a0-4bc1-bf4a-a1d52cb94278">
Aug 01 21:30:29 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 01 21:30:29 user nova-compute[72586]:         </nova:port>
Aug 01 21:30:29 user nova-compute[72586]:       </nova:ports>
Aug 01 21:30:29 user nova-compute[72586]:     </nova:instance>
Aug 01 21:30:29 user nova-compute[72586]:   </metadata>
Aug 01 21:30:29 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:30:29 user nova-compute[72586]:     <system>
Aug 01 21:30:29 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:30:29 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:30:29 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:30:29 user nova-compute[72586]:       <entry name="serial">7ac93270-a352-4844-900f-cd3486658610</entry>
Aug 01 21:30:29 user nova-compute[72586]:       <entry name="uuid">7ac93270-a352-4844-900f-cd3486658610</entry>
Aug 01 21:30:29 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:30:29 user nova-compute[72586]:     </system>
Aug 01 21:30:29 user nova-compute[72586]:   </sysinfo>
Aug 01 21:30:29 user nova-compute[72586]:   <os>
Aug 01 21:30:29 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:30:29 user nova-compute[72586]:     <boot dev="hd"/>
Aug 01 21:30:29 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:30:29 user nova-compute[72586]:   </os>
Aug 01 21:30:29 user nova-compute[72586]:   <features>
Aug 01 21:30:29 user nova-compute[72586]:     <acpi/>
Aug 01 21:30:29 user nova-compute[72586]:     <apic/>
Aug 01 21:30:29 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:30:29 user nova-compute[72586]:   </features>
Aug 01 21:30:29 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:30:29 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:30:29 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:30:29 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:30:29 user nova-compute[72586]:   </clock>
Aug 01 21:30:29 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:30:29 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:30:29 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:30:29 user nova-compute[72586]:   </cpu>
Aug 01 21:30:29 user nova-compute[72586]:   <devices>
Aug 01 21:30:29 user nova-compute[72586]:     <disk type="file" device="disk">
Aug 01 21:30:29 user nova-compute[72586]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 21:30:29 user nova-compute[72586]:       <source file="/opt/stack/data/nova/instances/7ac93270-a352-4844-900f-cd3486658610/disk"/>
Aug 01 21:30:29 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:30:29 user nova-compute[72586]:     </disk>
Aug 01 21:30:29 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:30:29 user nova-compute[72586]:       <mac address="fa:16:3e:c4:bc:0a"/>
Aug 01 21:30:29 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:30:29 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:30:29 user nova-compute[72586]:       <target dev="tapbbd2d76f-a2"/>
Aug 01 21:30:29 user nova-compute[72586]:     </interface>
Aug 01 21:30:29 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:30:29 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/7ac93270-a352-4844-900f-cd3486658610/console.log" append="off"/>
Aug 01 21:30:29 user nova-compute[72586]:     </serial>
Aug 01 21:30:29 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:30:29 user nova-compute[72586]:     <video>
Aug 01 21:30:29 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:30:29 user nova-compute[72586]:     </video>
Aug 01 21:30:29 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:30:29 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:30:29 user nova-compute[72586]:     </rng>
Aug 01 21:30:29 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:30:29 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:30:29 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:30:29 user nova-compute[72586]:     </memballoon>
Aug 01 21:30:29 user nova-compute[72586]:   </devices>
Aug 01 21:30:29 user nova-compute[72586]: </domain>
Aug 01 21:30:29 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:30:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-557306936',display_name='tempest-VolumesSnapshotTestJSON-instance-557306936',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-557306936',id=27,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXaE8NDQD4DTECaOIn7hFaMX+ppKuYimp/IfObSqCrHQzD5dWyrkP1e7m98N142JFBJMuquKn4QJz9op0IHPL+vZCEZASqZsTKSyFRvjnPENe9BHedQx5OxIt33Dun0Dw==',key_name='tempest-keypair-66140608',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dfd51ad6ca4045699c8d72f9382f1c62',ramdisk_id='',reservation_id='r-mek89l6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1613093006',owner_user_name='tempest-VolumesSnapshotTestJSON-1613093006-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:30:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e8daa888b0c4b8fa6e42cab3058bd4c',uuid=7ac93270-a352-4844-900f-cd3486658610,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bbd2d76f-a2a0-4bc1-bf4a-a1d52cb94278", "address": "fa:16:3e:c4:bc:0a", "network": {"id": "8e60d949-6c06-4e40-b792-d6f516b967d7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-603740209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfd51ad6ca4045699c8d72f9382f1c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbd2d76f-a2", "ovs_interfaceid": "bbd2d76f-a2a0-4bc1-bf4a-a1d52cb94278", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Converting VIF {"id": "bbd2d76f-a2a0-4bc1-bf4a-a1d52cb94278", "address": "fa:16:3e:c4:bc:0a", "network": {"id": "8e60d949-6c06-4e40-b792-d6f516b967d7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-603740209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfd51ad6ca4045699c8d72f9382f1c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbd2d76f-a2", "ovs_interfaceid": "bbd2d76f-a2a0-4bc1-bf4a-a1d52cb94278", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:bc:0a,bridge_name='br-int',has_traffic_filtering=True,id=bbd2d76f-a2a0-4bc1-bf4a-a1d52cb94278,network=Network(8e60d949-6c06-4e40-b792-d6f516b967d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbd2d76f-a2') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG os_vif [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:bc:0a,bridge_name='br-int',has_traffic_filtering=True,id=bbd2d76f-a2a0-4bc1-bf4a-a1d52cb94278,network=Network(8e60d949-6c06-4e40-b792-d6f516b967d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbd2d76f-a2') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbbd2d76f-a2, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbbd2d76f-a2, col_values=(('external_ids', {'iface-id': 'bbd2d76f-a2a0-4bc1-bf4a-a1d52cb94278', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:bc:0a', 'vm-uuid': '7ac93270-a352-4844-900f-cd3486658610'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:29 user nova-compute[72586]: INFO os_vif [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:bc:0a,bridge_name='br-int',has_traffic_filtering=True,id=bbd2d76f-a2a0-4bc1-bf4a-a1d52cb94278,network=Network(8e60d949-6c06-4e40-b792-d6f516b967d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbd2d76f-a2')
Aug 01 21:30:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] No VIF found with MAC fa:16:3e:c4:bc:0a, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Compute_service record updated for user:user {{(pid=72586) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 21:30:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.942s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:30:30 user nova-compute[72586]: DEBUG nova.compute.manager [req-acea0031-497d-4b2a-81c9-d23f72500630 req-5c3fbc61-3154-4378-b960-6ee4a3853a72 service nova] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Received event network-vif-plugged-68b636e3-234f-49e5-b0fb-9f99fffab5c5 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:30:30 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-acea0031-497d-4b2a-81c9-d23f72500630 req-5c3fbc61-3154-4378-b960-6ee4a3853a72 service nova] Acquiring lock "c3798403-855b-45e4-af48-ba6b62570dba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:30:30 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-acea0031-497d-4b2a-81c9-d23f72500630 req-5c3fbc61-3154-4378-b960-6ee4a3853a72 service nova] Lock "c3798403-855b-45e4-af48-ba6b62570dba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:30:30 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-acea0031-497d-4b2a-81c9-d23f72500630 req-5c3fbc61-3154-4378-b960-6ee4a3853a72 service nova] Lock "c3798403-855b-45e4-af48-ba6b62570dba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:30:30 user nova-compute[72586]: DEBUG nova.compute.manager [req-acea0031-497d-4b2a-81c9-d23f72500630 req-5c3fbc61-3154-4378-b960-6ee4a3853a72 service nova] [instance: c3798403-855b-45e4-af48-ba6b62570dba] No waiting events found dispatching network-vif-plugged-68b636e3-234f-49e5-b0fb-9f99fffab5c5 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:30:30 user nova-compute[72586]: WARNING nova.compute.manager [req-acea0031-497d-4b2a-81c9-d23f72500630 req-5c3fbc61-3154-4378-b960-6ee4a3853a72 service nova] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Received unexpected event network-vif-plugged-68b636e3-234f-49e5-b0fb-9f99fffab5c5 for instance with vm_state resized and task_state resize_reverting.
Aug 01 21:30:30 user nova-compute[72586]: DEBUG nova.compute.manager [req-acea0031-497d-4b2a-81c9-d23f72500630 req-5c3fbc61-3154-4378-b960-6ee4a3853a72 service nova] [instance: 7ac93270-a352-4844-900f-cd3486658610] Received event network-changed-bbd2d76f-a2a0-4bc1-bf4a-a1d52cb94278 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:30:30 user nova-compute[72586]: DEBUG nova.compute.manager [req-acea0031-497d-4b2a-81c9-d23f72500630 req-5c3fbc61-3154-4378-b960-6ee4a3853a72 service nova] [instance: 7ac93270-a352-4844-900f-cd3486658610] Refreshing instance network info cache due to event network-changed-bbd2d76f-a2a0-4bc1-bf4a-a1d52cb94278. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:30:30 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-acea0031-497d-4b2a-81c9-d23f72500630 req-5c3fbc61-3154-4378-b960-6ee4a3853a72 service nova] Acquiring lock "refresh_cache-7ac93270-a352-4844-900f-cd3486658610" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:30:30 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-acea0031-497d-4b2a-81c9-d23f72500630 req-5c3fbc61-3154-4378-b960-6ee4a3853a72 service nova] Acquired lock "refresh_cache-7ac93270-a352-4844-900f-cd3486658610" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:30:30 user nova-compute[72586]: DEBUG nova.network.neutron [req-acea0031-497d-4b2a-81c9-d23f72500630 req-5c3fbc61-3154-4378-b960-6ee4a3853a72 service nova] [instance: 7ac93270-a352-4844-900f-cd3486658610] Refreshing network info cache for port bbd2d76f-a2a0-4bc1-bf4a-a1d52cb94278 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:30:30 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:30:30 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:30:30 user nova-compute[72586]: DEBUG nova.objects.instance [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Lazy-loading 'migration_context' on Instance uuid c3798403-855b-45e4-af48-ba6b62570dba {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:30:30 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:30:30 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:30:30 user nova-compute[72586]: DEBUG nova.network.neutron [req-acea0031-497d-4b2a-81c9-d23f72500630 req-5c3fbc61-3154-4378-b960-6ee4a3853a72 service nova] [instance: 7ac93270-a352-4844-900f-cd3486658610] Updated VIF entry in instance network info cache for port bbd2d76f-a2a0-4bc1-bf4a-a1d52cb94278. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:30:30 user nova-compute[72586]: DEBUG nova.network.neutron [req-acea0031-497d-4b2a-81c9-d23f72500630 req-5c3fbc61-3154-4378-b960-6ee4a3853a72 service nova] [instance: 7ac93270-a352-4844-900f-cd3486658610] Updating instance_info_cache with network_info: [{"id": "bbd2d76f-a2a0-4bc1-bf4a-a1d52cb94278", "address": "fa:16:3e:c4:bc:0a", "network": {"id": "8e60d949-6c06-4e40-b792-d6f516b967d7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-603740209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfd51ad6ca4045699c8d72f9382f1c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbd2d76f-a2", "ovs_interfaceid": "bbd2d76f-a2a0-4bc1-bf4a-a1d52cb94278", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:30:30 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.451s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:30:30 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-acea0031-497d-4b2a-81c9-d23f72500630 req-5c3fbc61-3154-4378-b960-6ee4a3853a72 service nova] Releasing lock "refresh_cache-7ac93270-a352-4844-900f-cd3486658610" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:30:30 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:30 user nova-compute[72586]: INFO nova.compute.manager [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Swapping old allocation on dict_keys(['ca6775c1-2a64-43f9-9467-372aa0457b1d']) held by migration bedc08a7-a4ac-435e-91db-43271e345055 for instance
Aug 01 21:30:30 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:30:30 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:30:30 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Starting heal instance info cache {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 21:30:30 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:30 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:30 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:30 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Overwriting current allocation {'allocations': {'ca6775c1-2a64-43f9-9467-372aa0457b1d': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 32}}, 'project_id': '0c49158afdb04ea48c05f32782106197', 'user_id': '353f3e5b8859476b8213462a8a3d00b4', 'consumer_generation': 1} on consumer c3798403-855b-45e4-af48-ba6b62570dba {{(pid=72586) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 01 21:30:31 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "refresh_cache-d51eb56c-bce2-4593-abc3-878c358c9a74" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:30:31 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquired lock "refresh_cache-d51eb56c-bce2-4593-abc3-878c358c9a74" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:30:31 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Forcefully refreshing network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 21:30:31 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Acquiring lock "refresh_cache-c3798403-855b-45e4-af48-ba6b62570dba" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:30:31 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Acquired lock "refresh_cache-c3798403-855b-45e4-af48-ba6b62570dba" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:30:31 user nova-compute[72586]: DEBUG nova.network.neutron [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:30:31 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:31 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:31 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:31 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:31 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Updating instance_info_cache with network_info: [{"id": "0cdd112b-f316-4cf2-b3e5-82897e241453", "address": "fa:16:3e:f2:07:05", "network": {"id": "b40254e1-7668-4ef6-b133-681304d57290", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1667586785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f911c1cbc98a4d93b73090da5f655812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cdd112b-f3", "ovs_interfaceid": "0cdd112b-f316-4cf2-b3e5-82897e241453", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:30:31 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Releasing lock "refresh_cache-d51eb56c-bce2-4593-abc3-878c358c9a74" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:30:31 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Updated the network info_cache for instance {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 21:30:31 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:30:31 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:30:31 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:30:31 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:30:31 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72586) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 21:30:31 user nova-compute[72586]: DEBUG nova.network.neutron [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Updating instance_info_cache with network_info: [{"id": "68b636e3-234f-49e5-b0fb-9f99fffab5c5", "address": "fa:16:3e:a4:40:ed", "network": {"id": "42af123b-86fc-427d-b74a-a2e30c38720c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1787263710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c49158afdb04ea48c05f32782106197", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b636e3-23", "ovs_interfaceid": "68b636e3-234f-49e5-b0fb-9f99fffab5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:30:31 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Releasing lock "refresh_cache-c3798403-855b-45e4-af48-ba6b62570dba" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:30:31 user nova-compute[72586]: DEBUG os_brick.utils [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:30:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:31 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3d7f2c-a0ff-43c2-a2b8-af81e2705e5a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4bc202fb9cb\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:31 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c61bbc-c2c8-4515-b1e0-cf5de76abb40]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:31 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0f5e29-f396-41a8-80c4-50612a927a7c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:31 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc6cf02-226f-42e2-8fc6-81463a9d03b9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Running cmd (subprocess): nvme version {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] 'nvme version' failed. Not Retrying. {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:30:31 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] nvme not present on system {{(pid=72586) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 21:30:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:30:31 user nova-compute[72586]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 21:30:31 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[439ad67e-ecba-43d4-b6de-9693e5afff5c]: (4, '') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:32 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72586) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 21:30:32 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 21:30:32 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] LIGHTOS: no hostnqn found. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 21:30:32 user nova-compute[72586]: DEBUG os_brick.utils [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4bc202fb9cb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:30:32 user nova-compute[72586]: DEBUG nova.compute.manager [req-470684fb-5384-4b9c-9804-e2da71a16a0c req-c7883ac0-7ebd-4332-bbd3-fcf0d2b23ab7 service nova] [instance: 7ac93270-a352-4844-900f-cd3486658610] Received event network-vif-plugged-bbd2d76f-a2a0-4bc1-bf4a-a1d52cb94278 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:30:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-470684fb-5384-4b9c-9804-e2da71a16a0c req-c7883ac0-7ebd-4332-bbd3-fcf0d2b23ab7 service nova] Acquiring lock "7ac93270-a352-4844-900f-cd3486658610-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:30:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-470684fb-5384-4b9c-9804-e2da71a16a0c req-c7883ac0-7ebd-4332-bbd3-fcf0d2b23ab7 service nova] Lock "7ac93270-a352-4844-900f-cd3486658610-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:30:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-470684fb-5384-4b9c-9804-e2da71a16a0c req-c7883ac0-7ebd-4332-bbd3-fcf0d2b23ab7 service nova] Lock "7ac93270-a352-4844-900f-cd3486658610-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:30:32 user nova-compute[72586]: DEBUG nova.compute.manager [req-470684fb-5384-4b9c-9804-e2da71a16a0c req-c7883ac0-7ebd-4332-bbd3-fcf0d2b23ab7 service nova] [instance: 7ac93270-a352-4844-900f-cd3486658610] No waiting events found dispatching network-vif-plugged-bbd2d76f-a2a0-4bc1-bf4a-a1d52cb94278 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:30:32 user nova-compute[72586]: WARNING nova.compute.manager [req-470684fb-5384-4b9c-9804-e2da71a16a0c req-c7883ac0-7ebd-4332-bbd3-fcf0d2b23ab7 service nova] [instance: 7ac93270-a352-4844-900f-cd3486658610] Received unexpected event network-vif-plugged-bbd2d76f-a2a0-4bc1-bf4a-a1d52cb94278 for instance with vm_state building and task_state spawning.
Aug 01 21:30:32 user nova-compute[72586]: DEBUG nova.compute.manager [req-470684fb-5384-4b9c-9804-e2da71a16a0c req-c7883ac0-7ebd-4332-bbd3-fcf0d2b23ab7 service nova] [instance: 7ac93270-a352-4844-900f-cd3486658610] Received event network-vif-plugged-bbd2d76f-a2a0-4bc1-bf4a-a1d52cb94278 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:30:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-470684fb-5384-4b9c-9804-e2da71a16a0c req-c7883ac0-7ebd-4332-bbd3-fcf0d2b23ab7 service nova] Acquiring lock "7ac93270-a352-4844-900f-cd3486658610-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:30:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-470684fb-5384-4b9c-9804-e2da71a16a0c req-c7883ac0-7ebd-4332-bbd3-fcf0d2b23ab7 service nova] Lock "7ac93270-a352-4844-900f-cd3486658610-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:30:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-470684fb-5384-4b9c-9804-e2da71a16a0c req-c7883ac0-7ebd-4332-bbd3-fcf0d2b23ab7 service nova] Lock "7ac93270-a352-4844-900f-cd3486658610-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:30:32 user nova-compute[72586]: DEBUG nova.compute.manager [req-470684fb-5384-4b9c-9804-e2da71a16a0c req-c7883ac0-7ebd-4332-bbd3-fcf0d2b23ab7 service nova] [instance: 7ac93270-a352-4844-900f-cd3486658610] No waiting events found dispatching network-vif-plugged-bbd2d76f-a2a0-4bc1-bf4a-a1d52cb94278 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:30:32 user nova-compute[72586]: WARNING nova.compute.manager [req-470684fb-5384-4b9c-9804-e2da71a16a0c req-c7883ac0-7ebd-4332-bbd3-fcf0d2b23ab7 service nova] [instance: 7ac93270-a352-4844-900f-cd3486658610] Received unexpected event network-vif-plugged-bbd2d76f-a2a0-4bc1-bf4a-a1d52cb94278 for instance with vm_state building and task_state spawning.
Aug 01 21:30:32 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:30:32 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e277091-5dac-495d-8395-b97ffa256e64 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Calling os-brick to attach iSCSI Volume {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 21:30:32 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e277091-5dac-495d-8395-b97ffa256e64 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:aa629379-4387-45d9-8175-351c9df0e0bb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RyAQYasO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:30:32 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-1e277091-5dac-495d-8395-b97ffa256e64 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:30:32 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-1e277091-5dac-495d-8395-b97ffa256e64 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:30:32 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-1e277091-5dac-495d-8395-b97ffa256e64 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:30:32 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-1e277091-5dac-495d-8395-b97ffa256e64 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:30:32 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-1e277091-5dac-495d-8395-b97ffa256e64 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa629379-4387-45d9-8175-351c9df0e0bb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:30:32 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-1e277091-5dac-495d-8395-b97ffa256e64 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa629379-4387-45d9-8175-351c9df0e0bb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:30:32 user nova-compute[72586]: INFO os_brick.initiator.connectors.iscsi [None req-1e277091-5dac-495d-8395-b97ffa256e64 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 21:30:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa629379-4387-45d9-8175-351c9df0e0bb -p 172.16.0.220:3260 {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa629379-4387-45d9-8175-351c9df0e0bb -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:32 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[5544ed62-857b-47f7-8910-84282a93757e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:32 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e277091-5dac-495d-8395-b97ffa256e64 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 21:30:32 user nova-compute[72586]:  {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:30:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa629379-4387-45d9-8175-351c9df0e0bb -p 172.16.0.220:3260 --interface default --op new {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa629379-4387-45d9-8175-351c9df0e0bb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:32 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f42e8eb-e338-40da-ada8-239a347d39cf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa629379-4387-45d9-8175-351c9df0e0bb] added\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:32 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e277091-5dac-495d-8395-b97ffa256e64 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa629379-4387-45d9-8175-351c9df0e0bb] added
Aug 01 21:30:32 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:30:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa629379-4387-45d9-8175-351c9df0e0bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa629379-4387-45d9-8175-351c9df0e0bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:33 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce9bc3c-8ed1-4317-874f-bc4ecd1e1275]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:33 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e277091-5dac-495d-8395-b97ffa256e64 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:30:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa629379-4387-45d9-8175-351c9df0e0bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa629379-4387-45d9-8175-351c9df0e0bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:33 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[533dcccf-1d9b-4126-a6c9-9f75a81e1e64]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:33 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e277091-5dac-495d-8395-b97ffa256e64 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:30:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa629379-4387-45d9-8175-351c9df0e0bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RyAQYasO {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa629379-4387-45d9-8175-351c9df0e0bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RyAQYasO" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:33 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57752a0-9c93-4723-92f4-fbb0f821c9eb]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:33 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e277091-5dac-495d-8395-b97ffa256e64 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RyAQYasO'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:30:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa629379-4387-45d9-8175-351c9df0e0bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa629379-4387-45d9-8175-351c9df0e0bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:33 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaea3d6f-3d7e-4f09-bc92-318954f20409]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:33 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e277091-5dac-495d-8395-b97ffa256e64 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:30:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:33 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4199d20-6044-483b-9240-a26e9fd9a238]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:33 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e277091-5dac-495d-8395-b97ffa256e64 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)
Aug 01 21:30:33 user nova-compute[72586]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)
Aug 01 21:30:33 user nova-compute[72586]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 (non-flash)
Aug 01 21:30:33 user nova-compute[72586]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:30:33 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:30:33 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e277091-5dac-495d-8395-b97ffa256e64 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)
Aug 01 21:30:33 user nova-compute[72586]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)
Aug 01 21:30:33 user nova-compute[72586]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 (non-flash)
Aug 01 21:30:33 user nova-compute[72586]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:30:33 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:30:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa629379-4387-45d9-8175-351c9df0e0bb -p 172.16.0.220:3260 --login {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:33 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925433.1095862, 7ac93270-a352-4844-900f-cd3486658610 => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:30:33 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 7ac93270-a352-4844-900f-cd3486658610] VM Resumed (Lifecycle Event)
Aug 01 21:30:33 user nova-compute[72586]: DEBUG nova.compute.manager [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 7ac93270-a352-4844-900f-cd3486658610] Instance event wait completed in 0 seconds for  {{(pid=72586) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 21:30:33 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 7ac93270-a352-4844-900f-cd3486658610] Guest created on hypervisor {{(pid=72586) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 21:30:33 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 7ac93270-a352-4844-900f-cd3486658610] Instance spawned successfully.
Aug 01 21:30:33 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 7ac93270-a352-4844-900f-cd3486658610] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 21:30:33 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 7ac93270-a352-4844-900f-cd3486658610] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:30:33 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 7ac93270-a352-4844-900f-cd3486658610] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:30:33 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 7ac93270-a352-4844-900f-cd3486658610] Found default for hw_cdrom_bus of ide {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:30:33 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 7ac93270-a352-4844-900f-cd3486658610] Found default for hw_disk_bus of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:30:33 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 7ac93270-a352-4844-900f-cd3486658610] Found default for hw_input_bus of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:30:33 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 7ac93270-a352-4844-900f-cd3486658610] Found default for hw_pointer_model of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:30:33 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 7ac93270-a352-4844-900f-cd3486658610] Found default for hw_video_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:30:33 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 7ac93270-a352-4844-900f-cd3486658610] Found default for hw_vif_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:30:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa629379-4387-45d9-8175-351c9df0e0bb -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:33 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 7ac93270-a352-4844-900f-cd3486658610] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:30:33 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925433.1169152, 7ac93270-a352-4844-900f-cd3486658610 => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:30:33 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 7ac93270-a352-4844-900f-cd3486658610] VM Started (Lifecycle Event)
Aug 01 21:30:33 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d5912e-0d10-48ce-afc0-832ea32ba47e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa629379-4387-45d9-8175-351c9df0e0bb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aa629379-4387-45d9-8175-351c9df0e0bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:33 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e277091-5dac-495d-8395-b97ffa256e64 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa629379-4387-45d9-8175-351c9df0e0bb, portal: 172.16.0.220,3260]
Aug 01 21:30:33 user nova-compute[72586]: Login to [iface: default, target: iqn.2010-10.org.openstack:aa629379-4387-45d9-8175-351c9df0e0bb, portal: 172.16.0.220,3260] successful.
Aug 01 21:30:33 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:30:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa629379-4387-45d9-8175-351c9df0e0bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:33 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 7ac93270-a352-4844-900f-cd3486658610] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:30:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa629379-4387-45d9-8175-351c9df0e0bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:33 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e35de46-3d1b-464a-b28e-9d200a9d1e63]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:33 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e277091-5dac-495d-8395-b97ffa256e64 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:30:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:33 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 7ac93270-a352-4844-900f-cd3486658610] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:30:33 user nova-compute[72586]: INFO nova.compute.manager [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 7ac93270-a352-4844-900f-cd3486658610] Took 6.31 seconds to spawn the instance on the hypervisor.
Aug 01 21:30:33 user nova-compute[72586]: DEBUG nova.compute.manager [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 7ac93270-a352-4844-900f-cd3486658610] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:30:33 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 7ac93270-a352-4844-900f-cd3486658610] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:30:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:33 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9531686f-14f3-4ef5-bb41-7ae1dde39e5d]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa629379-4387-45d9-8175-351c9df0e0bb (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:33 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e277091-5dac-495d-8395-b97ffa256e64 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)
Aug 01 21:30:33 user nova-compute[72586]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)
Aug 01 21:30:33 user nova-compute[72586]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 (non-flash)
Aug 01 21:30:33 user nova-compute[72586]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:30:33 user nova-compute[72586]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa629379-4387-45d9-8175-351c9df0e0bb (non-flash)
Aug 01 21:30:33 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:30:33 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e277091-5dac-495d-8395-b97ffa256e64 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)
Aug 01 21:30:33 user nova-compute[72586]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)
Aug 01 21:30:33 user nova-compute[72586]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 (non-flash)
Aug 01 21:30:33 user nova-compute[72586]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:30:33 user nova-compute[72586]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa629379-4387-45d9-8175-351c9df0e0bb (non-flash)
Aug 01 21:30:33 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:30:33 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-1e277091-5dac-495d-8395-b97ffa256e64 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa629379-4387-45d9-8175-351c9df0e0bb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:30:33 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e277091-5dac-495d-8395-b97ffa256e64 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Connected to 172.16.0.220:3260 {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 21:30:33 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-1e277091-5dac-495d-8395-b97ffa256e64 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] HCTL ('37', '-', '-', 0) found on session 30 with lun 0 {{(pid=72586) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 21:30:33 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-1e277091-5dac-495d-8395-b97ffa256e64 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72586) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 21:30:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:33 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42189e1-4b23-4e96-91b0-89441c896e1b]: (4, ('- - 0', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:33 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-1e277091-5dac-495d-8395-b97ffa256e64 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Searching for a device in session 30 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:30:33 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e277091-5dac-495d-8395-b97ffa256e64 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RyAQYasO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 21:30:33 user nova-compute[72586]: INFO nova.compute.manager [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 7ac93270-a352-4844-900f-cd3486658610] Took 7.47 seconds to build instance.
Aug 01 21:30:33 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-ccc9fcd7-73ac-4b3a-8a6b-d0ec3d477c14 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lock "7ac93270-a352-4844-900f-cd3486658610" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.566s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:30:34 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-1e277091-5dac-495d-8395-b97ffa256e64 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:30:34 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e277091-5dac-495d-8395-b97ffa256e64 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23761626338613130', 'path': '/dev/sdf'} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:30:34 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e277091-5dac-495d-8395-b97ffa256e64 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23761626338613130', 'path': '/dev/sdf'} {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 21:30:34 user nova-compute[72586]: DEBUG nova.objects.instance [None req-1e277091-5dac-495d-8395-b97ffa256e64 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Lazy-loading 'flavor' on Instance uuid 09571c9f-bf42-475a-afac-0e3947168d7e {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:30:34 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-1e277091-5dac-495d-8395-b97ffa256e64 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 21:30:34 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:30:34 user nova-compute[72586]:   <source dev="/dev/sdf"/>
Aug 01 21:30:34 user nova-compute[72586]:   <target dev="vdc" bus="virtio"/>
Aug 01 21:30:34 user nova-compute[72586]:   <serial>aa629379-4387-45d9-8175-351c9df0e0bb</serial>
Aug 01 21:30:34 user nova-compute[72586]: </disk>
Aug 01 21:30:34 user nova-compute[72586]:  {{(pid=72586) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 21:30:34 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:34 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:34 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-1e277091-5dac-495d-8395-b97ffa256e64 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:30:34 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-1e277091-5dac-495d-8395-b97ffa256e64 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:30:34 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-1e277091-5dac-495d-8395-b97ffa256e64 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:30:34 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-1e277091-5dac-495d-8395-b97ffa256e64 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] No VIF found with MAC fa:16:3e:18:89:0a, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:30:34 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1e277091-5dac-495d-8395-b97ffa256e64 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Lock "09571c9f-bf42-475a-afac-0e3947168d7e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.597s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:30:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-85190e56-dd06-4f09-ad72-758a8918fa38 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Acquiring lock "09571c9f-bf42-475a-afac-0e3947168d7e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:30:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-85190e56-dd06-4f09-ad72-758a8918fa38 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Lock "09571c9f-bf42-475a-afac-0e3947168d7e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:30:35 user nova-compute[72586]: INFO nova.compute.manager [None req-85190e56-dd06-4f09-ad72-758a8918fa38 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Detaching volume aa629379-4387-45d9-8175-351c9df0e0bb
Aug 01 21:30:35 user nova-compute[72586]: INFO nova.virt.block_device [None req-85190e56-dd06-4f09-ad72-758a8918fa38 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Attempting to driver detach volume aa629379-4387-45d9-8175-351c9df0e0bb from mountpoint /dev/vdc
Aug 01 21:30:35 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-85190e56-dd06-4f09-ad72-758a8918fa38 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Attempting to detach device vdc from instance 09571c9f-bf42-475a-afac-0e3947168d7e from the persistent domain config. {{(pid=72586) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 21:30:35 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-85190e56-dd06-4f09-ad72-758a8918fa38 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 21:30:35 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:30:35 user nova-compute[72586]:   <source dev="/dev/sdf"/>
Aug 01 21:30:35 user nova-compute[72586]:   <target dev="vdc" bus="virtio"/>
Aug 01 21:30:35 user nova-compute[72586]:   <serial>aa629379-4387-45d9-8175-351c9df0e0bb</serial>
Aug 01 21:30:35 user nova-compute[72586]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 01 21:30:35 user nova-compute[72586]: </disk>
Aug 01 21:30:35 user nova-compute[72586]:  {{(pid=72586) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 21:30:35 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-85190e56-dd06-4f09-ad72-758a8918fa38 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Successfully detached device vdc from instance 09571c9f-bf42-475a-afac-0e3947168d7e from the persistent domain config.
Aug 01 21:30:35 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-85190e56-dd06-4f09-ad72-758a8918fa38 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 09571c9f-bf42-475a-afac-0e3947168d7e from the live domain config. {{(pid=72586) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 21:30:35 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-85190e56-dd06-4f09-ad72-758a8918fa38 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 21:30:35 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:30:35 user nova-compute[72586]:   <source dev="/dev/sdf"/>
Aug 01 21:30:35 user nova-compute[72586]:   <target dev="vdc" bus="virtio"/>
Aug 01 21:30:35 user nova-compute[72586]:   <serial>aa629379-4387-45d9-8175-351c9df0e0bb</serial>
Aug 01 21:30:35 user nova-compute[72586]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 01 21:30:35 user nova-compute[72586]: </disk>
Aug 01 21:30:35 user nova-compute[72586]:  {{(pid=72586) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 21:30:36 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Received event <DeviceRemovedEvent: 1690925436.0302272, 09571c9f-bf42-475a-afac-0e3947168d7e => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72586) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 21:30:36 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-85190e56-dd06-4f09-ad72-758a8918fa38 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 09571c9f-bf42-475a-afac-0e3947168d7e {{(pid=72586) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 21:30:36 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-85190e56-dd06-4f09-ad72-758a8918fa38 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Successfully detached device vdc from instance 09571c9f-bf42-475a-afac-0e3947168d7e from the live domain config.
Aug 01 21:30:36 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85190e56-dd06-4f09-ad72-758a8918fa38 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] calling os-brick to detach iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 21:30:36 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-85190e56-dd06-4f09-ad72-758a8918fa38 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, {'target_iqns': ['iqn.2010-10.org.openstack:aa629379-4387-45d9-8175-351c9df0e0bb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RyAQYasO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:30:36 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-85190e56-dd06-4f09-ad72-758a8918fa38 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:30:36 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-85190e56-dd06-4f09-ad72-758a8918fa38 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:30:36 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-85190e56-dd06-4f09-ad72-758a8918fa38 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:30:36 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-85190e56-dd06-4f09-ad72-758a8918fa38 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa629379-4387-45d9-8175-351c9df0e0bb', 0)] {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 21:30:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:36 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[96434d1d-a3ba-4fe9-90ab-4b71a2e38540]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa629379-4387-45d9-8175-351c9df0e0bb\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:36 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[88250ff2-73b9-4ce1-9fba-5a6a6b1ccac1]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa629379-4387-45d9-8175-351c9df0e0bb (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:36 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-85190e56-dd06-4f09-ad72-758a8918fa38 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)
Aug 01 21:30:36 user nova-compute[72586]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)
Aug 01 21:30:36 user nova-compute[72586]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 (non-flash)
Aug 01 21:30:36 user nova-compute[72586]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:30:36 user nova-compute[72586]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa629379-4387-45d9-8175-351c9df0e0bb (non-flash)
Aug 01 21:30:36 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:30:36 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-85190e56-dd06-4f09-ad72-758a8918fa38 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)
Aug 01 21:30:36 user nova-compute[72586]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)
Aug 01 21:30:36 user nova-compute[72586]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 (non-flash)
Aug 01 21:30:36 user nova-compute[72586]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:30:36 user nova-compute[72586]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa629379-4387-45d9-8175-351c9df0e0bb (non-flash)
Aug 01 21:30:36 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:30:36 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-85190e56-dd06-4f09-ad72-758a8918fa38 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ef1796f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa629379-4387-45d9-8175-351c9df0e0bb'): ({'sdf'}, set())}) {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 21:30:36 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-85190e56-dd06-4f09-ad72-758a8918fa38 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Removing single pathed devices sdf {{(pid=72586) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 21:30:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:36 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[059767e1-2a5e-4813-8c43-9cffa53ea423]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:36 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff23f8d2-e3f2-479d-9d42-828bca9012f4]: (4, ('ok\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:36 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-85190e56-dd06-4f09-ad72-758a8918fa38 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Flushing IO for device /dev/sdf {{(pid=72586) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 21:30:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:36 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[10eccff1-ceac-4ce4-9e33-413c2b3dcef9]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:36 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-85190e56-dd06-4f09-ad72-758a8918fa38 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72586) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 21:30:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.047s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:36 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f14b99-7b18-44fd-963f-82256b597460]: (4, ('1', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:36 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-85190e56-dd06-4f09-ad72-758a8918fa38 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 21:30:36 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-85190e56-dd06-4f09-ad72-758a8918fa38 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] SCSI volumes sdf have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 21:30:36 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-85190e56-dd06-4f09-ad72-758a8918fa38 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa629379-4387-45d9-8175-351c9df0e0bb')] {{(pid=72586) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 21:30:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa629379-4387-45d9-8175-351c9df0e0bb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa629379-4387-45d9-8175-351c9df0e0bb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:36 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[34286fce-ccdc-469d-87ee-da311975f091]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:36 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-85190e56-dd06-4f09-ad72-758a8918fa38 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:30:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa629379-4387-45d9-8175-351c9df0e0bb -p 172.16.0.220:3260 --logout {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa629379-4387-45d9-8175-351c9df0e0bb -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:36 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[28cf980e-4c04-4abe-a349-aa929fe93ac7]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:aa629379-4387-45d9-8175-351c9df0e0bb, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:aa629379-4387-45d9-8175-351c9df0e0bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:36 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-85190e56-dd06-4f09-ad72-758a8918fa38 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:aa629379-4387-45d9-8175-351c9df0e0bb, portal: 172.16.0.220,3260]
Aug 01 21:30:36 user nova-compute[72586]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:aa629379-4387-45d9-8175-351c9df0e0bb, portal: 172.16.0.220,3260] successful.
Aug 01 21:30:36 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:30:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa629379-4387-45d9-8175-351c9df0e0bb -p 172.16.0.220:3260 --op delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa629379-4387-45d9-8175-351c9df0e0bb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:36 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[61fed6ed-641c-4ca4-8e86-ea568595096b]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:36 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-85190e56-dd06-4f09-ad72-758a8918fa38 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:30:36 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-85190e56-dd06-4f09-ad72-758a8918fa38 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:30:36 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-85190e56-dd06-4f09-ad72-758a8918fa38 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] <== disconnect_volume: return (316ms) None {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:30:36 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85190e56-dd06-4f09-ad72-758a8918fa38 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Disconnected iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 21:30:37 user nova-compute[72586]: DEBUG nova.objects.instance [None req-85190e56-dd06-4f09-ad72-758a8918fa38 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Lazy-loading 'flavor' on Instance uuid 09571c9f-bf42-475a-afac-0e3947168d7e {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:30:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-85190e56-dd06-4f09-ad72-758a8918fa38 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Lock "09571c9f-bf42-475a-afac-0e3947168d7e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.861s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:30:38 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:30:38 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Cleaning up deleted instances {{(pid=72586) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 21:30:38 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] There are 0 instances to clean {{(pid=72586) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 21:30:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Starting finish_revert_migration {{(pid=72586) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Start _get_guest_xml network_info=[{"id": "68b636e3-234f-49e5-b0fb-9f99fffab5c5", "address": "fa:16:3e:a4:40:ed", "network": {"id": "42af123b-86fc-427d-b74a-a2e30c38720c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1787263710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c49158afdb04ea48c05f32782106197", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b636e3-23", "ovs_interfaceid": "68b636e3-234f-49e5-b0fb-9f99fffab5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '0243d46b-6819-42a5-926f-42b71f0c97ad'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tYAvmCpL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'c3798403-855b-45e4-af48-ba6b62570dba', 'attached_at': '2023-08-01T21:30:40.000000', 'detached_at': '', 'volume_id': '4927c194-c7b3-4b35-b484-30b4bc8744ea', 'serial': '4927c194-c7b3-4b35-b484-30b4bc8744ea'}, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'a5160ffe-da1e-4c59-8d29-fc7f5529a75d', 'delete_on_termination': False, 'volume_type': None} {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:30:40 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:30:40 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:30:40 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG nova.objects.instance [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Lazy-loading 'vcpu_model' on Instance uuid c3798403-855b-45e4-af48-ba6b62570dba {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Calling os-brick to attach iSCSI Volume {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tYAvmCpL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:30:40 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:30:40 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:30:40 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:30:40 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:30:40 user nova-compute[72586]: INFO os_brick.initiator.connectors.iscsi [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 21:30:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea -p 172.16.0.220:3260 {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[853b5e8f-722c-4bc4-a9e2-30ea07d6a202]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 21:30:40 user nova-compute[72586]:  {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea -p 172.16.0.220:3260 --interface default --op new {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[150d9fe2-1b60-44ee-9e2f-a822984a681a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea] added\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea] added
Aug 01 21:30:40 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6f5947-5b8f-43ea-ad19-c4d7dd1a0733]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8fd7a24-a0bb-48b8-bbc6-7616f0a2897b]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tYAvmCpL {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tYAvmCpL" returned: 0 in 0.025s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e69f2210-e9d9-4e26-9f3f-6586181152d9]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tYAvmCpL'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[6701d9d0-7c23-4d2c-b617-9fb78d7ea37f]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f8dca8-c471-4362-b5d2-f09e8ac50c77]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)
Aug 01 21:30:40 user nova-compute[72586]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)
Aug 01 21:30:40 user nova-compute[72586]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 (non-flash)
Aug 01 21:30:40 user nova-compute[72586]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:30:40 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)
Aug 01 21:30:40 user nova-compute[72586]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)
Aug 01 21:30:40 user nova-compute[72586]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 (non-flash)
Aug 01 21:30:40 user nova-compute[72586]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:30:40 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea -p 172.16.0.220:3260 --login {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7bef88-73a9-40bb-8280-579eef93ed2c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea, portal: 172.16.0.220,3260]
Aug 01 21:30:40 user nova-compute[72586]: Login to [iface: default, target: iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea, portal: 172.16.0.220,3260] successful.
Aug 01 21:30:40 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25c813b-7916-4763-ac81-91f380ee6186]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4873cc-4e63-43ae-b540-80920668b113]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)
Aug 01 21:30:40 user nova-compute[72586]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)
Aug 01 21:30:40 user nova-compute[72586]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 (non-flash)
Aug 01 21:30:40 user nova-compute[72586]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:30:40 user nova-compute[72586]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:30:40 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)
Aug 01 21:30:40 user nova-compute[72586]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)
Aug 01 21:30:40 user nova-compute[72586]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 (non-flash)
Aug 01 21:30:40 user nova-compute[72586]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:30:40 user nova-compute[72586]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:30:40 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Connected to 172.16.0.220:3260 {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] HCTL ('37', '-', '-', 0) found on session 31 with lun 0 {{(pid=72586) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72586) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d22b2e5-80b9-4f7a-90d6-7ce5c786ed06]: (4, ('- - 0', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Searching for a device in session 31 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:30:40 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tYAvmCpL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 21:30:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:30:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '23765333266316265', 'path': '/dev/sdf'} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:30:41 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765333266316265', 'path': '/dev/sdf'} {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 21:30:41 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:24:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-124717694',display_name='tempest-ServerActionsTestOtherB-server-124717694',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-124717694',id=17,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgvcOBvmaWJhEwOkJkVCtNJ+42NFJ7Wme/nrROdsaAYDVV1668xM0wdadU29PtL+UEfr1KV8jRhHGVoqdqnxjGi6czPksct12PqH1D7Zn6OKGhhWdLcIzx9a1L98V8jxQ==',key_name='tempest-keypair-177851533',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:28:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0c49158afdb04ea48c05f32782106197',ramdisk_id='',reservation_id='r-6rqr0y9w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1788994838',owner_user_name='tempest-ServerActionsTestOtherB-1788994838-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:30:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='353f3e5b8859476b8213462a8a3d00b4',uuid=c3798403-855b-45e4-af48-ba6b62570dba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "68b636e3-234f-49e5-b0fb-9f99fffab5c5", "address": "fa:16:3e:a4:40:ed", "network": {"id": "42af123b-86fc-427d-b74a-a2e30c38720c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1787263710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c49158afdb04ea48c05f32782106197", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b636e3-23", "ovs_interfaceid": "68b636e3-234f-49e5-b0fb-9f99fffab5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:30:41 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Converting VIF {"id": "68b636e3-234f-49e5-b0fb-9f99fffab5c5", "address": "fa:16:3e:a4:40:ed", "network": {"id": "42af123b-86fc-427d-b74a-a2e30c38720c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1787263710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c49158afdb04ea48c05f32782106197", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b636e3-23", "ovs_interfaceid": "68b636e3-234f-49e5-b0fb-9f99fffab5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:30:41 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:40:ed,bridge_name='br-int',has_traffic_filtering=True,id=68b636e3-234f-49e5-b0fb-9f99fffab5c5,network=Network(42af123b-86fc-427d-b74a-a2e30c38720c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68b636e3-23') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:30:41 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:30:41 user nova-compute[72586]:   <uuid>c3798403-855b-45e4-af48-ba6b62570dba</uuid>
Aug 01 21:30:41 user nova-compute[72586]:   <name>instance-00000011</name>
Aug 01 21:30:41 user nova-compute[72586]:   <memory>524288</memory>
Aug 01 21:30:41 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:30:41 user nova-compute[72586]:   <metadata>
Aug 01 21:30:41 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:30:41 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:30:41 user nova-compute[72586]:       <nova:name>tempest-ServerActionsTestOtherB-server-124717694</nova:name>
Aug 01 21:30:41 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:30:40</nova:creationTime>
Aug 01 21:30:41 user nova-compute[72586]:       <nova:flavor name="m1.tiny">
Aug 01 21:30:41 user nova-compute[72586]:         <nova:memory>512</nova:memory>
Aug 01 21:30:41 user nova-compute[72586]:         <nova:disk>1</nova:disk>
Aug 01 21:30:41 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:30:41 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:30:41 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:30:41 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:30:41 user nova-compute[72586]:       <nova:owner>
Aug 01 21:30:41 user nova-compute[72586]:         <nova:user uuid="353f3e5b8859476b8213462a8a3d00b4">tempest-ServerActionsTestOtherB-1788994838-project-member</nova:user>
Aug 01 21:30:41 user nova-compute[72586]:         <nova:project uuid="0c49158afdb04ea48c05f32782106197">tempest-ServerActionsTestOtherB-1788994838</nova:project>
Aug 01 21:30:41 user nova-compute[72586]:       </nova:owner>
Aug 01 21:30:41 user nova-compute[72586]:       <nova:root type="image" uuid="0243d46b-6819-42a5-926f-42b71f0c97ad"/>
Aug 01 21:30:41 user nova-compute[72586]:       <nova:ports>
Aug 01 21:30:41 user nova-compute[72586]:         <nova:port uuid="68b636e3-234f-49e5-b0fb-9f99fffab5c5">
Aug 01 21:30:41 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 01 21:30:41 user nova-compute[72586]:         </nova:port>
Aug 01 21:30:41 user nova-compute[72586]:       </nova:ports>
Aug 01 21:30:41 user nova-compute[72586]:     </nova:instance>
Aug 01 21:30:41 user nova-compute[72586]:   </metadata>
Aug 01 21:30:41 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:30:41 user nova-compute[72586]:     <system>
Aug 01 21:30:41 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:30:41 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:30:41 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:30:41 user nova-compute[72586]:       <entry name="serial">c3798403-855b-45e4-af48-ba6b62570dba</entry>
Aug 01 21:30:41 user nova-compute[72586]:       <entry name="uuid">c3798403-855b-45e4-af48-ba6b62570dba</entry>
Aug 01 21:30:41 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:30:41 user nova-compute[72586]:     </system>
Aug 01 21:30:41 user nova-compute[72586]:   </sysinfo>
Aug 01 21:30:41 user nova-compute[72586]:   <os>
Aug 01 21:30:41 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:30:41 user nova-compute[72586]:     <boot dev="hd"/>
Aug 01 21:30:41 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:30:41 user nova-compute[72586]:   </os>
Aug 01 21:30:41 user nova-compute[72586]:   <features>
Aug 01 21:30:41 user nova-compute[72586]:     <acpi/>
Aug 01 21:30:41 user nova-compute[72586]:     <apic/>
Aug 01 21:30:41 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:30:41 user nova-compute[72586]:   </features>
Aug 01 21:30:41 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:30:41 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:30:41 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:30:41 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:30:41 user nova-compute[72586]:   </clock>
Aug 01 21:30:41 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:30:41 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:30:41 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:30:41 user nova-compute[72586]:   </cpu>
Aug 01 21:30:41 user nova-compute[72586]:   <devices>
Aug 01 21:30:41 user nova-compute[72586]:     <disk type="file" device="disk">
Aug 01 21:30:41 user nova-compute[72586]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 21:30:41 user nova-compute[72586]:       <source file="/opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba/disk"/>
Aug 01 21:30:41 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:30:41 user nova-compute[72586]:     </disk>
Aug 01 21:30:41 user nova-compute[72586]:     <disk type="block" device="disk">
Aug 01 21:30:41 user nova-compute[72586]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:30:41 user nova-compute[72586]:       <source dev="/dev/sdf"/>
Aug 01 21:30:41 user nova-compute[72586]:       <target dev="vdb" bus="virtio"/>
Aug 01 21:30:41 user nova-compute[72586]:       <serial>4927c194-c7b3-4b35-b484-30b4bc8744ea</serial>
Aug 01 21:30:41 user nova-compute[72586]:     </disk>
Aug 01 21:30:41 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:30:41 user nova-compute[72586]:       <mac address="fa:16:3e:a4:40:ed"/>
Aug 01 21:30:41 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:30:41 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:30:41 user nova-compute[72586]:       <target dev="tap68b636e3-23"/>
Aug 01 21:30:41 user nova-compute[72586]:     </interface>
Aug 01 21:30:41 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:30:41 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba/console.log" append="off"/>
Aug 01 21:30:41 user nova-compute[72586]:     </serial>
Aug 01 21:30:41 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:30:41 user nova-compute[72586]:     <video>
Aug 01 21:30:41 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:30:41 user nova-compute[72586]:     </video>
Aug 01 21:30:41 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:30:41 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:30:41 user nova-compute[72586]:     </rng>
Aug 01 21:30:41 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:30:41 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:30:41 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:30:41 user nova-compute[72586]:     </memballoon>
Aug 01 21:30:41 user nova-compute[72586]:   </devices>
Aug 01 21:30:41 user nova-compute[72586]: </domain>
Aug 01 21:30:41 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:30:41 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:24:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-124717694',display_name='tempest-ServerActionsTestOtherB-server-124717694',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-124717694',id=17,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgvcOBvmaWJhEwOkJkVCtNJ+42NFJ7Wme/nrROdsaAYDVV1668xM0wdadU29PtL+UEfr1KV8jRhHGVoqdqnxjGi6czPksct12PqH1D7Zn6OKGhhWdLcIzx9a1L98V8jxQ==',key_name='tempest-keypair-177851533',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:28:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0c49158afdb04ea48c05f32782106197',ramdisk_id='',reservation_id='r-6rqr0y9w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1788994838',owner_user_name='tempest-ServerActionsTestOtherB-1788994838-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:30:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='353f3e5b8859476b8213462a8a3d00b4',uuid=c3798403-855b-45e4-af48-ba6b62570dba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "68b636e3-234f-49e5-b0fb-9f99fffab5c5", "address": "fa:16:3e:a4:40:ed", "network": {"id": "42af123b-86fc-427d-b74a-a2e30c38720c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1787263710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c49158afdb04ea48c05f32782106197", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b636e3-23", "ovs_interfaceid": "68b636e3-234f-49e5-b0fb-9f99fffab5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:30:41 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Converting VIF {"id": "68b636e3-234f-49e5-b0fb-9f99fffab5c5", "address": "fa:16:3e:a4:40:ed", "network": {"id": "42af123b-86fc-427d-b74a-a2e30c38720c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1787263710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c49158afdb04ea48c05f32782106197", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b636e3-23", "ovs_interfaceid": "68b636e3-234f-49e5-b0fb-9f99fffab5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:30:41 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:40:ed,bridge_name='br-int',has_traffic_filtering=True,id=68b636e3-234f-49e5-b0fb-9f99fffab5c5,network=Network(42af123b-86fc-427d-b74a-a2e30c38720c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68b636e3-23') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:30:41 user nova-compute[72586]: DEBUG os_vif [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:40:ed,bridge_name='br-int',has_traffic_filtering=True,id=68b636e3-234f-49e5-b0fb-9f99fffab5c5,network=Network(42af123b-86fc-427d-b74a-a2e30c38720c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68b636e3-23') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:30:41 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:41 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:30:41 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:30:41 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:41 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap68b636e3-23, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:30:41 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap68b636e3-23, col_values=(('external_ids', {'iface-id': '68b636e3-234f-49e5-b0fb-9f99fffab5c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:40:ed', 'vm-uuid': 'c3798403-855b-45e4-af48-ba6b62570dba'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:30:41 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:41 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:30:41 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:41 user nova-compute[72586]: INFO os_vif [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:40:ed,bridge_name='br-int',has_traffic_filtering=True,id=68b636e3-234f-49e5-b0fb-9f99fffab5c5,network=Network(42af123b-86fc-427d-b74a-a2e30c38720c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68b636e3-23')
Aug 01 21:30:42 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:30:43 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:43 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:43 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:43 user nova-compute[72586]: DEBUG nova.compute.manager [req-51c9f5de-b8df-4f62-90f8-e6ddc270c815 req-ec68fe4f-d8c5-4beb-a142-24cf0ca5b4d6 service nova] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Received event network-vif-plugged-68b636e3-234f-49e5-b0fb-9f99fffab5c5 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:30:43 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-51c9f5de-b8df-4f62-90f8-e6ddc270c815 req-ec68fe4f-d8c5-4beb-a142-24cf0ca5b4d6 service nova] Acquiring lock "c3798403-855b-45e4-af48-ba6b62570dba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:30:43 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-51c9f5de-b8df-4f62-90f8-e6ddc270c815 req-ec68fe4f-d8c5-4beb-a142-24cf0ca5b4d6 service nova] Lock "c3798403-855b-45e4-af48-ba6b62570dba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:30:43 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-51c9f5de-b8df-4f62-90f8-e6ddc270c815 req-ec68fe4f-d8c5-4beb-a142-24cf0ca5b4d6 service nova] Lock "c3798403-855b-45e4-af48-ba6b62570dba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:30:43 user nova-compute[72586]: DEBUG nova.compute.manager [req-51c9f5de-b8df-4f62-90f8-e6ddc270c815 req-ec68fe4f-d8c5-4beb-a142-24cf0ca5b4d6 service nova] [instance: c3798403-855b-45e4-af48-ba6b62570dba] No waiting events found dispatching network-vif-plugged-68b636e3-234f-49e5-b0fb-9f99fffab5c5 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:30:43 user nova-compute[72586]: WARNING nova.compute.manager [req-51c9f5de-b8df-4f62-90f8-e6ddc270c815 req-ec68fe4f-d8c5-4beb-a142-24cf0ca5b4d6 service nova] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Received unexpected event network-vif-plugged-68b636e3-234f-49e5-b0fb-9f99fffab5c5 for instance with vm_state resized and task_state resize_reverting.
Aug 01 21:30:43 user nova-compute[72586]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690925428.513856, c3798403-855b-45e4-af48-ba6b62570dba => Stopped> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:30:43 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: c3798403-855b-45e4-af48-ba6b62570dba] VM Stopped (Lifecycle Event)
Aug 01 21:30:43 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5c57ca15-c1e0-4e75-a962-021e3d146a46 None None] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:30:44 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:44 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:44 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:45 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925445.52193, c3798403-855b-45e4-af48-ba6b62570dba => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:30:45 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: c3798403-855b-45e4-af48-ba6b62570dba] VM Resumed (Lifecycle Event)
Aug 01 21:30:45 user nova-compute[72586]: DEBUG nova.compute.manager [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Instance event wait completed in 0 seconds for  {{(pid=72586) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 21:30:45 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Instance running successfully.
Aug 01 21:30:45 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] finish_revert_migration finished successfully. {{(pid=72586) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 01 21:30:45 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:30:45 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:30:45 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: c3798403-855b-45e4-af48-ba6b62570dba] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 01 21:30:45 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925445.5248997, c3798403-855b-45e4-af48-ba6b62570dba => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:30:45 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: c3798403-855b-45e4-af48-ba6b62570dba] VM Started (Lifecycle Event)
Aug 01 21:30:45 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:30:45 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:30:45 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: c3798403-855b-45e4-af48-ba6b62570dba] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 01 21:30:45 user nova-compute[72586]: INFO nova.compute.manager [None req-a7edc2d4-c468-4c92-a1e5-c58b53561d74 tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Updating instance to original state: 'active'
Aug 01 21:30:45 user nova-compute[72586]: DEBUG nova.compute.manager [req-4c6d2c82-34c5-4fdd-af98-67adbe317702 req-3c045463-756f-47c4-8c79-0f50187b8c43 service nova] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Received event network-vif-plugged-68b636e3-234f-49e5-b0fb-9f99fffab5c5 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:30:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-4c6d2c82-34c5-4fdd-af98-67adbe317702 req-3c045463-756f-47c4-8c79-0f50187b8c43 service nova] Acquiring lock "c3798403-855b-45e4-af48-ba6b62570dba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:30:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-4c6d2c82-34c5-4fdd-af98-67adbe317702 req-3c045463-756f-47c4-8c79-0f50187b8c43 service nova] Lock "c3798403-855b-45e4-af48-ba6b62570dba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:30:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-4c6d2c82-34c5-4fdd-af98-67adbe317702 req-3c045463-756f-47c4-8c79-0f50187b8c43 service nova] Lock "c3798403-855b-45e4-af48-ba6b62570dba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:30:45 user nova-compute[72586]: DEBUG nova.compute.manager [req-4c6d2c82-34c5-4fdd-af98-67adbe317702 req-3c045463-756f-47c4-8c79-0f50187b8c43 service nova] [instance: c3798403-855b-45e4-af48-ba6b62570dba] No waiting events found dispatching network-vif-plugged-68b636e3-234f-49e5-b0fb-9f99fffab5c5 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:30:45 user nova-compute[72586]: WARNING nova.compute.manager [req-4c6d2c82-34c5-4fdd-af98-67adbe317702 req-3c045463-756f-47c4-8c79-0f50187b8c43 service nova] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Received unexpected event network-vif-plugged-68b636e3-234f-49e5-b0fb-9f99fffab5c5 for instance with vm_state resized and task_state resize_reverting.
Aug 01 21:30:46 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-2652e587-2751-4b2c-a286-9992711dfd34 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Acquiring lock "d51eb56c-bce2-4593-abc3-878c358c9a74" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:30:46 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-2652e587-2751-4b2c-a286-9992711dfd34 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Lock "d51eb56c-bce2-4593-abc3-878c358c9a74" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:30:46 user nova-compute[72586]: INFO nova.compute.manager [None req-2652e587-2751-4b2c-a286-9992711dfd34 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Detaching volume 1aafe36a-8c91-4a47-9328-9ea0529e83d4
Aug 01 21:30:46 user nova-compute[72586]: INFO nova.virt.block_device [None req-2652e587-2751-4b2c-a286-9992711dfd34 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Attempting to driver detach volume 1aafe36a-8c91-4a47-9328-9ea0529e83d4 from mountpoint /dev/vdb
Aug 01 21:30:46 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-2652e587-2751-4b2c-a286-9992711dfd34 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Attempting to detach device vdb from instance d51eb56c-bce2-4593-abc3-878c358c9a74 from the persistent domain config. {{(pid=72586) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 21:30:46 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-2652e587-2751-4b2c-a286-9992711dfd34 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 21:30:46 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:30:46 user nova-compute[72586]:   <source dev="/dev/sdc"/>
Aug 01 21:30:46 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:30:46 user nova-compute[72586]:   <serial>1aafe36a-8c91-4a47-9328-9ea0529e83d4</serial>
Aug 01 21:30:46 user nova-compute[72586]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 21:30:46 user nova-compute[72586]: </disk>
Aug 01 21:30:46 user nova-compute[72586]:  {{(pid=72586) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 21:30:46 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-2652e587-2751-4b2c-a286-9992711dfd34 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Successfully detached device vdb from instance d51eb56c-bce2-4593-abc3-878c358c9a74 from the persistent domain config.
Aug 01 21:30:46 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-2652e587-2751-4b2c-a286-9992711dfd34 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d51eb56c-bce2-4593-abc3-878c358c9a74 from the live domain config. {{(pid=72586) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 21:30:46 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-2652e587-2751-4b2c-a286-9992711dfd34 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 21:30:46 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:30:46 user nova-compute[72586]:   <source dev="/dev/sdc"/>
Aug 01 21:30:46 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:30:46 user nova-compute[72586]:   <serial>1aafe36a-8c91-4a47-9328-9ea0529e83d4</serial>
Aug 01 21:30:46 user nova-compute[72586]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 21:30:46 user nova-compute[72586]: </disk>
Aug 01 21:30:46 user nova-compute[72586]:  {{(pid=72586) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 21:30:46 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:47 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Received event <DeviceRemovedEvent: 1690925447.113677, d51eb56c-bce2-4593-abc3-878c358c9a74 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72586) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 21:30:47 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-2652e587-2751-4b2c-a286-9992711dfd34 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d51eb56c-bce2-4593-abc3-878c358c9a74 {{(pid=72586) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 21:30:47 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-2652e587-2751-4b2c-a286-9992711dfd34 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Successfully detached device vdb from instance d51eb56c-bce2-4593-abc3-878c358c9a74 from the live domain config.
Aug 01 21:30:47 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2652e587-2751-4b2c-a286-9992711dfd34 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] calling os-brick to detach iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 21:30:47 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-2652e587-2751-4b2c-a286-9992711dfd34 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, {'target_iqns': ['iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vwWkRqrV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:30:47 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-2652e587-2751-4b2c-a286-9992711dfd34 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:30:47 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-2652e587-2751-4b2c-a286-9992711dfd34 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:30:47 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-2652e587-2751-4b2c-a286-9992711dfd34 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:30:47 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-2652e587-2751-4b2c-a286-9992711dfd34 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4', 0)] {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 21:30:47 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:47 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:47 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0405cef1-e6cf-4a49-ad2f-9dea8c2fa6f1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:47 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:47 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:47 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb88d353-4a31-4747-98f0-ac1b116d1d42]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:47 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-2652e587-2751-4b2c-a286-9992711dfd34 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)
Aug 01 21:30:47 user nova-compute[72586]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)
Aug 01 21:30:47 user nova-compute[72586]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 (non-flash)
Aug 01 21:30:47 user nova-compute[72586]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:30:47 user nova-compute[72586]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:30:47 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:30:47 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-2652e587-2751-4b2c-a286-9992711dfd34 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 (non-flash)
Aug 01 21:30:47 user nova-compute[72586]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)
Aug 01 21:30:47 user nova-compute[72586]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 (non-flash)
Aug 01 21:30:47 user nova-compute[72586]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:30:47 user nova-compute[72586]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:30:47 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:30:47 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-2652e587-2751-4b2c-a286-9992711dfd34 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ef1796950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4'): ({'sdc'}, set())}) {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 21:30:47 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-2652e587-2751-4b2c-a286-9992711dfd34 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Removing single pathed devices sdc {{(pid=72586) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 21:30:47 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:47 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:47 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[8760263a-53cd-488f-aa49-dcbb8be5ff57]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:47 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:47 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:47 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[07299563-8b07-4551-9c8e-577d5ba2734a]: (4, ('ok\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:47 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-2652e587-2751-4b2c-a286-9992711dfd34 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Flushing IO for device /dev/sdc {{(pid=72586) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 21:30:47 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:47 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:47 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[7408ab6c-3d6f-4576-a098-fc59cf8d880e]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:47 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-2652e587-2751-4b2c-a286-9992711dfd34 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72586) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 21:30:47 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:47 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.032s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:47 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc0f7c85-0cbb-45eb-83c2-f1cb98a481e4]: (4, ('1', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:47 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-2652e587-2751-4b2c-a286-9992711dfd34 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 21:30:47 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-2652e587-2751-4b2c-a286-9992711dfd34 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] SCSI volumes sdc have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 21:30:47 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-2652e587-2751-4b2c-a286-9992711dfd34 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4')] {{(pid=72586) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 21:30:47 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:47 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:47 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf61bfb-f4e4-4f3a-8398-b804544919c7]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:47 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-2652e587-2751-4b2c-a286-9992711dfd34 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:30:47 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 -p 172.16.0.220:3260 --logout {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:47 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:47 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc06d38-6117-4b9b-a58a-a57302485e50]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:47 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-2652e587-2751-4b2c-a286-9992711dfd34 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4, portal: 172.16.0.220,3260]
Aug 01 21:30:47 user nova-compute[72586]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4, portal: 172.16.0.220,3260] successful.
Aug 01 21:30:47 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:30:47 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 -p 172.16.0.220:3260 --op delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:47 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aafe36a-8c91-4a47-9328-9ea0529e83d4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:47 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8ee9ff-0b0e-4809-bf97-0954ca01a764]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:30:47 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-2652e587-2751-4b2c-a286-9992711dfd34 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:30:47 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-2652e587-2751-4b2c-a286-9992711dfd34 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:30:47 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-2652e587-2751-4b2c-a286-9992711dfd34 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] <== disconnect_volume: return (282ms) None {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:30:47 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2652e587-2751-4b2c-a286-9992711dfd34 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Disconnected iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 21:30:48 user nova-compute[72586]: DEBUG nova.objects.instance [None req-2652e587-2751-4b2c-a286-9992711dfd34 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Lazy-loading 'flavor' on Instance uuid d51eb56c-bce2-4593-abc3-878c358c9a74 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:30:48 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-2652e587-2751-4b2c-a286-9992711dfd34 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Lock "d51eb56c-bce2-4593-abc3-878c358c9a74" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.669s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:30:49 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:51 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:53 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Acquiring lock "f9b8f9c5-0129-429d-beb6-26d4c9cc085d" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:30:53 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "f9b8f9c5-0129-429d-beb6-26d4c9cc085d" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:30:53 user nova-compute[72586]: INFO nova.compute.manager [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Unshelving
Aug 01 21:30:53 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:30:53 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:30:53 user nova-compute[72586]: DEBUG nova.objects.instance [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lazy-loading 'pci_requests' on Instance uuid f9b8f9c5-0129-429d-beb6-26d4c9cc085d {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:30:53 user nova-compute[72586]: DEBUG nova.objects.instance [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lazy-loading 'numa_topology' on Instance uuid f9b8f9c5-0129-429d-beb6-26d4c9cc085d {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:30:53 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72586) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 21:30:53 user nova-compute[72586]: INFO nova.compute.claims [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Claim successful on node user
Aug 01 21:30:53 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:30:53 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:30:53 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.523s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:30:53 user nova-compute[72586]: INFO nova.network.neutron [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Updating port 46cc59ac-efc1-40c1-8a70-b848a9980413 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 01 21:30:54 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:54 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Acquiring lock "refresh_cache-f9b8f9c5-0129-429d-beb6-26d4c9cc085d" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:30:54 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Acquired lock "refresh_cache-f9b8f9c5-0129-429d-beb6-26d4c9cc085d" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:30:54 user nova-compute[72586]: DEBUG nova.network.neutron [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:30:54 user nova-compute[72586]: DEBUG nova.compute.manager [req-998c48f5-36e6-4a4d-aae3-c321badc3258 req-f49dd657-a109-45cb-9b64-57418f0ebc7a service nova] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Received event network-changed-46cc59ac-efc1-40c1-8a70-b848a9980413 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:30:54 user nova-compute[72586]: DEBUG nova.compute.manager [req-998c48f5-36e6-4a4d-aae3-c321badc3258 req-f49dd657-a109-45cb-9b64-57418f0ebc7a service nova] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Refreshing instance network info cache due to event network-changed-46cc59ac-efc1-40c1-8a70-b848a9980413. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:30:54 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-998c48f5-36e6-4a4d-aae3-c321badc3258 req-f49dd657-a109-45cb-9b64-57418f0ebc7a service nova] Acquiring lock "refresh_cache-f9b8f9c5-0129-429d-beb6-26d4c9cc085d" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:30:55 user nova-compute[72586]: DEBUG nova.network.neutron [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Updating instance_info_cache with network_info: [{"id": "46cc59ac-efc1-40c1-8a70-b848a9980413", "address": "fa:16:3e:6b:e7:10", "network": {"id": "a5da07bc-2f5d-461e-b31f-df624d9c6557", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948878141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae659e4ad43c44e2a8f6d48818bb796a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46cc59ac-ef", "ovs_interfaceid": "46cc59ac-efc1-40c1-8a70-b848a9980413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:30:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Releasing lock "refresh_cache-f9b8f9c5-0129-429d-beb6-26d4c9cc085d" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:30:55 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Creating instance directory {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 21:30:55 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Creating image(s)
Aug 01 21:30:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Acquiring lock "/opt/stack/data/nova/instances/f9b8f9c5-0129-429d-beb6-26d4c9cc085d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:30:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "/opt/stack/data/nova/instances/f9b8f9c5-0129-429d-beb6-26d4c9cc085d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:30:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "/opt/stack/data/nova/instances/f9b8f9c5-0129-429d-beb6-26d4c9cc085d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:30:55 user nova-compute[72586]: DEBUG nova.objects.instance [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lazy-loading 'trusted_certs' on Instance uuid f9b8f9c5-0129-429d-beb6-26d4c9cc085d {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:30:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-998c48f5-36e6-4a4d-aae3-c321badc3258 req-f49dd657-a109-45cb-9b64-57418f0ebc7a service nova] Acquired lock "refresh_cache-f9b8f9c5-0129-429d-beb6-26d4c9cc085d" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:30:55 user nova-compute[72586]: DEBUG nova.network.neutron [req-998c48f5-36e6-4a4d-aae3-c321badc3258 req-f49dd657-a109-45cb-9b64-57418f0ebc7a service nova] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Refreshing network info cache for port 46cc59ac-efc1-40c1-8a70-b848a9980413 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:30:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Acquiring lock "0827cb066310d196d104f1a1fa3b55bde3df850a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:30:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "0827cb066310d196d104f1a1fa3b55bde3df850a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:30:56 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0827cb066310d196d104f1a1fa3b55bde3df850a.part --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:56 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0827cb066310d196d104f1a1fa3b55bde3df850a.part --force-share --output=json" returned: 0 in 0.185s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:56 user nova-compute[72586]: DEBUG nova.virt.images [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] 2871d1b3-83f8-471a-9afd-df51257b65b8 was qcow2, converting to raw {{(pid=72586) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 21:30:56 user nova-compute[72586]: DEBUG nova.privsep.utils [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72586) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 21:30:56 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0827cb066310d196d104f1a1fa3b55bde3df850a.part /opt/stack/data/nova/instances/_base/0827cb066310d196d104f1a1fa3b55bde3df850a.converted {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:56 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:30:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0827cb066310d196d104f1a1fa3b55bde3df850a.part /opt/stack/data/nova/instances/_base/0827cb066310d196d104f1a1fa3b55bde3df850a.converted" returned: 0 in 0.472s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0827cb066310d196d104f1a1fa3b55bde3df850a.converted --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:57 user nova-compute[72586]: DEBUG nova.network.neutron [req-998c48f5-36e6-4a4d-aae3-c321badc3258 req-f49dd657-a109-45cb-9b64-57418f0ebc7a service nova] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Updated VIF entry in instance network info cache for port 46cc59ac-efc1-40c1-8a70-b848a9980413. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:30:57 user nova-compute[72586]: DEBUG nova.network.neutron [req-998c48f5-36e6-4a4d-aae3-c321badc3258 req-f49dd657-a109-45cb-9b64-57418f0ebc7a service nova] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Updating instance_info_cache with network_info: [{"id": "46cc59ac-efc1-40c1-8a70-b848a9980413", "address": "fa:16:3e:6b:e7:10", "network": {"id": "a5da07bc-2f5d-461e-b31f-df624d9c6557", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948878141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae659e4ad43c44e2a8f6d48818bb796a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46cc59ac-ef", "ovs_interfaceid": "46cc59ac-efc1-40c1-8a70-b848a9980413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:30:57 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-998c48f5-36e6-4a4d-aae3-c321badc3258 req-f49dd657-a109-45cb-9b64-57418f0ebc7a service nova] Releasing lock "refresh_cache-f9b8f9c5-0129-429d-beb6-26d4c9cc085d" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:30:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0827cb066310d196d104f1a1fa3b55bde3df850a.converted --force-share --output=json" returned: 0 in 0.152s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:57 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "0827cb066310d196d104f1a1fa3b55bde3df850a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.979s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:30:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0827cb066310d196d104f1a1fa3b55bde3df850a --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0827cb066310d196d104f1a1fa3b55bde3df850a --force-share --output=json" returned: 0 in 0.139s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:57 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Acquiring lock "0827cb066310d196d104f1a1fa3b55bde3df850a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:30:57 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "0827cb066310d196d104f1a1fa3b55bde3df850a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:30:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0827cb066310d196d104f1a1fa3b55bde3df850a --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0827cb066310d196d104f1a1fa3b55bde3df850a --force-share --output=json" returned: 0 in 0.145s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0827cb066310d196d104f1a1fa3b55bde3df850a,backing_fmt=raw /opt/stack/data/nova/instances/f9b8f9c5-0129-429d-beb6-26d4c9cc085d/disk 1073741824 {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0827cb066310d196d104f1a1fa3b55bde3df850a,backing_fmt=raw /opt/stack/data/nova/instances/f9b8f9c5-0129-429d-beb6-26d4c9cc085d/disk 1073741824" returned: 0 in 0.050s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:57 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "0827cb066310d196d104f1a1fa3b55bde3df850a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:30:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0827cb066310d196d104f1a1fa3b55bde3df850a --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0827cb066310d196d104f1a1fa3b55bde3df850a --force-share --output=json" returned: 0 in 0.143s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:57 user nova-compute[72586]: DEBUG nova.objects.instance [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lazy-loading 'migration_context' on Instance uuid f9b8f9c5-0129-429d-beb6-26d4c9cc085d {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:30:57 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Rebasing disk image.
Aug 01 21:30:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.135s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:30:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 -F raw /opt/stack/data/nova/instances/f9b8f9c5-0129-429d-beb6-26d4c9cc085d/disk {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:30:59 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-72db529a-1671-4c90-829e-24b30aadf156 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Acquiring lock "f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-72db529a-1671-4c90-829e-24b30aadf156 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lock "f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG nova.objects.instance [None req-72db529a-1671-4c90-829e-24b30aadf156 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lazy-loading 'flavor' on Instance uuid f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-72db529a-1671-4c90-829e-24b30aadf156 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lock "f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-72db529a-1671-4c90-829e-24b30aadf156 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Acquiring lock "f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-72db529a-1671-4c90-829e-24b30aadf156 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lock "f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:31:00 user nova-compute[72586]: INFO nova.compute.manager [None req-72db529a-1671-4c90-829e-24b30aadf156 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Attaching volume 5da0468b-3124-4690-ba25-6f0fc97f1abf to /dev/vdb
Aug 01 21:31:00 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 -F raw /opt/stack/data/nova/instances/f9b8f9c5-0129-429d-beb6-26d4c9cc085d/disk" returned: 0 in 2.639s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Created local disks {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Ensure instance console log exists: /opt/stack/data/nova/instances/f9b8f9c5-0129-429d-beb6-26d4c9cc085d/console.log {{(pid=72586) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Start _get_guest_xml network_info=[{"id": "46cc59ac-efc1-40c1-8a70-b848a9980413", "address": "fa:16:3e:6b:e7:10", "network": {"id": "a5da07bc-2f5d-461e-b31f-df624d9c6557", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948878141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae659e4ad43c44e2a8f6d48818bb796a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46cc59ac-ef", "ovs_interfaceid": "46cc59ac-efc1-40c1-8a70-b848a9980413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b9fcba4ffce7b333b9e9e39e9be988b4',container_format='bare',created_at=2023-08-01T21:29:00Z,direct_url=<?>,disk_format='qcow2',id=2871d1b3-83f8-471a-9afd-df51257b65b8,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-752033639-shelved',owner='ae659e4ad43c44e2a8f6d48818bb796a',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-01T21:29:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '0243d46b-6819-42a5-926f-42b71f0c97ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:31:00 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:31:00 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:31:00 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b9fcba4ffce7b333b9e9e39e9be988b4',container_format='bare',created_at=2023-08-01T21:29:00Z,direct_url=<?>,disk_format='qcow2',id=2871d1b3-83f8-471a-9afd-df51257b65b8,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-752033639-shelved',owner='ae659e4ad43c44e2a8f6d48818bb796a',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-01T21:29:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG nova.objects.instance [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lazy-loading 'vcpu_model' on Instance uuid f9b8f9c5-0129-429d-beb6-26d4c9cc085d {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T21:27:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-752033639',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-752033639',id=21,image_ref='2871d1b3-83f8-471a-9afd-df51257b65b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-105460435',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:27:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ae659e4ad43c44e2a8f6d48818bb796a',ramdisk_id='',reservation_id='r-odyjetm7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1935542868',owner_user_name='tempest-AttachVolumeShelveTestJSON-1935542868-project-member',shelved_at='2023-08-01T21:29:04.869172',shelved_host='user',shelved_image_id='2871d1b3-83f8-471a-9afd-df51257b65b8'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:30:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1a0d71c79c04216b9bf278f650aeb77',uuid=f9b8f9c5-0129-429d-beb6-26d4c9cc085d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "46cc59ac-efc1-40c1-8a70-b848a9980413", "address": "fa:16:3e:6b:e7:10", "network": {"id": "a5da07bc-2f5d-461e-b31f-df624d9c6557", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948878141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae659e4ad43c44e2a8f6d48818bb796a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46cc59ac-ef", "ovs_interfaceid": "46cc59ac-efc1-40c1-8a70-b848a9980413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Converting VIF {"id": "46cc59ac-efc1-40c1-8a70-b848a9980413", "address": "fa:16:3e:6b:e7:10", "network": {"id": "a5da07bc-2f5d-461e-b31f-df624d9c6557", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948878141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae659e4ad43c44e2a8f6d48818bb796a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46cc59ac-ef", "ovs_interfaceid": "46cc59ac-efc1-40c1-8a70-b848a9980413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:e7:10,bridge_name='br-int',has_traffic_filtering=True,id=46cc59ac-efc1-40c1-8a70-b848a9980413,network=Network(a5da07bc-2f5d-461e-b31f-df624d9c6557),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46cc59ac-ef') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG nova.objects.instance [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lazy-loading 'pci_devices' on Instance uuid f9b8f9c5-0129-429d-beb6-26d4c9cc085d {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG os_brick.utils [None req-72db529a-1671-4c90-829e-24b30aadf156 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:31:00 user nova-compute[72586]:   <uuid>f9b8f9c5-0129-429d-beb6-26d4c9cc085d</uuid>
Aug 01 21:31:00 user nova-compute[72586]:   <name>instance-00000015</name>
Aug 01 21:31:00 user nova-compute[72586]:   <memory>524288</memory>
Aug 01 21:31:00 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:31:00 user nova-compute[72586]:   <metadata>
Aug 01 21:31:00 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:31:00 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:31:00 user nova-compute[72586]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-752033639</nova:name>
Aug 01 21:31:00 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:31:00</nova:creationTime>
Aug 01 21:31:00 user nova-compute[72586]:       <nova:flavor name="m1.tiny">
Aug 01 21:31:00 user nova-compute[72586]:         <nova:memory>512</nova:memory>
Aug 01 21:31:00 user nova-compute[72586]:         <nova:disk>1</nova:disk>
Aug 01 21:31:00 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:31:00 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:31:00 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:31:00 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:31:00 user nova-compute[72586]:       <nova:owner>
Aug 01 21:31:00 user nova-compute[72586]:         <nova:user uuid="e1a0d71c79c04216b9bf278f650aeb77">tempest-AttachVolumeShelveTestJSON-1935542868-project-member</nova:user>
Aug 01 21:31:00 user nova-compute[72586]:         <nova:project uuid="ae659e4ad43c44e2a8f6d48818bb796a">tempest-AttachVolumeShelveTestJSON-1935542868</nova:project>
Aug 01 21:31:00 user nova-compute[72586]:       </nova:owner>
Aug 01 21:31:00 user nova-compute[72586]:       <nova:root type="image" uuid="2871d1b3-83f8-471a-9afd-df51257b65b8"/>
Aug 01 21:31:00 user nova-compute[72586]:       <nova:ports>
Aug 01 21:31:00 user nova-compute[72586]:         <nova:port uuid="46cc59ac-efc1-40c1-8a70-b848a9980413">
Aug 01 21:31:00 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 01 21:31:00 user nova-compute[72586]:         </nova:port>
Aug 01 21:31:00 user nova-compute[72586]:       </nova:ports>
Aug 01 21:31:00 user nova-compute[72586]:     </nova:instance>
Aug 01 21:31:00 user nova-compute[72586]:   </metadata>
Aug 01 21:31:00 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:31:00 user nova-compute[72586]:     <system>
Aug 01 21:31:00 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:31:00 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:31:00 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:31:00 user nova-compute[72586]:       <entry name="serial">f9b8f9c5-0129-429d-beb6-26d4c9cc085d</entry>
Aug 01 21:31:00 user nova-compute[72586]:       <entry name="uuid">f9b8f9c5-0129-429d-beb6-26d4c9cc085d</entry>
Aug 01 21:31:00 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:31:00 user nova-compute[72586]:     </system>
Aug 01 21:31:00 user nova-compute[72586]:   </sysinfo>
Aug 01 21:31:00 user nova-compute[72586]:   <os>
Aug 01 21:31:00 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:31:00 user nova-compute[72586]:     <boot dev="hd"/>
Aug 01 21:31:00 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:31:00 user nova-compute[72586]:   </os>
Aug 01 21:31:00 user nova-compute[72586]:   <features>
Aug 01 21:31:00 user nova-compute[72586]:     <acpi/>
Aug 01 21:31:00 user nova-compute[72586]:     <apic/>
Aug 01 21:31:00 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:31:00 user nova-compute[72586]:   </features>
Aug 01 21:31:00 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:31:00 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:31:00 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:31:00 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:31:00 user nova-compute[72586]:   </clock>
Aug 01 21:31:00 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:31:00 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:31:00 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:31:00 user nova-compute[72586]:   </cpu>
Aug 01 21:31:00 user nova-compute[72586]:   <devices>
Aug 01 21:31:00 user nova-compute[72586]:     <disk type="file" device="disk">
Aug 01 21:31:00 user nova-compute[72586]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 21:31:00 user nova-compute[72586]:       <source file="/opt/stack/data/nova/instances/f9b8f9c5-0129-429d-beb6-26d4c9cc085d/disk"/>
Aug 01 21:31:00 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:31:00 user nova-compute[72586]:     </disk>
Aug 01 21:31:00 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:31:00 user nova-compute[72586]:       <mac address="fa:16:3e:6b:e7:10"/>
Aug 01 21:31:00 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:31:00 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:31:00 user nova-compute[72586]:       <target dev="tap46cc59ac-ef"/>
Aug 01 21:31:00 user nova-compute[72586]:     </interface>
Aug 01 21:31:00 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:31:00 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/f9b8f9c5-0129-429d-beb6-26d4c9cc085d/console.log" append="off"/>
Aug 01 21:31:00 user nova-compute[72586]:     </serial>
Aug 01 21:31:00 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:31:00 user nova-compute[72586]:     <video>
Aug 01 21:31:00 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:31:00 user nova-compute[72586]:     </video>
Aug 01 21:31:00 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:31:00 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:31:00 user nova-compute[72586]:     </rng>
Aug 01 21:31:00 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:31:00 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:31:00 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:31:00 user nova-compute[72586]:     </memballoon>
Aug 01 21:31:00 user nova-compute[72586]:   </devices>
Aug 01 21:31:00 user nova-compute[72586]: </domain>
Aug 01 21:31:00 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T21:27:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-752033639',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-752033639',id=21,image_ref='2871d1b3-83f8-471a-9afd-df51257b65b8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-105460435',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:27:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ae659e4ad43c44e2a8f6d48818bb796a',ramdisk_id='',reservation_id='r-odyjetm7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1935542868',owner_user_name='tempest-AttachVolumeShelveTestJSON-1935542868-project-member',shelved_at='2023-08-01T21:29:04.869172',shelved_host='user',shelved_image_id='2871d1b3-83f8-471a-9afd-df51257b65b8'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:30:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1a0d71c79c04216b9bf278f650aeb77',uuid=f9b8f9c5-0129-429d-beb6-26d4c9cc085d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "46cc59ac-efc1-40c1-8a70-b848a9980413", "address": "fa:16:3e:6b:e7:10", "network": {"id": "a5da07bc-2f5d-461e-b31f-df624d9c6557", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948878141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae659e4ad43c44e2a8f6d48818bb796a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46cc59ac-ef", "ovs_interfaceid": "46cc59ac-efc1-40c1-8a70-b848a9980413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Converting VIF {"id": "46cc59ac-efc1-40c1-8a70-b848a9980413", "address": "fa:16:3e:6b:e7:10", "network": {"id": "a5da07bc-2f5d-461e-b31f-df624d9c6557", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948878141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae659e4ad43c44e2a8f6d48818bb796a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46cc59ac-ef", "ovs_interfaceid": "46cc59ac-efc1-40c1-8a70-b848a9980413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:e7:10,bridge_name='br-int',has_traffic_filtering=True,id=46cc59ac-efc1-40c1-8a70-b848a9980413,network=Network(a5da07bc-2f5d-461e-b31f-df624d9c6557),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46cc59ac-ef') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG os_vif [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:e7:10,bridge_name='br-int',has_traffic_filtering=True,id=46cc59ac-efc1-40c1-8a70-b848a9980413,network=Network(a5da07bc-2f5d-461e-b31f-df624d9c6557),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46cc59ac-ef') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap46cc59ac-ef, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap46cc59ac-ef, col_values=(('external_ids', {'iface-id': '46cc59ac-efc1-40c1-8a70-b848a9980413', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:e7:10', 'vm-uuid': 'f9b8f9c5-0129-429d-beb6-26d4c9cc085d'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6dcaee-1271-495b-ba82-60ebdca37f48]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4bc202fb9cb\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:00 user nova-compute[72586]: INFO os_vif [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:e7:10,bridge_name='br-int',has_traffic_filtering=True,id=46cc59ac-efc1-40c1-8a70-b848a9980413,network=Network(a5da07bc-2f5d-461e-b31f-df624d9c6557),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46cc59ac-ef')
Aug 01 21:31:00 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85aa436-6e15-4809-b70a-1d3442c96184]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8efa32-4186-41b3-8f33-2a21e0009835]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[3278a122-20bd-4c8c-a203-b7ff6899d879]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-72db529a-1671-4c90-829e-24b30aadf156 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Running cmd (subprocess): nvme version {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-72db529a-1671-4c90-829e-24b30aadf156 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] 'nvme version' failed. Not Retrying. {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.nvmeof [None req-72db529a-1671-4c90-829e-24b30aadf156 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] nvme not present on system {{(pid=72586) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] No VIF found with MAC fa:16:3e:6b:e7:10, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:31:00 user nova-compute[72586]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 21:31:00 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[5771b65a-d0fb-4ff0-9da8-555dbbb3bdc6]: (4, '') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-72db529a-1671-4c90-829e-24b30aadf156 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72586) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-72db529a-1671-4c90-829e-24b30aadf156 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-72db529a-1671-4c90-829e-24b30aadf156 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] LIGHTOS: no hostnqn found. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG os_brick.utils [None req-72db529a-1671-4c90-829e-24b30aadf156 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4bc202fb9cb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:31:00 user nova-compute[72586]: DEBUG nova.virt.block_device [None req-72db529a-1671-4c90-829e-24b30aadf156 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Updating existing volume attachment record: 70318b43-0d10-4864-b228-4e5d1cc0c0f1 {{(pid=72586) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 21:31:02 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:02 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:02 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:02 user nova-compute[72586]: DEBUG nova.compute.manager [req-0d5f023f-d5b9-480d-9e46-eed63b0d57b0 req-7926ee34-8064-4fad-95d4-3633b458b2a7 service nova] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Received event network-vif-plugged-46cc59ac-efc1-40c1-8a70-b848a9980413 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:31:02 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-0d5f023f-d5b9-480d-9e46-eed63b0d57b0 req-7926ee34-8064-4fad-95d4-3633b458b2a7 service nova] Acquiring lock "f9b8f9c5-0129-429d-beb6-26d4c9cc085d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:31:02 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-0d5f023f-d5b9-480d-9e46-eed63b0d57b0 req-7926ee34-8064-4fad-95d4-3633b458b2a7 service nova] Lock "f9b8f9c5-0129-429d-beb6-26d4c9cc085d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:31:02 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-0d5f023f-d5b9-480d-9e46-eed63b0d57b0 req-7926ee34-8064-4fad-95d4-3633b458b2a7 service nova] Lock "f9b8f9c5-0129-429d-beb6-26d4c9cc085d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:31:02 user nova-compute[72586]: DEBUG nova.compute.manager [req-0d5f023f-d5b9-480d-9e46-eed63b0d57b0 req-7926ee34-8064-4fad-95d4-3633b458b2a7 service nova] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] No waiting events found dispatching network-vif-plugged-46cc59ac-efc1-40c1-8a70-b848a9980413 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:31:02 user nova-compute[72586]: WARNING nova.compute.manager [req-0d5f023f-d5b9-480d-9e46-eed63b0d57b0 req-7926ee34-8064-4fad-95d4-3633b458b2a7 service nova] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Received unexpected event network-vif-plugged-46cc59ac-efc1-40c1-8a70-b848a9980413 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 01 21:31:02 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:02 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:02 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:03 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:04 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:04 user nova-compute[72586]: DEBUG nova.compute.manager [req-d06037ed-5cb6-4ddf-a4b2-e660c9f357f5 req-340e2445-1d17-4d4e-9969-8d2a3fa739f7 service nova] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Received event network-vif-plugged-46cc59ac-efc1-40c1-8a70-b848a9980413 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:31:04 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d06037ed-5cb6-4ddf-a4b2-e660c9f357f5 req-340e2445-1d17-4d4e-9969-8d2a3fa739f7 service nova] Acquiring lock "f9b8f9c5-0129-429d-beb6-26d4c9cc085d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:31:04 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d06037ed-5cb6-4ddf-a4b2-e660c9f357f5 req-340e2445-1d17-4d4e-9969-8d2a3fa739f7 service nova] Lock "f9b8f9c5-0129-429d-beb6-26d4c9cc085d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:31:04 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d06037ed-5cb6-4ddf-a4b2-e660c9f357f5 req-340e2445-1d17-4d4e-9969-8d2a3fa739f7 service nova] Lock "f9b8f9c5-0129-429d-beb6-26d4c9cc085d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:31:04 user nova-compute[72586]: DEBUG nova.compute.manager [req-d06037ed-5cb6-4ddf-a4b2-e660c9f357f5 req-340e2445-1d17-4d4e-9969-8d2a3fa739f7 service nova] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] No waiting events found dispatching network-vif-plugged-46cc59ac-efc1-40c1-8a70-b848a9980413 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:31:04 user nova-compute[72586]: WARNING nova.compute.manager [req-d06037ed-5cb6-4ddf-a4b2-e660c9f357f5 req-340e2445-1d17-4d4e-9969-8d2a3fa739f7 service nova] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Received unexpected event network-vif-plugged-46cc59ac-efc1-40c1-8a70-b848a9980413 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 01 21:31:04 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925464.6303341, f9b8f9c5-0129-429d-beb6-26d4c9cc085d => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:31:04 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] VM Resumed (Lifecycle Event)
Aug 01 21:31:04 user nova-compute[72586]: DEBUG nova.compute.manager [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Instance event wait completed in 0 seconds for  {{(pid=72586) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 21:31:04 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Guest created on hypervisor {{(pid=72586) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 21:31:04 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Instance spawned successfully.
Aug 01 21:31:04 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:31:04 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:31:04 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:31:04 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925464.6329474, f9b8f9c5-0129-429d-beb6-26d4c9cc085d => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:31:04 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] VM Started (Lifecycle Event)
Aug 01 21:31:04 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:31:04 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:31:04 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:31:05 user nova-compute[72586]: DEBUG nova.compute.manager [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:31:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-571e6d64-e097-4f3d-84bc-30cfb55404ab tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "f9b8f9c5-0129-429d-beb6-26d4c9cc085d" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.076s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:31:05 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:09 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:10 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:10 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72db529a-1671-4c90-829e-24b30aadf156 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Calling os-brick to attach iSCSI Volume {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 21:31:10 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-72db529a-1671-4c90-829e-24b30aadf156 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5da0468b-3124-4690-ba25-6f0fc97f1abf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sGyJvdfx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:31:10 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-72db529a-1671-4c90-829e-24b30aadf156 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:31:10 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-72db529a-1671-4c90-829e-24b30aadf156 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:31:10 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-72db529a-1671-4c90-829e-24b30aadf156 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:31:10 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-72db529a-1671-4c90-829e-24b30aadf156 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:31:10 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-72db529a-1671-4c90-829e-24b30aadf156 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5da0468b-3124-4690-ba25-6f0fc97f1abf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:31:10 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-72db529a-1671-4c90-829e-24b30aadf156 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5da0468b-3124-4690-ba25-6f0fc97f1abf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.079s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:31:10 user nova-compute[72586]: INFO os_brick.initiator.connectors.iscsi [None req-72db529a-1671-4c90-829e-24b30aadf156 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 21:31:10 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da0468b-3124-4690-ba25-6f0fc97f1abf -p 172.16.0.220:3260 {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:31:11 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da0468b-3124-4690-ba25-6f0fc97f1abf -p 172.16.0.220:3260" returned: 21 in 0.254s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:31:11 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33948cc-e0bb-4b99-9aff-6bffa7adb1d9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:31:11 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-72db529a-1671-4c90-829e-24b30aadf156 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 21:31:11 user nova-compute[72586]:  {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:31:11 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da0468b-3124-4690-ba25-6f0fc97f1abf -p 172.16.0.220:3260 --interface default --op new {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:31:11 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da0468b-3124-4690-ba25-6f0fc97f1abf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.132s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:31:11 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d77ac8-def2-4225-a5d4-4be1552e4db0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5da0468b-3124-4690-ba25-6f0fc97f1abf] added\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:31:11 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-72db529a-1671-4c90-829e-24b30aadf156 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5da0468b-3124-4690-ba25-6f0fc97f1abf] added
Aug 01 21:31:11 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:31:11 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da0468b-3124-4690-ba25-6f0fc97f1abf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:31:11 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da0468b-3124-4690-ba25-6f0fc97f1abf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:31:11 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4904f9-5c7d-473a-8fd1-fa4d0baeecbd]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:31:11 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-72db529a-1671-4c90-829e-24b30aadf156 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:31:11 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da0468b-3124-4690-ba25-6f0fc97f1abf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:31:11 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da0468b-3124-4690-ba25-6f0fc97f1abf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:31:11 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[562c856d-a947-42a5-bf92-a3ea5abac312]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:31:11 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-72db529a-1671-4c90-829e-24b30aadf156 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:31:11 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da0468b-3124-4690-ba25-6f0fc97f1abf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sGyJvdfx {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:31:11 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da0468b-3124-4690-ba25-6f0fc97f1abf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sGyJvdfx" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:31:11 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d72b8f7-37e0-4ec2-814f-62afa0794aaf]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:31:11 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-72db529a-1671-4c90-829e-24b30aadf156 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sGyJvdfx'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:31:11 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da0468b-3124-4690-ba25-6f0fc97f1abf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:31:11 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da0468b-3124-4690-ba25-6f0fc97f1abf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.053s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:31:11 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9241866d-f462-48ad-b1aa-5a584a8dea3e]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:31:11 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-72db529a-1671-4c90-829e-24b30aadf156 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:31:11 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:31:11 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.227s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:31:11 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e1ae76-c948-45f5-923b-ec14b58329b4]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a23337b8-f764-488e-b2e1-69c35bcc8dd9 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:31:11 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-72db529a-1671-4c90-829e-24b30aadf156 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)
Aug 01 21:31:11 user nova-compute[72586]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 (non-flash)
Aug 01 21:31:11 user nova-compute[72586]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:31:11 user nova-compute[72586]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:31:11 user nova-compute[72586]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a23337b8-f764-488e-b2e1-69c35bcc8dd9 (non-flash)
Aug 01 21:31:11 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:31:11 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-72db529a-1671-4c90-829e-24b30aadf156 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)
Aug 01 21:31:11 user nova-compute[72586]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 (non-flash)
Aug 01 21:31:11 user nova-compute[72586]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:31:11 user nova-compute[72586]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:31:11 user nova-compute[72586]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a23337b8-f764-488e-b2e1-69c35bcc8dd9 (non-flash)
Aug 01 21:31:11 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:31:11 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da0468b-3124-4690-ba25-6f0fc97f1abf -p 172.16.0.220:3260 --login {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:31:11 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da0468b-3124-4690-ba25-6f0fc97f1abf -p 172.16.0.220:3260 --login" returned: 0 in 0.223s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:31:11 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d14933c-6243-4884-bf49-1fe02fef2e9b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5da0468b-3124-4690-ba25-6f0fc97f1abf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5da0468b-3124-4690-ba25-6f0fc97f1abf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:31:11 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-72db529a-1671-4c90-829e-24b30aadf156 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5da0468b-3124-4690-ba25-6f0fc97f1abf, portal: 172.16.0.220,3260]
Aug 01 21:31:11 user nova-compute[72586]: Login to [iface: default, target: iqn.2010-10.org.openstack:5da0468b-3124-4690-ba25-6f0fc97f1abf, portal: 172.16.0.220,3260] successful.
Aug 01 21:31:11 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:31:11 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da0468b-3124-4690-ba25-6f0fc97f1abf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:31:11 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da0468b-3124-4690-ba25-6f0fc97f1abf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:31:11 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9566d380-5340-478b-a5f6-3fdd6987c152]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:31:11 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-72db529a-1671-4c90-829e-24b30aadf156 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:31:11 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:31:11 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:31:11 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ddb7fa-31b0-4997-b1c9-61c1b870fc88]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a23337b8-f764-488e-b2e1-69c35bcc8dd9 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da0468b-3124-4690-ba25-6f0fc97f1abf (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:31:11 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-72db529a-1671-4c90-829e-24b30aadf156 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)
Aug 01 21:31:11 user nova-compute[72586]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 (non-flash)
Aug 01 21:31:11 user nova-compute[72586]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:31:11 user nova-compute[72586]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:31:11 user nova-compute[72586]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a23337b8-f764-488e-b2e1-69c35bcc8dd9 (non-flash)
Aug 01 21:31:11 user nova-compute[72586]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da0468b-3124-4690-ba25-6f0fc97f1abf (non-flash)
Aug 01 21:31:11 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:31:11 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-72db529a-1671-4c90-829e-24b30aadf156 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)
Aug 01 21:31:11 user nova-compute[72586]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 (non-flash)
Aug 01 21:31:11 user nova-compute[72586]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:31:11 user nova-compute[72586]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:31:11 user nova-compute[72586]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a23337b8-f764-488e-b2e1-69c35bcc8dd9 (non-flash)
Aug 01 21:31:11 user nova-compute[72586]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da0468b-3124-4690-ba25-6f0fc97f1abf (non-flash)
Aug 01 21:31:11 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:31:11 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-72db529a-1671-4c90-829e-24b30aadf156 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5da0468b-3124-4690-ba25-6f0fc97f1abf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.067s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:31:11 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-72db529a-1671-4c90-829e-24b30aadf156 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Connected to 172.16.0.220:3260 {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 21:31:11 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-72db529a-1671-4c90-829e-24b30aadf156 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] HCTL ('38', '-', '-', 0) found on session 33 with lun 0 {{(pid=72586) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 21:31:11 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-72db529a-1671-4c90-829e-24b30aadf156 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72586) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 21:31:11 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:31:12 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:31:12 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[294f5911-d028-4e48-8213-0bc0525c648a]: (4, ('- - 0', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:31:12 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-72db529a-1671-4c90-829e-24b30aadf156 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Searching for a device in session 33 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:31:12 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-72db529a-1671-4c90-829e-24b30aadf156 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sGyJvdfx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 21:31:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-72db529a-1671-4c90-829e-24b30aadf156 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.179s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:31:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-72db529a-1671-4c90-829e-24b30aadf156 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] <== connect_volume: return (2180ms) {'type': 'block', 'scsi_wwn': '26130376434656333', 'path': '/dev/sdg'} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:31:13 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72db529a-1671-4c90-829e-24b30aadf156 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26130376434656333', 'path': '/dev/sdg'} {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 21:31:13 user nova-compute[72586]: DEBUG nova.objects.instance [None req-72db529a-1671-4c90-829e-24b30aadf156 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lazy-loading 'flavor' on Instance uuid f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:31:13 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-72db529a-1671-4c90-829e-24b30aadf156 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 21:31:13 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:31:13 user nova-compute[72586]:   <source dev="/dev/sdg"/>
Aug 01 21:31:13 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:31:13 user nova-compute[72586]:   <serial>5da0468b-3124-4690-ba25-6f0fc97f1abf</serial>
Aug 01 21:31:13 user nova-compute[72586]: </disk>
Aug 01 21:31:13 user nova-compute[72586]:  {{(pid=72586) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 21:31:13 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-72db529a-1671-4c90-829e-24b30aadf156 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:31:13 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-72db529a-1671-4c90-829e-24b30aadf156 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:31:13 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-72db529a-1671-4c90-829e-24b30aadf156 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] No VIF found with MAC fa:16:3e:ac:44:36, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:31:13 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-72db529a-1671-4c90-829e-24b30aadf156 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lock "f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.156s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:31:14 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:15 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-110f7d14-5c66-4ea7-90af-6bbe709252ac tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Acquiring lock "f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:31:15 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-110f7d14-5c66-4ea7-90af-6bbe709252ac tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lock "f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:31:15 user nova-compute[72586]: INFO nova.compute.manager [None req-110f7d14-5c66-4ea7-90af-6bbe709252ac tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Detaching volume 5da0468b-3124-4690-ba25-6f0fc97f1abf
Aug 01 21:31:15 user nova-compute[72586]: INFO nova.virt.block_device [None req-110f7d14-5c66-4ea7-90af-6bbe709252ac tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Attempting to driver detach volume 5da0468b-3124-4690-ba25-6f0fc97f1abf from mountpoint /dev/vdb
Aug 01 21:31:15 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-110f7d14-5c66-4ea7-90af-6bbe709252ac tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Attempting to detach device vdb from instance f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536 from the persistent domain config. {{(pid=72586) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 21:31:15 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-110f7d14-5c66-4ea7-90af-6bbe709252ac tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 21:31:15 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:31:15 user nova-compute[72586]:   <source dev="/dev/sdg"/>
Aug 01 21:31:15 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:31:15 user nova-compute[72586]:   <serial>5da0468b-3124-4690-ba25-6f0fc97f1abf</serial>
Aug 01 21:31:15 user nova-compute[72586]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 21:31:15 user nova-compute[72586]: </disk>
Aug 01 21:31:15 user nova-compute[72586]:  {{(pid=72586) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 21:31:15 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-110f7d14-5c66-4ea7-90af-6bbe709252ac tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Successfully detached device vdb from instance f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536 from the persistent domain config.
Aug 01 21:31:15 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-110f7d14-5c66-4ea7-90af-6bbe709252ac tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536 from the live domain config. {{(pid=72586) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 21:31:15 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-110f7d14-5c66-4ea7-90af-6bbe709252ac tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 21:31:15 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:31:15 user nova-compute[72586]:   <source dev="/dev/sdg"/>
Aug 01 21:31:15 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:31:15 user nova-compute[72586]:   <serial>5da0468b-3124-4690-ba25-6f0fc97f1abf</serial>
Aug 01 21:31:15 user nova-compute[72586]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 21:31:15 user nova-compute[72586]: </disk>
Aug 01 21:31:15 user nova-compute[72586]:  {{(pid=72586) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 21:31:15 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:16 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Received event <DeviceRemovedEvent: 1690925476.0599232, f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72586) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 21:31:16 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-110f7d14-5c66-4ea7-90af-6bbe709252ac tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536 {{(pid=72586) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 21:31:16 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-110f7d14-5c66-4ea7-90af-6bbe709252ac tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Successfully detached device vdb from instance f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536 from the live domain config.
Aug 01 21:31:16 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-110f7d14-5c66-4ea7-90af-6bbe709252ac tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] calling os-brick to detach iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 21:31:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-110f7d14-5c66-4ea7-90af-6bbe709252ac tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, {'target_iqns': ['iqn.2010-10.org.openstack:5da0468b-3124-4690-ba25-6f0fc97f1abf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sGyJvdfx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:31:16 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-110f7d14-5c66-4ea7-90af-6bbe709252ac tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:31:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-110f7d14-5c66-4ea7-90af-6bbe709252ac tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:31:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-110f7d14-5c66-4ea7-90af-6bbe709252ac tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:31:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-110f7d14-5c66-4ea7-90af-6bbe709252ac tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5da0468b-3124-4690-ba25-6f0fc97f1abf', 0)] {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 21:31:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:31:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:31:16 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[130a6369-8018-4e88-9942-100aa503bd2c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5da0468b-3124-4690-ba25-6f0fc97f1abf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a23337b8-f764-488e-b2e1-69c35bcc8dd9\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:31:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:31:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:31:16 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f1f18a-a65f-4268-aa54-9c7c3b38d10d]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a23337b8-f764-488e-b2e1-69c35bcc8dd9 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da0468b-3124-4690-ba25-6f0fc97f1abf (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:31:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-110f7d14-5c66-4ea7-90af-6bbe709252ac tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)
Aug 01 21:31:16 user nova-compute[72586]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 (non-flash)
Aug 01 21:31:16 user nova-compute[72586]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:31:16 user nova-compute[72586]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:31:16 user nova-compute[72586]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a23337b8-f764-488e-b2e1-69c35bcc8dd9 (non-flash)
Aug 01 21:31:16 user nova-compute[72586]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da0468b-3124-4690-ba25-6f0fc97f1abf (non-flash)
Aug 01 21:31:16 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:31:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-110f7d14-5c66-4ea7-90af-6bbe709252ac tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)
Aug 01 21:31:16 user nova-compute[72586]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 (non-flash)
Aug 01 21:31:16 user nova-compute[72586]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:31:16 user nova-compute[72586]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:31:16 user nova-compute[72586]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a23337b8-f764-488e-b2e1-69c35bcc8dd9 (non-flash)
Aug 01 21:31:16 user nova-compute[72586]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da0468b-3124-4690-ba25-6f0fc97f1abf (non-flash)
Aug 01 21:31:16 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:31:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-110f7d14-5c66-4ea7-90af-6bbe709252ac tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ed03d5a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5da0468b-3124-4690-ba25-6f0fc97f1abf'): ({'sdg'}, set())}) {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 21:31:16 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-110f7d14-5c66-4ea7-90af-6bbe709252ac tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Removing single pathed devices sdg {{(pid=72586) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 21:31:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:31:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:31:16 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee61dd7-f6df-45bb-b36d-342550b97682]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:31:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:31:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.028s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:31:16 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[971c68c5-5485-4295-bc48-506c6dc7367c]: (4, ('ok\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:31:16 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-110f7d14-5c66-4ea7-90af-6bbe709252ac tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Flushing IO for device /dev/sdg {{(pid=72586) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 21:31:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:31:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:31:16 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[4329a7d6-0409-4c1a-b99e-5bdb6a1e8630]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:31:16 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-110f7d14-5c66-4ea7-90af-6bbe709252ac tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72586) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 21:31:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:31:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.040s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:31:16 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc163cc-f1e3-4247-8f52-b4ffbaa87584]: (4, ('1', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:31:16 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-110f7d14-5c66-4ea7-90af-6bbe709252ac tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 21:31:16 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-110f7d14-5c66-4ea7-90af-6bbe709252ac tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] SCSI volumes sdg have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 21:31:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-110f7d14-5c66-4ea7-90af-6bbe709252ac tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5da0468b-3124-4690-ba25-6f0fc97f1abf')] {{(pid=72586) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 21:31:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da0468b-3124-4690-ba25-6f0fc97f1abf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:31:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da0468b-3124-4690-ba25-6f0fc97f1abf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.083s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:31:16 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded6b18d-7733-4fca-ab7e-9880df6f6d18]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:31:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-110f7d14-5c66-4ea7-90af-6bbe709252ac tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:31:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da0468b-3124-4690-ba25-6f0fc97f1abf -p 172.16.0.220:3260 --logout {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:31:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da0468b-3124-4690-ba25-6f0fc97f1abf -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:31:16 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fac27f4-73a7-483d-8c08-5ac066dc522f]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:5da0468b-3124-4690-ba25-6f0fc97f1abf, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:5da0468b-3124-4690-ba25-6f0fc97f1abf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:31:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-110f7d14-5c66-4ea7-90af-6bbe709252ac tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:5da0468b-3124-4690-ba25-6f0fc97f1abf, portal: 172.16.0.220,3260]
Aug 01 21:31:16 user nova-compute[72586]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:5da0468b-3124-4690-ba25-6f0fc97f1abf, portal: 172.16.0.220,3260] successful.
Aug 01 21:31:16 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:31:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da0468b-3124-4690-ba25-6f0fc97f1abf -p 172.16.0.220:3260 --op delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:31:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da0468b-3124-4690-ba25-6f0fc97f1abf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:31:16 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0527f366-d811-45d1-8ffd-54c40271a98a]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:31:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-110f7d14-5c66-4ea7-90af-6bbe709252ac tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:31:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-110f7d14-5c66-4ea7-90af-6bbe709252ac tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.396s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:31:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-110f7d14-5c66-4ea7-90af-6bbe709252ac tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] <== disconnect_volume: return (396ms) None {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:31:16 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-110f7d14-5c66-4ea7-90af-6bbe709252ac tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Disconnected iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 21:31:17 user nova-compute[72586]: DEBUG nova.objects.instance [None req-110f7d14-5c66-4ea7-90af-6bbe709252ac tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lazy-loading 'flavor' on Instance uuid f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:31:17 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-110f7d14-5c66-4ea7-90af-6bbe709252ac tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lock "f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.055s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:31:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:20 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:22 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:31:24 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:25 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-59c8a55b-2ede-4abd-8180-4a4fb0082aa5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Acquiring lock "09571c9f-bf42-475a-afac-0e3947168d7e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:31:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-59c8a55b-2ede-4abd-8180-4a4fb0082aa5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Lock "09571c9f-bf42-475a-afac-0e3947168d7e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:31:25 user nova-compute[72586]: INFO nova.compute.manager [None req-59c8a55b-2ede-4abd-8180-4a4fb0082aa5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Detaching volume 33373a5a-73b8-450c-80f1-743847fd50b6
Aug 01 21:31:25 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:31:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:31:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:31:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:31:25 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Auditing locally available compute resources for user (node: user) {{(pid=72586) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 21:31:25 user nova-compute[72586]: INFO nova.virt.block_device [None req-59c8a55b-2ede-4abd-8180-4a4fb0082aa5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Attempting to driver detach volume 33373a5a-73b8-450c-80f1-743847fd50b6 from mountpoint /dev/vdb
Aug 01 21:31:25 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-59c8a55b-2ede-4abd-8180-4a4fb0082aa5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Attempting to detach device vdb from instance 09571c9f-bf42-475a-afac-0e3947168d7e from the persistent domain config. {{(pid=72586) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 21:31:25 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-59c8a55b-2ede-4abd-8180-4a4fb0082aa5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 21:31:25 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:31:25 user nova-compute[72586]:   <source dev="/dev/sde"/>
Aug 01 21:31:25 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:31:25 user nova-compute[72586]:   <serial>33373a5a-73b8-450c-80f1-743847fd50b6</serial>
Aug 01 21:31:25 user nova-compute[72586]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 21:31:25 user nova-compute[72586]: </disk>
Aug 01 21:31:25 user nova-compute[72586]:  {{(pid=72586) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 21:31:25 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-59c8a55b-2ede-4abd-8180-4a4fb0082aa5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Successfully detached device vdb from instance 09571c9f-bf42-475a-afac-0e3947168d7e from the persistent domain config.
Aug 01 21:31:25 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-59c8a55b-2ede-4abd-8180-4a4fb0082aa5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 09571c9f-bf42-475a-afac-0e3947168d7e from the live domain config. {{(pid=72586) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 21:31:25 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-59c8a55b-2ede-4abd-8180-4a4fb0082aa5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 21:31:25 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:31:25 user nova-compute[72586]:   <source dev="/dev/sde"/>
Aug 01 21:31:25 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:31:25 user nova-compute[72586]:   <serial>33373a5a-73b8-450c-80f1-743847fd50b6</serial>
Aug 01 21:31:25 user nova-compute[72586]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 21:31:25 user nova-compute[72586]: </disk>
Aug 01 21:31:25 user nova-compute[72586]:  {{(pid=72586) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 21:31:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:31:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:31:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:31:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:31:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:31:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Received event <DeviceRemovedEvent: 1690925486.4167936, 09571c9f-bf42-475a-afac-0e3947168d7e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72586) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 21:31:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:31:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-59c8a55b-2ede-4abd-8180-4a4fb0082aa5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 09571c9f-bf42-475a-afac-0e3947168d7e {{(pid=72586) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 21:31:26 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-59c8a55b-2ede-4abd-8180-4a4fb0082aa5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Successfully detached device vdb from instance 09571c9f-bf42-475a-afac-0e3947168d7e from the live domain config.
Aug 01 21:31:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59c8a55b-2ede-4abd-8180-4a4fb0082aa5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] calling os-brick to detach iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 21:31:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c8a55b-2ede-4abd-8180-4a4fb0082aa5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, {'target_iqns': ['iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PJFDejSI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:31:26 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-59c8a55b-2ede-4abd-8180-4a4fb0082aa5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:31:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-59c8a55b-2ede-4abd-8180-4a4fb0082aa5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:31:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-59c8a55b-2ede-4abd-8180-4a4fb0082aa5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:31:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c8a55b-2ede-4abd-8180-4a4fb0082aa5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6', 0)] {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 21:31:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:31:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:31:26 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07387bc-2891-4b4b-a71f-2f507f18648f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:31:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:31:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:31:26 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c029a9-3042-4478-83b7-d5fce0e89c18]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:31:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c8a55b-2ede-4abd-8180-4a4fb0082aa5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)
Aug 01 21:31:26 user nova-compute[72586]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 (non-flash)
Aug 01 21:31:26 user nova-compute[72586]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:31:26 user nova-compute[72586]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:31:26 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:31:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c8a55b-2ede-4abd-8180-4a4fb0082aa5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)
Aug 01 21:31:26 user nova-compute[72586]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 (non-flash)
Aug 01 21:31:26 user nova-compute[72586]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:31:26 user nova-compute[72586]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:31:26 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:31:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c8a55b-2ede-4abd-8180-4a4fb0082aa5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ee80e3010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6'): ({'sde'}, set())}) {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 21:31:26 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-59c8a55b-2ede-4abd-8180-4a4fb0082aa5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Removing single pathed devices sde {{(pid=72586) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 21:31:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:31:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:31:26 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a64f08e-c8aa-45ef-aa3b-87cd76c786bb]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:31:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:31:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:31:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:31:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:31:26 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf32a434-b109-4230-a707-2af74288270c]: (4, ('ok\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:31:26 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-59c8a55b-2ede-4abd-8180-4a4fb0082aa5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Flushing IO for device /dev/sde {{(pid=72586) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 21:31:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:31:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:31:26 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba829e0e-9f5f-40a1-b752-c10a0454fc0e]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:31:26 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-59c8a55b-2ede-4abd-8180-4a4fb0082aa5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72586) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 21:31:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:31:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:31:26 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb464864-1029-419e-8258-d1af18fc5dbb]: (4, ('1', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:31:26 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-59c8a55b-2ede-4abd-8180-4a4fb0082aa5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 21:31:26 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-59c8a55b-2ede-4abd-8180-4a4fb0082aa5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] SCSI volumes sde have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 21:31:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c8a55b-2ede-4abd-8180-4a4fb0082aa5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6')] {{(pid=72586) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 21:31:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:31:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:31:26 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[743cc1df-1ee3-48fc-a97c-c8077dd66e6b]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:31:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c8a55b-2ede-4abd-8180-4a4fb0082aa5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:31:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 -p 172.16.0.220:3260 --logout {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:31:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:31:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:31:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:31:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.096s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:31:26 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d04d3f8-5235-4059-b01c-9aaeb1c4c1c0]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:31:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c8a55b-2ede-4abd-8180-4a4fb0082aa5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6, portal: 172.16.0.220,3260]
Aug 01 21:31:26 user nova-compute[72586]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6, portal: 172.16.0.220,3260] successful.
Aug 01 21:31:26 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:31:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 -p 172.16.0.220:3260 --op delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:31:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33373a5a-73b8-450c-80f1-743847fd50b6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:31:26 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[52454517-4027-480c-b494-6c4cedd5b87a]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:31:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c8a55b-2ede-4abd-8180-4a4fb0082aa5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:31:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-59c8a55b-2ede-4abd-8180-4a4fb0082aa5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:31:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c8a55b-2ede-4abd-8180-4a4fb0082aa5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] <== disconnect_volume: return (359ms) None {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:31:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59c8a55b-2ede-4abd-8180-4a4fb0082aa5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Disconnected iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 21:31:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:31:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:31:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:31:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:31:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:31:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:31:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:31:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51eb56c-bce2-4593-abc3-878c358c9a74/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:31:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51eb56c-bce2-4593-abc3-878c358c9a74/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:31:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51eb56c-bce2-4593-abc3-878c358c9a74/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:31:27 user nova-compute[72586]: DEBUG nova.objects.instance [None req-59c8a55b-2ede-4abd-8180-4a4fb0082aa5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Lazy-loading 'flavor' on Instance uuid 09571c9f-bf42-475a-afac-0e3947168d7e {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:31:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51eb56c-bce2-4593-abc3-878c358c9a74/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:31:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b0d907-2515-4a06-8b35-9ddd09ce42c3/disk.rescue --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:31:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-59c8a55b-2ede-4abd-8180-4a4fb0082aa5 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Lock "09571c9f-bf42-475a-afac-0e3947168d7e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.809s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:31:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b0d907-2515-4a06-8b35-9ddd09ce42c3/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:31:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b0d907-2515-4a06-8b35-9ddd09ce42c3/disk.rescue --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:31:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b0d907-2515-4a06-8b35-9ddd09ce42c3/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:31:27 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /opt/stack/data/nova/instances/f6b0d907-2515-4a06-8b35-9ddd09ce42c3/disk (vdb) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:31:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:31:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:31:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:31:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:31:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9b8f9c5-0129-429d-beb6-26d4c9cc085d/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:31:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9b8f9c5-0129-429d-beb6-26d4c9cc085d/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:31:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9b8f9c5-0129-429d-beb6-26d4c9cc085d/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:31:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9b8f9c5-0129-429d-beb6-26d4c9cc085d/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:31:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.rescue --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:31:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:31:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.rescue --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:31:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:31:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:31:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:31:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:31:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:31:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ac93270-a352-4844-900f-cd3486658610/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:31:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ac93270-a352-4844-900f-cd3486658610/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:31:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ac93270-a352-4844-900f-cd3486658610/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:31:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ac93270-a352-4844-900f-cd3486658610/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:31:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09571c9f-bf42-475a-afac-0e3947168d7e/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:31:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09571c9f-bf42-475a-afac-0e3947168d7e/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:31:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09571c9f-bf42-475a-afac-0e3947168d7e/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:31:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09571c9f-bf42-475a-afac-0e3947168d7e/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:31:30 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:30 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:31:30 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:31:30 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Hypervisor/Node resource view: name=user free_ram=7121MB free_disk=25.184112548828125GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72586) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 21:31:30 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:31:30 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:31:30 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 042f0031-1e4d-41d0-8bfa-36001675cfe3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:31:30 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 413c3426-18ad-4a5c-af04-e0e7fc90f050 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:31:30 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 49c24c77-f102-4aed-8314-b04aad5f6b3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:31:30 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance d51eb56c-bce2-4593-abc3-878c358c9a74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:31:30 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:31:30 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance af2de810-b22f-4fa9-835c-c673abd145db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:31:30 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance f6b0d907-2515-4a06-8b35-9ddd09ce42c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:31:30 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 09571c9f-bf42-475a-afac-0e3947168d7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:31:30 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance c3798403-855b-45e4-af48-ba6b62570dba actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:31:30 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 161fab9d-a7d1-4ea0-b4b9-2afc54040eef actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:31:30 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 7ac93270-a352-4844-900f-cd3486658610 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:31:30 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance f9b8f9c5-0129-429d-beb6-26d4c9cc085d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:31:30 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 21:31:30 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 21:31:30 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:30 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:31:30 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:31:30 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Compute_service record updated for user:user {{(pid=72586) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 21:31:30 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.590s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:31:31 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:31:31 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:31:31 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Starting heal instance info cache {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 21:31:31 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "refresh_cache-c3798403-855b-45e4-af48-ba6b62570dba" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:31:31 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquired lock "refresh_cache-c3798403-855b-45e4-af48-ba6b62570dba" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:31:31 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Forcefully refreshing network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 21:31:32 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Updating instance_info_cache with network_info: [{"id": "68b636e3-234f-49e5-b0fb-9f99fffab5c5", "address": "fa:16:3e:a4:40:ed", "network": {"id": "42af123b-86fc-427d-b74a-a2e30c38720c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1787263710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c49158afdb04ea48c05f32782106197", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b636e3-23", "ovs_interfaceid": "68b636e3-234f-49e5-b0fb-9f99fffab5c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:31:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Releasing lock "refresh_cache-c3798403-855b-45e4-af48-ba6b62570dba" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:31:32 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Updated the network info_cache for instance {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 21:31:32 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:31:32 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:31:32 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:31:32 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72586) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 21:31:32 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:31:33 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:31:34 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:35 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:35 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-6bda24db-eb94-483d-8e8b-75b0d608b146 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Acquiring lock "d51eb56c-bce2-4593-abc3-878c358c9a74" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:31:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-6bda24db-eb94-483d-8e8b-75b0d608b146 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Lock "d51eb56c-bce2-4593-abc3-878c358c9a74" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:31:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-6bda24db-eb94-483d-8e8b-75b0d608b146 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Acquiring lock "d51eb56c-bce2-4593-abc3-878c358c9a74-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:31:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-6bda24db-eb94-483d-8e8b-75b0d608b146 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Lock "d51eb56c-bce2-4593-abc3-878c358c9a74-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:31:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-6bda24db-eb94-483d-8e8b-75b0d608b146 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Lock "d51eb56c-bce2-4593-abc3-878c358c9a74-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:31:37 user nova-compute[72586]: INFO nova.compute.manager [None req-6bda24db-eb94-483d-8e8b-75b0d608b146 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Terminating instance
Aug 01 21:31:37 user nova-compute[72586]: DEBUG nova.compute.manager [None req-6bda24db-eb94-483d-8e8b-75b0d608b146 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Start destroying the instance on the hypervisor. {{(pid=72586) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 21:31:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:37 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Instance destroyed successfully.
Aug 01 21:31:37 user nova-compute[72586]: DEBUG nova.objects.instance [None req-6bda24db-eb94-483d-8e8b-75b0d608b146 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Lazy-loading 'resources' on Instance uuid d51eb56c-bce2-4593-abc3-878c358c9a74 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:31:37 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-6bda24db-eb94-483d-8e8b-75b0d608b146 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:24:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2052800267',display_name='tempest-ServerStableDeviceRescueTest-server-2052800267',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2052800267',id=16,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOAvh66e+pEUdqXK4j6Bev4qsj5Kw07j5qNS+OqbzC0rxd8JE0DAFrfEkFQTMqQTO8zjMSitipbfpifLdeH7ftdHAX9wDP0Yye10y43OrSHeNISMfjmF8SQTQ58PdQpW2A==',key_name='tempest-keypair-2114790470',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:28:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f911c1cbc98a4d93b73090da5f655812',ramdisk_id='',reservation_id='r-ls9h6vet',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1118462212',owner_user_name='tempest-ServerStableDeviceRescueTest-1118462212-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:30:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d22bbcdb21c5414b805fadba9cd1ce70',uuid=d51eb56c-bce2-4593-abc3-878c358c9a74,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0cdd112b-f316-4cf2-b3e5-82897e241453", "address": "fa:16:3e:f2:07:05", "network": {"id": "b40254e1-7668-4ef6-b133-681304d57290", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1667586785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f911c1cbc98a4d93b73090da5f655812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cdd112b-f3", "ovs_interfaceid": "0cdd112b-f316-4cf2-b3e5-82897e241453", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:31:37 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-6bda24db-eb94-483d-8e8b-75b0d608b146 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Converting VIF {"id": "0cdd112b-f316-4cf2-b3e5-82897e241453", "address": "fa:16:3e:f2:07:05", "network": {"id": "b40254e1-7668-4ef6-b133-681304d57290", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1667586785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f911c1cbc98a4d93b73090da5f655812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cdd112b-f3", "ovs_interfaceid": "0cdd112b-f316-4cf2-b3e5-82897e241453", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:31:37 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-6bda24db-eb94-483d-8e8b-75b0d608b146 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f2:07:05,bridge_name='br-int',has_traffic_filtering=True,id=0cdd112b-f316-4cf2-b3e5-82897e241453,network=Network(b40254e1-7668-4ef6-b133-681304d57290),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cdd112b-f3') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:31:37 user nova-compute[72586]: DEBUG os_vif [None req-6bda24db-eb94-483d-8e8b-75b0d608b146 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:07:05,bridge_name='br-int',has_traffic_filtering=True,id=0cdd112b-f316-4cf2-b3e5-82897e241453,network=Network(b40254e1-7668-4ef6-b133-681304d57290),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cdd112b-f3') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:31:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0cdd112b-f3, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:31:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:37 user nova-compute[72586]: INFO os_vif [None req-6bda24db-eb94-483d-8e8b-75b0d608b146 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:07:05,bridge_name='br-int',has_traffic_filtering=True,id=0cdd112b-f316-4cf2-b3e5-82897e241453,network=Network(b40254e1-7668-4ef6-b133-681304d57290),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cdd112b-f3')
Aug 01 21:31:37 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-6bda24db-eb94-483d-8e8b-75b0d608b146 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Deleting instance files /opt/stack/data/nova/instances/d51eb56c-bce2-4593-abc3-878c358c9a74_del
Aug 01 21:31:37 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-6bda24db-eb94-483d-8e8b-75b0d608b146 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Deletion of /opt/stack/data/nova/instances/d51eb56c-bce2-4593-abc3-878c358c9a74_del complete
Aug 01 21:31:37 user nova-compute[72586]: INFO nova.compute.manager [None req-6bda24db-eb94-483d-8e8b-75b0d608b146 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 01 21:31:37 user nova-compute[72586]: DEBUG oslo.service.loopingcall [None req-6bda24db-eb94-483d-8e8b-75b0d608b146 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72586) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 21:31:37 user nova-compute[72586]: DEBUG nova.compute.manager [-] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Deallocating network for instance {{(pid=72586) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 21:31:37 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] deallocate_for_instance() {{(pid=72586) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 21:31:38 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:38 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:31:38 user nova-compute[72586]: DEBUG nova.compute.manager [req-a60d0b9b-1fc7-4eaa-93f6-1b6ea719a691 req-bfbc886a-4565-4a83-a3eb-832d5e14f547 service nova] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Received event network-vif-unplugged-0cdd112b-f316-4cf2-b3e5-82897e241453 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:31:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-a60d0b9b-1fc7-4eaa-93f6-1b6ea719a691 req-bfbc886a-4565-4a83-a3eb-832d5e14f547 service nova] Acquiring lock "d51eb56c-bce2-4593-abc3-878c358c9a74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:31:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-a60d0b9b-1fc7-4eaa-93f6-1b6ea719a691 req-bfbc886a-4565-4a83-a3eb-832d5e14f547 service nova] Lock "d51eb56c-bce2-4593-abc3-878c358c9a74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:31:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-a60d0b9b-1fc7-4eaa-93f6-1b6ea719a691 req-bfbc886a-4565-4a83-a3eb-832d5e14f547 service nova] Lock "d51eb56c-bce2-4593-abc3-878c358c9a74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:31:38 user nova-compute[72586]: DEBUG nova.compute.manager [req-a60d0b9b-1fc7-4eaa-93f6-1b6ea719a691 req-bfbc886a-4565-4a83-a3eb-832d5e14f547 service nova] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] No waiting events found dispatching network-vif-unplugged-0cdd112b-f316-4cf2-b3e5-82897e241453 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:31:38 user nova-compute[72586]: DEBUG nova.compute.manager [req-a60d0b9b-1fc7-4eaa-93f6-1b6ea719a691 req-bfbc886a-4565-4a83-a3eb-832d5e14f547 service nova] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Received event network-vif-unplugged-0cdd112b-f316-4cf2-b3e5-82897e241453 for instance with task_state deleting. {{(pid=72586) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 21:31:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:39 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:31:39 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Took 1.65 seconds to deallocate network for instance.
Aug 01 21:31:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-6bda24db-eb94-483d-8e8b-75b0d608b146 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:31:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-6bda24db-eb94-483d-8e8b-75b0d608b146 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:31:40 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-6bda24db-eb94-483d-8e8b-75b0d608b146 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:31:40 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-6bda24db-eb94-483d-8e8b-75b0d608b146 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:31:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-6bda24db-eb94-483d-8e8b-75b0d608b146 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.487s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:31:40 user nova-compute[72586]: INFO nova.scheduler.client.report [None req-6bda24db-eb94-483d-8e8b-75b0d608b146 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Deleted allocations for instance d51eb56c-bce2-4593-abc3-878c358c9a74
Aug 01 21:31:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-6bda24db-eb94-483d-8e8b-75b0d608b146 tempest-ServerStableDeviceRescueTest-1118462212 tempest-ServerStableDeviceRescueTest-1118462212-project-member] Lock "d51eb56c-bce2-4593-abc3-878c358c9a74" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.170s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:31:40 user nova-compute[72586]: DEBUG nova.compute.manager [req-2a844392-e236-4f7b-9903-5ab6e4ca93d3 req-dc431093-2086-4932-ad58-757d30dc5475 service nova] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Received event network-vif-plugged-0cdd112b-f316-4cf2-b3e5-82897e241453 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:31:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-2a844392-e236-4f7b-9903-5ab6e4ca93d3 req-dc431093-2086-4932-ad58-757d30dc5475 service nova] Acquiring lock "d51eb56c-bce2-4593-abc3-878c358c9a74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:31:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-2a844392-e236-4f7b-9903-5ab6e4ca93d3 req-dc431093-2086-4932-ad58-757d30dc5475 service nova] Lock "d51eb56c-bce2-4593-abc3-878c358c9a74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:31:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-2a844392-e236-4f7b-9903-5ab6e4ca93d3 req-dc431093-2086-4932-ad58-757d30dc5475 service nova] Lock "d51eb56c-bce2-4593-abc3-878c358c9a74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:31:40 user nova-compute[72586]: DEBUG nova.compute.manager [req-2a844392-e236-4f7b-9903-5ab6e4ca93d3 req-dc431093-2086-4932-ad58-757d30dc5475 service nova] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] No waiting events found dispatching network-vif-plugged-0cdd112b-f316-4cf2-b3e5-82897e241453 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:31:40 user nova-compute[72586]: WARNING nova.compute.manager [req-2a844392-e236-4f7b-9903-5ab6e4ca93d3 req-dc431093-2086-4932-ad58-757d30dc5475 service nova] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Received unexpected event network-vif-plugged-0cdd112b-f316-4cf2-b3e5-82897e241453 for instance with vm_state deleted and task_state None.
Aug 01 21:31:40 user nova-compute[72586]: DEBUG nova.compute.manager [req-2a844392-e236-4f7b-9903-5ab6e4ca93d3 req-dc431093-2086-4932-ad58-757d30dc5475 service nova] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Received event network-vif-deleted-0cdd112b-f316-4cf2-b3e5-82897e241453 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:31:42 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:42 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:44 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:44 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:48 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Acquiring lock "0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:31:48 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:31:48 user nova-compute[72586]: DEBUG nova.compute.manager [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Starting instance... {{(pid=72586) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 21:31:48 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:31:48 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:31:48 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72586) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 21:31:48 user nova-compute[72586]: INFO nova.compute.claims [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Claim successful on node user
Aug 01 21:31:48 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:31:48 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:31:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.488s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:31:49 user nova-compute[72586]: DEBUG nova.compute.manager [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Start building networks asynchronously for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 21:31:49 user nova-compute[72586]: DEBUG nova.compute.manager [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Allocating IP information in the background. {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 21:31:49 user nova-compute[72586]: DEBUG nova.network.neutron [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] allocate_for_instance() {{(pid=72586) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 21:31:49 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 21:31:49 user nova-compute[72586]: DEBUG nova.compute.manager [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Start building block device mappings for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 21:31:49 user nova-compute[72586]: DEBUG nova.policy [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fed345b7cf8f44bfa83d45d408a18c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ae5f1c56b348de8a03f1a4bcdd9b5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72586) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 21:31:49 user nova-compute[72586]: DEBUG nova.compute.manager [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Start spawning the instance on the hypervisor. {{(pid=72586) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 21:31:49 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Creating instance directory {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 21:31:49 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Creating image(s)
Aug 01 21:31:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Acquiring lock "/opt/stack/data/nova/instances/0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:31:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "/opt/stack/data/nova/instances/0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:31:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "/opt/stack/data/nova/instances/0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:31:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Acquiring lock "b4c15f4ad18a8fa36f6467fbeacb2e64b53dd35c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:31:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "b4c15f4ad18a8fa36f6467fbeacb2e64b53dd35c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:31:49 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b4c15f4ad18a8fa36f6467fbeacb2e64b53dd35c.part --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:31:49 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:49 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b4c15f4ad18a8fa36f6467fbeacb2e64b53dd35c.part --force-share --output=json" returned: 0 in 0.139s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:31:49 user nova-compute[72586]: DEBUG nova.virt.images [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] 7666a25e-0535-48eb-95b3-7909d90f3507 was qcow2, converting to raw {{(pid=72586) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 21:31:49 user nova-compute[72586]: DEBUG nova.privsep.utils [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72586) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 21:31:49 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b4c15f4ad18a8fa36f6467fbeacb2e64b53dd35c.part /opt/stack/data/nova/instances/_base/b4c15f4ad18a8fa36f6467fbeacb2e64b53dd35c.converted {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:31:49 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b4c15f4ad18a8fa36f6467fbeacb2e64b53dd35c.part /opt/stack/data/nova/instances/_base/b4c15f4ad18a8fa36f6467fbeacb2e64b53dd35c.converted" returned: 0 in 0.116s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:31:49 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b4c15f4ad18a8fa36f6467fbeacb2e64b53dd35c.converted --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:31:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b4c15f4ad18a8fa36f6467fbeacb2e64b53dd35c.converted --force-share --output=json" returned: 0 in 0.130s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:31:50 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "b4c15f4ad18a8fa36f6467fbeacb2e64b53dd35c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.780s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:31:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b4c15f4ad18a8fa36f6467fbeacb2e64b53dd35c --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:31:50 user nova-compute[72586]: DEBUG nova.network.neutron [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Successfully created port: 5b244939-e725-4cc8-8407-a7dd0bbc7ec4 {{(pid=72586) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 21:31:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b4c15f4ad18a8fa36f6467fbeacb2e64b53dd35c --force-share --output=json" returned: 0 in 0.137s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:31:50 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Acquiring lock "b4c15f4ad18a8fa36f6467fbeacb2e64b53dd35c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:31:50 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "b4c15f4ad18a8fa36f6467fbeacb2e64b53dd35c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:31:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b4c15f4ad18a8fa36f6467fbeacb2e64b53dd35c --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:31:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b4c15f4ad18a8fa36f6467fbeacb2e64b53dd35c --force-share --output=json" returned: 0 in 0.135s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:31:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b4c15f4ad18a8fa36f6467fbeacb2e64b53dd35c,backing_fmt=raw /opt/stack/data/nova/instances/0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f/disk 1073741824 {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:31:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b4c15f4ad18a8fa36f6467fbeacb2e64b53dd35c,backing_fmt=raw /opt/stack/data/nova/instances/0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f/disk 1073741824" returned: 0 in 0.050s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:31:50 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "b4c15f4ad18a8fa36f6467fbeacb2e64b53dd35c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.192s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:31:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b4c15f4ad18a8fa36f6467fbeacb2e64b53dd35c --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:31:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b4c15f4ad18a8fa36f6467fbeacb2e64b53dd35c --force-share --output=json" returned: 0 in 0.139s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:31:50 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f/disk. size=1073741824 {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 21:31:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:31:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:31:50 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Cannot resize image /opt/stack/data/nova/instances/0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f/disk to a smaller size. {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 21:31:50 user nova-compute[72586]: DEBUG nova.objects.instance [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lazy-loading 'migration_context' on Instance uuid 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:31:50 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Created local disks {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 21:31:50 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Ensure instance console log exists: /opt/stack/data/nova/instances/0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f/console.log {{(pid=72586) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 21:31:50 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:31:50 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:31:50 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:31:50 user nova-compute[72586]: DEBUG nova.network.neutron [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Successfully updated port: 5b244939-e725-4cc8-8407-a7dd0bbc7ec4 {{(pid=72586) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 21:31:50 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Acquiring lock "refresh_cache-0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:31:50 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Acquired lock "refresh_cache-0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:31:50 user nova-compute[72586]: DEBUG nova.network.neutron [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:31:50 user nova-compute[72586]: DEBUG nova.compute.manager [req-4a42a616-6959-4f2f-9e62-90f2b7f2fea2 req-df261303-7094-4045-9217-4a77f9943b5e service nova] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Received event network-changed-5b244939-e725-4cc8-8407-a7dd0bbc7ec4 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:31:50 user nova-compute[72586]: DEBUG nova.compute.manager [req-4a42a616-6959-4f2f-9e62-90f2b7f2fea2 req-df261303-7094-4045-9217-4a77f9943b5e service nova] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Refreshing instance network info cache due to event network-changed-5b244939-e725-4cc8-8407-a7dd0bbc7ec4. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:31:50 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-4a42a616-6959-4f2f-9e62-90f2b7f2fea2 req-df261303-7094-4045-9217-4a77f9943b5e service nova] Acquiring lock "refresh_cache-0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:31:50 user nova-compute[72586]: DEBUG nova.network.neutron [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Instance cache missing network info. {{(pid=72586) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 21:31:51 user nova-compute[72586]: DEBUG nova.network.neutron [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Updating instance_info_cache with network_info: [{"id": "5b244939-e725-4cc8-8407-a7dd0bbc7ec4", "address": "fa:16:3e:cc:46:65", "network": {"id": "56c3419f-2c2c-4dda-88d7-ba96e2a689fd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-705071098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ae5f1c56b348de8a03f1a4bcdd9b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b244939-e7", "ovs_interfaceid": "5b244939-e725-4cc8-8407-a7dd0bbc7ec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:31:51 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Releasing lock "refresh_cache-0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:31:51 user nova-compute[72586]: DEBUG nova.compute.manager [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Instance network_info: |[{"id": "5b244939-e725-4cc8-8407-a7dd0bbc7ec4", "address": "fa:16:3e:cc:46:65", "network": {"id": "56c3419f-2c2c-4dda-88d7-ba96e2a689fd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-705071098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ae5f1c56b348de8a03f1a4bcdd9b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b244939-e7", "ovs_interfaceid": "5b244939-e725-4cc8-8407-a7dd0bbc7ec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 21:31:51 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-4a42a616-6959-4f2f-9e62-90f2b7f2fea2 req-df261303-7094-4045-9217-4a77f9943b5e service nova] Acquired lock "refresh_cache-0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:31:51 user nova-compute[72586]: DEBUG nova.network.neutron [req-4a42a616-6959-4f2f-9e62-90f2b7f2fea2 req-df261303-7094-4045-9217-4a77f9943b5e service nova] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Refreshing network info cache for port 5b244939-e725-4cc8-8407-a7dd0bbc7ec4 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:31:51 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Start _get_guest_xml network_info=[{"id": "5b244939-e725-4cc8-8407-a7dd0bbc7ec4", "address": "fa:16:3e:cc:46:65", "network": {"id": "56c3419f-2c2c-4dda-88d7-ba96e2a689fd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-705071098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ae5f1c56b348de8a03f1a4bcdd9b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b244939-e7", "ovs_interfaceid": "5b244939-e725-4cc8-8407-a7dd0bbc7ec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:31:46Z,direct_url=<?>,disk_format='qcow2',id=7666a25e-0535-48eb-95b3-7909d90f3507,min_disk=0,min_ram=0,name='tempest-scenario-img--670607852',owner='f7ae5f1c56b348de8a03f1a4bcdd9b5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:31:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '7666a25e-0535-48eb-95b3-7909d90f3507'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:31:51 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:31:51 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:31:51 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:31:51 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:31:51 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:31:51 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:31:51 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:31:51 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:31:46Z,direct_url=<?>,disk_format='qcow2',id=7666a25e-0535-48eb-95b3-7909d90f3507,min_disk=0,min_ram=0,name='tempest-scenario-img--670607852',owner='f7ae5f1c56b348de8a03f1a4bcdd9b5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:31:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:31:51 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:31:51 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:31:51 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:31:51 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:31:51 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:31:51 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:31:51 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:31:51 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:31:51 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:31:51 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:31:51 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:31:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-486932535',display_name='tempest-TestMinimumBasicScenario-server-486932535',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-486932535',id=28,image_ref='7666a25e-0535-48eb-95b3-7909d90f3507',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLujS2qMrbfTLmfjrvCC34ccfhBDvh7Itzo7X58DZeJvTyAF9F25vXUHTGj+pY1BDjgMf45Ki5YpDsHtKHkbdasD+FbKu3GDFuEEYGHTNp7IfnciNn/M3BAitR1uYoYOOA==',key_name='tempest-TestMinimumBasicScenario-2086993178',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7ae5f1c56b348de8a03f1a4bcdd9b5c',ramdisk_id='',reservation_id='r-m440bki2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7666a25e-0535-48eb-95b3-7909d90f3507',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1119751084',owner_user_name='tempest-TestMinimumBasicScenario-1119751084-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:31:49Z,user_data=None,user_id='fed345b7cf8f44bfa83d45d408a18c4a',uuid=0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b244939-e725-4cc8-8407-a7dd0bbc7ec4", "address": "fa:16:3e:cc:46:65", "network": {"id": "56c3419f-2c2c-4dda-88d7-ba96e2a689fd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-705071098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ae5f1c56b348de8a03f1a4bcdd9b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b244939-e7", "ovs_interfaceid": "5b244939-e725-4cc8-8407-a7dd0bbc7ec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:31:51 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Converting VIF {"id": "5b244939-e725-4cc8-8407-a7dd0bbc7ec4", "address": "fa:16:3e:cc:46:65", "network": {"id": "56c3419f-2c2c-4dda-88d7-ba96e2a689fd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-705071098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ae5f1c56b348de8a03f1a4bcdd9b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b244939-e7", "ovs_interfaceid": "5b244939-e725-4cc8-8407-a7dd0bbc7ec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:31:51 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:46:65,bridge_name='br-int',has_traffic_filtering=True,id=5b244939-e725-4cc8-8407-a7dd0bbc7ec4,network=Network(56c3419f-2c2c-4dda-88d7-ba96e2a689fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b244939-e7') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:31:51 user nova-compute[72586]: DEBUG nova.objects.instance [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lazy-loading 'pci_devices' on Instance uuid 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:31:51 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:31:51 user nova-compute[72586]:   <uuid>0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f</uuid>
Aug 01 21:31:51 user nova-compute[72586]:   <name>instance-0000001c</name>
Aug 01 21:31:51 user nova-compute[72586]:   <memory>524288</memory>
Aug 01 21:31:51 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:31:51 user nova-compute[72586]:   <metadata>
Aug 01 21:31:51 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:31:51 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:31:51 user nova-compute[72586]:       <nova:name>tempest-TestMinimumBasicScenario-server-486932535</nova:name>
Aug 01 21:31:51 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:31:51</nova:creationTime>
Aug 01 21:31:51 user nova-compute[72586]:       <nova:flavor name="m1.tiny">
Aug 01 21:31:51 user nova-compute[72586]:         <nova:memory>512</nova:memory>
Aug 01 21:31:51 user nova-compute[72586]:         <nova:disk>1</nova:disk>
Aug 01 21:31:51 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:31:51 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:31:51 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:31:51 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:31:51 user nova-compute[72586]:       <nova:owner>
Aug 01 21:31:51 user nova-compute[72586]:         <nova:user uuid="fed345b7cf8f44bfa83d45d408a18c4a">tempest-TestMinimumBasicScenario-1119751084-project-member</nova:user>
Aug 01 21:31:51 user nova-compute[72586]:         <nova:project uuid="f7ae5f1c56b348de8a03f1a4bcdd9b5c">tempest-TestMinimumBasicScenario-1119751084</nova:project>
Aug 01 21:31:51 user nova-compute[72586]:       </nova:owner>
Aug 01 21:31:51 user nova-compute[72586]:       <nova:root type="image" uuid="7666a25e-0535-48eb-95b3-7909d90f3507"/>
Aug 01 21:31:51 user nova-compute[72586]:       <nova:ports>
Aug 01 21:31:51 user nova-compute[72586]:         <nova:port uuid="5b244939-e725-4cc8-8407-a7dd0bbc7ec4">
Aug 01 21:31:51 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 01 21:31:51 user nova-compute[72586]:         </nova:port>
Aug 01 21:31:51 user nova-compute[72586]:       </nova:ports>
Aug 01 21:31:51 user nova-compute[72586]:     </nova:instance>
Aug 01 21:31:51 user nova-compute[72586]:   </metadata>
Aug 01 21:31:51 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:31:51 user nova-compute[72586]:     <system>
Aug 01 21:31:51 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:31:51 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:31:51 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:31:51 user nova-compute[72586]:       <entry name="serial">0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f</entry>
Aug 01 21:31:51 user nova-compute[72586]:       <entry name="uuid">0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f</entry>
Aug 01 21:31:51 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:31:51 user nova-compute[72586]:     </system>
Aug 01 21:31:51 user nova-compute[72586]:   </sysinfo>
Aug 01 21:31:51 user nova-compute[72586]:   <os>
Aug 01 21:31:51 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:31:51 user nova-compute[72586]:     <boot dev="hd"/>
Aug 01 21:31:51 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:31:51 user nova-compute[72586]:   </os>
Aug 01 21:31:51 user nova-compute[72586]:   <features>
Aug 01 21:31:51 user nova-compute[72586]:     <acpi/>
Aug 01 21:31:51 user nova-compute[72586]:     <apic/>
Aug 01 21:31:51 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:31:51 user nova-compute[72586]:   </features>
Aug 01 21:31:51 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:31:51 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:31:51 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:31:51 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:31:51 user nova-compute[72586]:   </clock>
Aug 01 21:31:51 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:31:51 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:31:51 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:31:51 user nova-compute[72586]:   </cpu>
Aug 01 21:31:51 user nova-compute[72586]:   <devices>
Aug 01 21:31:51 user nova-compute[72586]:     <disk type="file" device="disk">
Aug 01 21:31:51 user nova-compute[72586]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 21:31:51 user nova-compute[72586]:       <source file="/opt/stack/data/nova/instances/0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f/disk"/>
Aug 01 21:31:51 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:31:51 user nova-compute[72586]:     </disk>
Aug 01 21:31:51 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:31:51 user nova-compute[72586]:       <mac address="fa:16:3e:cc:46:65"/>
Aug 01 21:31:51 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:31:51 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:31:51 user nova-compute[72586]:       <target dev="tap5b244939-e7"/>
Aug 01 21:31:51 user nova-compute[72586]:     </interface>
Aug 01 21:31:51 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:31:51 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f/console.log" append="off"/>
Aug 01 21:31:51 user nova-compute[72586]:     </serial>
Aug 01 21:31:51 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:31:51 user nova-compute[72586]:     <video>
Aug 01 21:31:51 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:31:51 user nova-compute[72586]:     </video>
Aug 01 21:31:51 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:31:51 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:31:51 user nova-compute[72586]:     </rng>
Aug 01 21:31:51 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:31:51 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:31:51 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:31:51 user nova-compute[72586]:     </memballoon>
Aug 01 21:31:51 user nova-compute[72586]:   </devices>
Aug 01 21:31:51 user nova-compute[72586]: </domain>
Aug 01 21:31:51 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:31:51 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:31:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-486932535',display_name='tempest-TestMinimumBasicScenario-server-486932535',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-486932535',id=28,image_ref='7666a25e-0535-48eb-95b3-7909d90f3507',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLujS2qMrbfTLmfjrvCC34ccfhBDvh7Itzo7X58DZeJvTyAF9F25vXUHTGj+pY1BDjgMf45Ki5YpDsHtKHkbdasD+FbKu3GDFuEEYGHTNp7IfnciNn/M3BAitR1uYoYOOA==',key_name='tempest-TestMinimumBasicScenario-2086993178',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7ae5f1c56b348de8a03f1a4bcdd9b5c',ramdisk_id='',reservation_id='r-m440bki2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7666a25e-0535-48eb-95b3-7909d90f3507',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1119751084',owner_user_name='tempest-TestMinimumBasicScenario-1119751084-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:31:49Z,user_data=None,user_id='fed345b7cf8f44bfa83d45d408a18c4a',uuid=0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b244939-e725-4cc8-8407-a7dd0bbc7ec4", "address": "fa:16:3e:cc:46:65", "network": {"id": "56c3419f-2c2c-4dda-88d7-ba96e2a689fd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-705071098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ae5f1c56b348de8a03f1a4bcdd9b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b244939-e7", "ovs_interfaceid": "5b244939-e725-4cc8-8407-a7dd0bbc7ec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:31:51 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Converting VIF {"id": "5b244939-e725-4cc8-8407-a7dd0bbc7ec4", "address": "fa:16:3e:cc:46:65", "network": {"id": "56c3419f-2c2c-4dda-88d7-ba96e2a689fd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-705071098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ae5f1c56b348de8a03f1a4bcdd9b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b244939-e7", "ovs_interfaceid": "5b244939-e725-4cc8-8407-a7dd0bbc7ec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:31:51 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:46:65,bridge_name='br-int',has_traffic_filtering=True,id=5b244939-e725-4cc8-8407-a7dd0bbc7ec4,network=Network(56c3419f-2c2c-4dda-88d7-ba96e2a689fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b244939-e7') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:31:51 user nova-compute[72586]: DEBUG os_vif [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:46:65,bridge_name='br-int',has_traffic_filtering=True,id=5b244939-e725-4cc8-8407-a7dd0bbc7ec4,network=Network(56c3419f-2c2c-4dda-88d7-ba96e2a689fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b244939-e7') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:31:51 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:51 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:31:51 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:31:51 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:51 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b244939-e7, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:31:51 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5b244939-e7, col_values=(('external_ids', {'iface-id': '5b244939-e725-4cc8-8407-a7dd0bbc7ec4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:46:65', 'vm-uuid': '0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:31:51 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:51 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:31:51 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:51 user nova-compute[72586]: INFO os_vif [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:46:65,bridge_name='br-int',has_traffic_filtering=True,id=5b244939-e725-4cc8-8407-a7dd0bbc7ec4,network=Network(56c3419f-2c2c-4dda-88d7-ba96e2a689fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b244939-e7')
Aug 01 21:31:51 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:31:51 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] No VIF found with MAC fa:16:3e:cc:46:65, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:31:51 user nova-compute[72586]: DEBUG nova.network.neutron [req-4a42a616-6959-4f2f-9e62-90f2b7f2fea2 req-df261303-7094-4045-9217-4a77f9943b5e service nova] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Updated VIF entry in instance network info cache for port 5b244939-e725-4cc8-8407-a7dd0bbc7ec4. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:31:51 user nova-compute[72586]: DEBUG nova.network.neutron [req-4a42a616-6959-4f2f-9e62-90f2b7f2fea2 req-df261303-7094-4045-9217-4a77f9943b5e service nova] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Updating instance_info_cache with network_info: [{"id": "5b244939-e725-4cc8-8407-a7dd0bbc7ec4", "address": "fa:16:3e:cc:46:65", "network": {"id": "56c3419f-2c2c-4dda-88d7-ba96e2a689fd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-705071098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ae5f1c56b348de8a03f1a4bcdd9b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b244939-e7", "ovs_interfaceid": "5b244939-e725-4cc8-8407-a7dd0bbc7ec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:31:51 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-4a42a616-6959-4f2f-9e62-90f2b7f2fea2 req-df261303-7094-4045-9217-4a77f9943b5e service nova] Releasing lock "refresh_cache-0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:31:51 user nova-compute[72586]: INFO nova.compute.manager [None req-739c6581-51d9-4f49-aba2-d6f4f5d87981 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Unrescuing
Aug 01 21:31:51 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-739c6581-51d9-4f49-aba2-d6f4f5d87981 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Acquiring lock "refresh_cache-f6b0d907-2515-4a06-8b35-9ddd09ce42c3" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:31:51 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-739c6581-51d9-4f49-aba2-d6f4f5d87981 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Acquired lock "refresh_cache-f6b0d907-2515-4a06-8b35-9ddd09ce42c3" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:31:51 user nova-compute[72586]: DEBUG nova.network.neutron [None req-739c6581-51d9-4f49-aba2-d6f4f5d87981 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:31:52 user nova-compute[72586]: DEBUG nova.network.neutron [None req-739c6581-51d9-4f49-aba2-d6f4f5d87981 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Updating instance_info_cache with network_info: [{"id": "440ca7d3-e2b8-4edf-9339-bd8d247d5da2", "address": "fa:16:3e:29:ff:63", "network": {"id": "d229a8de-7a2b-4dcd-a9ac-44a40349676e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-67691992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b1a1d82f39347119a9fb49fb8e8893f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap440ca7d3-e2", "ovs_interfaceid": "440ca7d3-e2b8-4edf-9339-bd8d247d5da2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:31:52 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-739c6581-51d9-4f49-aba2-d6f4f5d87981 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Releasing lock "refresh_cache-f6b0d907-2515-4a06-8b35-9ddd09ce42c3" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:31:52 user nova-compute[72586]: DEBUG nova.objects.instance [None req-739c6581-51d9-4f49-aba2-d6f4f5d87981 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lazy-loading 'flavor' on Instance uuid f6b0d907-2515-4a06-8b35-9ddd09ce42c3 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:31:52 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:52 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:52 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:52 user nova-compute[72586]: DEBUG nova.compute.manager [req-337f462f-f2e5-4c20-b59a-c27d792d9451 req-cdeedcba-4efc-4c83-bf72-b708cb748867 service nova] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Received event network-vif-unplugged-440ca7d3-e2b8-4edf-9339-bd8d247d5da2 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:31:52 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-337f462f-f2e5-4c20-b59a-c27d792d9451 req-cdeedcba-4efc-4c83-bf72-b708cb748867 service nova] Acquiring lock "f6b0d907-2515-4a06-8b35-9ddd09ce42c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:31:52 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-337f462f-f2e5-4c20-b59a-c27d792d9451 req-cdeedcba-4efc-4c83-bf72-b708cb748867 service nova] Lock "f6b0d907-2515-4a06-8b35-9ddd09ce42c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:31:52 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-337f462f-f2e5-4c20-b59a-c27d792d9451 req-cdeedcba-4efc-4c83-bf72-b708cb748867 service nova] Lock "f6b0d907-2515-4a06-8b35-9ddd09ce42c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:31:52 user nova-compute[72586]: DEBUG nova.compute.manager [req-337f462f-f2e5-4c20-b59a-c27d792d9451 req-cdeedcba-4efc-4c83-bf72-b708cb748867 service nova] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] No waiting events found dispatching network-vif-unplugged-440ca7d3-e2b8-4edf-9339-bd8d247d5da2 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:31:52 user nova-compute[72586]: WARNING nova.compute.manager [req-337f462f-f2e5-4c20-b59a-c27d792d9451 req-cdeedcba-4efc-4c83-bf72-b708cb748867 service nova] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Received unexpected event network-vif-unplugged-440ca7d3-e2b8-4edf-9339-bd8d247d5da2 for instance with vm_state rescued and task_state unrescuing.
Aug 01 21:31:52 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:52 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:52 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:52 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:52 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:52 user nova-compute[72586]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690925497.832549, d51eb56c-bce2-4593-abc3-878c358c9a74 => Stopped> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:31:52 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] VM Stopped (Lifecycle Event)
Aug 01 21:31:52 user nova-compute[72586]: DEBUG nova.compute.manager [None req-07554420-6d80-49e6-9ab3-3fcc4c140c73 None None] [instance: d51eb56c-bce2-4593-abc3-878c358c9a74] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:31:52 user nova-compute[72586]: DEBUG nova.compute.manager [req-fb480b2f-d956-4afe-a37b-548730d2de11 req-12eb7c00-a9e9-4910-b030-e1cfcdba2ebf service nova] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Received event network-vif-plugged-5b244939-e725-4cc8-8407-a7dd0bbc7ec4 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:31:52 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-fb480b2f-d956-4afe-a37b-548730d2de11 req-12eb7c00-a9e9-4910-b030-e1cfcdba2ebf service nova] Acquiring lock "0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:31:52 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-fb480b2f-d956-4afe-a37b-548730d2de11 req-12eb7c00-a9e9-4910-b030-e1cfcdba2ebf service nova] Lock "0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:31:52 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-fb480b2f-d956-4afe-a37b-548730d2de11 req-12eb7c00-a9e9-4910-b030-e1cfcdba2ebf service nova] Lock "0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:31:52 user nova-compute[72586]: DEBUG nova.compute.manager [req-fb480b2f-d956-4afe-a37b-548730d2de11 req-12eb7c00-a9e9-4910-b030-e1cfcdba2ebf service nova] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] No waiting events found dispatching network-vif-plugged-5b244939-e725-4cc8-8407-a7dd0bbc7ec4 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:31:52 user nova-compute[72586]: WARNING nova.compute.manager [req-fb480b2f-d956-4afe-a37b-548730d2de11 req-12eb7c00-a9e9-4910-b030-e1cfcdba2ebf service nova] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Received unexpected event network-vif-plugged-5b244939-e725-4cc8-8407-a7dd0bbc7ec4 for instance with vm_state building and task_state spawning.
Aug 01 21:31:53 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:53 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:53 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:53 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Instance destroyed successfully.
Aug 01 21:31:53 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:53 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:54 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:54 user nova-compute[72586]: DEBUG nova.compute.manager [req-14051e79-4fff-4ad1-a3a7-7547cbf801f5 req-97f13d0b-25c2-4715-b8c8-d6312cb25970 service nova] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Received event network-vif-plugged-440ca7d3-e2b8-4edf-9339-bd8d247d5da2 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:31:54 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-14051e79-4fff-4ad1-a3a7-7547cbf801f5 req-97f13d0b-25c2-4715-b8c8-d6312cb25970 service nova] Acquiring lock "f6b0d907-2515-4a06-8b35-9ddd09ce42c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:31:54 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-14051e79-4fff-4ad1-a3a7-7547cbf801f5 req-97f13d0b-25c2-4715-b8c8-d6312cb25970 service nova] Lock "f6b0d907-2515-4a06-8b35-9ddd09ce42c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:31:54 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-14051e79-4fff-4ad1-a3a7-7547cbf801f5 req-97f13d0b-25c2-4715-b8c8-d6312cb25970 service nova] Lock "f6b0d907-2515-4a06-8b35-9ddd09ce42c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:31:54 user nova-compute[72586]: DEBUG nova.compute.manager [req-14051e79-4fff-4ad1-a3a7-7547cbf801f5 req-97f13d0b-25c2-4715-b8c8-d6312cb25970 service nova] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] No waiting events found dispatching network-vif-plugged-440ca7d3-e2b8-4edf-9339-bd8d247d5da2 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:31:54 user nova-compute[72586]: WARNING nova.compute.manager [req-14051e79-4fff-4ad1-a3a7-7547cbf801f5 req-97f13d0b-25c2-4715-b8c8-d6312cb25970 service nova] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Received unexpected event network-vif-plugged-440ca7d3-e2b8-4edf-9339-bd8d247d5da2 for instance with vm_state rescued and task_state unrescuing.
Aug 01 21:31:54 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:54 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:54 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:54 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:54 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:54 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:54 user nova-compute[72586]: DEBUG nova.compute.manager [req-88a59588-cce6-42db-a840-80031d5af370 req-b43d7dc2-7620-42fe-8581-44707bfbc71f service nova] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Received event network-vif-plugged-5b244939-e725-4cc8-8407-a7dd0bbc7ec4 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:31:54 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-88a59588-cce6-42db-a840-80031d5af370 req-b43d7dc2-7620-42fe-8581-44707bfbc71f service nova] Acquiring lock "0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:31:54 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-88a59588-cce6-42db-a840-80031d5af370 req-b43d7dc2-7620-42fe-8581-44707bfbc71f service nova] Lock "0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:31:54 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-88a59588-cce6-42db-a840-80031d5af370 req-b43d7dc2-7620-42fe-8581-44707bfbc71f service nova] Lock "0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:31:54 user nova-compute[72586]: DEBUG nova.compute.manager [req-88a59588-cce6-42db-a840-80031d5af370 req-b43d7dc2-7620-42fe-8581-44707bfbc71f service nova] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] No waiting events found dispatching network-vif-plugged-5b244939-e725-4cc8-8407-a7dd0bbc7ec4 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:31:54 user nova-compute[72586]: WARNING nova.compute.manager [req-88a59588-cce6-42db-a840-80031d5af370 req-b43d7dc2-7620-42fe-8581-44707bfbc71f service nova] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Received unexpected event network-vif-plugged-5b244939-e725-4cc8-8407-a7dd0bbc7ec4 for instance with vm_state building and task_state spawning.
Aug 01 21:31:55 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925515.1450083, 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:31:55 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] VM Resumed (Lifecycle Event)
Aug 01 21:31:55 user nova-compute[72586]: DEBUG nova.compute.manager [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Instance event wait completed in 0 seconds for  {{(pid=72586) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 21:31:55 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Guest created on hypervisor {{(pid=72586) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 21:31:55 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Instance spawned successfully.
Aug 01 21:31:55 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 21:31:55 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:31:55 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:31:55 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Found default for hw_cdrom_bus of ide {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:31:55 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Found default for hw_disk_bus of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:31:55 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Found default for hw_input_bus of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:31:55 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Found default for hw_pointer_model of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:31:55 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Found default for hw_video_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:31:55 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Found default for hw_vif_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:31:55 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:31:55 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925515.1461952, 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:31:55 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] VM Started (Lifecycle Event)
Aug 01 21:31:55 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:31:55 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:31:55 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:31:55 user nova-compute[72586]: INFO nova.compute.manager [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Took 6.04 seconds to spawn the instance on the hypervisor.
Aug 01 21:31:55 user nova-compute[72586]: DEBUG nova.compute.manager [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:31:55 user nova-compute[72586]: INFO nova.compute.manager [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Took 6.82 seconds to build instance.
Aug 01 21:31:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1deaaab7-e990-4e60-bf4b-c7362b982fa3 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.914s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:31:56 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:56 user nova-compute[72586]: DEBUG nova.compute.manager [req-4da6f368-8d6a-4a69-956e-50c704260c97 req-02d778c6-d9db-4241-aae2-4a5b6e5be08e service nova] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Received event network-vif-plugged-440ca7d3-e2b8-4edf-9339-bd8d247d5da2 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:31:56 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-4da6f368-8d6a-4a69-956e-50c704260c97 req-02d778c6-d9db-4241-aae2-4a5b6e5be08e service nova] Acquiring lock "f6b0d907-2515-4a06-8b35-9ddd09ce42c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:31:56 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-4da6f368-8d6a-4a69-956e-50c704260c97 req-02d778c6-d9db-4241-aae2-4a5b6e5be08e service nova] Lock "f6b0d907-2515-4a06-8b35-9ddd09ce42c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:31:56 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-4da6f368-8d6a-4a69-956e-50c704260c97 req-02d778c6-d9db-4241-aae2-4a5b6e5be08e service nova] Lock "f6b0d907-2515-4a06-8b35-9ddd09ce42c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:31:56 user nova-compute[72586]: DEBUG nova.compute.manager [req-4da6f368-8d6a-4a69-956e-50c704260c97 req-02d778c6-d9db-4241-aae2-4a5b6e5be08e service nova] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] No waiting events found dispatching network-vif-plugged-440ca7d3-e2b8-4edf-9339-bd8d247d5da2 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:31:56 user nova-compute[72586]: WARNING nova.compute.manager [req-4da6f368-8d6a-4a69-956e-50c704260c97 req-02d778c6-d9db-4241-aae2-4a5b6e5be08e service nova] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Received unexpected event network-vif-plugged-440ca7d3-e2b8-4edf-9339-bd8d247d5da2 for instance with vm_state rescued and task_state unrescuing.
Aug 01 21:31:56 user nova-compute[72586]: DEBUG nova.compute.manager [req-4da6f368-8d6a-4a69-956e-50c704260c97 req-02d778c6-d9db-4241-aae2-4a5b6e5be08e service nova] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Received event network-vif-plugged-440ca7d3-e2b8-4edf-9339-bd8d247d5da2 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:31:56 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-4da6f368-8d6a-4a69-956e-50c704260c97 req-02d778c6-d9db-4241-aae2-4a5b6e5be08e service nova] Acquiring lock "f6b0d907-2515-4a06-8b35-9ddd09ce42c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:31:56 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-4da6f368-8d6a-4a69-956e-50c704260c97 req-02d778c6-d9db-4241-aae2-4a5b6e5be08e service nova] Lock "f6b0d907-2515-4a06-8b35-9ddd09ce42c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:31:56 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-4da6f368-8d6a-4a69-956e-50c704260c97 req-02d778c6-d9db-4241-aae2-4a5b6e5be08e service nova] Lock "f6b0d907-2515-4a06-8b35-9ddd09ce42c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:31:56 user nova-compute[72586]: DEBUG nova.compute.manager [req-4da6f368-8d6a-4a69-956e-50c704260c97 req-02d778c6-d9db-4241-aae2-4a5b6e5be08e service nova] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] No waiting events found dispatching network-vif-plugged-440ca7d3-e2b8-4edf-9339-bd8d247d5da2 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:31:56 user nova-compute[72586]: WARNING nova.compute.manager [req-4da6f368-8d6a-4a69-956e-50c704260c97 req-02d778c6-d9db-4241-aae2-4a5b6e5be08e service nova] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Received unexpected event network-vif-plugged-440ca7d3-e2b8-4edf-9339-bd8d247d5da2 for instance with vm_state rescued and task_state unrescuing.
Aug 01 21:31:56 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Removed pending event for f6b0d907-2515-4a06-8b35-9ddd09ce42c3 due to event {{(pid=72586) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 21:31:56 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925516.8758817, f6b0d907-2515-4a06-8b35-9ddd09ce42c3 => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:31:56 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] VM Resumed (Lifecycle Event)
Aug 01 21:31:56 user nova-compute[72586]: DEBUG nova.compute.manager [None req-739c6581-51d9-4f49-aba2-d6f4f5d87981 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:31:56 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:31:56 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:31:56 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 01 21:31:56 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925516.879938, f6b0d907-2515-4a06-8b35-9ddd09ce42c3 => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:31:56 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] VM Started (Lifecycle Event)
Aug 01 21:31:56 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:31:56 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:31:57 user nova-compute[72586]: INFO nova.compute.manager [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Rescuing
Aug 01 21:31:57 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Acquiring lock "refresh_cache-161fab9d-a7d1-4ea0-b4b9-2afc54040eef" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:31:57 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Acquired lock "refresh_cache-161fab9d-a7d1-4ea0-b4b9-2afc54040eef" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:31:57 user nova-compute[72586]: DEBUG nova.network.neutron [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:31:58 user nova-compute[72586]: DEBUG nova.network.neutron [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Updating instance_info_cache with network_info: [{"id": "c082b11d-fb01-4def-98b8-6b2966ce364c", "address": "fa:16:3e:b6:24:7c", "network": {"id": "86940e5d-852b-48fc-9b0e-858305321349", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1967467603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d847d04360420c80ea5608d5a2b15a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc082b11d-fb", "ovs_interfaceid": "c082b11d-fb01-4def-98b8-6b2966ce364c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:31:58 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Releasing lock "refresh_cache-161fab9d-a7d1-4ea0-b4b9-2afc54040eef" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:31:58 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:58 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:58 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:58 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:31:58 user nova-compute[72586]: DEBUG nova.compute.manager [req-45d9c93b-a0d7-4d3b-a24d-a506e6d2ff90 req-d6ab847f-d4a7-49d6-a69f-9463814f6e79 service nova] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Received event network-vif-unplugged-c082b11d-fb01-4def-98b8-6b2966ce364c {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:31:58 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-45d9c93b-a0d7-4d3b-a24d-a506e6d2ff90 req-d6ab847f-d4a7-49d6-a69f-9463814f6e79 service nova] Acquiring lock "161fab9d-a7d1-4ea0-b4b9-2afc54040eef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:31:58 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-45d9c93b-a0d7-4d3b-a24d-a506e6d2ff90 req-d6ab847f-d4a7-49d6-a69f-9463814f6e79 service nova] Lock "161fab9d-a7d1-4ea0-b4b9-2afc54040eef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:31:58 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-45d9c93b-a0d7-4d3b-a24d-a506e6d2ff90 req-d6ab847f-d4a7-49d6-a69f-9463814f6e79 service nova] Lock "161fab9d-a7d1-4ea0-b4b9-2afc54040eef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:31:58 user nova-compute[72586]: DEBUG nova.compute.manager [req-45d9c93b-a0d7-4d3b-a24d-a506e6d2ff90 req-d6ab847f-d4a7-49d6-a69f-9463814f6e79 service nova] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] No waiting events found dispatching network-vif-unplugged-c082b11d-fb01-4def-98b8-6b2966ce364c {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:31:58 user nova-compute[72586]: WARNING nova.compute.manager [req-45d9c93b-a0d7-4d3b-a24d-a506e6d2ff90 req-d6ab847f-d4a7-49d6-a69f-9463814f6e79 service nova] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Received unexpected event network-vif-unplugged-c082b11d-fb01-4def-98b8-6b2966ce364c for instance with vm_state active and task_state rescuing.
Aug 01 21:31:58 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Instance destroyed successfully.
Aug 01 21:31:59 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Attempting a stable device rescue
Aug 01 21:31:59 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72586) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 01 21:31:59 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Instance directory exists: not creating {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 01 21:31:59 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Creating image(s)
Aug 01 21:31:59 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Acquiring lock "/opt/stack/data/nova/instances/161fab9d-a7d1-4ea0-b4b9-2afc54040eef/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:31:59 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "/opt/stack/data/nova/instances/161fab9d-a7d1-4ea0-b4b9-2afc54040eef/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:31:59 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "/opt/stack/data/nova/instances/161fab9d-a7d1-4ea0-b4b9-2afc54040eef/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:31:59 user nova-compute[72586]: DEBUG nova.objects.instance [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lazy-loading 'trusted_certs' on Instance uuid 161fab9d-a7d1-4ea0-b4b9-2afc54040eef {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:31:59 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Acquiring lock "bcc4a6e008b642e8af0e223900f983c2ebd5af9a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:31:59 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "bcc4a6e008b642e8af0e223900f983c2ebd5af9a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:32:00 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bcc4a6e008b642e8af0e223900f983c2ebd5af9a.part --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:00 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:32:00 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bcc4a6e008b642e8af0e223900f983c2ebd5af9a.part --force-share --output=json" returned: 0 in 0.143s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:00 user nova-compute[72586]: DEBUG nova.virt.images [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] 716059a0-2c08-46e0-80be-b2c04664009a was qcow2, converting to raw {{(pid=72586) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 21:32:00 user nova-compute[72586]: DEBUG nova.privsep.utils [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72586) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 21:32:00 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bcc4a6e008b642e8af0e223900f983c2ebd5af9a.part /opt/stack/data/nova/instances/_base/bcc4a6e008b642e8af0e223900f983c2ebd5af9a.converted {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:00 user nova-compute[72586]: DEBUG nova.compute.manager [req-e36af859-81ae-464c-ad4a-677b58bc1b7c req-2e476635-c1d2-418e-9eb3-bf946a706a68 service nova] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Received event network-vif-plugged-c082b11d-fb01-4def-98b8-6b2966ce364c {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:32:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-e36af859-81ae-464c-ad4a-677b58bc1b7c req-2e476635-c1d2-418e-9eb3-bf946a706a68 service nova] Acquiring lock "161fab9d-a7d1-4ea0-b4b9-2afc54040eef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:32:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-e36af859-81ae-464c-ad4a-677b58bc1b7c req-2e476635-c1d2-418e-9eb3-bf946a706a68 service nova] Lock "161fab9d-a7d1-4ea0-b4b9-2afc54040eef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:32:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-e36af859-81ae-464c-ad4a-677b58bc1b7c req-2e476635-c1d2-418e-9eb3-bf946a706a68 service nova] Lock "161fab9d-a7d1-4ea0-b4b9-2afc54040eef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:32:00 user nova-compute[72586]: DEBUG nova.compute.manager [req-e36af859-81ae-464c-ad4a-677b58bc1b7c req-2e476635-c1d2-418e-9eb3-bf946a706a68 service nova] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] No waiting events found dispatching network-vif-plugged-c082b11d-fb01-4def-98b8-6b2966ce364c {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:32:00 user nova-compute[72586]: WARNING nova.compute.manager [req-e36af859-81ae-464c-ad4a-677b58bc1b7c req-2e476635-c1d2-418e-9eb3-bf946a706a68 service nova] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Received unexpected event network-vif-plugged-c082b11d-fb01-4def-98b8-6b2966ce364c for instance with vm_state active and task_state rescuing.
Aug 01 21:32:00 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bcc4a6e008b642e8af0e223900f983c2ebd5af9a.part /opt/stack/data/nova/instances/_base/bcc4a6e008b642e8af0e223900f983c2ebd5af9a.converted" returned: 0 in 0.508s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:00 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bcc4a6e008b642e8af0e223900f983c2ebd5af9a.converted --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bcc4a6e008b642e8af0e223900f983c2ebd5af9a.converted --force-share --output=json" returned: 0 in 0.139s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "bcc4a6e008b642e8af0e223900f983c2ebd5af9a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.039s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Acquiring lock "bcc4a6e008b642e8af0e223900f983c2ebd5af9a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "bcc4a6e008b642e8af0e223900f983c2ebd5af9a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bcc4a6e008b642e8af0e223900f983c2ebd5af9a --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bcc4a6e008b642e8af0e223900f983c2ebd5af9a --force-share --output=json" returned: 0 in 0.137s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bcc4a6e008b642e8af0e223900f983c2ebd5af9a,backing_fmt=raw /opt/stack/data/nova/instances/161fab9d-a7d1-4ea0-b4b9-2afc54040eef/disk.rescue {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bcc4a6e008b642e8af0e223900f983c2ebd5af9a,backing_fmt=raw /opt/stack/data/nova/instances/161fab9d-a7d1-4ea0-b4b9-2afc54040eef/disk.rescue" returned: 0 in 0.049s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "bcc4a6e008b642e8af0e223900f983c2ebd5af9a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.192s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG nova.objects.instance [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lazy-loading 'migration_context' on Instance uuid 161fab9d-a7d1-4ea0-b4b9-2afc54040eef {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Created local disks {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Start _get_guest_xml network_info=[{"id": "c082b11d-fb01-4def-98b8-6b2966ce364c", "address": "fa:16:3e:b6:24:7c", "network": {"id": "86940e5d-852b-48fc-9b0e-858305321349", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1967467603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1967467603-network", "vif_mac": "fa:16:3e:b6:24:7c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d847d04360420c80ea5608d5a2b15a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc082b11d-fb", "ovs_interfaceid": "c082b11d-fb01-4def-98b8-6b2966ce364c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '716059a0-2c08-46e0-80be-b2c04664009a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oqjwfXlR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '161fab9d-a7d1-4ea0-b4b9-2afc54040eef', 'attached_at': '', 'detached_at': '', 'volume_id': '0acebba2-aca8-4728-b4d6-0d836a537e33', 'serial': '0acebba2-aca8-4728-b4d6-0d836a537e33'}, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '7f4b3c7a-799d-4b19-94ae-897b9a6bee2a', 'delete_on_termination': False, 'volume_type': None} {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG nova.objects.instance [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lazy-loading 'resources' on Instance uuid 161fab9d-a7d1-4ea0-b4b9-2afc54040eef {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG nova.objects.instance [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lazy-loading 'numa_topology' on Instance uuid 161fab9d-a7d1-4ea0-b4b9-2afc54040eef {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:32:01 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:32:01 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:32:01 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG nova.objects.instance [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lazy-loading 'vcpu_model' on Instance uuid 161fab9d-a7d1-4ea0-b4b9-2afc54040eef {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Calling os-brick to attach iSCSI Volume {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oqjwfXlR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:32:01 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:32:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:32:01 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:32:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:32:01 user nova-compute[72586]: INFO os_brick.initiator.connectors.iscsi [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 21:32:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 -p 172.16.0.220:3260 {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[06323fe8-058c-4b80-984d-3d31ba3aae74]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = oqjwfXlR\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 01 21:32:01 user nova-compute[72586]: node.name = iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33
Aug 01 21:32:01 user nova-compute[72586]: node.tpgt = -1
Aug 01 21:32:01 user nova-compute[72586]: node.startup = automatic
Aug 01 21:32:01 user nova-compute[72586]: node.leading_login = No
Aug 01 21:32:01 user nova-compute[72586]: iface.iscsi_ifacename = default
Aug 01 21:32:01 user nova-compute[72586]: iface.net_ifacename = <empty>
Aug 01 21:32:01 user nova-compute[72586]: iface.ipaddress = <empty>
Aug 01 21:32:01 user nova-compute[72586]: iface.prefix_len = 0
Aug 01 21:32:01 user nova-compute[72586]: iface.hwaddress = <empty>
Aug 01 21:32:01 user nova-compute[72586]: iface.transport_name = tcp
Aug 01 21:32:01 user nova-compute[72586]: iface.initiatorname = <empty>
Aug 01 21:32:01 user nova-compute[72586]: iface.state = <empty>
Aug 01 21:32:01 user nova-compute[72586]: iface.vlan_id = 0
Aug 01 21:32:01 user nova-compute[72586]: iface.vlan_priority = 0
Aug 01 21:32:01 user nova-compute[72586]: iface.vlan_state = <empty>
Aug 01 21:32:01 user nova-compute[72586]: iface.iface_num = 0
Aug 01 21:32:01 user nova-compute[72586]: iface.mtu = 0
Aug 01 21:32:01 user nova-compute[72586]: iface.port = 0
Aug 01 21:32:01 user nova-compute[72586]: iface.bootproto = <empty>
Aug 01 21:32:01 user nova-compute[72586]: iface.subnet_mask = <empty>
Aug 01 21:32:01 user nova-compute[72586]: iface.gateway = <empty>
Aug 01 21:32:01 user nova-compute[72586]: iface.dhcp_alt_client_id_state = <empty>
Aug 01 21:32:01 user nova-compute[72586]: iface.dhcp_alt_client_id = <empty>
Aug 01 21:32:01 user nova-compute[72586]: iface.dhcp_dns = <empty>
Aug 01 21:32:01 user nova-compute[72586]: iface.dhcp_learn_iqn = <empty>
Aug 01 21:32:01 user nova-compute[72586]: iface.dhcp_req_vendor_id_state = <empty>
Aug 01 21:32:01 user nova-compute[72586]: iface.dhcp_vendor_id_state = <empty>
Aug 01 21:32:01 user nova-compute[72586]: iface.dhcp_vendor_id = <empty>
Aug 01 21:32:01 user nova-compute[72586]: iface.dhcp_slp_da = <empty>
Aug 01 21:32:01 user nova-compute[72586]: iface.fragmentation = <empty>
Aug 01 21:32:01 user nova-compute[72586]: iface.gratuitous_arp = <empty>
Aug 01 21:32:01 user nova-compute[72586]: iface.incoming_forwarding = <empty>
Aug 01 21:32:01 user nova-compute[72586]: iface.tos_state = <empty>
Aug 01 21:32:01 user nova-compute[72586]: iface.tos = 0
Aug 01 21:32:01 user nova-compute[72586]: iface.ttl = 0
Aug 01 21:32:01 user nova-compute[72586]: iface.delayed_ack = <empty>
Aug 01 21:32:01 user nova-compute[72586]: iface.tcp_nagle = <empty>
Aug 01 21:32:01 user nova-compute[72586]: iface.tcp_wsf_state = <empty>
Aug 01 21:32:01 user nova-compute[72586]: iface.tcp_wsf = 0
Aug 01 21:32:01 user nova-compute[72586]: iface.tcp_timer_scale = 0
Aug 01 21:32:01 user nova-compute[72586]: iface.tcp_timestamp = <empty>
Aug 01 21:32:01 user nova-compute[72586]: iface.redirect = <empty>
Aug 01 21:32:01 user nova-compute[72586]: iface.def_task_mgmt_timeout = 0
Aug 01 21:32:01 user nova-compute[72586]: iface.header_digest = <empty>
Aug 01 21:32:01 user nova-compute[72586]: iface.data_digest = <empty>
Aug 01 21:32:01 user nova-compute[72586]: iface.immediate_data = <empty>
Aug 01 21:32:01 user nova-compute[72586]: iface.initial_r2t = <empty>
Aug 01 21:32:01 user nova-compute[72586]: iface.data_seq_inorder = <empty>
Aug 01 21:32:01 user nova-compute[72586]: iface.data_pdu_inorder = <empty>
Aug 01 21:32:01 user nova-compute[72586]: iface.erl = 0
Aug 01 21:32:01 user nova-compute[72586]: iface.max_receive_data_len = 0
Aug 01 21:32:01 user nova-compute[72586]: iface.first_burst_len = 0
Aug 01 21:32:01 user nova-compute[72586]: iface.max_outstanding_r2t = 0
Aug 01 21:32:01 user nova-compute[72586]: iface.max_burst_len = 0
Aug 01 21:32:01 user nova-compute[72586]: iface.chap_auth = <empty>
Aug 01 21:32:01 user nova-compute[72586]: iface.bidi_chap = <empty>
Aug 01 21:32:01 user nova-compute[72586]: iface.strict_login_compliance = <empty>
Aug 01 21:32:01 user nova-compute[72586]: iface.discovery_auth = <empty>
Aug 01 21:32:01 user nova-compute[72586]: iface.discovery_logout = <empty>
Aug 01 21:32:01 user nova-compute[72586]: node.discovery_address = <empty>
Aug 01 21:32:01 user nova-compute[72586]: node.discovery_port = 0
Aug 01 21:32:01 user nova-compute[72586]: node.discovery_type = static
Aug 01 21:32:01 user nova-compute[72586]: node.session.initial_cmdsn = 0
Aug 01 21:32:01 user nova-compute[72586]: node.session.initial_login_retry_max = 8
Aug 01 21:32:01 user nova-compute[72586]: node.session.xmit_thread_priority = -20
Aug 01 21:32:01 user nova-compute[72586]: node.session.cmds_max = 128
Aug 01 21:32:01 user nova-compute[72586]: node.session.queue_depth = 32
Aug 01 21:32:01 user nova-compute[72586]: node.session.nr_sessions = 1
Aug 01 21:32:01 user nova-compute[72586]: node.session.auth.authmethod = CHAP
Aug 01 21:32:01 user nova-compute[72586]: node.session.auth.username = oqjwfXlR
Aug 01 21:32:01 user nova-compute[72586]: node.session.auth.password = ***
Aug 01 21:32:01 user nova-compute[72586]: node.session.auth.username_in = <empty>
Aug 01 21:32:01 user nova-compute[72586]: node.session.auth.password_in = <empty>
Aug 01 21:32:01 user nova-compute[72586]: node.session.auth.chap_algs = MD5
Aug 01 21:32:01 user nova-compute[72586]: node.session.timeo.replacement_timeout = 120
Aug 01 21:32:01 user nova-compute[72586]: node.session.err_timeo.abort_timeout = 15
Aug 01 21:32:01 user nova-compute[72586]: node.session.err_timeo.lu_reset_timeout = 30
Aug 01 21:32:01 user nova-compute[72586]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 01 21:32:01 user nova-compute[72586]: node.session.err_timeo.host_reset_timeout = 60
Aug 01 21:32:01 user nova-compute[72586]: node.session.iscsi.FastAbort = Yes
Aug 01 21:32:01 user nova-compute[72586]: node.session.iscsi.InitialR2T = No
Aug 01 21:32:01 user nova-compute[72586]: node.session.iscsi.ImmediateData = Yes
Aug 01 21:32:01 user nova-compute[72586]: node.session.iscsi.FirstBurstLength = 262144
Aug 01 21:32:01 user nova-compute[72586]: node.session.iscsi.MaxBurstLength = 16776192
Aug 01 21:32:01 user nova-compute[72586]: node.session.iscsi.DefaultTime2Retain = 0
Aug 01 21:32:01 user nova-compute[72586]: node.session.iscsi.DefaultTime2Wait = 2
Aug 01 21:32:01 user nova-compute[72586]: node.session.iscsi.MaxConnections = 1
Aug 01 21:32:01 user nova-compute[72586]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 01 21:32:01 user nova-compute[72586]: node.session.iscsi.ERL = 0
Aug 01 21:32:01 user nova-compute[72586]: node.session.scan = manual
Aug 01 21:32:01 user nova-compute[72586]: node.session.reopen_max = 0
Aug 01 21:32:01 user nova-compute[72586]: node.conn[0].address = 172.16.0.220
Aug 01 21:32:01 user nova-compute[72586]: node.conn[0].port = 3260
Aug 01 21:32:01 user nova-compute[72586]: node.conn[0].startup = manual
Aug 01 21:32:01 user nova-compute[72586]: node.conn[0].tcp.window_size = 524288
Aug 01 21:32:01 user nova-compute[72586]: node.conn[0].tcp.type_of_service = 0
Aug 01 21:32:01 user nova-compute[72586]: node.conn[0].timeo.logout_timeout = 15
Aug 01 21:32:01 user nova-compute[72586]: node.conn[0].timeo.login_timeout = 15
Aug 01 21:32:01 user nova-compute[72586]: node.conn[0].timeo.auth_timeout = 45
Aug 01 21:32:01 user nova-compute[72586]: node.conn[0].timeo.noop_out_interval = 5
Aug 01 21:32:01 user nova-compute[72586]: node.conn[0].timeo.noop_out_timeout = 5
Aug 01 21:32:01 user nova-compute[72586]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 01 21:32:01 user nova-compute[72586]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 01 21:32:01 user nova-compute[72586]: node.conn[0].iscsi.HeaderDigest = None
Aug 01 21:32:01 user nova-compute[72586]: node.conn[0].iscsi.DataDigest = None
Aug 01 21:32:01 user nova-compute[72586]: node.conn[0].iscsi.IFMarker = No
Aug 01 21:32:01 user nova-compute[72586]: node.conn[0].iscsi.OFMarker = No
Aug 01 21:32:01 user nova-compute[72586]: # END RECORD
Aug 01 21:32:01 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1360e959-ddd1-429e-a3fe-d4037208e569]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[05451bab-b74b-4bd8-b8c8-c3ff78b6c8ec]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oqjwfXlR {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oqjwfXlR" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad936731-a1fe-4be7-b03b-6e3cea5986b7]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oqjwfXlR'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f7634df-1d81-4f55-944b-f6a6031c99df]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[22272a57-c6d3-4e64-a3b4-a1d7b254c2f9]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)
Aug 01 21:32:01 user nova-compute[72586]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:32:01 user nova-compute[72586]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:32:01 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)
Aug 01 21:32:01 user nova-compute[72586]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:32:01 user nova-compute[72586]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:32:01 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.141s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Connected to 172.16.0.220:3260 {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] HCTL ('33', '0', '0', 0) found on session 29 with lun 0 {{(pid=72586) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=72586) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.012s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d9134e-5e69-4711-bc4a-af5709a40b0c]: (4, ('0 0 0', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Searching for a device in session 29 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oqjwfXlR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.162s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] <== connect_volume: return (164ms) {'type': 'block', 'scsi_wwn': '26466633335363564', 'path': '/dev/sdb'} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26466633335363564', 'path': '/dev/sdb'} {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:30:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1000542455',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1000542455',id=26,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:30:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88d847d04360420c80ea5608d5a2b15a',ramdisk_id='',reservation_id='r-khodwewo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1268085586',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:30:27Z,user_data=None,user_id='a984642731b9413c97038f65052ab92d',uuid=161fab9d-a7d1-4ea0-b4b9-2afc54040eef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c082b11d-fb01-4def-98b8-6b2966ce364c", "address": "fa:16:3e:b6:24:7c", "network": {"id": "86940e5d-852b-48fc-9b0e-858305321349", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1967467603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1967467603-network", "vif_mac": "fa:16:3e:b6:24:7c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d847d04360420c80ea5608d5a2b15a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc082b11d-fb", "ovs_interfaceid": "c082b11d-fb01-4def-98b8-6b2966ce364c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Converting VIF {"id": "c082b11d-fb01-4def-98b8-6b2966ce364c", "address": "fa:16:3e:b6:24:7c", "network": {"id": "86940e5d-852b-48fc-9b0e-858305321349", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1967467603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1967467603-network", "vif_mac": "fa:16:3e:b6:24:7c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d847d04360420c80ea5608d5a2b15a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc082b11d-fb", "ovs_interfaceid": "c082b11d-fb01-4def-98b8-6b2966ce364c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:24:7c,bridge_name='br-int',has_traffic_filtering=True,id=c082b11d-fb01-4def-98b8-6b2966ce364c,network=Network(86940e5d-852b-48fc-9b0e-858305321349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc082b11d-fb') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG nova.objects.instance [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lazy-loading 'pci_devices' on Instance uuid 161fab9d-a7d1-4ea0-b4b9-2afc54040eef {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:32:01 user nova-compute[72586]:   <uuid>161fab9d-a7d1-4ea0-b4b9-2afc54040eef</uuid>
Aug 01 21:32:01 user nova-compute[72586]:   <name>instance-0000001a</name>
Aug 01 21:32:01 user nova-compute[72586]:   <memory>524288</memory>
Aug 01 21:32:01 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:32:01 user nova-compute[72586]:   <metadata>
Aug 01 21:32:01 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:32:01 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:32:01 user nova-compute[72586]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1000542455</nova:name>
Aug 01 21:32:01 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:32:01</nova:creationTime>
Aug 01 21:32:01 user nova-compute[72586]:       <nova:flavor name="m1.tiny">
Aug 01 21:32:01 user nova-compute[72586]:         <nova:memory>512</nova:memory>
Aug 01 21:32:01 user nova-compute[72586]:         <nova:disk>1</nova:disk>
Aug 01 21:32:01 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:32:01 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:32:01 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:32:01 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:32:01 user nova-compute[72586]:       <nova:owner>
Aug 01 21:32:01 user nova-compute[72586]:         <nova:user uuid="a984642731b9413c97038f65052ab92d">tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member</nova:user>
Aug 01 21:32:01 user nova-compute[72586]:         <nova:project uuid="88d847d04360420c80ea5608d5a2b15a">tempest-ServerBootFromVolumeStableRescueTest-1268085586</nova:project>
Aug 01 21:32:01 user nova-compute[72586]:       </nova:owner>
Aug 01 21:32:01 user nova-compute[72586]:       <nova:root type="image" uuid="0243d46b-6819-42a5-926f-42b71f0c97ad"/>
Aug 01 21:32:01 user nova-compute[72586]:       <nova:ports>
Aug 01 21:32:01 user nova-compute[72586]:         <nova:port uuid="c082b11d-fb01-4def-98b8-6b2966ce364c">
Aug 01 21:32:01 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 01 21:32:01 user nova-compute[72586]:         </nova:port>
Aug 01 21:32:01 user nova-compute[72586]:       </nova:ports>
Aug 01 21:32:01 user nova-compute[72586]:     </nova:instance>
Aug 01 21:32:01 user nova-compute[72586]:   </metadata>
Aug 01 21:32:01 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:32:01 user nova-compute[72586]:     <system>
Aug 01 21:32:01 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:32:01 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:32:01 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:32:01 user nova-compute[72586]:       <entry name="serial">161fab9d-a7d1-4ea0-b4b9-2afc54040eef</entry>
Aug 01 21:32:01 user nova-compute[72586]:       <entry name="uuid">161fab9d-a7d1-4ea0-b4b9-2afc54040eef</entry>
Aug 01 21:32:01 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:32:01 user nova-compute[72586]:     </system>
Aug 01 21:32:01 user nova-compute[72586]:   </sysinfo>
Aug 01 21:32:01 user nova-compute[72586]:   <os>
Aug 01 21:32:01 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:32:01 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:32:01 user nova-compute[72586]:   </os>
Aug 01 21:32:01 user nova-compute[72586]:   <features>
Aug 01 21:32:01 user nova-compute[72586]:     <acpi/>
Aug 01 21:32:01 user nova-compute[72586]:     <apic/>
Aug 01 21:32:01 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:32:01 user nova-compute[72586]:   </features>
Aug 01 21:32:01 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:32:01 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:32:01 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:32:01 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:32:01 user nova-compute[72586]:   </clock>
Aug 01 21:32:01 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:32:01 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:32:01 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:32:01 user nova-compute[72586]:   </cpu>
Aug 01 21:32:01 user nova-compute[72586]:   <devices>
Aug 01 21:32:01 user nova-compute[72586]:     <disk type="block" device="disk">
Aug 01 21:32:01 user nova-compute[72586]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:32:01 user nova-compute[72586]:       <source dev="/dev/sdb"/>
Aug 01 21:32:01 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:32:01 user nova-compute[72586]:       <serial>0acebba2-aca8-4728-b4d6-0d836a537e33</serial>
Aug 01 21:32:01 user nova-compute[72586]:     </disk>
Aug 01 21:32:01 user nova-compute[72586]:     <disk type="file" device="disk">
Aug 01 21:32:01 user nova-compute[72586]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 21:32:01 user nova-compute[72586]:       <source file="/opt/stack/data/nova/instances/161fab9d-a7d1-4ea0-b4b9-2afc54040eef/disk.rescue"/>
Aug 01 21:32:01 user nova-compute[72586]:       <target dev="vdb" bus="virtio"/>
Aug 01 21:32:01 user nova-compute[72586]:       <boot order="1"/>
Aug 01 21:32:01 user nova-compute[72586]:     </disk>
Aug 01 21:32:01 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:32:01 user nova-compute[72586]:       <mac address="fa:16:3e:b6:24:7c"/>
Aug 01 21:32:01 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:32:01 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:32:01 user nova-compute[72586]:       <target dev="tapc082b11d-fb"/>
Aug 01 21:32:01 user nova-compute[72586]:     </interface>
Aug 01 21:32:01 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:32:01 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/161fab9d-a7d1-4ea0-b4b9-2afc54040eef/console.log" append="off"/>
Aug 01 21:32:01 user nova-compute[72586]:     </serial>
Aug 01 21:32:01 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:32:01 user nova-compute[72586]:     <video>
Aug 01 21:32:01 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:32:01 user nova-compute[72586]:     </video>
Aug 01 21:32:01 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:32:01 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:32:01 user nova-compute[72586]:     </rng>
Aug 01 21:32:01 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:32:01 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:32:01 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:32:01 user nova-compute[72586]:     </memballoon>
Aug 01 21:32:01 user nova-compute[72586]:   </devices>
Aug 01 21:32:01 user nova-compute[72586]: </domain>
Aug 01 21:32:01 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:32:01 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Instance destroyed successfully.
Aug 01 21:32:01 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:32:01 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] No VIF found with MAC fa:16:3e:b6:24:7c, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:32:03 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:32:03 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:32:03 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:32:03 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:32:03 user nova-compute[72586]: DEBUG nova.compute.manager [req-2bc6073e-a4d7-4d31-94d4-208e40986cfc req-da28d3df-979e-4b25-9704-ce26d6bca2c9 service nova] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Received event network-vif-plugged-c082b11d-fb01-4def-98b8-6b2966ce364c {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:32:03 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-2bc6073e-a4d7-4d31-94d4-208e40986cfc req-da28d3df-979e-4b25-9704-ce26d6bca2c9 service nova] Acquiring lock "161fab9d-a7d1-4ea0-b4b9-2afc54040eef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:32:03 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-2bc6073e-a4d7-4d31-94d4-208e40986cfc req-da28d3df-979e-4b25-9704-ce26d6bca2c9 service nova] Lock "161fab9d-a7d1-4ea0-b4b9-2afc54040eef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:32:03 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-2bc6073e-a4d7-4d31-94d4-208e40986cfc req-da28d3df-979e-4b25-9704-ce26d6bca2c9 service nova] Lock "161fab9d-a7d1-4ea0-b4b9-2afc54040eef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:32:03 user nova-compute[72586]: DEBUG nova.compute.manager [req-2bc6073e-a4d7-4d31-94d4-208e40986cfc req-da28d3df-979e-4b25-9704-ce26d6bca2c9 service nova] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] No waiting events found dispatching network-vif-plugged-c082b11d-fb01-4def-98b8-6b2966ce364c {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:32:03 user nova-compute[72586]: WARNING nova.compute.manager [req-2bc6073e-a4d7-4d31-94d4-208e40986cfc req-da28d3df-979e-4b25-9704-ce26d6bca2c9 service nova] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Received unexpected event network-vif-plugged-c082b11d-fb01-4def-98b8-6b2966ce364c for instance with vm_state active and task_state rescuing.
Aug 01 21:32:03 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:32:03 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:32:04 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:32:05 user nova-compute[72586]: DEBUG nova.compute.manager [req-96adf39c-1a6e-42b7-9b7e-2f5ae502e3d8 req-654bda1f-90e2-4dd7-8023-2fe61ff0992d service nova] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Received event network-vif-plugged-c082b11d-fb01-4def-98b8-6b2966ce364c {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:32:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-96adf39c-1a6e-42b7-9b7e-2f5ae502e3d8 req-654bda1f-90e2-4dd7-8023-2fe61ff0992d service nova] Acquiring lock "161fab9d-a7d1-4ea0-b4b9-2afc54040eef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:32:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-96adf39c-1a6e-42b7-9b7e-2f5ae502e3d8 req-654bda1f-90e2-4dd7-8023-2fe61ff0992d service nova] Lock "161fab9d-a7d1-4ea0-b4b9-2afc54040eef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:32:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-96adf39c-1a6e-42b7-9b7e-2f5ae502e3d8 req-654bda1f-90e2-4dd7-8023-2fe61ff0992d service nova] Lock "161fab9d-a7d1-4ea0-b4b9-2afc54040eef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:32:05 user nova-compute[72586]: DEBUG nova.compute.manager [req-96adf39c-1a6e-42b7-9b7e-2f5ae502e3d8 req-654bda1f-90e2-4dd7-8023-2fe61ff0992d service nova] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] No waiting events found dispatching network-vif-plugged-c082b11d-fb01-4def-98b8-6b2966ce364c {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:32:05 user nova-compute[72586]: WARNING nova.compute.manager [req-96adf39c-1a6e-42b7-9b7e-2f5ae502e3d8 req-654bda1f-90e2-4dd7-8023-2fe61ff0992d service nova] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Received unexpected event network-vif-plugged-c082b11d-fb01-4def-98b8-6b2966ce364c for instance with vm_state active and task_state rescuing.
Aug 01 21:32:05 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Removed pending event for 161fab9d-a7d1-4ea0-b4b9-2afc54040eef due to event {{(pid=72586) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 21:32:05 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925525.6684318, 161fab9d-a7d1-4ea0-b4b9-2afc54040eef => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:32:05 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] VM Resumed (Lifecycle Event)
Aug 01 21:32:05 user nova-compute[72586]: DEBUG nova.compute.manager [None req-56c1df8e-9c40-4ab8-a8de-384a96407a69 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:32:05 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:32:05 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:32:05 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 01 21:32:05 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925525.6771033, 161fab9d-a7d1-4ea0-b4b9-2afc54040eef => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:32:05 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] VM Started (Lifecycle Event)
Aug 01 21:32:05 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:32:05 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:32:06 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:32:09 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:32:09 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b7127c20-8d7f-4b16-b0f3-9a043ea39f85 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Acquiring lock "f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:32:09 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b7127c20-8d7f-4b16-b0f3-9a043ea39f85 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lock "f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:32:09 user nova-compute[72586]: DEBUG nova.objects.instance [None req-b7127c20-8d7f-4b16-b0f3-9a043ea39f85 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lazy-loading 'flavor' on Instance uuid f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:32:09 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b7127c20-8d7f-4b16-b0f3-9a043ea39f85 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lock "f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:32:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b7127c20-8d7f-4b16-b0f3-9a043ea39f85 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Acquiring lock "f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:32:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b7127c20-8d7f-4b16-b0f3-9a043ea39f85 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lock "f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:32:10 user nova-compute[72586]: INFO nova.compute.manager [None req-b7127c20-8d7f-4b16-b0f3-9a043ea39f85 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Attaching volume 56dd151d-1010-4dd6-9ffb-605e9d40b193 to /dev/vdb
Aug 01 21:32:10 user nova-compute[72586]: DEBUG os_brick.utils [None req-b7127c20-8d7f-4b16-b0f3-9a043ea39f85 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:32:10 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:10 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:10 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ae5d09-e980-4da9-a504-e9c10be388ef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4bc202fb9cb\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:10 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:10 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:10 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0df073-99e4-4d3f-b6f9-94f10986abc5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:10 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:10 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.036s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:10 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[937d7f15-2da6-4ba1-a9e2-9561dbfd4bd7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:10 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b1270c-413d-4428-ab20-76ed44bccf25]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:10 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-b7127c20-8d7f-4b16-b0f3-9a043ea39f85 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Running cmd (subprocess): nvme version {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:10 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-b7127c20-8d7f-4b16-b0f3-9a043ea39f85 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] 'nvme version' failed. Not Retrying. {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:32:10 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b7127c20-8d7f-4b16-b0f3-9a043ea39f85 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] nvme not present on system {{(pid=72586) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 21:32:10 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:10 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:32:10 user nova-compute[72586]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 21:32:10 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[4afe59c5-ad7a-410f-b3b9-715db35407b6]: (4, '') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:10 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-b7127c20-8d7f-4b16-b0f3-9a043ea39f85 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72586) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 21:32:10 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-b7127c20-8d7f-4b16-b0f3-9a043ea39f85 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 21:32:10 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-b7127c20-8d7f-4b16-b0f3-9a043ea39f85 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] LIGHTOS: no hostnqn found. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 21:32:10 user nova-compute[72586]: DEBUG os_brick.utils [None req-b7127c20-8d7f-4b16-b0f3-9a043ea39f85 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4bc202fb9cb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:32:10 user nova-compute[72586]: DEBUG nova.virt.block_device [None req-b7127c20-8d7f-4b16-b0f3-9a043ea39f85 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Updating existing volume attachment record: 2e79c082-dc5c-496e-9aea-4d2c44303c32 {{(pid=72586) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 21:32:11 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:32:14 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:32:16 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:32:16 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-7e37b2a2-a50a-4b73-9c23-4ec310132049 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Acquiring lock "09571c9f-bf42-475a-afac-0e3947168d7e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:32:16 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-7e37b2a2-a50a-4b73-9c23-4ec310132049 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Lock "09571c9f-bf42-475a-afac-0e3947168d7e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:32:16 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-7e37b2a2-a50a-4b73-9c23-4ec310132049 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Acquiring lock "09571c9f-bf42-475a-afac-0e3947168d7e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:32:16 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-7e37b2a2-a50a-4b73-9c23-4ec310132049 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Lock "09571c9f-bf42-475a-afac-0e3947168d7e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:32:16 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-7e37b2a2-a50a-4b73-9c23-4ec310132049 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Lock "09571c9f-bf42-475a-afac-0e3947168d7e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:32:16 user nova-compute[72586]: INFO nova.compute.manager [None req-7e37b2a2-a50a-4b73-9c23-4ec310132049 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Terminating instance
Aug 01 21:32:16 user nova-compute[72586]: DEBUG nova.compute.manager [None req-7e37b2a2-a50a-4b73-9c23-4ec310132049 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Start destroying the instance on the hypervisor. {{(pid=72586) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 21:32:16 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:32:16 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:32:16 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:32:16 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:32:16 user nova-compute[72586]: DEBUG nova.compute.manager [req-e0c74b0d-5a7c-4978-a520-393b8c0dcab0 req-13bcdcf0-f345-4045-8e9a-ca8e95e5180c service nova] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Received event network-vif-unplugged-72b0f9c6-102b-4a73-bdb2-9f4f4181e81e {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:32:16 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-e0c74b0d-5a7c-4978-a520-393b8c0dcab0 req-13bcdcf0-f345-4045-8e9a-ca8e95e5180c service nova] Acquiring lock "09571c9f-bf42-475a-afac-0e3947168d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:32:16 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-e0c74b0d-5a7c-4978-a520-393b8c0dcab0 req-13bcdcf0-f345-4045-8e9a-ca8e95e5180c service nova] Lock "09571c9f-bf42-475a-afac-0e3947168d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:32:16 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-e0c74b0d-5a7c-4978-a520-393b8c0dcab0 req-13bcdcf0-f345-4045-8e9a-ca8e95e5180c service nova] Lock "09571c9f-bf42-475a-afac-0e3947168d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:32:16 user nova-compute[72586]: DEBUG nova.compute.manager [req-e0c74b0d-5a7c-4978-a520-393b8c0dcab0 req-13bcdcf0-f345-4045-8e9a-ca8e95e5180c service nova] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] No waiting events found dispatching network-vif-unplugged-72b0f9c6-102b-4a73-bdb2-9f4f4181e81e {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:32:16 user nova-compute[72586]: DEBUG nova.compute.manager [req-e0c74b0d-5a7c-4978-a520-393b8c0dcab0 req-13bcdcf0-f345-4045-8e9a-ca8e95e5180c service nova] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Received event network-vif-unplugged-72b0f9c6-102b-4a73-bdb2-9f4f4181e81e for instance with task_state deleting. {{(pid=72586) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 21:32:17 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Acquiring lock "314f9b05-527c-459d-aca7-acc696ac613f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:32:17 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "314f9b05-527c-459d-aca7-acc696ac613f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:32:17 user nova-compute[72586]: DEBUG nova.compute.manager [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Starting instance... {{(pid=72586) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 21:32:17 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Instance destroyed successfully.
Aug 01 21:32:17 user nova-compute[72586]: DEBUG nova.objects.instance [None req-7e37b2a2-a50a-4b73-9c23-4ec310132049 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Lazy-loading 'resources' on Instance uuid 09571c9f-bf42-475a-afac-0e3947168d7e {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:32:17 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-7e37b2a2-a50a-4b73-9c23-4ec310132049 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:28:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-138821445',display_name='tempest-TestServerVolumeAttachmentScenario-server-138821445',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-138821445',id=25,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJhPkgMLOdiRFcpMS72PXhkhMY8B5BqYZFAfIfUitXNymXOApyKhG/5NCed+3F0X8Tu+aI+DLUuBOONpfIIenvmYUcLylyZHzeH9Mdt/v/Mvp2iXdTIz5whSCB8pzqUc4A==',key_name='tempest-keypair-1727093272',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:28:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cedafac8150441a086c3197698ba58e5',ramdisk_id='',reservation_id='r-4bfoq4r5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-609353703',owner_user_name='tempest-TestServerVolumeAttachmentScenario-609353703-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:28:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='afdf04a7e03d41e8ad25485939b3e14a',uuid=09571c9f-bf42-475a-afac-0e3947168d7e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72b0f9c6-102b-4a73-bdb2-9f4f4181e81e", "address": "fa:16:3e:18:89:0a", "network": {"id": "3da39b49-6be1-40be-93db-5bd61034e9a7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1015949721-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cedafac8150441a086c3197698ba58e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72b0f9c6-10", "ovs_interfaceid": "72b0f9c6-102b-4a73-bdb2-9f4f4181e81e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:32:17 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-7e37b2a2-a50a-4b73-9c23-4ec310132049 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Converting VIF {"id": "72b0f9c6-102b-4a73-bdb2-9f4f4181e81e", "address": "fa:16:3e:18:89:0a", "network": {"id": "3da39b49-6be1-40be-93db-5bd61034e9a7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1015949721-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cedafac8150441a086c3197698ba58e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72b0f9c6-10", "ovs_interfaceid": "72b0f9c6-102b-4a73-bdb2-9f4f4181e81e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:32:17 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-7e37b2a2-a50a-4b73-9c23-4ec310132049 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:18:89:0a,bridge_name='br-int',has_traffic_filtering=True,id=72b0f9c6-102b-4a73-bdb2-9f4f4181e81e,network=Network(3da39b49-6be1-40be-93db-5bd61034e9a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72b0f9c6-10') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:32:17 user nova-compute[72586]: DEBUG os_vif [None req-7e37b2a2-a50a-4b73-9c23-4ec310132049 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:89:0a,bridge_name='br-int',has_traffic_filtering=True,id=72b0f9c6-102b-4a73-bdb2-9f4f4181e81e,network=Network(3da39b49-6be1-40be-93db-5bd61034e9a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72b0f9c6-10') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:32:17 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:32:17 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap72b0f9c6-10, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:32:17 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:32:17 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:32:17 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:32:17 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:32:17 user nova-compute[72586]: INFO os_vif [None req-7e37b2a2-a50a-4b73-9c23-4ec310132049 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:89:0a,bridge_name='br-int',has_traffic_filtering=True,id=72b0f9c6-102b-4a73-bdb2-9f4f4181e81e,network=Network(3da39b49-6be1-40be-93db-5bd61034e9a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72b0f9c6-10')
Aug 01 21:32:17 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-7e37b2a2-a50a-4b73-9c23-4ec310132049 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Deleting instance files /opt/stack/data/nova/instances/09571c9f-bf42-475a-afac-0e3947168d7e_del
Aug 01 21:32:17 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-7e37b2a2-a50a-4b73-9c23-4ec310132049 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Deletion of /opt/stack/data/nova/instances/09571c9f-bf42-475a-afac-0e3947168d7e_del complete
Aug 01 21:32:17 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72586) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 21:32:17 user nova-compute[72586]: INFO nova.compute.claims [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Claim successful on node user
Aug 01 21:32:17 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:32:17 user nova-compute[72586]: INFO nova.compute.manager [None req-7e37b2a2-a50a-4b73-9c23-4ec310132049 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Took 1.10 seconds to destroy the instance on the hypervisor.
Aug 01 21:32:17 user nova-compute[72586]: DEBUG oslo.service.loopingcall [None req-7e37b2a2-a50a-4b73-9c23-4ec310132049 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72586) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 21:32:17 user nova-compute[72586]: DEBUG nova.compute.manager [-] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Deallocating network for instance {{(pid=72586) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 21:32:17 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] deallocate_for_instance() {{(pid=72586) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 21:32:17 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:32:17 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:32:17 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.671s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:32:17 user nova-compute[72586]: DEBUG nova.compute.manager [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Start building networks asynchronously for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 21:32:17 user nova-compute[72586]: DEBUG nova.compute.manager [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Allocating IP information in the background. {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 21:32:17 user nova-compute[72586]: DEBUG nova.network.neutron [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] allocate_for_instance() {{(pid=72586) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 21:32:17 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 21:32:17 user nova-compute[72586]: DEBUG nova.compute.manager [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Start building block device mappings for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 21:32:18 user nova-compute[72586]: DEBUG nova.policy [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '88d01b1101164c859b19d41e251447a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19af48ffce7e4703b6d978bc3563680e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72586) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 21:32:18 user nova-compute[72586]: INFO nova.virt.block_device [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Booting with volume 594ff51e-685a-4144-8733-decfebb84843 at /dev/vda
Aug 01 21:32:18 user nova-compute[72586]: DEBUG os_brick.utils [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:32:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:18 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f8d31b-8771-4512-94f9-991139e53501]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4bc202fb9cb\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:18 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ac7ca0-ef8c-41a4-a258-94b441bca56d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:18 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[92aefbe4-c2ec-40b9-9661-f5d383e4f612]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:18 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff30255-0977-43ef-ba63-69ffe6160954]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Running cmd (subprocess): nvme version {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] 'nvme version' failed. Not Retrying. {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:32:18 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] nvme not present on system {{(pid=72586) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 21:32:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:32:18 user nova-compute[72586]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 21:32:18 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa36a53e-5b13-45aa-97f1-4cad7e9c199f]: (4, '') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:18 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72586) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 21:32:18 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 21:32:18 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] LIGHTOS: no hostnqn found. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 21:32:18 user nova-compute[72586]: DEBUG os_brick.utils [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4bc202fb9cb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:32:18 user nova-compute[72586]: DEBUG nova.virt.block_device [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Updating existing volume attachment record: b702d1c7-01ac-4e9d-b2e2-f714ff7cb946 {{(pid=72586) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 21:32:18 user nova-compute[72586]: DEBUG nova.compute.manager [req-7f145889-ed82-49af-99b8-f793f63bab68 req-1abb797c-080f-4c38-8856-3b0fff622652 service nova] [instance: 7ac93270-a352-4844-900f-cd3486658610] Received event network-changed-bbd2d76f-a2a0-4bc1-bf4a-a1d52cb94278 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:32:18 user nova-compute[72586]: DEBUG nova.compute.manager [req-7f145889-ed82-49af-99b8-f793f63bab68 req-1abb797c-080f-4c38-8856-3b0fff622652 service nova] [instance: 7ac93270-a352-4844-900f-cd3486658610] Refreshing instance network info cache due to event network-changed-bbd2d76f-a2a0-4bc1-bf4a-a1d52cb94278. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:32:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-7f145889-ed82-49af-99b8-f793f63bab68 req-1abb797c-080f-4c38-8856-3b0fff622652 service nova] Acquiring lock "refresh_cache-7ac93270-a352-4844-900f-cd3486658610" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:32:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-7f145889-ed82-49af-99b8-f793f63bab68 req-1abb797c-080f-4c38-8856-3b0fff622652 service nova] Acquired lock "refresh_cache-7ac93270-a352-4844-900f-cd3486658610" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:32:18 user nova-compute[72586]: DEBUG nova.network.neutron [req-7f145889-ed82-49af-99b8-f793f63bab68 req-1abb797c-080f-4c38-8856-3b0fff622652 service nova] [instance: 7ac93270-a352-4844-900f-cd3486658610] Refreshing network info cache for port bbd2d76f-a2a0-4bc1-bf4a-a1d52cb94278 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:32:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a2f531e4-d15b-413e-9ae0-653ea32617a4 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Acquiring lock "7ac93270-a352-4844-900f-cd3486658610" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:32:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a2f531e4-d15b-413e-9ae0-653ea32617a4 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lock "7ac93270-a352-4844-900f-cd3486658610" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:32:18 user nova-compute[72586]: DEBUG nova.compute.manager [req-a804d67e-32c0-4382-8cea-b8baed6285be req-032ec364-11ae-43d1-9605-b0149316632e service nova] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Received event network-vif-plugged-72b0f9c6-102b-4a73-bdb2-9f4f4181e81e {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:32:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-a804d67e-32c0-4382-8cea-b8baed6285be req-032ec364-11ae-43d1-9605-b0149316632e service nova] Acquiring lock "09571c9f-bf42-475a-afac-0e3947168d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:32:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-a804d67e-32c0-4382-8cea-b8baed6285be req-032ec364-11ae-43d1-9605-b0149316632e service nova] Lock "09571c9f-bf42-475a-afac-0e3947168d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:32:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-a804d67e-32c0-4382-8cea-b8baed6285be req-032ec364-11ae-43d1-9605-b0149316632e service nova] Lock "09571c9f-bf42-475a-afac-0e3947168d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:32:18 user nova-compute[72586]: DEBUG nova.compute.manager [req-a804d67e-32c0-4382-8cea-b8baed6285be req-032ec364-11ae-43d1-9605-b0149316632e service nova] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] No waiting events found dispatching network-vif-plugged-72b0f9c6-102b-4a73-bdb2-9f4f4181e81e {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:32:18 user nova-compute[72586]: WARNING nova.compute.manager [req-a804d67e-32c0-4382-8cea-b8baed6285be req-032ec364-11ae-43d1-9605-b0149316632e service nova] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Received unexpected event network-vif-plugged-72b0f9c6-102b-4a73-bdb2-9f4f4181e81e for instance with vm_state active and task_state deleting.
Aug 01 21:32:18 user nova-compute[72586]: DEBUG nova.objects.instance [None req-a2f531e4-d15b-413e-9ae0-653ea32617a4 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lazy-loading 'flavor' on Instance uuid 7ac93270-a352-4844-900f-cd3486658610 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:32:18 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-a2f531e4-d15b-413e-9ae0-653ea32617a4 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 7ac93270-a352-4844-900f-cd3486658610] Ignoring supplied device name: /dev/vdb
Aug 01 21:32:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a2f531e4-d15b-413e-9ae0-653ea32617a4 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lock "7ac93270-a352-4844-900f-cd3486658610" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a2f531e4-d15b-413e-9ae0-653ea32617a4 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Acquiring lock "7ac93270-a352-4844-900f-cd3486658610" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a2f531e4-d15b-413e-9ae0-653ea32617a4 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lock "7ac93270-a352-4844-900f-cd3486658610" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:32:19 user nova-compute[72586]: INFO nova.compute.manager [None req-a2f531e4-d15b-413e-9ae0-653ea32617a4 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 7ac93270-a352-4844-900f-cd3486658610] Attaching volume 6168f95e-6eb8-40f2-ba7c-85aff08346d5 to /dev/vdb
Aug 01 21:32:19 user nova-compute[72586]: DEBUG os_brick.utils [None req-a2f531e4-d15b-413e-9ae0-653ea32617a4 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e3c45a-5237-40c6-9a5e-2a3943c0978a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4bc202fb9cb\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[947b5d3a-1dd9-4b86-8426-695c001d2f1a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[58bdc17d-fcf6-4bed-a662-c218bb49828c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0363ee3-3c5c-490a-a3f8-ac2240918088]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-a2f531e4-d15b-413e-9ae0-653ea32617a4 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Running cmd (subprocess): nvme version {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-a2f531e4-d15b-413e-9ae0-653ea32617a4 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] 'nvme version' failed. Not Retrying. {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a2f531e4-d15b-413e-9ae0-653ea32617a4 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] nvme not present on system {{(pid=72586) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7127c20-8d7f-4b16-b0f3-9a043ea39f85 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Calling os-brick to attach iSCSI Volume {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7127c20-8d7f-4b16-b0f3-9a043ea39f85 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:56dd151d-1010-4dd6-9ffb-605e9d40b193'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hQunaIit', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:32:19 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-b7127c20-8d7f-4b16-b0f3-9a043ea39f85 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:32:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-b7127c20-8d7f-4b16-b0f3-9a043ea39f85 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-b7127c20-8d7f-4b16-b0f3-9a043ea39f85 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:32:19 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-b7127c20-8d7f-4b16-b0f3-9a043ea39f85 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:32:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-b7127c20-8d7f-4b16-b0f3-9a043ea39f85 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56dd151d-1010-4dd6-9ffb-605e9d40b193" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-b7127c20-8d7f-4b16-b0f3-9a043ea39f85 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56dd151d-1010-4dd6-9ffb-605e9d40b193" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:32:19 user nova-compute[72586]: INFO os_brick.initiator.connectors.iscsi [None req-b7127c20-8d7f-4b16-b0f3-9a043ea39f85 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 21:32:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:32:19 user nova-compute[72586]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 21:32:19 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e73053c-7f8f-4d47-9bd4-12b150121124]: (4, '') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-a2f531e4-d15b-413e-9ae0-653ea32617a4 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72586) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-a2f531e4-d15b-413e-9ae0-653ea32617a4 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-a2f531e4-d15b-413e-9ae0-653ea32617a4 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] LIGHTOS: no hostnqn found. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG os_brick.utils [None req-a2f531e4-d15b-413e-9ae0-653ea32617a4 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] <== get_connector_properties: return (167ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4bc202fb9cb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG nova.virt.block_device [None req-a2f531e4-d15b-413e-9ae0-653ea32617a4 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 7ac93270-a352-4844-900f-cd3486658610] Updating existing volume attachment record: 5edf7a41-3b08-48c6-8c6e-9c158dc2115d {{(pid=72586) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56dd151d-1010-4dd6-9ffb-605e9d40b193 -p 172.16.0.220:3260 {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG nova.network.neutron [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Successfully created port: eeebb619-be12-42d7-96f3-e309b6d4cdaf {{(pid=72586) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56dd151d-1010-4dd6-9ffb-605e9d40b193 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1366eb-bc79-4f80-91d4-be094aeff315]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7127c20-8d7f-4b16-b0f3-9a043ea39f85 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 21:32:19 user nova-compute[72586]:  {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56dd151d-1010-4dd6-9ffb-605e9d40b193 -p 172.16.0.220:3260 --interface default --op new {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:19 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Took 1.95 seconds to deallocate network for instance.
Aug 01 21:32:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56dd151d-1010-4dd6-9ffb-605e9d40b193 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[45fc1efc-1d9e-493c-b806-1cd809454da4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:56dd151d-1010-4dd6-9ffb-605e9d40b193] added\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7127c20-8d7f-4b16-b0f3-9a043ea39f85 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:56dd151d-1010-4dd6-9ffb-605e9d40b193] added
Aug 01 21:32:19 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56dd151d-1010-4dd6-9ffb-605e9d40b193 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56dd151d-1010-4dd6-9ffb-605e9d40b193 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19b863c-9e58-4af0-b49e-25a04b40818a]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7127c20-8d7f-4b16-b0f3-9a043ea39f85 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56dd151d-1010-4dd6-9ffb-605e9d40b193 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56dd151d-1010-4dd6-9ffb-605e9d40b193 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1d1e11-54ee-43d7-98be-a0768415b7d8]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7127c20-8d7f-4b16-b0f3-9a043ea39f85 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56dd151d-1010-4dd6-9ffb-605e9d40b193 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hQunaIit {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-7e37b2a2-a50a-4b73-9c23-4ec310132049 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-7e37b2a2-a50a-4b73-9c23-4ec310132049 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56dd151d-1010-4dd6-9ffb-605e9d40b193 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hQunaIit" returned: 0 in 0.027s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[742f240f-4cf4-45c7-87d3-fc2bdf789993]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7127c20-8d7f-4b16-b0f3-9a043ea39f85 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hQunaIit'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56dd151d-1010-4dd6-9ffb-605e9d40b193 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56dd151d-1010-4dd6-9ffb-605e9d40b193 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c26d1d-f999-4c93-b49e-2999fd46dc04]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7127c20-8d7f-4b16-b0f3-9a043ea39f85 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG nova.network.neutron [req-7f145889-ed82-49af-99b8-f793f63bab68 req-1abb797c-080f-4c38-8856-3b0fff622652 service nova] [instance: 7ac93270-a352-4844-900f-cd3486658610] Updated VIF entry in instance network info cache for port bbd2d76f-a2a0-4bc1-bf4a-a1d52cb94278. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG nova.network.neutron [req-7f145889-ed82-49af-99b8-f793f63bab68 req-1abb797c-080f-4c38-8856-3b0fff622652 service nova] [instance: 7ac93270-a352-4844-900f-cd3486658610] Updating instance_info_cache with network_info: [{"id": "bbd2d76f-a2a0-4bc1-bf4a-a1d52cb94278", "address": "fa:16:3e:c4:bc:0a", "network": {"id": "8e60d949-6c06-4e40-b792-d6f516b967d7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-603740209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfd51ad6ca4045699c8d72f9382f1c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbd2d76f-a2", "ovs_interfaceid": "bbd2d76f-a2a0-4bc1-bf4a-a1d52cb94278", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9abb9e3a-3049-4c7d-b60d-5ab28806aa9e]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7127c20-8d7f-4b16-b0f3-9a043ea39f85 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)
Aug 01 21:32:19 user nova-compute[72586]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:32:19 user nova-compute[72586]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:32:19 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7127c20-8d7f-4b16-b0f3-9a043ea39f85 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)
Aug 01 21:32:19 user nova-compute[72586]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:32:19 user nova-compute[72586]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:32:19 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-7f145889-ed82-49af-99b8-f793f63bab68 req-1abb797c-080f-4c38-8856-3b0fff622652 service nova] Releasing lock "refresh_cache-7ac93270-a352-4844-900f-cd3486658610" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56dd151d-1010-4dd6-9ffb-605e9d40b193 -p 172.16.0.220:3260 --login {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56dd151d-1010-4dd6-9ffb-605e9d40b193 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[478484f4-9656-4eba-91ed-808eea59f463]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:56dd151d-1010-4dd6-9ffb-605e9d40b193, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:56dd151d-1010-4dd6-9ffb-605e9d40b193, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7127c20-8d7f-4b16-b0f3-9a043ea39f85 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:56dd151d-1010-4dd6-9ffb-605e9d40b193, portal: 172.16.0.220,3260]
Aug 01 21:32:19 user nova-compute[72586]: Login to [iface: default, target: iqn.2010-10.org.openstack:56dd151d-1010-4dd6-9ffb-605e9d40b193, portal: 172.16.0.220,3260] successful.
Aug 01 21:32:19 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56dd151d-1010-4dd6-9ffb-605e9d40b193 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56dd151d-1010-4dd6-9ffb-605e9d40b193 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.061s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a82635c-efdd-4ce5-8034-89c570e405dc]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7127c20-8d7f-4b16-b0f3-9a043ea39f85 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce75d4d1-584f-4338-af41-6f5e07c21fc6]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56dd151d-1010-4dd6-9ffb-605e9d40b193 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7127c20-8d7f-4b16-b0f3-9a043ea39f85 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)
Aug 01 21:32:19 user nova-compute[72586]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:32:19 user nova-compute[72586]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:32:19 user nova-compute[72586]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56dd151d-1010-4dd6-9ffb-605e9d40b193 (non-flash)
Aug 01 21:32:19 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7127c20-8d7f-4b16-b0f3-9a043ea39f85 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)
Aug 01 21:32:19 user nova-compute[72586]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:32:19 user nova-compute[72586]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:32:19 user nova-compute[72586]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56dd151d-1010-4dd6-9ffb-605e9d40b193 (non-flash)
Aug 01 21:32:19 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-b7127c20-8d7f-4b16-b0f3-9a043ea39f85 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56dd151d-1010-4dd6-9ffb-605e9d40b193" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.411s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7127c20-8d7f-4b16-b0f3-9a043ea39f85 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Connected to 172.16.0.220:3260 {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-b7127c20-8d7f-4b16-b0f3-9a043ea39f85 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] HCTL ('34', '-', '-', 0) found on session 34 with lun 0 {{(pid=72586) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-b7127c20-8d7f-4b16-b0f3-9a043ea39f85 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72586) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.030s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[84efd04f-7a3c-4c54-a0c0-2e5afddc70a9]: (4, ('- - 0', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-b7127c20-8d7f-4b16-b0f3-9a043ea39f85 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Searching for a device in session 34 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7127c20-8d7f-4b16-b0f3-9a043ea39f85 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hQunaIit', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-7e37b2a2-a50a-4b73-9c23-4ec310132049 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:32:19 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-7e37b2a2-a50a-4b73-9c23-4ec310132049 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:32:20 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-7e37b2a2-a50a-4b73-9c23-4ec310132049 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.537s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:32:20 user nova-compute[72586]: INFO nova.scheduler.client.report [None req-7e37b2a2-a50a-4b73-9c23-4ec310132049 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Deleted allocations for instance 09571c9f-bf42-475a-afac-0e3947168d7e
Aug 01 21:32:20 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-7e37b2a2-a50a-4b73-9c23-4ec310132049 tempest-TestServerVolumeAttachmentScenario-609353703 tempest-TestServerVolumeAttachmentScenario-609353703-project-member] Lock "09571c9f-bf42-475a-afac-0e3947168d7e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.827s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:32:20 user nova-compute[72586]: DEBUG nova.network.neutron [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Successfully updated port: eeebb619-be12-42d7-96f3-e309b6d4cdaf {{(pid=72586) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 21:32:20 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Acquiring lock "refresh_cache-314f9b05-527c-459d-aca7-acc696ac613f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:32:20 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Acquired lock "refresh_cache-314f9b05-527c-459d-aca7-acc696ac613f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:32:20 user nova-compute[72586]: DEBUG nova.network.neutron [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:32:20 user nova-compute[72586]: DEBUG nova.compute.manager [req-f2af827a-569d-4a0e-bc30-bf807a4c81a2 req-9948bc86-5c94-4f8e-a197-3a3f4fdc55b8 service nova] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Received event network-changed-eeebb619-be12-42d7-96f3-e309b6d4cdaf {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:32:20 user nova-compute[72586]: DEBUG nova.compute.manager [req-f2af827a-569d-4a0e-bc30-bf807a4c81a2 req-9948bc86-5c94-4f8e-a197-3a3f4fdc55b8 service nova] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Refreshing instance network info cache due to event network-changed-eeebb619-be12-42d7-96f3-e309b6d4cdaf. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:32:20 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-f2af827a-569d-4a0e-bc30-bf807a4c81a2 req-9948bc86-5c94-4f8e-a197-3a3f4fdc55b8 service nova] Acquiring lock "refresh_cache-314f9b05-527c-459d-aca7-acc696ac613f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:32:20 user nova-compute[72586]: DEBUG nova.network.neutron [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Instance cache missing network info. {{(pid=72586) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 21:32:20 user nova-compute[72586]: DEBUG nova.compute.manager [req-b7029b78-e571-4f9e-a16b-efb35fc9cd1a req-0a8c585e-b56c-427f-a1f1-b087d3336740 service nova] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Received event network-vif-deleted-72b0f9c6-102b-4a73-bdb2-9f4f4181e81e {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:32:20 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-b7127c20-8d7f-4b16-b0f3-9a043ea39f85 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.456s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:32:20 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7127c20-8d7f-4b16-b0f3-9a043ea39f85 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] <== connect_volume: return (1459ms) {'type': 'block', 'scsi_wwn': '23538346132613939', 'path': '/dev/sdc'} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:32:20 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7127c20-8d7f-4b16-b0f3-9a043ea39f85 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538346132613939', 'path': '/dev/sdc'} {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 21:32:20 user nova-compute[72586]: DEBUG nova.objects.instance [None req-b7127c20-8d7f-4b16-b0f3-9a043ea39f85 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lazy-loading 'flavor' on Instance uuid f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:32:20 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-b7127c20-8d7f-4b16-b0f3-9a043ea39f85 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 21:32:20 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:32:20 user nova-compute[72586]:   <source dev="/dev/sdc"/>
Aug 01 21:32:20 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:32:20 user nova-compute[72586]:   <serial>56dd151d-1010-4dd6-9ffb-605e9d40b193</serial>
Aug 01 21:32:20 user nova-compute[72586]: </disk>
Aug 01 21:32:20 user nova-compute[72586]:  {{(pid=72586) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 21:32:20 user nova-compute[72586]: DEBUG nova.network.neutron [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Updating instance_info_cache with network_info: [{"id": "eeebb619-be12-42d7-96f3-e309b6d4cdaf", "address": "fa:16:3e:5d:69:cd", "network": {"id": "aab9a541-2149-4c65-b60e-80a1daca6632", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1355256264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19af48ffce7e4703b6d978bc3563680e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeebb619-be", "ovs_interfaceid": "eeebb619-be12-42d7-96f3-e309b6d4cdaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:32:20 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Releasing lock "refresh_cache-314f9b05-527c-459d-aca7-acc696ac613f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:32:20 user nova-compute[72586]: DEBUG nova.compute.manager [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Instance network_info: |[{"id": "eeebb619-be12-42d7-96f3-e309b6d4cdaf", "address": "fa:16:3e:5d:69:cd", "network": {"id": "aab9a541-2149-4c65-b60e-80a1daca6632", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1355256264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19af48ffce7e4703b6d978bc3563680e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeebb619-be", "ovs_interfaceid": "eeebb619-be12-42d7-96f3-e309b6d4cdaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 21:32:20 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-f2af827a-569d-4a0e-bc30-bf807a4c81a2 req-9948bc86-5c94-4f8e-a197-3a3f4fdc55b8 service nova] Acquired lock "refresh_cache-314f9b05-527c-459d-aca7-acc696ac613f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:32:20 user nova-compute[72586]: DEBUG nova.network.neutron [req-f2af827a-569d-4a0e-bc30-bf807a4c81a2 req-9948bc86-5c94-4f8e-a197-3a3f4fdc55b8 service nova] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Refreshing network info cache for port eeebb619-be12-42d7-96f3-e309b6d4cdaf {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:32:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-b7127c20-8d7f-4b16-b0f3-9a043ea39f85 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:32:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-b7127c20-8d7f-4b16-b0f3-9a043ea39f85 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:32:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-b7127c20-8d7f-4b16-b0f3-9a043ea39f85 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] No VIF found with MAC fa:16:3e:ac:44:36, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:32:21 user nova-compute[72586]: DEBUG nova.network.neutron [req-f2af827a-569d-4a0e-bc30-bf807a4c81a2 req-9948bc86-5c94-4f8e-a197-3a3f4fdc55b8 service nova] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Updated VIF entry in instance network info cache for port eeebb619-be12-42d7-96f3-e309b6d4cdaf. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:32:21 user nova-compute[72586]: DEBUG nova.network.neutron [req-f2af827a-569d-4a0e-bc30-bf807a4c81a2 req-9948bc86-5c94-4f8e-a197-3a3f4fdc55b8 service nova] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Updating instance_info_cache with network_info: [{"id": "eeebb619-be12-42d7-96f3-e309b6d4cdaf", "address": "fa:16:3e:5d:69:cd", "network": {"id": "aab9a541-2149-4c65-b60e-80a1daca6632", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1355256264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19af48ffce7e4703b6d978bc3563680e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeebb619-be", "ovs_interfaceid": "eeebb619-be12-42d7-96f3-e309b6d4cdaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:32:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-f2af827a-569d-4a0e-bc30-bf807a4c81a2 req-9948bc86-5c94-4f8e-a197-3a3f4fdc55b8 service nova] Releasing lock "refresh_cache-314f9b05-527c-459d-aca7-acc696ac613f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:32:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b7127c20-8d7f-4b16-b0f3-9a043ea39f85 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lock "f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.219s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:32:22 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:32:22 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:32:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-92b5b4bf-882e-4289-af63-a321b6920264 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Acquiring lock "f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:32:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-92b5b4bf-882e-4289-af63-a321b6920264 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lock "f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:32:23 user nova-compute[72586]: INFO nova.compute.manager [None req-92b5b4bf-882e-4289-af63-a321b6920264 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Detaching volume 56dd151d-1010-4dd6-9ffb-605e9d40b193
Aug 01 21:32:23 user nova-compute[72586]: INFO nova.virt.block_device [None req-92b5b4bf-882e-4289-af63-a321b6920264 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Attempting to driver detach volume 56dd151d-1010-4dd6-9ffb-605e9d40b193 from mountpoint /dev/vdb
Aug 01 21:32:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-92b5b4bf-882e-4289-af63-a321b6920264 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Attempting to detach device vdb from instance f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536 from the persistent domain config. {{(pid=72586) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 21:32:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-92b5b4bf-882e-4289-af63-a321b6920264 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 21:32:23 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:32:23 user nova-compute[72586]:   <source dev="/dev/sdc"/>
Aug 01 21:32:23 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:32:23 user nova-compute[72586]:   <serial>56dd151d-1010-4dd6-9ffb-605e9d40b193</serial>
Aug 01 21:32:23 user nova-compute[72586]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 21:32:23 user nova-compute[72586]: </disk>
Aug 01 21:32:23 user nova-compute[72586]:  {{(pid=72586) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 21:32:23 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-92b5b4bf-882e-4289-af63-a321b6920264 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Successfully detached device vdb from instance f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536 from the persistent domain config.
Aug 01 21:32:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-92b5b4bf-882e-4289-af63-a321b6920264 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536 from the live domain config. {{(pid=72586) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 21:32:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-92b5b4bf-882e-4289-af63-a321b6920264 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 21:32:23 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:32:23 user nova-compute[72586]:   <source dev="/dev/sdc"/>
Aug 01 21:32:23 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:32:23 user nova-compute[72586]:   <serial>56dd151d-1010-4dd6-9ffb-605e9d40b193</serial>
Aug 01 21:32:23 user nova-compute[72586]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 21:32:23 user nova-compute[72586]: </disk>
Aug 01 21:32:23 user nova-compute[72586]:  {{(pid=72586) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 21:32:24 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Received event <DeviceRemovedEvent: 1690925544.190368, f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72586) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 21:32:24 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-92b5b4bf-882e-4289-af63-a321b6920264 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536 {{(pid=72586) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 21:32:24 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-92b5b4bf-882e-4289-af63-a321b6920264 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Successfully detached device vdb from instance f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536 from the live domain config.
Aug 01 21:32:24 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92b5b4bf-882e-4289-af63-a321b6920264 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] calling os-brick to detach iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 21:32:24 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b5b4bf-882e-4289-af63-a321b6920264 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, {'target_iqns': ['iqn.2010-10.org.openstack:56dd151d-1010-4dd6-9ffb-605e9d40b193'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hQunaIit', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:32:24 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-92b5b4bf-882e-4289-af63-a321b6920264 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:32:24 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-92b5b4bf-882e-4289-af63-a321b6920264 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:32:24 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-92b5b4bf-882e-4289-af63-a321b6920264 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:32:24 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b5b4bf-882e-4289-af63-a321b6920264 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56dd151d-1010-4dd6-9ffb-605e9d40b193', 0)] {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 21:32:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:24 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[29371a28-d65f-4f85-b1fe-4362e4bea9c4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56dd151d-1010-4dd6-9ffb-605e9d40b193\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:24 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a96f4ae-05c8-4fe5-a18c-4a1c3a319738]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56dd151d-1010-4dd6-9ffb-605e9d40b193 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:24 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b5b4bf-882e-4289-af63-a321b6920264 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)
Aug 01 21:32:24 user nova-compute[72586]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:32:24 user nova-compute[72586]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:32:24 user nova-compute[72586]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56dd151d-1010-4dd6-9ffb-605e9d40b193 (non-flash)
Aug 01 21:32:24 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:32:24 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b5b4bf-882e-4289-af63-a321b6920264 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)
Aug 01 21:32:24 user nova-compute[72586]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:32:24 user nova-compute[72586]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:32:24 user nova-compute[72586]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56dd151d-1010-4dd6-9ffb-605e9d40b193 (non-flash)
Aug 01 21:32:24 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:32:24 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b5b4bf-882e-4289-af63-a321b6920264 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ed03d6dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56dd151d-1010-4dd6-9ffb-605e9d40b193'): ({'sdc'}, set())}) {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 21:32:24 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-92b5b4bf-882e-4289-af63-a321b6920264 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Removing single pathed devices sdc {{(pid=72586) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 21:32:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:24 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[490983e5-7ebd-4407-bc5c-0d47de5c3173]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:24 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[43cc52c2-d0ef-415a-9dfe-ec4d67d59023]: (4, ('ok\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:24 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-92b5b4bf-882e-4289-af63-a321b6920264 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Flushing IO for device /dev/sdc {{(pid=72586) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 21:32:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:24 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[72985689-f61a-479c-93de-7101764fa4d3]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:24 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-92b5b4bf-882e-4289-af63-a321b6920264 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72586) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 21:32:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:24 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd8b21c-cbf5-4fbf-8741-0009de621044]: (4, ('1', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:24 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-92b5b4bf-882e-4289-af63-a321b6920264 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 21:32:24 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-92b5b4bf-882e-4289-af63-a321b6920264 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] SCSI volumes sdc have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 21:32:24 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b5b4bf-882e-4289-af63-a321b6920264 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56dd151d-1010-4dd6-9ffb-605e9d40b193')] {{(pid=72586) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 21:32:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56dd151d-1010-4dd6-9ffb-605e9d40b193 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56dd151d-1010-4dd6-9ffb-605e9d40b193 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:24 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5d9353-7e99-4490-b498-564884bfc978]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:24 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b5b4bf-882e-4289-af63-a321b6920264 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:32:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56dd151d-1010-4dd6-9ffb-605e9d40b193 -p 172.16.0.220:3260 --logout {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56dd151d-1010-4dd6-9ffb-605e9d40b193 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:24 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52d02db-26bd-44f0-b933-13204a88cdce]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:56dd151d-1010-4dd6-9ffb-605e9d40b193, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:56dd151d-1010-4dd6-9ffb-605e9d40b193, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:24 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b5b4bf-882e-4289-af63-a321b6920264 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:56dd151d-1010-4dd6-9ffb-605e9d40b193, portal: 172.16.0.220,3260]
Aug 01 21:32:24 user nova-compute[72586]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:56dd151d-1010-4dd6-9ffb-605e9d40b193, portal: 172.16.0.220,3260] successful.
Aug 01 21:32:24 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:32:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56dd151d-1010-4dd6-9ffb-605e9d40b193 -p 172.16.0.220:3260 --op delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56dd151d-1010-4dd6-9ffb-605e9d40b193 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:24 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e9278d-8cfa-484b-828e-c528795a7fbf]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:24 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b5b4bf-882e-4289-af63-a321b6920264 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:32:24 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-92b5b4bf-882e-4289-af63-a321b6920264 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:32:24 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b5b4bf-882e-4289-af63-a321b6920264 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] <== disconnect_volume: return (290ms) None {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:32:24 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92b5b4bf-882e-4289-af63-a321b6920264 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Disconnected iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 21:32:24 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:32:25 user nova-compute[72586]: DEBUG nova.objects.instance [None req-92b5b4bf-882e-4289-af63-a321b6920264 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lazy-loading 'flavor' on Instance uuid f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:32:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-92b5b4bf-882e-4289-af63-a321b6920264 tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lock "f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.618s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG nova.compute.manager [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Start spawning the instance on the hypervisor. {{(pid=72586) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Creating instance directory {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 21:32:26 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Creating image(s)
Aug 01 21:32:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Did not create local disks {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Ensure instance console log exists: /opt/stack/data/nova/instances/314f9b05-527c-459d-aca7-acc696ac613f/console.log {{(pid=72586) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Start _get_guest_xml network_info=[{"id": "eeebb619-be12-42d7-96f3-e309b6d4cdaf", "address": "fa:16:3e:5d:69:cd", "network": {"id": "aab9a541-2149-4c65-b60e-80a1daca6632", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1355256264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19af48ffce7e4703b6d978bc3563680e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeebb619-be", "ovs_interfaceid": "eeebb619-be12-42d7-96f3-e309b6d4cdaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'roGchSeU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '314f9b05-527c-459d-aca7-acc696ac613f', 'attached_at': '', 'detached_at': '', 'volume_id': '594ff51e-685a-4144-8733-decfebb84843', 'serial': '594ff51e-685a-4144-8733-decfebb84843'}, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'b702d1c7-01ac-4e9d-b2e2-f714ff7cb946', 'delete_on_termination': True, 'volume_type': None} {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:32:26 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:32:26 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:32:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Calling os-brick to attach iSCSI Volume {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'roGchSeU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:32:26 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:32:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:32:26 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:32:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:32:26 user nova-compute[72586]: INFO os_brick.initiator.connectors.iscsi [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 21:32:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 -p 172.16.0.220:3260 {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[431ba01f-d98d-4b07-89cf-791ac687ba06]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 21:32:26 user nova-compute[72586]:  {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 -p 172.16.0.220:3260 --interface default --op new {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce75f6fa-beb2-487b-b2d1-a9dc7ec5b5b3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843] added\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843] added
Aug 01 21:32:26 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[702980d2-31fe-44d4-9af6-5ec2d050ce54]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dec6487-423a-4acc-b710-5dc912a77c42]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v roGchSeU {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v roGchSeU" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f832d00-3223-4d4e-9c75-42465988e99f]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'roGchSeU'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e02f7c9-9ecd-41b8-a39a-f2a2fbd8a4a9]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[693a138f-b598-4361-99c7-dfb87cbf7d3b]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)
Aug 01 21:32:26 user nova-compute[72586]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:32:26 user nova-compute[72586]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:32:26 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)
Aug 01 21:32:26 user nova-compute[72586]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:32:26 user nova-compute[72586]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:32:26 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 -p 172.16.0.220:3260 --login {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5a9fbd-085c-4534-8965-b2e3042fe299]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843, portal: 172.16.0.220,3260]
Aug 01 21:32:26 user nova-compute[72586]: Login to [iface: default, target: iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843, portal: 172.16.0.220,3260] successful.
Aug 01 21:32:26 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6c7965-0b8b-4a0d-9dad-e138c02d4e34]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50246f0-0320-41a6-8d44-411b712374d1]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)
Aug 01 21:32:26 user nova-compute[72586]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:32:26 user nova-compute[72586]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:32:26 user nova-compute[72586]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 (non-flash)
Aug 01 21:32:26 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)
Aug 01 21:32:26 user nova-compute[72586]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:32:26 user nova-compute[72586]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:32:26 user nova-compute[72586]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 (non-flash)
Aug 01 21:32:26 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Connected to 172.16.0.220:3260 {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] HCTL ('34', '-', '-', 0) found on session 35 with lun 0 {{(pid=72586) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72586) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0971ea-3013-4089-acad-aa5f8fff1dec]: (4, ('- - 0', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Searching for a device in session 35 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'roGchSeU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72586) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:32:26 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Auditing locally available compute resources for user (node: user) {{(pid=72586) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 21:32:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:27 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:32:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:27 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:32:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161fab9d-a7d1-4ea0-b4b9-2afc54040eef/disk.rescue --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161fab9d-a7d1-4ea0-b4b9-2afc54040eef/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161fab9d-a7d1-4ea0-b4b9-2afc54040eef/disk.rescue --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:27 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2f531e4-d15b-413e-9ae0-653ea32617a4 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 7ac93270-a352-4844-900f-cd3486658610] Calling os-brick to attach iSCSI Volume {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 21:32:27 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f531e4-d15b-413e-9ae0-653ea32617a4 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6168f95e-6eb8-40f2-ba7c-85aff08346d5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OnJPrXQx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:32:27 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-a2f531e4-d15b-413e-9ae0-653ea32617a4 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:32:27 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-a2f531e4-d15b-413e-9ae0-653ea32617a4 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:32:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161fab9d-a7d1-4ea0-b4b9-2afc54040eef/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:27 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:32:27 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '26636643961363439', 'path': '/dev/sdc'} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:32:27 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636643961363439', 'path': '/dev/sdc'} {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 21:32:27 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-a2f531e4-d15b-413e-9ae0-653ea32617a4 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.231s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:32:27 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-a2f531e4-d15b-413e-9ae0-653ea32617a4 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:32:27 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-a2f531e4-d15b-413e-9ae0-653ea32617a4 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6168f95e-6eb8-40f2-ba7c-85aff08346d5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:32:27 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-a2f531e4-d15b-413e-9ae0-653ea32617a4 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6168f95e-6eb8-40f2-ba7c-85aff08346d5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:32:27 user nova-compute[72586]: INFO os_brick.initiator.connectors.iscsi [None req-a2f531e4-d15b-413e-9ae0-653ea32617a4 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 21:32:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6168f95e-6eb8-40f2-ba7c-85aff08346d5 -p 172.16.0.220:3260 {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6168f95e-6eb8-40f2-ba7c-85aff08346d5 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:27 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[657505af-3842-4041-bfc1-6303db1be9fe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:27 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f531e4-d15b-413e-9ae0-653ea32617a4 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 21:32:27 user nova-compute[72586]:  {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:32:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6168f95e-6eb8-40f2-ba7c-85aff08346d5 -p 172.16.0.220:3260 --interface default --op new {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6168f95e-6eb8-40f2-ba7c-85aff08346d5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:27 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d99970-f0d1-4abe-8b80-b388282316a3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6168f95e-6eb8-40f2-ba7c-85aff08346d5] added\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:27 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f531e4-d15b-413e-9ae0-653ea32617a4 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6168f95e-6eb8-40f2-ba7c-85aff08346d5] added
Aug 01 21:32:27 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:32:27 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:32:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-400634865',display_name='tempest-ServerActionsTestOtherA-server-400634865',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-400634865',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPk4vuGAtPXP/Itqq7TbQ+6Sv+k5bpNQFeCgGdApIPBaVaeUmQBoiJZa5I5091aDIuYBB7Uba3sQDG1YP/kTFSXvqkIW2yu6s2YyWP+iKPKZLzdQkqmU2IfIy2EEsidssA==',key_name='tempest-keypair-400537691',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='19af48ffce7e4703b6d978bc3563680e',ramdisk_id='',reservation_id='r-0fzqwm4s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-825165282',owner_user_name='tempest-ServerActionsTestOtherA-825165282-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:32:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88d01b1101164c859b19d41e251447a5',uuid=314f9b05-527c-459d-aca7-acc696ac613f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eeebb619-be12-42d7-96f3-e309b6d4cdaf", "address": "fa:16:3e:5d:69:cd", "network": {"id": "aab9a541-2149-4c65-b60e-80a1daca6632", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1355256264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19af48ffce7e4703b6d978bc3563680e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeebb619-be", "ovs_interfaceid": "eeebb619-be12-42d7-96f3-e309b6d4cdaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:32:27 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Converting VIF {"id": "eeebb619-be12-42d7-96f3-e309b6d4cdaf", "address": "fa:16:3e:5d:69:cd", "network": {"id": "aab9a541-2149-4c65-b60e-80a1daca6632", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1355256264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19af48ffce7e4703b6d978bc3563680e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeebb619-be", "ovs_interfaceid": "eeebb619-be12-42d7-96f3-e309b6d4cdaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:32:27 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:69:cd,bridge_name='br-int',has_traffic_filtering=True,id=eeebb619-be12-42d7-96f3-e309b6d4cdaf,network=Network(aab9a541-2149-4c65-b60e-80a1daca6632),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeebb619-be') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:32:27 user nova-compute[72586]: DEBUG nova.objects.instance [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lazy-loading 'pci_devices' on Instance uuid 314f9b05-527c-459d-aca7-acc696ac613f {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:32:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6168f95e-6eb8-40f2-ba7c-85aff08346d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6168f95e-6eb8-40f2-ba7c-85aff08346d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:27 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:32:27 user nova-compute[72586]:   <uuid>314f9b05-527c-459d-aca7-acc696ac613f</uuid>
Aug 01 21:32:27 user nova-compute[72586]:   <name>instance-0000001d</name>
Aug 01 21:32:27 user nova-compute[72586]:   <memory>524288</memory>
Aug 01 21:32:27 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:32:27 user nova-compute[72586]:   <metadata>
Aug 01 21:32:27 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:32:27 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:32:27 user nova-compute[72586]:       <nova:name>tempest-ServerActionsTestOtherA-server-400634865</nova:name>
Aug 01 21:32:27 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:32:26</nova:creationTime>
Aug 01 21:32:27 user nova-compute[72586]:       <nova:flavor name="m1.tiny">
Aug 01 21:32:27 user nova-compute[72586]:         <nova:memory>512</nova:memory>
Aug 01 21:32:27 user nova-compute[72586]:         <nova:disk>1</nova:disk>
Aug 01 21:32:27 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:32:27 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:32:27 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:32:27 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:32:27 user nova-compute[72586]:       <nova:owner>
Aug 01 21:32:27 user nova-compute[72586]:         <nova:user uuid="88d01b1101164c859b19d41e251447a5">tempest-ServerActionsTestOtherA-825165282-project-member</nova:user>
Aug 01 21:32:27 user nova-compute[72586]:         <nova:project uuid="19af48ffce7e4703b6d978bc3563680e">tempest-ServerActionsTestOtherA-825165282</nova:project>
Aug 01 21:32:27 user nova-compute[72586]:       </nova:owner>
Aug 01 21:32:27 user nova-compute[72586]:       <nova:ports>
Aug 01 21:32:27 user nova-compute[72586]:         <nova:port uuid="eeebb619-be12-42d7-96f3-e309b6d4cdaf">
Aug 01 21:32:27 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 01 21:32:27 user nova-compute[72586]:         </nova:port>
Aug 01 21:32:27 user nova-compute[72586]:       </nova:ports>
Aug 01 21:32:27 user nova-compute[72586]:     </nova:instance>
Aug 01 21:32:27 user nova-compute[72586]:   </metadata>
Aug 01 21:32:27 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:32:27 user nova-compute[72586]:     <system>
Aug 01 21:32:27 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:32:27 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:32:27 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:32:27 user nova-compute[72586]:       <entry name="serial">314f9b05-527c-459d-aca7-acc696ac613f</entry>
Aug 01 21:32:27 user nova-compute[72586]:       <entry name="uuid">314f9b05-527c-459d-aca7-acc696ac613f</entry>
Aug 01 21:32:27 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:32:27 user nova-compute[72586]:     </system>
Aug 01 21:32:27 user nova-compute[72586]:   </sysinfo>
Aug 01 21:32:27 user nova-compute[72586]:   <os>
Aug 01 21:32:27 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:32:27 user nova-compute[72586]:     <boot dev="hd"/>
Aug 01 21:32:27 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:32:27 user nova-compute[72586]:   </os>
Aug 01 21:32:27 user nova-compute[72586]:   <features>
Aug 01 21:32:27 user nova-compute[72586]:     <acpi/>
Aug 01 21:32:27 user nova-compute[72586]:     <apic/>
Aug 01 21:32:27 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:32:27 user nova-compute[72586]:   </features>
Aug 01 21:32:27 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:32:27 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:32:27 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:32:27 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:32:27 user nova-compute[72586]:   </clock>
Aug 01 21:32:27 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:32:27 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:32:27 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:32:27 user nova-compute[72586]:   </cpu>
Aug 01 21:32:27 user nova-compute[72586]:   <devices>
Aug 01 21:32:27 user nova-compute[72586]:     <disk type="block" device="disk">
Aug 01 21:32:27 user nova-compute[72586]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:32:27 user nova-compute[72586]:       <source dev="/dev/sdc"/>
Aug 01 21:32:27 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:32:27 user nova-compute[72586]:       <serial>594ff51e-685a-4144-8733-decfebb84843</serial>
Aug 01 21:32:27 user nova-compute[72586]:     </disk>
Aug 01 21:32:27 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:32:27 user nova-compute[72586]:       <mac address="fa:16:3e:5d:69:cd"/>
Aug 01 21:32:27 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:32:27 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:32:27 user nova-compute[72586]:       <target dev="tapeeebb619-be"/>
Aug 01 21:32:27 user nova-compute[72586]:     </interface>
Aug 01 21:32:27 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:32:27 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/314f9b05-527c-459d-aca7-acc696ac613f/console.log" append="off"/>
Aug 01 21:32:27 user nova-compute[72586]:     </serial>
Aug 01 21:32:27 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:32:27 user nova-compute[72586]:     <video>
Aug 01 21:32:27 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:32:27 user nova-compute[72586]:     </video>
Aug 01 21:32:27 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:32:27 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:32:27 user nova-compute[72586]:     </rng>
Aug 01 21:32:27 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:32:27 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:32:27 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:32:27 user nova-compute[72586]:     </memballoon>
Aug 01 21:32:27 user nova-compute[72586]:   </devices>
Aug 01 21:32:27 user nova-compute[72586]: </domain>
Aug 01 21:32:27 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:32:27 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:32:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-400634865',display_name='tempest-ServerActionsTestOtherA-server-400634865',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-400634865',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPk4vuGAtPXP/Itqq7TbQ+6Sv+k5bpNQFeCgGdApIPBaVaeUmQBoiJZa5I5091aDIuYBB7Uba3sQDG1YP/kTFSXvqkIW2yu6s2YyWP+iKPKZLzdQkqmU2IfIy2EEsidssA==',key_name='tempest-keypair-400537691',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='19af48ffce7e4703b6d978bc3563680e',ramdisk_id='',reservation_id='r-0fzqwm4s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-825165282',owner_user_name='tempest-ServerActionsTestOtherA-825165282-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:32:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88d01b1101164c859b19d41e251447a5',uuid=314f9b05-527c-459d-aca7-acc696ac613f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eeebb619-be12-42d7-96f3-e309b6d4cdaf", "address": "fa:16:3e:5d:69:cd", "network": {"id": "aab9a541-2149-4c65-b60e-80a1daca6632", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1355256264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19af48ffce7e4703b6d978bc3563680e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeebb619-be", "ovs_interfaceid": "eeebb619-be12-42d7-96f3-e309b6d4cdaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:32:27 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Converting VIF {"id": "eeebb619-be12-42d7-96f3-e309b6d4cdaf", "address": "fa:16:3e:5d:69:cd", "network": {"id": "aab9a541-2149-4c65-b60e-80a1daca6632", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1355256264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19af48ffce7e4703b6d978bc3563680e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeebb619-be", "ovs_interfaceid": "eeebb619-be12-42d7-96f3-e309b6d4cdaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:32:27 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:69:cd,bridge_name='br-int',has_traffic_filtering=True,id=eeebb619-be12-42d7-96f3-e309b6d4cdaf,network=Network(aab9a541-2149-4c65-b60e-80a1daca6632),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeebb619-be') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:32:27 user nova-compute[72586]: DEBUG os_vif [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:69:cd,bridge_name='br-int',has_traffic_filtering=True,id=eeebb619-be12-42d7-96f3-e309b6d4cdaf,network=Network(aab9a541-2149-4c65-b60e-80a1daca6632),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeebb619-be') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:32:27 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:32:27 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:32:27 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:32:27 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[43341dfc-82d9-401a-bc99-a57fd8b5b921]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:27 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f531e4-d15b-413e-9ae0-653ea32617a4 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:32:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6168f95e-6eb8-40f2-ba7c-85aff08346d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:27 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:32:27 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeeebb619-be, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:32:27 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapeeebb619-be, col_values=(('external_ids', {'iface-id': 'eeebb619-be12-42d7-96f3-e309b6d4cdaf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:69:cd', 'vm-uuid': '314f9b05-527c-459d-aca7-acc696ac613f'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:32:27 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:32:27 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:32:27 user nova-compute[72586]: INFO os_vif [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:69:cd,bridge_name='br-int',has_traffic_filtering=True,id=eeebb619-be12-42d7-96f3-e309b6d4cdaf,network=Network(aab9a541-2149-4c65-b60e-80a1daca6632),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeebb619-be')
Aug 01 21:32:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6168f95e-6eb8-40f2-ba7c-85aff08346d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:27 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6393af-9937-4a69-971f-95c9c3ef4c15]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:27 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f531e4-d15b-413e-9ae0-653ea32617a4 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:32:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6168f95e-6eb8-40f2-ba7c-85aff08346d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OnJPrXQx {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:27 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:32:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6168f95e-6eb8-40f2-ba7c-85aff08346d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OnJPrXQx" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:27 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c360f0-58e2-46f6-b6c1-57e4229cc8cf]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:27 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f531e4-d15b-413e-9ae0-653ea32617a4 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OnJPrXQx'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:32:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6168f95e-6eb8-40f2-ba7c-85aff08346d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6168f95e-6eb8-40f2-ba7c-85aff08346d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:28 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[991dcb73-0745-4892-93e6-95a630e497f4]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:28 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f531e4-d15b-413e-9ae0-653ea32617a4 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:32:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:28 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:32:28 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] No VIF found with MAC fa:16:3e:5d:69:cd, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:32:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:28 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d26408-602c-4100-a975-cc0fd78f2fee]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:28 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f531e4-d15b-413e-9ae0-653ea32617a4 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)
Aug 01 21:32:28 user nova-compute[72586]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:32:28 user nova-compute[72586]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:32:28 user nova-compute[72586]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 (non-flash)
Aug 01 21:32:28 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:32:28 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f531e4-d15b-413e-9ae0-653ea32617a4 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)
Aug 01 21:32:28 user nova-compute[72586]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:32:28 user nova-compute[72586]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:32:28 user nova-compute[72586]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 (non-flash)
Aug 01 21:32:28 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:32:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6168f95e-6eb8-40f2-ba7c-85aff08346d5 -p 172.16.0.220:3260 --login {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6168f95e-6eb8-40f2-ba7c-85aff08346d5 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:28 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4dedda-89e5-4923-94cb-367c80022981]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6168f95e-6eb8-40f2-ba7c-85aff08346d5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6168f95e-6eb8-40f2-ba7c-85aff08346d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:28 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f531e4-d15b-413e-9ae0-653ea32617a4 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6168f95e-6eb8-40f2-ba7c-85aff08346d5, portal: 172.16.0.220,3260]
Aug 01 21:32:28 user nova-compute[72586]: Login to [iface: default, target: iqn.2010-10.org.openstack:6168f95e-6eb8-40f2-ba7c-85aff08346d5, portal: 172.16.0.220,3260] successful.
Aug 01 21:32:28 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:32:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6168f95e-6eb8-40f2-ba7c-85aff08346d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6168f95e-6eb8-40f2-ba7c-85aff08346d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.193s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:28 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6e077e-1e34-4a81-b9a4-d6a607344464]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:28 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f531e4-d15b-413e-9ae0-653ea32617a4 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:32:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:28 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d718cef-6946-4a68-bf74-2582738b2c9d]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6168f95e-6eb8-40f2-ba7c-85aff08346d5 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:28 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f531e4-d15b-413e-9ae0-653ea32617a4 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)
Aug 01 21:32:28 user nova-compute[72586]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:32:28 user nova-compute[72586]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:32:28 user nova-compute[72586]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 (non-flash)
Aug 01 21:32:28 user nova-compute[72586]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6168f95e-6eb8-40f2-ba7c-85aff08346d5 (non-flash)
Aug 01 21:32:28 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:32:28 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f531e4-d15b-413e-9ae0-653ea32617a4 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)
Aug 01 21:32:28 user nova-compute[72586]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:32:28 user nova-compute[72586]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:32:28 user nova-compute[72586]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 (non-flash)
Aug 01 21:32:28 user nova-compute[72586]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6168f95e-6eb8-40f2-ba7c-85aff08346d5 (non-flash)
Aug 01 21:32:28 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:32:28 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-a2f531e4-d15b-413e-9ae0-653ea32617a4 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6168f95e-6eb8-40f2-ba7c-85aff08346d5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.599s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:32:28 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f531e4-d15b-413e-9ae0-653ea32617a4 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Connected to 172.16.0.220:3260 {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 21:32:28 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-a2f531e4-d15b-413e-9ae0-653ea32617a4 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] HCTL ('36', '-', '-', 0) found on session 36 with lun 0 {{(pid=72586) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 21:32:28 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-a2f531e4-d15b-413e-9ae0-653ea32617a4 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72586) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 21:32:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:28 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a146bf5-694e-4acd-abd5-c774857bcedf]: (4, ('- - 0', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:28 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-a2f531e4-d15b-413e-9ae0-653ea32617a4 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Searching for a device in session 36 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:32:28 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f531e4-d15b-413e-9ae0-653ea32617a4 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OnJPrXQx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 21:32:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b0d907-2515-4a06-8b35-9ddd09ce42c3/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b0d907-2515-4a06-8b35-9ddd09ce42c3/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b0d907-2515-4a06-8b35-9ddd09ce42c3/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:32:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b0d907-2515-4a06-8b35-9ddd09ce42c3/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:32:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:32:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:29 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-a2f531e4-d15b-413e-9ae0-653ea32617a4 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.650s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:32:29 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f531e4-d15b-413e-9ae0-653ea32617a4 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] <== connect_volume: return (1885ms) {'type': 'block', 'scsi_wwn': '26337633664323733', 'path': '/dev/sde'} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:32:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2f531e4-d15b-413e-9ae0-653ea32617a4 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 7ac93270-a352-4844-900f-cd3486658610] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26337633664323733', 'path': '/dev/sde'} {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 21:32:29 user nova-compute[72586]: DEBUG nova.objects.instance [None req-a2f531e4-d15b-413e-9ae0-653ea32617a4 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lazy-loading 'flavor' on Instance uuid 7ac93270-a352-4844-900f-cd3486658610 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:32:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-a2f531e4-d15b-413e-9ae0-653ea32617a4 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 21:32:29 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:32:29 user nova-compute[72586]:   <source dev="/dev/sde"/>
Aug 01 21:32:29 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:32:29 user nova-compute[72586]:   <serial>6168f95e-6eb8-40f2-ba7c-85aff08346d5</serial>
Aug 01 21:32:29 user nova-compute[72586]: </disk>
Aug 01 21:32:29 user nova-compute[72586]:  {{(pid=72586) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 21:32:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:32:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:32:29 user nova-compute[72586]: DEBUG nova.compute.manager [req-63f899dd-ddc9-4a35-afbe-9a9e2a719c8f req-88216dd2-77d5-42f6-9eab-64f885c28b2c service nova] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Received event network-vif-plugged-eeebb619-be12-42d7-96f3-e309b6d4cdaf {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:32:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-63f899dd-ddc9-4a35-afbe-9a9e2a719c8f req-88216dd2-77d5-42f6-9eab-64f885c28b2c service nova] Acquiring lock "314f9b05-527c-459d-aca7-acc696ac613f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:32:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-63f899dd-ddc9-4a35-afbe-9a9e2a719c8f req-88216dd2-77d5-42f6-9eab-64f885c28b2c service nova] Lock "314f9b05-527c-459d-aca7-acc696ac613f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:32:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-63f899dd-ddc9-4a35-afbe-9a9e2a719c8f req-88216dd2-77d5-42f6-9eab-64f885c28b2c service nova] Lock "314f9b05-527c-459d-aca7-acc696ac613f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:32:29 user nova-compute[72586]: DEBUG nova.compute.manager [req-63f899dd-ddc9-4a35-afbe-9a9e2a719c8f req-88216dd2-77d5-42f6-9eab-64f885c28b2c service nova] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] No waiting events found dispatching network-vif-plugged-eeebb619-be12-42d7-96f3-e309b6d4cdaf {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:32:29 user nova-compute[72586]: WARNING nova.compute.manager [req-63f899dd-ddc9-4a35-afbe-9a9e2a719c8f req-88216dd2-77d5-42f6-9eab-64f885c28b2c service nova] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Received unexpected event network-vif-plugged-eeebb619-be12-42d7-96f3-e309b6d4cdaf for instance with vm_state building and task_state spawning.
Aug 01 21:32:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9b8f9c5-0129-429d-beb6-26d4c9cc085d/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9b8f9c5-0129-429d-beb6-26d4c9cc085d/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9b8f9c5-0129-429d-beb6-26d4c9cc085d/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9b8f9c5-0129-429d-beb6-26d4c9cc085d/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.rescue --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.rescue --force-share --output=json" returned: 0 in 0.159s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.rescue --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:30 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-a2f531e4-d15b-413e-9ae0-653ea32617a4 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:32:30 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-a2f531e4-d15b-413e-9ae0-653ea32617a4 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:32:30 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-a2f531e4-d15b-413e-9ae0-653ea32617a4 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] No VIF found with MAC fa:16:3e:c4:bc:0a, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:32:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:30 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a2f531e4-d15b-413e-9ae0-653ea32617a4 tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lock "7ac93270-a352-4844-900f-cd3486658610" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.284s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:32:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ac93270-a352-4844-900f-cd3486658610/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ac93270-a352-4844-900f-cd3486658610/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ac93270-a352-4844-900f-cd3486658610/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ac93270-a352-4844-900f-cd3486658610/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:30 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:32:32 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925551.9008956, 314f9b05-527c-459d-aca7-acc696ac613f => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:32:32 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] VM Resumed (Lifecycle Event)
Aug 01 21:32:32 user nova-compute[72586]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690925537.178472, 09571c9f-bf42-475a-afac-0e3947168d7e => Stopped> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:32:32 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] VM Stopped (Lifecycle Event)
Aug 01 21:32:32 user nova-compute[72586]: DEBUG nova.compute.manager [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Instance event wait completed in 0 seconds for  {{(pid=72586) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 21:32:32 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Guest created on hypervisor {{(pid=72586) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 21:32:32 user nova-compute[72586]: DEBUG nova.compute.manager [req-ec4a52c3-3629-4704-8c6d-c6a2f5905b62 req-60a86501-06ed-452d-a257-7701e2c57c96 service nova] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Received event network-vif-plugged-eeebb619-be12-42d7-96f3-e309b6d4cdaf {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:32:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ec4a52c3-3629-4704-8c6d-c6a2f5905b62 req-60a86501-06ed-452d-a257-7701e2c57c96 service nova] Acquiring lock "314f9b05-527c-459d-aca7-acc696ac613f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:32:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ec4a52c3-3629-4704-8c6d-c6a2f5905b62 req-60a86501-06ed-452d-a257-7701e2c57c96 service nova] Lock "314f9b05-527c-459d-aca7-acc696ac613f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:32:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ec4a52c3-3629-4704-8c6d-c6a2f5905b62 req-60a86501-06ed-452d-a257-7701e2c57c96 service nova] Lock "314f9b05-527c-459d-aca7-acc696ac613f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:32:32 user nova-compute[72586]: DEBUG nova.compute.manager [req-ec4a52c3-3629-4704-8c6d-c6a2f5905b62 req-60a86501-06ed-452d-a257-7701e2c57c96 service nova] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] No waiting events found dispatching network-vif-plugged-eeebb619-be12-42d7-96f3-e309b6d4cdaf {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:32:32 user nova-compute[72586]: WARNING nova.compute.manager [req-ec4a52c3-3629-4704-8c6d-c6a2f5905b62 req-60a86501-06ed-452d-a257-7701e2c57c96 service nova] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Received unexpected event network-vif-plugged-eeebb619-be12-42d7-96f3-e309b6d4cdaf for instance with vm_state building and task_state spawning.
Aug 01 21:32:32 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:32:32 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:32:32 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:32:32 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:32:32 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Hypervisor/Node resource view: name=user free_ram=7051MB free_disk=25.139850616455078GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72586) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 21:32:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:32:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:32:32 user nova-compute[72586]: DEBUG nova.compute.manager [None req-a4363481-079b-421f-b07b-ee60156b95a3 None None] [instance: 09571c9f-bf42-475a-afac-0e3947168d7e] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:32:32 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Instance spawned successfully.
Aug 01 21:32:32 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 21:32:32 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:32:32 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925551.9017966, 314f9b05-527c-459d-aca7-acc696ac613f => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:32:32 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] VM Started (Lifecycle Event)
Aug 01 21:32:32 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Found default for hw_cdrom_bus of ide {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:32:32 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Found default for hw_disk_bus of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:32:32 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Found default for hw_input_bus of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:32:32 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Found default for hw_pointer_model of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:32:32 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Found default for hw_video_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:32:32 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Found default for hw_vif_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:32:32 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:32:32 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:32:32 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:32:32 user nova-compute[72586]: INFO nova.compute.manager [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Took 5.89 seconds to spawn the instance on the hypervisor.
Aug 01 21:32:32 user nova-compute[72586]: DEBUG nova.compute.manager [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:32:32 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 042f0031-1e4d-41d0-8bfa-36001675cfe3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:32:32 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 413c3426-18ad-4a5c-af04-e0e7fc90f050 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:32:32 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 49c24c77-f102-4aed-8314-b04aad5f6b3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:32:32 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:32:32 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance af2de810-b22f-4fa9-835c-c673abd145db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:32:32 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance f6b0d907-2515-4a06-8b35-9ddd09ce42c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:32:32 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance c3798403-855b-45e4-af48-ba6b62570dba actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:32:32 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 161fab9d-a7d1-4ea0-b4b9-2afc54040eef actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:32:32 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 7ac93270-a352-4844-900f-cd3486658610 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:32:32 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance f9b8f9c5-0129-429d-beb6-26d4c9cc085d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:32:32 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:32:32 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 314f9b05-527c-459d-aca7-acc696ac613f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:32:32 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 21:32:32 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 21:32:32 user nova-compute[72586]: INFO nova.compute.manager [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Took 15.27 seconds to build instance.
Aug 01 21:32:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-ac5a3d63-8d3b-4be1-b1c2-01a7a1b57c5b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "314f9b05-527c-459d-aca7-acc696ac613f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.415s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:32:32 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:32:32 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:32:32 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Compute_service record updated for user:user {{(pid=72586) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 21:32:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.572s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:32:32 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:32:33 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:32:33 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:32:33 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Starting heal instance info cache {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 21:32:34 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "refresh_cache-f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:32:34 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquired lock "refresh_cache-f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:32:34 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Forcefully refreshing network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 21:32:34 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:32:35 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Updating instance_info_cache with network_info: [{"id": "c9c37169-5d08-49e3-9fdf-705b9bbe1d2f", "address": "fa:16:3e:ac:44:36", "network": {"id": "9ac81b44-4ebf-4780-8146-bebeb56a36b8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1925422576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6493ab8139843b191e013e61f12c877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9c37169-5d", "ovs_interfaceid": "c9c37169-5d08-49e3-9fdf-705b9bbe1d2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:32:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Releasing lock "refresh_cache-f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:32:35 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Updated the network info_cache for instance {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 21:32:35 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:32:35 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:32:35 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:32:35 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:32:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:32:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:32:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:32:42 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:32:43 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-59e5edb7-40f3-4c3a-bba2-067004fd1317 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Acquiring lock "f9b8f9c5-0129-429d-beb6-26d4c9cc085d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:32:43 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-59e5edb7-40f3-4c3a-bba2-067004fd1317 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "f9b8f9c5-0129-429d-beb6-26d4c9cc085d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:32:43 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-59e5edb7-40f3-4c3a-bba2-067004fd1317 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Acquiring lock "f9b8f9c5-0129-429d-beb6-26d4c9cc085d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:32:43 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-59e5edb7-40f3-4c3a-bba2-067004fd1317 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "f9b8f9c5-0129-429d-beb6-26d4c9cc085d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:32:43 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-59e5edb7-40f3-4c3a-bba2-067004fd1317 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "f9b8f9c5-0129-429d-beb6-26d4c9cc085d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:32:43 user nova-compute[72586]: INFO nova.compute.manager [None req-59e5edb7-40f3-4c3a-bba2-067004fd1317 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Terminating instance
Aug 01 21:32:43 user nova-compute[72586]: DEBUG nova.compute.manager [None req-59e5edb7-40f3-4c3a-bba2-067004fd1317 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Start destroying the instance on the hypervisor. {{(pid=72586) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 21:32:43 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:32:43 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:32:43 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:32:43 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:32:43 user nova-compute[72586]: DEBUG nova.compute.manager [req-c2a04916-d1bc-47ad-a3cd-cc57a40a8286 req-5f34a512-4ad9-4958-86c2-bc92c8eee2fc service nova] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Received event network-vif-unplugged-46cc59ac-efc1-40c1-8a70-b848a9980413 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:32:43 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-c2a04916-d1bc-47ad-a3cd-cc57a40a8286 req-5f34a512-4ad9-4958-86c2-bc92c8eee2fc service nova] Acquiring lock "f9b8f9c5-0129-429d-beb6-26d4c9cc085d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:32:43 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-c2a04916-d1bc-47ad-a3cd-cc57a40a8286 req-5f34a512-4ad9-4958-86c2-bc92c8eee2fc service nova] Lock "f9b8f9c5-0129-429d-beb6-26d4c9cc085d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:32:43 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-c2a04916-d1bc-47ad-a3cd-cc57a40a8286 req-5f34a512-4ad9-4958-86c2-bc92c8eee2fc service nova] Lock "f9b8f9c5-0129-429d-beb6-26d4c9cc085d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:32:43 user nova-compute[72586]: DEBUG nova.compute.manager [req-c2a04916-d1bc-47ad-a3cd-cc57a40a8286 req-5f34a512-4ad9-4958-86c2-bc92c8eee2fc service nova] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] No waiting events found dispatching network-vif-unplugged-46cc59ac-efc1-40c1-8a70-b848a9980413 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:32:43 user nova-compute[72586]: DEBUG nova.compute.manager [req-c2a04916-d1bc-47ad-a3cd-cc57a40a8286 req-5f34a512-4ad9-4958-86c2-bc92c8eee2fc service nova] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Received event network-vif-unplugged-46cc59ac-efc1-40c1-8a70-b848a9980413 for instance with task_state deleting. {{(pid=72586) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 21:32:44 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:32:44 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:32:44 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:32:44 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Instance destroyed successfully.
Aug 01 21:32:44 user nova-compute[72586]: DEBUG nova.objects.instance [None req-59e5edb7-40f3-4c3a-bba2-067004fd1317 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lazy-loading 'resources' on Instance uuid f9b8f9c5-0129-429d-beb6-26d4c9cc085d {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:32:44 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:32:44 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-59e5edb7-40f3-4c3a-bba2-067004fd1317 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T21:27:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-752033639',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-752033639',id=21,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK+9xUA7KLirmjYXQN9xELNaip42kAK1K7NxqLVfWWWYEllpiSswXBraxjyOXQGON5DFb+0ISh6DPQXFXhdjXqTtRm5876SEIwEXMmgsj++30+zSSmVyL8OhHncTWDSK7g==',key_name='tempest-keypair-105460435',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:31:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae659e4ad43c44e2a8f6d48818bb796a',ramdisk_id='',reservation_id='r-odyjetm7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1935542868',owner_user_name='tempest-AttachVolumeShelveTestJSON-1935542868-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:31:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1a0d71c79c04216b9bf278f650aeb77',uuid=f9b8f9c5-0129-429d-beb6-26d4c9cc085d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "46cc59ac-efc1-40c1-8a70-b848a9980413", "address": "fa:16:3e:6b:e7:10", "network": {"id": "a5da07bc-2f5d-461e-b31f-df624d9c6557", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948878141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae659e4ad43c44e2a8f6d48818bb796a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46cc59ac-ef", "ovs_interfaceid": "46cc59ac-efc1-40c1-8a70-b848a9980413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:32:44 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-59e5edb7-40f3-4c3a-bba2-067004fd1317 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Converting VIF {"id": "46cc59ac-efc1-40c1-8a70-b848a9980413", "address": "fa:16:3e:6b:e7:10", "network": {"id": "a5da07bc-2f5d-461e-b31f-df624d9c6557", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948878141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae659e4ad43c44e2a8f6d48818bb796a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46cc59ac-ef", "ovs_interfaceid": "46cc59ac-efc1-40c1-8a70-b848a9980413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:32:44 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-59e5edb7-40f3-4c3a-bba2-067004fd1317 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:e7:10,bridge_name='br-int',has_traffic_filtering=True,id=46cc59ac-efc1-40c1-8a70-b848a9980413,network=Network(a5da07bc-2f5d-461e-b31f-df624d9c6557),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46cc59ac-ef') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:32:44 user nova-compute[72586]: DEBUG os_vif [None req-59e5edb7-40f3-4c3a-bba2-067004fd1317 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:e7:10,bridge_name='br-int',has_traffic_filtering=True,id=46cc59ac-efc1-40c1-8a70-b848a9980413,network=Network(a5da07bc-2f5d-461e-b31f-df624d9c6557),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46cc59ac-ef') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:32:44 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:32:44 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap46cc59ac-ef, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:32:44 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:32:44 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:32:44 user nova-compute[72586]: INFO os_vif [None req-59e5edb7-40f3-4c3a-bba2-067004fd1317 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:e7:10,bridge_name='br-int',has_traffic_filtering=True,id=46cc59ac-efc1-40c1-8a70-b848a9980413,network=Network(a5da07bc-2f5d-461e-b31f-df624d9c6557),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46cc59ac-ef')
Aug 01 21:32:44 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-59e5edb7-40f3-4c3a-bba2-067004fd1317 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Deleting instance files /opt/stack/data/nova/instances/f9b8f9c5-0129-429d-beb6-26d4c9cc085d_del
Aug 01 21:32:44 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-59e5edb7-40f3-4c3a-bba2-067004fd1317 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Deletion of /opt/stack/data/nova/instances/f9b8f9c5-0129-429d-beb6-26d4c9cc085d_del complete
Aug 01 21:32:44 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:32:44 user nova-compute[72586]: INFO nova.compute.manager [None req-59e5edb7-40f3-4c3a-bba2-067004fd1317 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Took 0.76 seconds to destroy the instance on the hypervisor.
Aug 01 21:32:44 user nova-compute[72586]: DEBUG oslo.service.loopingcall [None req-59e5edb7-40f3-4c3a-bba2-067004fd1317 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72586) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 21:32:44 user nova-compute[72586]: DEBUG nova.compute.manager [-] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Deallocating network for instance {{(pid=72586) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 21:32:44 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] deallocate_for_instance() {{(pid=72586) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 21:32:44 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:32:44 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:32:44 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:32:44 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:32:44 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:32:45 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:32:45 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Took 1.25 seconds to deallocate network for instance.
Aug 01 21:32:45 user nova-compute[72586]: DEBUG nova.compute.manager [req-6a5ec648-2233-4acb-acb2-b457bd8341f5 req-19ceeb8d-894b-45ce-8e89-78183363e5a0 service nova] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Received event network-vif-deleted-46cc59ac-efc1-40c1-8a70-b848a9980413 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:32:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-59e5edb7-40f3-4c3a-bba2-067004fd1317 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:32:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-59e5edb7-40f3-4c3a-bba2-067004fd1317 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:32:45 user nova-compute[72586]: DEBUG nova.compute.manager [req-fff932e1-e70e-4fa6-a2d9-99434652e9f7 req-4c898258-73fc-4208-ae6b-a582b5642578 service nova] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Received event network-vif-plugged-46cc59ac-efc1-40c1-8a70-b848a9980413 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:32:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-fff932e1-e70e-4fa6-a2d9-99434652e9f7 req-4c898258-73fc-4208-ae6b-a582b5642578 service nova] Acquiring lock "f9b8f9c5-0129-429d-beb6-26d4c9cc085d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:32:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-fff932e1-e70e-4fa6-a2d9-99434652e9f7 req-4c898258-73fc-4208-ae6b-a582b5642578 service nova] Lock "f9b8f9c5-0129-429d-beb6-26d4c9cc085d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:32:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-fff932e1-e70e-4fa6-a2d9-99434652e9f7 req-4c898258-73fc-4208-ae6b-a582b5642578 service nova] Lock "f9b8f9c5-0129-429d-beb6-26d4c9cc085d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:32:45 user nova-compute[72586]: DEBUG nova.compute.manager [req-fff932e1-e70e-4fa6-a2d9-99434652e9f7 req-4c898258-73fc-4208-ae6b-a582b5642578 service nova] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] No waiting events found dispatching network-vif-plugged-46cc59ac-efc1-40c1-8a70-b848a9980413 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:32:45 user nova-compute[72586]: WARNING nova.compute.manager [req-fff932e1-e70e-4fa6-a2d9-99434652e9f7 req-4c898258-73fc-4208-ae6b-a582b5642578 service nova] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Received unexpected event network-vif-plugged-46cc59ac-efc1-40c1-8a70-b848a9980413 for instance with vm_state deleted and task_state None.
Aug 01 21:32:45 user nova-compute[72586]: DEBUG nova.compute.manager [req-fff932e1-e70e-4fa6-a2d9-99434652e9f7 req-4c898258-73fc-4208-ae6b-a582b5642578 service nova] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Received event network-vif-plugged-46cc59ac-efc1-40c1-8a70-b848a9980413 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:32:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-fff932e1-e70e-4fa6-a2d9-99434652e9f7 req-4c898258-73fc-4208-ae6b-a582b5642578 service nova] Acquiring lock "f9b8f9c5-0129-429d-beb6-26d4c9cc085d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:32:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-fff932e1-e70e-4fa6-a2d9-99434652e9f7 req-4c898258-73fc-4208-ae6b-a582b5642578 service nova] Lock "f9b8f9c5-0129-429d-beb6-26d4c9cc085d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:32:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-fff932e1-e70e-4fa6-a2d9-99434652e9f7 req-4c898258-73fc-4208-ae6b-a582b5642578 service nova] Lock "f9b8f9c5-0129-429d-beb6-26d4c9cc085d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:32:45 user nova-compute[72586]: DEBUG nova.compute.manager [req-fff932e1-e70e-4fa6-a2d9-99434652e9f7 req-4c898258-73fc-4208-ae6b-a582b5642578 service nova] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] No waiting events found dispatching network-vif-plugged-46cc59ac-efc1-40c1-8a70-b848a9980413 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:32:45 user nova-compute[72586]: WARNING nova.compute.manager [req-fff932e1-e70e-4fa6-a2d9-99434652e9f7 req-4c898258-73fc-4208-ae6b-a582b5642578 service nova] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Received unexpected event network-vif-plugged-46cc59ac-efc1-40c1-8a70-b848a9980413 for instance with vm_state deleted and task_state None.
Aug 01 21:32:45 user nova-compute[72586]: DEBUG nova.compute.manager [req-fff932e1-e70e-4fa6-a2d9-99434652e9f7 req-4c898258-73fc-4208-ae6b-a582b5642578 service nova] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Received event network-vif-plugged-46cc59ac-efc1-40c1-8a70-b848a9980413 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:32:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-fff932e1-e70e-4fa6-a2d9-99434652e9f7 req-4c898258-73fc-4208-ae6b-a582b5642578 service nova] Acquiring lock "f9b8f9c5-0129-429d-beb6-26d4c9cc085d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:32:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-fff932e1-e70e-4fa6-a2d9-99434652e9f7 req-4c898258-73fc-4208-ae6b-a582b5642578 service nova] Lock "f9b8f9c5-0129-429d-beb6-26d4c9cc085d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:32:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-fff932e1-e70e-4fa6-a2d9-99434652e9f7 req-4c898258-73fc-4208-ae6b-a582b5642578 service nova] Lock "f9b8f9c5-0129-429d-beb6-26d4c9cc085d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:32:45 user nova-compute[72586]: DEBUG nova.compute.manager [req-fff932e1-e70e-4fa6-a2d9-99434652e9f7 req-4c898258-73fc-4208-ae6b-a582b5642578 service nova] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] No waiting events found dispatching network-vif-plugged-46cc59ac-efc1-40c1-8a70-b848a9980413 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:32:45 user nova-compute[72586]: WARNING nova.compute.manager [req-fff932e1-e70e-4fa6-a2d9-99434652e9f7 req-4c898258-73fc-4208-ae6b-a582b5642578 service nova] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Received unexpected event network-vif-plugged-46cc59ac-efc1-40c1-8a70-b848a9980413 for instance with vm_state deleted and task_state None.
Aug 01 21:32:45 user nova-compute[72586]: DEBUG nova.compute.manager [req-fff932e1-e70e-4fa6-a2d9-99434652e9f7 req-4c898258-73fc-4208-ae6b-a582b5642578 service nova] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Received event network-vif-plugged-46cc59ac-efc1-40c1-8a70-b848a9980413 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:32:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-fff932e1-e70e-4fa6-a2d9-99434652e9f7 req-4c898258-73fc-4208-ae6b-a582b5642578 service nova] Acquiring lock "f9b8f9c5-0129-429d-beb6-26d4c9cc085d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:32:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-fff932e1-e70e-4fa6-a2d9-99434652e9f7 req-4c898258-73fc-4208-ae6b-a582b5642578 service nova] Lock "f9b8f9c5-0129-429d-beb6-26d4c9cc085d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:32:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-fff932e1-e70e-4fa6-a2d9-99434652e9f7 req-4c898258-73fc-4208-ae6b-a582b5642578 service nova] Lock "f9b8f9c5-0129-429d-beb6-26d4c9cc085d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:32:45 user nova-compute[72586]: DEBUG nova.compute.manager [req-fff932e1-e70e-4fa6-a2d9-99434652e9f7 req-4c898258-73fc-4208-ae6b-a582b5642578 service nova] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] No waiting events found dispatching network-vif-plugged-46cc59ac-efc1-40c1-8a70-b848a9980413 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:32:45 user nova-compute[72586]: WARNING nova.compute.manager [req-fff932e1-e70e-4fa6-a2d9-99434652e9f7 req-4c898258-73fc-4208-ae6b-a582b5642578 service nova] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Received unexpected event network-vif-plugged-46cc59ac-efc1-40c1-8a70-b848a9980413 for instance with vm_state deleted and task_state None.
Aug 01 21:32:45 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-59e5edb7-40f3-4c3a-bba2-067004fd1317 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:32:45 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-59e5edb7-40f3-4c3a-bba2-067004fd1317 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:32:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-59e5edb7-40f3-4c3a-bba2-067004fd1317 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.424s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:32:46 user nova-compute[72586]: INFO nova.scheduler.client.report [None req-59e5edb7-40f3-4c3a-bba2-067004fd1317 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Deleted allocations for instance f9b8f9c5-0129-429d-beb6-26d4c9cc085d
Aug 01 21:32:46 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-59e5edb7-40f3-4c3a-bba2-067004fd1317 tempest-AttachVolumeShelveTestJSON-1935542868 tempest-AttachVolumeShelveTestJSON-1935542868-project-member] Lock "f9b8f9c5-0129-429d-beb6-26d4c9cc085d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.644s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:32:49 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:32:49 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:32:52 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-ca17a510-ebcb-46f5-b04f-9e747bf5aa8d tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Acquiring lock "7ac93270-a352-4844-900f-cd3486658610" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:32:52 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-ca17a510-ebcb-46f5-b04f-9e747bf5aa8d tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lock "7ac93270-a352-4844-900f-cd3486658610" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:32:52 user nova-compute[72586]: INFO nova.compute.manager [None req-ca17a510-ebcb-46f5-b04f-9e747bf5aa8d tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 7ac93270-a352-4844-900f-cd3486658610] Detaching volume 6168f95e-6eb8-40f2-ba7c-85aff08346d5
Aug 01 21:32:52 user nova-compute[72586]: INFO nova.virt.block_device [None req-ca17a510-ebcb-46f5-b04f-9e747bf5aa8d tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 7ac93270-a352-4844-900f-cd3486658610] Attempting to driver detach volume 6168f95e-6eb8-40f2-ba7c-85aff08346d5 from mountpoint /dev/vdb
Aug 01 21:32:52 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-ca17a510-ebcb-46f5-b04f-9e747bf5aa8d tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Attempting to detach device vdb from instance 7ac93270-a352-4844-900f-cd3486658610 from the persistent domain config. {{(pid=72586) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 21:32:52 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-ca17a510-ebcb-46f5-b04f-9e747bf5aa8d tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 21:32:52 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:32:52 user nova-compute[72586]:   <source dev="/dev/sde"/>
Aug 01 21:32:52 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:32:52 user nova-compute[72586]:   <serial>6168f95e-6eb8-40f2-ba7c-85aff08346d5</serial>
Aug 01 21:32:52 user nova-compute[72586]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 21:32:52 user nova-compute[72586]: </disk>
Aug 01 21:32:52 user nova-compute[72586]:  {{(pid=72586) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 21:32:52 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-ca17a510-ebcb-46f5-b04f-9e747bf5aa8d tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Successfully detached device vdb from instance 7ac93270-a352-4844-900f-cd3486658610 from the persistent domain config.
Aug 01 21:32:52 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-ca17a510-ebcb-46f5-b04f-9e747bf5aa8d tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7ac93270-a352-4844-900f-cd3486658610 from the live domain config. {{(pid=72586) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 21:32:52 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-ca17a510-ebcb-46f5-b04f-9e747bf5aa8d tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 21:32:52 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:32:52 user nova-compute[72586]:   <source dev="/dev/sde"/>
Aug 01 21:32:52 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:32:52 user nova-compute[72586]:   <serial>6168f95e-6eb8-40f2-ba7c-85aff08346d5</serial>
Aug 01 21:32:52 user nova-compute[72586]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 21:32:52 user nova-compute[72586]: </disk>
Aug 01 21:32:52 user nova-compute[72586]:  {{(pid=72586) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 21:32:52 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a7509295-ac5a-472c-a6cd-6bbbe020caac tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Acquiring lock "7ac93270-a352-4844-900f-cd3486658610" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:32:53 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Received event <DeviceRemovedEvent: 1690925573.0290718, 7ac93270-a352-4844-900f-cd3486658610 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72586) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 21:32:53 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-ca17a510-ebcb-46f5-b04f-9e747bf5aa8d tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7ac93270-a352-4844-900f-cd3486658610 {{(pid=72586) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 21:32:53 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-ca17a510-ebcb-46f5-b04f-9e747bf5aa8d tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Successfully detached device vdb from instance 7ac93270-a352-4844-900f-cd3486658610 from the live domain config.
Aug 01 21:32:53 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca17a510-ebcb-46f5-b04f-9e747bf5aa8d tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 7ac93270-a352-4844-900f-cd3486658610] calling os-brick to detach iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 21:32:53 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca17a510-ebcb-46f5-b04f-9e747bf5aa8d tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, {'target_iqns': ['iqn.2010-10.org.openstack:6168f95e-6eb8-40f2-ba7c-85aff08346d5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OnJPrXQx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:32:53 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-ca17a510-ebcb-46f5-b04f-9e747bf5aa8d tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:32:53 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-ca17a510-ebcb-46f5-b04f-9e747bf5aa8d tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:32:53 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-ca17a510-ebcb-46f5-b04f-9e747bf5aa8d tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:32:53 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca17a510-ebcb-46f5-b04f-9e747bf5aa8d tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6168f95e-6eb8-40f2-ba7c-85aff08346d5', 0)] {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 21:32:53 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:53 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:53 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[acdf8b5d-2cf5-439c-9e72-1b07f6698b01]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6168f95e-6eb8-40f2-ba7c-85aff08346d5\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:53 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:53 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:53 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff20d7bb-0344-4623-97df-2c363f1e3912]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6168f95e-6eb8-40f2-ba7c-85aff08346d5 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:53 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca17a510-ebcb-46f5-b04f-9e747bf5aa8d tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)
Aug 01 21:32:53 user nova-compute[72586]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:32:53 user nova-compute[72586]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:32:53 user nova-compute[72586]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 (non-flash)
Aug 01 21:32:53 user nova-compute[72586]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6168f95e-6eb8-40f2-ba7c-85aff08346d5 (non-flash)
Aug 01 21:32:53 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:32:53 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca17a510-ebcb-46f5-b04f-9e747bf5aa8d tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)
Aug 01 21:32:53 user nova-compute[72586]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:32:53 user nova-compute[72586]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:32:53 user nova-compute[72586]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 (non-flash)
Aug 01 21:32:53 user nova-compute[72586]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6168f95e-6eb8-40f2-ba7c-85aff08346d5 (non-flash)
Aug 01 21:32:53 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:32:53 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca17a510-ebcb-46f5-b04f-9e747bf5aa8d tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ee837bc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6168f95e-6eb8-40f2-ba7c-85aff08346d5'): ({'sde'}, set())}) {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 21:32:53 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-ca17a510-ebcb-46f5-b04f-9e747bf5aa8d tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Removing single pathed devices sde {{(pid=72586) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 21:32:53 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:53 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:53 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[a915db3d-6549-4cb0-abbe-8f920bdc20ce]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:53 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:53 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:53 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8a450e-083e-4381-9d98-dcc9d46f5cd1]: (4, ('ok\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:53 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-ca17a510-ebcb-46f5-b04f-9e747bf5aa8d tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Flushing IO for device /dev/sde {{(pid=72586) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 21:32:53 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:53 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:53 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ee8021-1c86-4874-9d72-01696f94cf94]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:53 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-ca17a510-ebcb-46f5-b04f-9e747bf5aa8d tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72586) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 21:32:53 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:53 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:53 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc0792e-9a8c-47f6-99e2-bc3e7596ebfe]: (4, ('1', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:53 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-ca17a510-ebcb-46f5-b04f-9e747bf5aa8d tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 21:32:53 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-ca17a510-ebcb-46f5-b04f-9e747bf5aa8d tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] SCSI volumes sde have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 21:32:53 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca17a510-ebcb-46f5-b04f-9e747bf5aa8d tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6168f95e-6eb8-40f2-ba7c-85aff08346d5')] {{(pid=72586) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 21:32:53 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6168f95e-6eb8-40f2-ba7c-85aff08346d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:53 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6168f95e-6eb8-40f2-ba7c-85aff08346d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:53 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce55f72-6ff9-4d55-9fdf-adc207c6c3d4]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:53 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca17a510-ebcb-46f5-b04f-9e747bf5aa8d tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:32:53 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6168f95e-6eb8-40f2-ba7c-85aff08346d5 -p 172.16.0.220:3260 --logout {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:53 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6168f95e-6eb8-40f2-ba7c-85aff08346d5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:53 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e34726-8c5a-4c2e-9afe-1e0e8b688d96]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:6168f95e-6eb8-40f2-ba7c-85aff08346d5, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:6168f95e-6eb8-40f2-ba7c-85aff08346d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:53 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca17a510-ebcb-46f5-b04f-9e747bf5aa8d tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:6168f95e-6eb8-40f2-ba7c-85aff08346d5, portal: 172.16.0.220,3260]
Aug 01 21:32:53 user nova-compute[72586]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:6168f95e-6eb8-40f2-ba7c-85aff08346d5, portal: 172.16.0.220,3260] successful.
Aug 01 21:32:53 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:32:53 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6168f95e-6eb8-40f2-ba7c-85aff08346d5 -p 172.16.0.220:3260 --op delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:53 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6168f95e-6eb8-40f2-ba7c-85aff08346d5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:53 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7963efb-bae2-4b8e-ad8a-3209e9207391]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:53 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca17a510-ebcb-46f5-b04f-9e747bf5aa8d tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:32:53 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-ca17a510-ebcb-46f5-b04f-9e747bf5aa8d tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:32:53 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca17a510-ebcb-46f5-b04f-9e747bf5aa8d tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] <== disconnect_volume: return (296ms) None {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:32:53 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca17a510-ebcb-46f5-b04f-9e747bf5aa8d tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 7ac93270-a352-4844-900f-cd3486658610] Disconnected iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 21:32:54 user nova-compute[72586]: DEBUG nova.objects.instance [None req-ca17a510-ebcb-46f5-b04f-9e747bf5aa8d tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lazy-loading 'flavor' on Instance uuid 7ac93270-a352-4844-900f-cd3486658610 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:32:54 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:32:54 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-ca17a510-ebcb-46f5-b04f-9e747bf5aa8d tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lock "7ac93270-a352-4844-900f-cd3486658610" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.650s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:32:54 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a7509295-ac5a-472c-a6cd-6bbbe020caac tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lock "7ac93270-a352-4844-900f-cd3486658610" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.531s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:32:54 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a7509295-ac5a-472c-a6cd-6bbbe020caac tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Acquiring lock "7ac93270-a352-4844-900f-cd3486658610-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:32:54 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a7509295-ac5a-472c-a6cd-6bbbe020caac tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lock "7ac93270-a352-4844-900f-cd3486658610-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:32:54 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a7509295-ac5a-472c-a6cd-6bbbe020caac tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lock "7ac93270-a352-4844-900f-cd3486658610-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:32:54 user nova-compute[72586]: INFO nova.compute.manager [None req-a7509295-ac5a-472c-a6cd-6bbbe020caac tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 7ac93270-a352-4844-900f-cd3486658610] Terminating instance
Aug 01 21:32:54 user nova-compute[72586]: DEBUG nova.compute.manager [None req-a7509295-ac5a-472c-a6cd-6bbbe020caac tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 7ac93270-a352-4844-900f-cd3486658610] Start destroying the instance on the hypervisor. {{(pid=72586) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 21:32:54 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:32:54 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:32:54 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:32:54 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:32:54 user nova-compute[72586]: DEBUG nova.compute.manager [req-3a732d5d-8db7-403d-bf04-81f0353a87e0 req-0975d443-15c9-4836-a5d3-763c88fd8c0b service nova] [instance: 7ac93270-a352-4844-900f-cd3486658610] Received event network-vif-unplugged-bbd2d76f-a2a0-4bc1-bf4a-a1d52cb94278 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:32:54 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-3a732d5d-8db7-403d-bf04-81f0353a87e0 req-0975d443-15c9-4836-a5d3-763c88fd8c0b service nova] Acquiring lock "7ac93270-a352-4844-900f-cd3486658610-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:32:54 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-3a732d5d-8db7-403d-bf04-81f0353a87e0 req-0975d443-15c9-4836-a5d3-763c88fd8c0b service nova] Lock "7ac93270-a352-4844-900f-cd3486658610-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:32:54 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-3a732d5d-8db7-403d-bf04-81f0353a87e0 req-0975d443-15c9-4836-a5d3-763c88fd8c0b service nova] Lock "7ac93270-a352-4844-900f-cd3486658610-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:32:54 user nova-compute[72586]: DEBUG nova.compute.manager [req-3a732d5d-8db7-403d-bf04-81f0353a87e0 req-0975d443-15c9-4836-a5d3-763c88fd8c0b service nova] [instance: 7ac93270-a352-4844-900f-cd3486658610] No waiting events found dispatching network-vif-unplugged-bbd2d76f-a2a0-4bc1-bf4a-a1d52cb94278 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:32:54 user nova-compute[72586]: DEBUG nova.compute.manager [req-3a732d5d-8db7-403d-bf04-81f0353a87e0 req-0975d443-15c9-4836-a5d3-763c88fd8c0b service nova] [instance: 7ac93270-a352-4844-900f-cd3486658610] Received event network-vif-unplugged-bbd2d76f-a2a0-4bc1-bf4a-a1d52cb94278 for instance with task_state deleting. {{(pid=72586) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 21:32:54 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:32:54 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 7ac93270-a352-4844-900f-cd3486658610] Instance destroyed successfully.
Aug 01 21:32:54 user nova-compute[72586]: DEBUG nova.objects.instance [None req-a7509295-ac5a-472c-a6cd-6bbbe020caac tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lazy-loading 'resources' on Instance uuid 7ac93270-a352-4844-900f-cd3486658610 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:32:54 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-a7509295-ac5a-472c-a6cd-6bbbe020caac tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:30:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-557306936',display_name='tempest-VolumesSnapshotTestJSON-instance-557306936',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-557306936',id=27,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXaE8NDQD4DTECaOIn7hFaMX+ppKuYimp/IfObSqCrHQzD5dWyrkP1e7m98N142JFBJMuquKn4QJz9op0IHPL+vZCEZASqZsTKSyFRvjnPENe9BHedQx5OxIt33Dun0Dw==',key_name='tempest-keypair-66140608',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:30:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dfd51ad6ca4045699c8d72f9382f1c62',ramdisk_id='',reservation_id='r-mek89l6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1613093006',owner_user_name='tempest-VolumesSnapshotTestJSON-1613093006-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:30:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e8daa888b0c4b8fa6e42cab3058bd4c',uuid=7ac93270-a352-4844-900f-cd3486658610,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bbd2d76f-a2a0-4bc1-bf4a-a1d52cb94278", "address": "fa:16:3e:c4:bc:0a", "network": {"id": "8e60d949-6c06-4e40-b792-d6f516b967d7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-603740209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfd51ad6ca4045699c8d72f9382f1c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbd2d76f-a2", "ovs_interfaceid": "bbd2d76f-a2a0-4bc1-bf4a-a1d52cb94278", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:32:54 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-a7509295-ac5a-472c-a6cd-6bbbe020caac tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Converting VIF {"id": "bbd2d76f-a2a0-4bc1-bf4a-a1d52cb94278", "address": "fa:16:3e:c4:bc:0a", "network": {"id": "8e60d949-6c06-4e40-b792-d6f516b967d7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-603740209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfd51ad6ca4045699c8d72f9382f1c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbd2d76f-a2", "ovs_interfaceid": "bbd2d76f-a2a0-4bc1-bf4a-a1d52cb94278", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:32:54 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-a7509295-ac5a-472c-a6cd-6bbbe020caac tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:bc:0a,bridge_name='br-int',has_traffic_filtering=True,id=bbd2d76f-a2a0-4bc1-bf4a-a1d52cb94278,network=Network(8e60d949-6c06-4e40-b792-d6f516b967d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbd2d76f-a2') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:32:54 user nova-compute[72586]: DEBUG os_vif [None req-a7509295-ac5a-472c-a6cd-6bbbe020caac tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:bc:0a,bridge_name='br-int',has_traffic_filtering=True,id=bbd2d76f-a2a0-4bc1-bf4a-a1d52cb94278,network=Network(8e60d949-6c06-4e40-b792-d6f516b967d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbd2d76f-a2') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:32:54 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:32:54 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbbd2d76f-a2, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:32:54 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:32:54 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:32:54 user nova-compute[72586]: INFO os_vif [None req-a7509295-ac5a-472c-a6cd-6bbbe020caac tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:bc:0a,bridge_name='br-int',has_traffic_filtering=True,id=bbd2d76f-a2a0-4bc1-bf4a-a1d52cb94278,network=Network(8e60d949-6c06-4e40-b792-d6f516b967d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbd2d76f-a2')
Aug 01 21:32:54 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7509295-ac5a-472c-a6cd-6bbbe020caac tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 7ac93270-a352-4844-900f-cd3486658610] calling os-brick to detach iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 21:32:54 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7509295-ac5a-472c-a6cd-6bbbe020caac tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, {'target_iqns': ['iqn.2010-10.org.openstack:6168f95e-6eb8-40f2-ba7c-85aff08346d5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OnJPrXQx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:32:54 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-a7509295-ac5a-472c-a6cd-6bbbe020caac tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:32:54 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-a7509295-ac5a-472c-a6cd-6bbbe020caac tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:32:54 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-a7509295-ac5a-472c-a6cd-6bbbe020caac tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:32:54 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7509295-ac5a-472c-a6cd-6bbbe020caac tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6168f95e-6eb8-40f2-ba7c-85aff08346d5', 0)] {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 21:32:54 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:54 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:54 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f3cec9-41fe-4ca5-aa6b-572af225cbe4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:54 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:32:55 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:32:55 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[a147d079-32b2-45d7-9be5-9a844f8fce15]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:32:55 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7509295-ac5a-472c-a6cd-6bbbe020caac tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)
Aug 01 21:32:55 user nova-compute[72586]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:32:55 user nova-compute[72586]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:32:55 user nova-compute[72586]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 (non-flash)
Aug 01 21:32:55 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:32:55 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7509295-ac5a-472c-a6cd-6bbbe020caac tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)
Aug 01 21:32:55 user nova-compute[72586]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:32:55 user nova-compute[72586]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:32:55 user nova-compute[72586]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 (non-flash)
Aug 01 21:32:55 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:32:55 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7509295-ac5a-472c-a6cd-6bbbe020caac tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ed02cc8b0>, {}) {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 21:32:55 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7509295-ac5a-472c-a6cd-6bbbe020caac tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Disconnecting from: [] {{(pid=72586) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 21:32:55 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-a7509295-ac5a-472c-a6cd-6bbbe020caac tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.049s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:32:55 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7509295-ac5a-472c-a6cd-6bbbe020caac tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] <== disconnect_volume: return (50ms) None {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:32:55 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7509295-ac5a-472c-a6cd-6bbbe020caac tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 7ac93270-a352-4844-900f-cd3486658610] Disconnected iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 21:32:55 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-a7509295-ac5a-472c-a6cd-6bbbe020caac tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 7ac93270-a352-4844-900f-cd3486658610] Deleting instance files /opt/stack/data/nova/instances/7ac93270-a352-4844-900f-cd3486658610_del
Aug 01 21:32:55 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-a7509295-ac5a-472c-a6cd-6bbbe020caac tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 7ac93270-a352-4844-900f-cd3486658610] Deletion of /opt/stack/data/nova/instances/7ac93270-a352-4844-900f-cd3486658610_del complete
Aug 01 21:32:55 user nova-compute[72586]: INFO nova.compute.manager [None req-a7509295-ac5a-472c-a6cd-6bbbe020caac tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 7ac93270-a352-4844-900f-cd3486658610] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 01 21:32:55 user nova-compute[72586]: DEBUG oslo.service.loopingcall [None req-a7509295-ac5a-472c-a6cd-6bbbe020caac tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72586) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 21:32:55 user nova-compute[72586]: DEBUG nova.compute.manager [-] [instance: 7ac93270-a352-4844-900f-cd3486658610] Deallocating network for instance {{(pid=72586) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 21:32:55 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 7ac93270-a352-4844-900f-cd3486658610] deallocate_for_instance() {{(pid=72586) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 21:32:56 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 7ac93270-a352-4844-900f-cd3486658610] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:32:56 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 7ac93270-a352-4844-900f-cd3486658610] Took 1.18 seconds to deallocate network for instance.
Aug 01 21:32:56 user nova-compute[72586]: DEBUG nova.compute.manager [req-8174c24f-9c18-4492-9572-de377b84693f req-2b6f3150-f0fd-418d-b11a-17174cc4fd35 service nova] [instance: 7ac93270-a352-4844-900f-cd3486658610] Received event network-vif-deleted-bbd2d76f-a2a0-4bc1-bf4a-a1d52cb94278 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:32:56 user nova-compute[72586]: WARNING nova.volume.cinder [None req-a7509295-ac5a-472c-a6cd-6bbbe020caac tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Attachment 5edf7a41-3b08-48c6-8c6e-9c158dc2115d does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 5edf7a41-3b08-48c6-8c6e-9c158dc2115d. (HTTP 404) (Request-ID: req-70134ae0-79de-483c-bf46-360fed132901)
Aug 01 21:32:56 user nova-compute[72586]: INFO nova.compute.manager [None req-a7509295-ac5a-472c-a6cd-6bbbe020caac tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] [instance: 7ac93270-a352-4844-900f-cd3486658610] Took 0.02 seconds to detach 1 volumes for instance.
Aug 01 21:32:56 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a7509295-ac5a-472c-a6cd-6bbbe020caac tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:32:56 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a7509295-ac5a-472c-a6cd-6bbbe020caac tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:32:56 user nova-compute[72586]: DEBUG nova.compute.manager [req-91c21d10-ddc2-43a5-9686-561e0f318b8a req-c4668553-dc41-4eb1-bbc1-9bf145a2eb3a service nova] [instance: 7ac93270-a352-4844-900f-cd3486658610] Received event network-vif-plugged-bbd2d76f-a2a0-4bc1-bf4a-a1d52cb94278 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:32:56 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-91c21d10-ddc2-43a5-9686-561e0f318b8a req-c4668553-dc41-4eb1-bbc1-9bf145a2eb3a service nova] Acquiring lock "7ac93270-a352-4844-900f-cd3486658610-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:32:56 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-91c21d10-ddc2-43a5-9686-561e0f318b8a req-c4668553-dc41-4eb1-bbc1-9bf145a2eb3a service nova] Lock "7ac93270-a352-4844-900f-cd3486658610-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:32:56 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-91c21d10-ddc2-43a5-9686-561e0f318b8a req-c4668553-dc41-4eb1-bbc1-9bf145a2eb3a service nova] Lock "7ac93270-a352-4844-900f-cd3486658610-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:32:56 user nova-compute[72586]: DEBUG nova.compute.manager [req-91c21d10-ddc2-43a5-9686-561e0f318b8a req-c4668553-dc41-4eb1-bbc1-9bf145a2eb3a service nova] [instance: 7ac93270-a352-4844-900f-cd3486658610] No waiting events found dispatching network-vif-plugged-bbd2d76f-a2a0-4bc1-bf4a-a1d52cb94278 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:32:56 user nova-compute[72586]: WARNING nova.compute.manager [req-91c21d10-ddc2-43a5-9686-561e0f318b8a req-c4668553-dc41-4eb1-bbc1-9bf145a2eb3a service nova] [instance: 7ac93270-a352-4844-900f-cd3486658610] Received unexpected event network-vif-plugged-bbd2d76f-a2a0-4bc1-bf4a-a1d52cb94278 for instance with vm_state deleted and task_state None.
Aug 01 21:32:56 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-a7509295-ac5a-472c-a6cd-6bbbe020caac tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:32:56 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-a7509295-ac5a-472c-a6cd-6bbbe020caac tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:32:56 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a7509295-ac5a-472c-a6cd-6bbbe020caac tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.328s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:32:56 user nova-compute[72586]: INFO nova.scheduler.client.report [None req-a7509295-ac5a-472c-a6cd-6bbbe020caac tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Deleted allocations for instance 7ac93270-a352-4844-900f-cd3486658610
Aug 01 21:32:56 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a7509295-ac5a-472c-a6cd-6bbbe020caac tempest-VolumesSnapshotTestJSON-1613093006 tempest-VolumesSnapshotTestJSON-1613093006-project-member] Lock "7ac93270-a352-4844-900f-cd3486658610" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.654s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:32:59 user nova-compute[72586]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690925564.0770805, f9b8f9c5-0129-429d-beb6-26d4c9cc085d => Stopped> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:32:59 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] VM Stopped (Lifecycle Event)
Aug 01 21:32:59 user nova-compute[72586]: DEBUG nova.compute.manager [None req-6506ddc7-b565-47ae-8e21-aaa79b032269 None None] [instance: f9b8f9c5-0129-429d-beb6-26d4c9cc085d] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:32:59 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:32:59 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:33:04 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:33:04 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:33:09 user nova-compute[72586]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690925574.9188035, 7ac93270-a352-4844-900f-cd3486658610 => Stopped> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:33:09 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 7ac93270-a352-4844-900f-cd3486658610] VM Stopped (Lifecycle Event)
Aug 01 21:33:09 user nova-compute[72586]: DEBUG nova.compute.manager [None req-c0bd7545-adb0-4186-8dfb-b347e7bf8308 None None] [instance: 7ac93270-a352-4844-900f-cd3486658610] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:33:09 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:33:14 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:33:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-25ee00b8-6c00-4523-91f3-8522944804de tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Acquiring lock "c3798403-855b-45e4-af48-ba6b62570dba" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:33:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-25ee00b8-6c00-4523-91f3-8522944804de tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Lock "c3798403-855b-45e4-af48-ba6b62570dba" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:33:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-25ee00b8-6c00-4523-91f3-8522944804de tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Acquiring lock "c3798403-855b-45e4-af48-ba6b62570dba-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:33:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-25ee00b8-6c00-4523-91f3-8522944804de tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Lock "c3798403-855b-45e4-af48-ba6b62570dba-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:33:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-25ee00b8-6c00-4523-91f3-8522944804de tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Lock "c3798403-855b-45e4-af48-ba6b62570dba-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:33:18 user nova-compute[72586]: INFO nova.compute.manager [None req-25ee00b8-6c00-4523-91f3-8522944804de tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Terminating instance
Aug 01 21:33:18 user nova-compute[72586]: DEBUG nova.compute.manager [None req-25ee00b8-6c00-4523-91f3-8522944804de tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Start destroying the instance on the hypervisor. {{(pid=72586) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 21:33:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:33:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:33:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:33:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:33:19 user nova-compute[72586]: DEBUG nova.compute.manager [req-d850d183-d18a-4aa9-ae53-2a8a373a99b2 req-7a2bef33-5802-4e42-95ad-39a667925651 service nova] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Received event network-vif-unplugged-68b636e3-234f-49e5-b0fb-9f99fffab5c5 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:33:19 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d850d183-d18a-4aa9-ae53-2a8a373a99b2 req-7a2bef33-5802-4e42-95ad-39a667925651 service nova] Acquiring lock "c3798403-855b-45e4-af48-ba6b62570dba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:33:19 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d850d183-d18a-4aa9-ae53-2a8a373a99b2 req-7a2bef33-5802-4e42-95ad-39a667925651 service nova] Lock "c3798403-855b-45e4-af48-ba6b62570dba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:33:19 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d850d183-d18a-4aa9-ae53-2a8a373a99b2 req-7a2bef33-5802-4e42-95ad-39a667925651 service nova] Lock "c3798403-855b-45e4-af48-ba6b62570dba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:33:19 user nova-compute[72586]: DEBUG nova.compute.manager [req-d850d183-d18a-4aa9-ae53-2a8a373a99b2 req-7a2bef33-5802-4e42-95ad-39a667925651 service nova] [instance: c3798403-855b-45e4-af48-ba6b62570dba] No waiting events found dispatching network-vif-unplugged-68b636e3-234f-49e5-b0fb-9f99fffab5c5 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:33:19 user nova-compute[72586]: DEBUG nova.compute.manager [req-d850d183-d18a-4aa9-ae53-2a8a373a99b2 req-7a2bef33-5802-4e42-95ad-39a667925651 service nova] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Received event network-vif-unplugged-68b636e3-234f-49e5-b0fb-9f99fffab5c5 for instance with task_state deleting. {{(pid=72586) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 21:33:19 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Instance destroyed successfully.
Aug 01 21:33:19 user nova-compute[72586]: DEBUG nova.objects.instance [None req-25ee00b8-6c00-4523-91f3-8522944804de tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Lazy-loading 'resources' on Instance uuid c3798403-855b-45e4-af48-ba6b62570dba {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:33:19 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-25ee00b8-6c00-4523-91f3-8522944804de tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:24:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-124717694',display_name='tempest-ServerActionsTestOtherB-server-124717694',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-124717694',id=17,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgvcOBvmaWJhEwOkJkVCtNJ+42NFJ7Wme/nrROdsaAYDVV1668xM0wdadU29PtL+UEfr1KV8jRhHGVoqdqnxjGi6czPksct12PqH1D7Zn6OKGhhWdLcIzx9a1L98V8jxQ==',key_name='tempest-keypair-177851533',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:30:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0c49158afdb04ea48c05f32782106197',ramdisk_id='',reservation_id='r-6rqr0y9w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1788994838',owner_user_name='tempest-ServerActionsTestOtherB-1788994838-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:30:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='353f3e5b8859476b8213462a8a3d00b4',uuid=c3798403-855b-45e4-af48-ba6b62570dba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "68b636e3-234f-49e5-b0fb-9f99fffab5c5", "address": "fa:16:3e:a4:40:ed", "network": {"id": "42af123b-86fc-427d-b74a-a2e30c38720c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1787263710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c49158afdb04ea48c05f32782106197", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b636e3-23", "ovs_interfaceid": "68b636e3-234f-49e5-b0fb-9f99fffab5c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:33:19 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-25ee00b8-6c00-4523-91f3-8522944804de tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Converting VIF {"id": "68b636e3-234f-49e5-b0fb-9f99fffab5c5", "address": "fa:16:3e:a4:40:ed", "network": {"id": "42af123b-86fc-427d-b74a-a2e30c38720c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1787263710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c49158afdb04ea48c05f32782106197", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b636e3-23", "ovs_interfaceid": "68b636e3-234f-49e5-b0fb-9f99fffab5c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:33:19 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-25ee00b8-6c00-4523-91f3-8522944804de tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:40:ed,bridge_name='br-int',has_traffic_filtering=True,id=68b636e3-234f-49e5-b0fb-9f99fffab5c5,network=Network(42af123b-86fc-427d-b74a-a2e30c38720c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68b636e3-23') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:33:19 user nova-compute[72586]: DEBUG os_vif [None req-25ee00b8-6c00-4523-91f3-8522944804de tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:40:ed,bridge_name='br-int',has_traffic_filtering=True,id=68b636e3-234f-49e5-b0fb-9f99fffab5c5,network=Network(42af123b-86fc-427d-b74a-a2e30c38720c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68b636e3-23') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:33:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:33:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap68b636e3-23, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:33:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:33:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:33:19 user nova-compute[72586]: INFO os_vif [None req-25ee00b8-6c00-4523-91f3-8522944804de tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:40:ed,bridge_name='br-int',has_traffic_filtering=True,id=68b636e3-234f-49e5-b0fb-9f99fffab5c5,network=Network(42af123b-86fc-427d-b74a-a2e30c38720c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68b636e3-23')
Aug 01 21:33:19 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25ee00b8-6c00-4523-91f3-8522944804de tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] calling os-brick to detach iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 21:33:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ee00b8-6c00-4523-91f3-8522944804de tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, {'target_iqns': ['iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tYAvmCpL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:33:19 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-25ee00b8-6c00-4523-91f3-8522944804de tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:33:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-25ee00b8-6c00-4523-91f3-8522944804de tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:33:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-25ee00b8-6c00-4523-91f3-8522944804de tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:33:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ee00b8-6c00-4523-91f3-8522944804de tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea', 0)] {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 21:33:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:33:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:33:19 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[c896e2c1-f7ad-4317-9666-c5d4d64c4932]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:33:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:33:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:33:19 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[4def4218-894a-4f20-b4a0-8c86fbcd814c]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:33:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ee00b8-6c00-4523-91f3-8522944804de tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)
Aug 01 21:33:19 user nova-compute[72586]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:33:19 user nova-compute[72586]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:33:19 user nova-compute[72586]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 (non-flash)
Aug 01 21:33:19 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:33:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ee00b8-6c00-4523-91f3-8522944804de tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)
Aug 01 21:33:19 user nova-compute[72586]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:33:19 user nova-compute[72586]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea (non-flash)
Aug 01 21:33:19 user nova-compute[72586]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 (non-flash)
Aug 01 21:33:19 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:33:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ee00b8-6c00-4523-91f3-8522944804de tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ee81ee830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea'): ({'sdf'}, set())}) {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 21:33:19 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-25ee00b8-6c00-4523-91f3-8522944804de tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Removing single pathed devices sdf {{(pid=72586) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 21:33:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:33:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:33:19 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbea494e-de1f-4352-827e-86c566b692aa]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:33:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:33:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.101s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:33:19 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a67f0e5-eb1e-45f0-9ea4-cb46cb1949f8]: (4, ('ok\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:33:19 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-25ee00b8-6c00-4523-91f3-8522944804de tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Flushing IO for device /dev/sdf {{(pid=72586) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 21:33:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:33:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:33:19 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[544ddf12-cc2a-4ec0-8ec1-2c87b11b2c1d]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:33:19 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-25ee00b8-6c00-4523-91f3-8522944804de tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72586) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 21:33:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:33:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.057s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:33:19 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b950c0-7e94-476b-a2a6-1f959e3f3110]: (4, ('1', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:33:19 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-25ee00b8-6c00-4523-91f3-8522944804de tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 21:33:19 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-25ee00b8-6c00-4523-91f3-8522944804de tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] SCSI volumes sdf have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 21:33:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ee00b8-6c00-4523-91f3-8522944804de tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea')] {{(pid=72586) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 21:33:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:33:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:33:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.036s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:33:19 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9667a039-c793-4820-a705-87886f614c74]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:33:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ee00b8-6c00-4523-91f3-8522944804de tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:33:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea -p 172.16.0.220:3260 --logout {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:33:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:33:20 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a960456-9beb-4fb6-b9a5-1791eab2902b]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:33:20 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ee00b8-6c00-4523-91f3-8522944804de tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea, portal: 172.16.0.220,3260]
Aug 01 21:33:20 user nova-compute[72586]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea, portal: 172.16.0.220,3260] successful.
Aug 01 21:33:20 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:33:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea -p 172.16.0.220:3260 --op delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:33:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4927c194-c7b3-4b35-b484-30b4bc8744ea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:33:20 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[6224d435-36ef-47d9-a3ef-6cf34d6758f3]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:33:20 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ee00b8-6c00-4523-91f3-8522944804de tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:33:20 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-25ee00b8-6c00-4523-91f3-8522944804de tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.421s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:33:20 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ee00b8-6c00-4523-91f3-8522944804de tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] <== disconnect_volume: return (422ms) None {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:33:20 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25ee00b8-6c00-4523-91f3-8522944804de tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Disconnected iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 21:33:20 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-25ee00b8-6c00-4523-91f3-8522944804de tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Deleting instance files /opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba_del
Aug 01 21:33:20 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-25ee00b8-6c00-4523-91f3-8522944804de tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Deletion of /opt/stack/data/nova/instances/c3798403-855b-45e4-af48-ba6b62570dba_del complete
Aug 01 21:33:20 user nova-compute[72586]: INFO nova.compute.manager [None req-25ee00b8-6c00-4523-91f3-8522944804de tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Took 1.33 seconds to destroy the instance on the hypervisor.
Aug 01 21:33:20 user nova-compute[72586]: DEBUG oslo.service.loopingcall [None req-25ee00b8-6c00-4523-91f3-8522944804de tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72586) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 21:33:20 user nova-compute[72586]: DEBUG nova.compute.manager [-] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Deallocating network for instance {{(pid=72586) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 21:33:20 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: c3798403-855b-45e4-af48-ba6b62570dba] deallocate_for_instance() {{(pid=72586) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 21:33:20 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:33:21 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:33:21 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Took 1.05 seconds to deallocate network for instance.
Aug 01 21:33:21 user nova-compute[72586]: DEBUG nova.compute.manager [req-506e2f70-e241-42d7-9dbc-e27e07950668 req-83e5bada-2411-476c-aa02-8abd4b8813fe service nova] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Received event network-vif-deleted-68b636e3-234f-49e5-b0fb-9f99fffab5c5 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:33:21 user nova-compute[72586]: DEBUG nova.compute.manager [req-c1d33ecf-322f-40d6-a91a-2eb4878d5c99 req-9dcd1c31-ac1d-48aa-8470-78994e2aa070 service nova] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Received event network-vif-plugged-68b636e3-234f-49e5-b0fb-9f99fffab5c5 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:33:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-c1d33ecf-322f-40d6-a91a-2eb4878d5c99 req-9dcd1c31-ac1d-48aa-8470-78994e2aa070 service nova] Acquiring lock "c3798403-855b-45e4-af48-ba6b62570dba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:33:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-c1d33ecf-322f-40d6-a91a-2eb4878d5c99 req-9dcd1c31-ac1d-48aa-8470-78994e2aa070 service nova] Lock "c3798403-855b-45e4-af48-ba6b62570dba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:33:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-c1d33ecf-322f-40d6-a91a-2eb4878d5c99 req-9dcd1c31-ac1d-48aa-8470-78994e2aa070 service nova] Lock "c3798403-855b-45e4-af48-ba6b62570dba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:33:21 user nova-compute[72586]: DEBUG nova.compute.manager [req-c1d33ecf-322f-40d6-a91a-2eb4878d5c99 req-9dcd1c31-ac1d-48aa-8470-78994e2aa070 service nova] [instance: c3798403-855b-45e4-af48-ba6b62570dba] No waiting events found dispatching network-vif-plugged-68b636e3-234f-49e5-b0fb-9f99fffab5c5 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:33:21 user nova-compute[72586]: WARNING nova.compute.manager [req-c1d33ecf-322f-40d6-a91a-2eb4878d5c99 req-9dcd1c31-ac1d-48aa-8470-78994e2aa070 service nova] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Received unexpected event network-vif-plugged-68b636e3-234f-49e5-b0fb-9f99fffab5c5 for instance with vm_state active and task_state deleting.
Aug 01 21:33:21 user nova-compute[72586]: INFO nova.compute.manager [None req-25ee00b8-6c00-4523-91f3-8522944804de tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Took 0.78 seconds to detach 1 volumes for instance.
Aug 01 21:33:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-25ee00b8-6c00-4523-91f3-8522944804de tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:33:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-25ee00b8-6c00-4523-91f3-8522944804de tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:33:22 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-25ee00b8-6c00-4523-91f3-8522944804de tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:33:22 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-25ee00b8-6c00-4523-91f3-8522944804de tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:33:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-25ee00b8-6c00-4523-91f3-8522944804de tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.352s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:33:22 user nova-compute[72586]: INFO nova.scheduler.client.report [None req-25ee00b8-6c00-4523-91f3-8522944804de tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Deleted allocations for instance c3798403-855b-45e4-af48-ba6b62570dba
Aug 01 21:33:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-25ee00b8-6c00-4523-91f3-8522944804de tempest-ServerActionsTestOtherB-1788994838 tempest-ServerActionsTestOtherB-1788994838-project-member] Lock "c3798403-855b-45e4-af48-ba6b62570dba" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.733s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:33:22 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:33:24 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:33:24 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:33:27 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:33:27 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72586) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 21:33:27 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:33:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:33:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:33:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:33:27 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Auditing locally available compute resources for user (node: user) {{(pid=72586) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 21:33:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:33:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:33:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:33:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:33:28 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:33:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161fab9d-a7d1-4ea0-b4b9-2afc54040eef/disk.rescue --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:33:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161fab9d-a7d1-4ea0-b4b9-2afc54040eef/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:33:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161fab9d-a7d1-4ea0-b4b9-2afc54040eef/disk.rescue --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:33:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161fab9d-a7d1-4ea0-b4b9-2afc54040eef/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:33:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:33:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:33:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:33:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:33:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:33:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:33:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:33:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:33:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:33:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:33:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:33:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:33:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b0d907-2515-4a06-8b35-9ddd09ce42c3/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:33:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:33:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b0d907-2515-4a06-8b35-9ddd09ce42c3/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:33:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b0d907-2515-4a06-8b35-9ddd09ce42c3/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:33:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b0d907-2515-4a06-8b35-9ddd09ce42c3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:33:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:33:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:33:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:33:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:33:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:33:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.rescue --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:33:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.rescue --force-share --output=json" returned: 0 in 0.157s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:33:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.rescue --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:33:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.rescue --force-share --output=json" returned: 0 in 0.152s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:33:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:33:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:33:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:33:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:33:30 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:33:31 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:33:31 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:33:31 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Hypervisor/Node resource view: name=user free_ram=7514MB free_disk=25.21871566772461GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72586) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 21:33:31 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:33:31 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:33:31 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 042f0031-1e4d-41d0-8bfa-36001675cfe3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:33:31 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 413c3426-18ad-4a5c-af04-e0e7fc90f050 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:33:31 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 49c24c77-f102-4aed-8314-b04aad5f6b3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:33:31 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:33:31 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance af2de810-b22f-4fa9-835c-c673abd145db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:33:31 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance f6b0d907-2515-4a06-8b35-9ddd09ce42c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:33:31 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 161fab9d-a7d1-4ea0-b4b9-2afc54040eef actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:33:31 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:33:31 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 314f9b05-527c-459d-aca7-acc696ac613f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:33:31 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 21:33:31 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 21:33:31 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:33:31 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:33:31 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Compute_service record updated for user:user {{(pid=72586) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 21:33:31 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.489s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:33:32 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:33:32 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:33:32 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:33:32 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:33:32 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Starting heal instance info cache {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 21:33:33 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "refresh_cache-af2de810-b22f-4fa9-835c-c673abd145db" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:33:33 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquired lock "refresh_cache-af2de810-b22f-4fa9-835c-c673abd145db" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:33:33 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Forcefully refreshing network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 21:33:33 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Updating instance_info_cache with network_info: [{"id": "b3d7d993-0a45-40ab-8cdd-e3eb06183294", "address": "fa:16:3e:29:af:12", "network": {"id": "86940e5d-852b-48fc-9b0e-858305321349", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1967467603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d847d04360420c80ea5608d5a2b15a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3d7d993-0a", "ovs_interfaceid": "b3d7d993-0a45-40ab-8cdd-e3eb06183294", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:33:33 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Releasing lock "refresh_cache-af2de810-b22f-4fa9-835c-c673abd145db" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:33:33 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Updated the network info_cache for instance {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 21:33:33 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:33:34 user nova-compute[72586]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690925599.6027496, c3798403-855b-45e4-af48-ba6b62570dba => Stopped> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:33:34 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: c3798403-855b-45e4-af48-ba6b62570dba] VM Stopped (Lifecycle Event)
Aug 01 21:33:34 user nova-compute[72586]: DEBUG nova.compute.manager [None req-750e5acf-9821-4303-b4dd-a534b12c9338 None None] [instance: c3798403-855b-45e4-af48-ba6b62570dba] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:33:34 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:33:35 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:33:38 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:33:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:33:42 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-ab865b5c-830a-49a6-927f-b425ffc46172 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Acquiring lock "0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:33:42 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-ab865b5c-830a-49a6-927f-b425ffc46172 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:33:42 user nova-compute[72586]: DEBUG nova.objects.instance [None req-ab865b5c-830a-49a6-927f-b425ffc46172 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lazy-loading 'flavor' on Instance uuid 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:33:42 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-ab865b5c-830a-49a6-927f-b425ffc46172 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:33:43 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-ab865b5c-830a-49a6-927f-b425ffc46172 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Acquiring lock "0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:33:43 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-ab865b5c-830a-49a6-927f-b425ffc46172 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:33:43 user nova-compute[72586]: INFO nova.compute.manager [None req-ab865b5c-830a-49a6-927f-b425ffc46172 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Attaching volume cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 to /dev/vdb
Aug 01 21:33:43 user nova-compute[72586]: DEBUG os_brick.utils [None req-ab865b5c-830a-49a6-927f-b425ffc46172 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:33:43 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:33:43 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:33:43 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb82a64-8d41-4bfa-8bd5-d9fa72684e4d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4bc202fb9cb\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:33:43 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:33:43 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:33:43 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[edfe2cd3-d83a-491c-9b86-bc3a5a53c004]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:33:43 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:33:43 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:33:43 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f12d3df-aa3f-48a0-b12a-0213d1898f47]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:33:43 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[259a38b0-9f88-4018-9236-199e7cd31c59]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:33:43 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-ab865b5c-830a-49a6-927f-b425ffc46172 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Running cmd (subprocess): nvme version {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:33:43 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-ab865b5c-830a-49a6-927f-b425ffc46172 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] 'nvme version' failed. Not Retrying. {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:33:43 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ab865b5c-830a-49a6-927f-b425ffc46172 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] nvme not present on system {{(pid=72586) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 21:33:43 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:33:43 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:33:43 user nova-compute[72586]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 21:33:43 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb22752-afe4-414b-8ed0-32b8a2fac0c2]: (4, '') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:33:43 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-ab865b5c-830a-49a6-927f-b425ffc46172 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72586) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 21:33:43 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-ab865b5c-830a-49a6-927f-b425ffc46172 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 21:33:43 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-ab865b5c-830a-49a6-927f-b425ffc46172 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] LIGHTOS: no hostnqn found. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 21:33:43 user nova-compute[72586]: DEBUG os_brick.utils [None req-ab865b5c-830a-49a6-927f-b425ffc46172 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4bc202fb9cb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:33:43 user nova-compute[72586]: DEBUG nova.virt.block_device [None req-ab865b5c-830a-49a6-927f-b425ffc46172 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Updating existing volume attachment record: d02d8439-a413-4da1-a748-2cd12b3a9c15 {{(pid=72586) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 21:33:43 user nova-compute[72586]: DEBUG nova.compute.manager [req-fa50673e-3079-403e-a837-45b22ede43a8 req-83f542e5-247b-4e89-bde1-45e5c81e1408 service nova] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Received event network-changed-440ca7d3-e2b8-4edf-9339-bd8d247d5da2 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:33:43 user nova-compute[72586]: DEBUG nova.compute.manager [req-fa50673e-3079-403e-a837-45b22ede43a8 req-83f542e5-247b-4e89-bde1-45e5c81e1408 service nova] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Refreshing instance network info cache due to event network-changed-440ca7d3-e2b8-4edf-9339-bd8d247d5da2. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:33:43 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-fa50673e-3079-403e-a837-45b22ede43a8 req-83f542e5-247b-4e89-bde1-45e5c81e1408 service nova] Acquiring lock "refresh_cache-f6b0d907-2515-4a06-8b35-9ddd09ce42c3" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:33:43 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-fa50673e-3079-403e-a837-45b22ede43a8 req-83f542e5-247b-4e89-bde1-45e5c81e1408 service nova] Acquired lock "refresh_cache-f6b0d907-2515-4a06-8b35-9ddd09ce42c3" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:33:43 user nova-compute[72586]: DEBUG nova.network.neutron [req-fa50673e-3079-403e-a837-45b22ede43a8 req-83f542e5-247b-4e89-bde1-45e5c81e1408 service nova] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Refreshing network info cache for port 440ca7d3-e2b8-4edf-9339-bd8d247d5da2 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:33:44 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-43557061-3600-44c5-91e0-d0735f410a74 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Acquiring lock "f6b0d907-2515-4a06-8b35-9ddd09ce42c3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:33:44 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-43557061-3600-44c5-91e0-d0735f410a74 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "f6b0d907-2515-4a06-8b35-9ddd09ce42c3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:33:44 user nova-compute[72586]: INFO nova.compute.manager [None req-43557061-3600-44c5-91e0-d0735f410a74 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Detaching volume 0f09b89d-693e-44b6-902b-f51e81d20b36
Aug 01 21:33:44 user nova-compute[72586]: DEBUG nova.network.neutron [req-fa50673e-3079-403e-a837-45b22ede43a8 req-83f542e5-247b-4e89-bde1-45e5c81e1408 service nova] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Updated VIF entry in instance network info cache for port 440ca7d3-e2b8-4edf-9339-bd8d247d5da2. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:33:44 user nova-compute[72586]: DEBUG nova.network.neutron [req-fa50673e-3079-403e-a837-45b22ede43a8 req-83f542e5-247b-4e89-bde1-45e5c81e1408 service nova] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Updating instance_info_cache with network_info: [{"id": "440ca7d3-e2b8-4edf-9339-bd8d247d5da2", "address": "fa:16:3e:29:ff:63", "network": {"id": "d229a8de-7a2b-4dcd-a9ac-44a40349676e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-67691992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b1a1d82f39347119a9fb49fb8e8893f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap440ca7d3-e2", "ovs_interfaceid": "440ca7d3-e2b8-4edf-9339-bd8d247d5da2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:33:44 user nova-compute[72586]: INFO nova.virt.block_device [None req-43557061-3600-44c5-91e0-d0735f410a74 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Attempting to driver detach volume 0f09b89d-693e-44b6-902b-f51e81d20b36 from mountpoint /dev/vdb
Aug 01 21:33:44 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-fa50673e-3079-403e-a837-45b22ede43a8 req-83f542e5-247b-4e89-bde1-45e5c81e1408 service nova] Releasing lock "refresh_cache-f6b0d907-2515-4a06-8b35-9ddd09ce42c3" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:33:44 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-43557061-3600-44c5-91e0-d0735f410a74 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Attempting to detach device vdb from instance f6b0d907-2515-4a06-8b35-9ddd09ce42c3 from the persistent domain config. {{(pid=72586) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 21:33:44 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-43557061-3600-44c5-91e0-d0735f410a74 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 21:33:44 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:33:44 user nova-compute[72586]:   <source dev="/dev/sdd"/>
Aug 01 21:33:44 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:33:44 user nova-compute[72586]:   <serial>0f09b89d-693e-44b6-902b-f51e81d20b36</serial>
Aug 01 21:33:44 user nova-compute[72586]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 21:33:44 user nova-compute[72586]: </disk>
Aug 01 21:33:44 user nova-compute[72586]:  {{(pid=72586) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 21:33:44 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-43557061-3600-44c5-91e0-d0735f410a74 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Successfully detached device vdb from instance f6b0d907-2515-4a06-8b35-9ddd09ce42c3 from the persistent domain config.
Aug 01 21:33:44 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-43557061-3600-44c5-91e0-d0735f410a74 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f6b0d907-2515-4a06-8b35-9ddd09ce42c3 from the live domain config. {{(pid=72586) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 21:33:44 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-43557061-3600-44c5-91e0-d0735f410a74 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 21:33:44 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:33:44 user nova-compute[72586]:   <source dev="/dev/sdd"/>
Aug 01 21:33:44 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:33:44 user nova-compute[72586]:   <serial>0f09b89d-693e-44b6-902b-f51e81d20b36</serial>
Aug 01 21:33:44 user nova-compute[72586]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 21:33:44 user nova-compute[72586]: </disk>
Aug 01 21:33:44 user nova-compute[72586]:  {{(pid=72586) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 21:33:44 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:33:44 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-860629af-1394-4f7c-b3f1-a832765a138a tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Acquiring lock "f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:33:44 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-860629af-1394-4f7c-b3f1-a832765a138a tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lock "f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:33:44 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-860629af-1394-4f7c-b3f1-a832765a138a tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Acquiring lock "f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:33:44 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-860629af-1394-4f7c-b3f1-a832765a138a tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lock "f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:33:44 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-860629af-1394-4f7c-b3f1-a832765a138a tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lock "f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:33:44 user nova-compute[72586]: INFO nova.compute.manager [None req-860629af-1394-4f7c-b3f1-a832765a138a tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Terminating instance
Aug 01 21:33:44 user nova-compute[72586]: DEBUG nova.compute.manager [None req-860629af-1394-4f7c-b3f1-a832765a138a tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Start destroying the instance on the hypervisor. {{(pid=72586) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 21:33:44 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:33:44 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:33:44 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:33:44 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:33:44 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:33:44 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Received event <DeviceRemovedEvent: 1690925624.918509, f6b0d907-2515-4a06-8b35-9ddd09ce42c3 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72586) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 21:33:44 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-43557061-3600-44c5-91e0-d0735f410a74 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f6b0d907-2515-4a06-8b35-9ddd09ce42c3 {{(pid=72586) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 21:33:44 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-43557061-3600-44c5-91e0-d0735f410a74 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Successfully detached device vdb from instance f6b0d907-2515-4a06-8b35-9ddd09ce42c3 from the live domain config.
Aug 01 21:33:44 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43557061-3600-44c5-91e0-d0735f410a74 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] calling os-brick to detach iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 21:33:44 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-43557061-3600-44c5-91e0-d0735f410a74 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, {'target_iqns': ['iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iLyYtsdO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:33:44 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-43557061-3600-44c5-91e0-d0735f410a74 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:33:44 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-43557061-3600-44c5-91e0-d0735f410a74 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:33:44 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-43557061-3600-44c5-91e0-d0735f410a74 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:33:44 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-43557061-3600-44c5-91e0-d0735f410a74 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36', 0)] {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 21:33:44 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:33:44 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:33:44 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3a0965-d476-4201-bd86-224b59498650]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:33:44 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:33:44 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:33:44 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea1beb1-5eb2-4b33-9ac2-6590e4489782]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:33:44 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-43557061-3600-44c5-91e0-d0735f410a74 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)
Aug 01 21:33:44 user nova-compute[72586]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:33:44 user nova-compute[72586]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 (non-flash)
Aug 01 21:33:44 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:33:44 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-43557061-3600-44c5-91e0-d0735f410a74 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 (non-flash)
Aug 01 21:33:44 user nova-compute[72586]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:33:44 user nova-compute[72586]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 (non-flash)
Aug 01 21:33:44 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:33:45 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-43557061-3600-44c5-91e0-d0735f410a74 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ef6fad360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36'): ({'sdd'}, set())}) {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 21:33:45 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-43557061-3600-44c5-91e0-d0735f410a74 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Removing single pathed devices sdd {{(pid=72586) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 21:33:45 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:33:45 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:33:45 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c12d44-8417-4eba-9d50-fb46eaacde46]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:33:45 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:33:45 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.028s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:33:45 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea234704-ef83-457f-8680-4015b926aac5]: (4, ('ok\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:33:45 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-43557061-3600-44c5-91e0-d0735f410a74 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Flushing IO for device /dev/sdd {{(pid=72586) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 21:33:45 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:33:45 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.062s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:33:45 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[710b2efd-a62a-433c-add9-c8ade3d1705c]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:33:45 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-43557061-3600-44c5-91e0-d0735f410a74 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72586) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 21:33:45 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:33:45 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:33:45 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5e2bc7-8cd3-4359-b97e-d49943a3263f]: (4, ('1', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:33:45 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-43557061-3600-44c5-91e0-d0735f410a74 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 21:33:45 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-43557061-3600-44c5-91e0-d0735f410a74 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] SCSI volumes sdd have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 21:33:45 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-43557061-3600-44c5-91e0-d0735f410a74 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36')] {{(pid=72586) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 21:33:45 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:33:45 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:33:45 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2aaeab-be08-4b5e-8dfd-5f25856486ee]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:33:45 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-43557061-3600-44c5-91e0-d0735f410a74 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:33:45 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 -p 172.16.0.220:3260 --logout {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:33:45 user nova-compute[72586]: DEBUG nova.compute.manager [req-b2d56030-7186-4aed-be8b-cbae5314fa94 req-a8cd57c4-f6f4-4724-99d1-79b6f5824c55 service nova] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Received event network-vif-unplugged-c9c37169-5d08-49e3-9fdf-705b9bbe1d2f {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:33:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-b2d56030-7186-4aed-be8b-cbae5314fa94 req-a8cd57c4-f6f4-4724-99d1-79b6f5824c55 service nova] Acquiring lock "f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:33:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-b2d56030-7186-4aed-be8b-cbae5314fa94 req-a8cd57c4-f6f4-4724-99d1-79b6f5824c55 service nova] Lock "f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:33:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-b2d56030-7186-4aed-be8b-cbae5314fa94 req-a8cd57c4-f6f4-4724-99d1-79b6f5824c55 service nova] Lock "f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:33:45 user nova-compute[72586]: DEBUG nova.compute.manager [req-b2d56030-7186-4aed-be8b-cbae5314fa94 req-a8cd57c4-f6f4-4724-99d1-79b6f5824c55 service nova] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] No waiting events found dispatching network-vif-unplugged-c9c37169-5d08-49e3-9fdf-705b9bbe1d2f {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:33:45 user nova-compute[72586]: DEBUG nova.compute.manager [req-b2d56030-7186-4aed-be8b-cbae5314fa94 req-a8cd57c4-f6f4-4724-99d1-79b6f5824c55 service nova] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Received event network-vif-unplugged-c9c37169-5d08-49e3-9fdf-705b9bbe1d2f for instance with task_state deleting. {{(pid=72586) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 21:33:45 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:33:45 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f37bacd-edb1-4c55-8401-a55330e6b2b9]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:33:45 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-43557061-3600-44c5-91e0-d0735f410a74 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36, portal: 172.16.0.220,3260]
Aug 01 21:33:45 user nova-compute[72586]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36, portal: 172.16.0.220,3260] successful.
Aug 01 21:33:45 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:33:45 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 -p 172.16.0.220:3260 --op delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:33:45 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f09b89d-693e-44b6-902b-f51e81d20b36 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:33:45 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b1af9c-01b0-4a83-9ff9-51d2b964762f]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:33:45 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-43557061-3600-44c5-91e0-d0735f410a74 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:33:45 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-43557061-3600-44c5-91e0-d0735f410a74 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.395s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:33:45 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-43557061-3600-44c5-91e0-d0735f410a74 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] <== disconnect_volume: return (396ms) None {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:33:45 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43557061-3600-44c5-91e0-d0735f410a74 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Disconnected iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 21:33:45 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Instance destroyed successfully.
Aug 01 21:33:45 user nova-compute[72586]: DEBUG nova.objects.instance [None req-860629af-1394-4f7c-b3f1-a832765a138a tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lazy-loading 'resources' on Instance uuid f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:33:45 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-860629af-1394-4f7c-b3f1-a832765a138a tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:26:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-126933273',display_name='tempest-SnapshotDataIntegrityTests-server-126933273',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-126933273',id=19,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7BxuMdIZxuc72OR+/9o2mfTCKogaaJQw0W3UrLNxJOa2XuM1a9MeVmtAUOqc2nCXBIm3RyystcERj8JPuFFrNZnvF6yqV8rDaDg8ZMzzI5LRaDe1X2D+I7obyIzf+ZSg==',key_name='tempest-keypair-685232566',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:26:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e6493ab8139843b191e013e61f12c877',ramdisk_id='',reservation_id='r-psj7gsuv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-215581212',owner_user_name='tempest-SnapshotDataIntegrityTests-215581212-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:26:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='794eb6a1fe4e4d3f868b57f774918b4f',uuid=f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c9c37169-5d08-49e3-9fdf-705b9bbe1d2f", "address": "fa:16:3e:ac:44:36", "network": {"id": "9ac81b44-4ebf-4780-8146-bebeb56a36b8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1925422576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6493ab8139843b191e013e61f12c877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9c37169-5d", "ovs_interfaceid": "c9c37169-5d08-49e3-9fdf-705b9bbe1d2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:33:45 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-860629af-1394-4f7c-b3f1-a832765a138a tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Converting VIF {"id": "c9c37169-5d08-49e3-9fdf-705b9bbe1d2f", "address": "fa:16:3e:ac:44:36", "network": {"id": "9ac81b44-4ebf-4780-8146-bebeb56a36b8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1925422576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6493ab8139843b191e013e61f12c877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9c37169-5d", "ovs_interfaceid": "c9c37169-5d08-49e3-9fdf-705b9bbe1d2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:33:45 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-860629af-1394-4f7c-b3f1-a832765a138a tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:44:36,bridge_name='br-int',has_traffic_filtering=True,id=c9c37169-5d08-49e3-9fdf-705b9bbe1d2f,network=Network(9ac81b44-4ebf-4780-8146-bebeb56a36b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9c37169-5d') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:33:45 user nova-compute[72586]: DEBUG os_vif [None req-860629af-1394-4f7c-b3f1-a832765a138a tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:44:36,bridge_name='br-int',has_traffic_filtering=True,id=c9c37169-5d08-49e3-9fdf-705b9bbe1d2f,network=Network(9ac81b44-4ebf-4780-8146-bebeb56a36b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9c37169-5d') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:33:45 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:33:45 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc9c37169-5d, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:33:45 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:33:45 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:33:45 user nova-compute[72586]: INFO os_vif [None req-860629af-1394-4f7c-b3f1-a832765a138a tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:44:36,bridge_name='br-int',has_traffic_filtering=True,id=c9c37169-5d08-49e3-9fdf-705b9bbe1d2f,network=Network(9ac81b44-4ebf-4780-8146-bebeb56a36b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9c37169-5d')
Aug 01 21:33:45 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-860629af-1394-4f7c-b3f1-a832765a138a tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Deleting instance files /opt/stack/data/nova/instances/f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536_del
Aug 01 21:33:45 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-860629af-1394-4f7c-b3f1-a832765a138a tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Deletion of /opt/stack/data/nova/instances/f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536_del complete
Aug 01 21:33:45 user nova-compute[72586]: INFO nova.compute.manager [None req-860629af-1394-4f7c-b3f1-a832765a138a tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 01 21:33:45 user nova-compute[72586]: DEBUG oslo.service.loopingcall [None req-860629af-1394-4f7c-b3f1-a832765a138a tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72586) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 21:33:45 user nova-compute[72586]: DEBUG nova.compute.manager [-] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Deallocating network for instance {{(pid=72586) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 21:33:45 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] deallocate_for_instance() {{(pid=72586) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 21:33:45 user nova-compute[72586]: DEBUG nova.compute.manager [req-176c70d8-d170-4859-8669-ed6bb41edacf req-4673b99e-ca26-4e35-bb6d-61235b083d37 service nova] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Received event network-changed-440ca7d3-e2b8-4edf-9339-bd8d247d5da2 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:33:45 user nova-compute[72586]: DEBUG nova.compute.manager [req-176c70d8-d170-4859-8669-ed6bb41edacf req-4673b99e-ca26-4e35-bb6d-61235b083d37 service nova] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Refreshing instance network info cache due to event network-changed-440ca7d3-e2b8-4edf-9339-bd8d247d5da2. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:33:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-176c70d8-d170-4859-8669-ed6bb41edacf req-4673b99e-ca26-4e35-bb6d-61235b083d37 service nova] Acquiring lock "refresh_cache-f6b0d907-2515-4a06-8b35-9ddd09ce42c3" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:33:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-176c70d8-d170-4859-8669-ed6bb41edacf req-4673b99e-ca26-4e35-bb6d-61235b083d37 service nova] Acquired lock "refresh_cache-f6b0d907-2515-4a06-8b35-9ddd09ce42c3" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:33:45 user nova-compute[72586]: DEBUG nova.network.neutron [req-176c70d8-d170-4859-8669-ed6bb41edacf req-4673b99e-ca26-4e35-bb6d-61235b083d37 service nova] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Refreshing network info cache for port 440ca7d3-e2b8-4edf-9339-bd8d247d5da2 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:33:46 user nova-compute[72586]: DEBUG nova.objects.instance [None req-43557061-3600-44c5-91e0-d0735f410a74 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lazy-loading 'flavor' on Instance uuid f6b0d907-2515-4a06-8b35-9ddd09ce42c3 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:33:46 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-43557061-3600-44c5-91e0-d0735f410a74 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "f6b0d907-2515-4a06-8b35-9ddd09ce42c3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.875s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:33:46 user nova-compute[72586]: DEBUG nova.network.neutron [req-176c70d8-d170-4859-8669-ed6bb41edacf req-4673b99e-ca26-4e35-bb6d-61235b083d37 service nova] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Updated VIF entry in instance network info cache for port 440ca7d3-e2b8-4edf-9339-bd8d247d5da2. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:33:46 user nova-compute[72586]: DEBUG nova.network.neutron [req-176c70d8-d170-4859-8669-ed6bb41edacf req-4673b99e-ca26-4e35-bb6d-61235b083d37 service nova] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Updating instance_info_cache with network_info: [{"id": "440ca7d3-e2b8-4edf-9339-bd8d247d5da2", "address": "fa:16:3e:29:ff:63", "network": {"id": "d229a8de-7a2b-4dcd-a9ac-44a40349676e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-67691992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b1a1d82f39347119a9fb49fb8e8893f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap440ca7d3-e2", "ovs_interfaceid": "440ca7d3-e2b8-4edf-9339-bd8d247d5da2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:33:46 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-176c70d8-d170-4859-8669-ed6bb41edacf req-4673b99e-ca26-4e35-bb6d-61235b083d37 service nova] Releasing lock "refresh_cache-f6b0d907-2515-4a06-8b35-9ddd09ce42c3" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:33:46 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:33:46 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Took 1.04 seconds to deallocate network for instance.
Aug 01 21:33:46 user nova-compute[72586]: DEBUG nova.compute.manager [req-948d4cc6-cff0-4b69-8ec9-321d918736b2 req-97a02cf0-a155-4adb-a20c-339ed5684d80 service nova] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Received event network-vif-deleted-c9c37169-5d08-49e3-9fdf-705b9bbe1d2f {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:33:46 user nova-compute[72586]: INFO nova.compute.manager [req-948d4cc6-cff0-4b69-8ec9-321d918736b2 req-97a02cf0-a155-4adb-a20c-339ed5684d80 service nova] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Neutron deleted interface c9c37169-5d08-49e3-9fdf-705b9bbe1d2f; detaching it from the instance and deleting it from the info cache
Aug 01 21:33:46 user nova-compute[72586]: DEBUG nova.network.neutron [req-948d4cc6-cff0-4b69-8ec9-321d918736b2 req-97a02cf0-a155-4adb-a20c-339ed5684d80 service nova] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:33:46 user nova-compute[72586]: DEBUG nova.compute.manager [req-948d4cc6-cff0-4b69-8ec9-321d918736b2 req-97a02cf0-a155-4adb-a20c-339ed5684d80 service nova] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Detach interface failed, port_id=c9c37169-5d08-49e3-9fdf-705b9bbe1d2f, reason: Instance f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536 could not be found. {{(pid=72586) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 21:33:46 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-860629af-1394-4f7c-b3f1-a832765a138a tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:33:46 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-860629af-1394-4f7c-b3f1-a832765a138a tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:33:46 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-860629af-1394-4f7c-b3f1-a832765a138a tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:33:46 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-860629af-1394-4f7c-b3f1-a832765a138a tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:33:46 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-860629af-1394-4f7c-b3f1-a832765a138a tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.303s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:33:47 user nova-compute[72586]: INFO nova.scheduler.client.report [None req-860629af-1394-4f7c-b3f1-a832765a138a tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Deleted allocations for instance f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536
Aug 01 21:33:47 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-860629af-1394-4f7c-b3f1-a832765a138a tempest-SnapshotDataIntegrityTests-215581212 tempest-SnapshotDataIntegrityTests-215581212-project-member] Lock "f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.529s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:33:47 user nova-compute[72586]: DEBUG nova.compute.manager [req-a59833b8-562a-40fe-853e-2a8920d9b5fa req-cd6ff0c8-5921-4ad2-89e7-1268c4f6aec4 service nova] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Received event network-vif-plugged-c9c37169-5d08-49e3-9fdf-705b9bbe1d2f {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:33:47 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-a59833b8-562a-40fe-853e-2a8920d9b5fa req-cd6ff0c8-5921-4ad2-89e7-1268c4f6aec4 service nova] Acquiring lock "f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:33:47 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-a59833b8-562a-40fe-853e-2a8920d9b5fa req-cd6ff0c8-5921-4ad2-89e7-1268c4f6aec4 service nova] Lock "f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:33:47 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-a59833b8-562a-40fe-853e-2a8920d9b5fa req-cd6ff0c8-5921-4ad2-89e7-1268c4f6aec4 service nova] Lock "f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:33:47 user nova-compute[72586]: DEBUG nova.compute.manager [req-a59833b8-562a-40fe-853e-2a8920d9b5fa req-cd6ff0c8-5921-4ad2-89e7-1268c4f6aec4 service nova] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] No waiting events found dispatching network-vif-plugged-c9c37169-5d08-49e3-9fdf-705b9bbe1d2f {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:33:47 user nova-compute[72586]: WARNING nova.compute.manager [req-a59833b8-562a-40fe-853e-2a8920d9b5fa req-cd6ff0c8-5921-4ad2-89e7-1268c4f6aec4 service nova] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Received unexpected event network-vif-plugged-c9c37169-5d08-49e3-9fdf-705b9bbe1d2f for instance with vm_state deleted and task_state None.
Aug 01 21:33:48 user nova-compute[72586]: INFO nova.compute.manager [None req-09aca45a-4353-4dba-9b78-239f4b45e7c9 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Unrescuing
Aug 01 21:33:48 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-09aca45a-4353-4dba-9b78-239f4b45e7c9 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Acquiring lock "refresh_cache-161fab9d-a7d1-4ea0-b4b9-2afc54040eef" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:33:48 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-09aca45a-4353-4dba-9b78-239f4b45e7c9 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Acquired lock "refresh_cache-161fab9d-a7d1-4ea0-b4b9-2afc54040eef" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:33:48 user nova-compute[72586]: DEBUG nova.network.neutron [None req-09aca45a-4353-4dba-9b78-239f4b45e7c9 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:33:50 user nova-compute[72586]: DEBUG nova.network.neutron [None req-09aca45a-4353-4dba-9b78-239f4b45e7c9 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Updating instance_info_cache with network_info: [{"id": "c082b11d-fb01-4def-98b8-6b2966ce364c", "address": "fa:16:3e:b6:24:7c", "network": {"id": "86940e5d-852b-48fc-9b0e-858305321349", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1967467603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d847d04360420c80ea5608d5a2b15a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc082b11d-fb", "ovs_interfaceid": "c082b11d-fb01-4def-98b8-6b2966ce364c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:33:50 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-09aca45a-4353-4dba-9b78-239f4b45e7c9 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Releasing lock "refresh_cache-161fab9d-a7d1-4ea0-b4b9-2afc54040eef" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:33:50 user nova-compute[72586]: DEBUG nova.objects.instance [None req-09aca45a-4353-4dba-9b78-239f4b45e7c9 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lazy-loading 'flavor' on Instance uuid 161fab9d-a7d1-4ea0-b4b9-2afc54040eef {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:33:50 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:33:50 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:33:50 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:33:50 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:33:50 user nova-compute[72586]: DEBUG nova.compute.manager [req-87efa049-c79d-4c07-b62c-450f9ed0ce51 req-161d4b9d-9721-4add-8492-e2d1242aa64b service nova] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Received event network-vif-unplugged-c082b11d-fb01-4def-98b8-6b2966ce364c {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:33:50 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-87efa049-c79d-4c07-b62c-450f9ed0ce51 req-161d4b9d-9721-4add-8492-e2d1242aa64b service nova] Acquiring lock "161fab9d-a7d1-4ea0-b4b9-2afc54040eef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:33:50 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-87efa049-c79d-4c07-b62c-450f9ed0ce51 req-161d4b9d-9721-4add-8492-e2d1242aa64b service nova] Lock "161fab9d-a7d1-4ea0-b4b9-2afc54040eef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:33:50 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-87efa049-c79d-4c07-b62c-450f9ed0ce51 req-161d4b9d-9721-4add-8492-e2d1242aa64b service nova] Lock "161fab9d-a7d1-4ea0-b4b9-2afc54040eef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:33:50 user nova-compute[72586]: DEBUG nova.compute.manager [req-87efa049-c79d-4c07-b62c-450f9ed0ce51 req-161d4b9d-9721-4add-8492-e2d1242aa64b service nova] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] No waiting events found dispatching network-vif-unplugged-c082b11d-fb01-4def-98b8-6b2966ce364c {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:33:50 user nova-compute[72586]: WARNING nova.compute.manager [req-87efa049-c79d-4c07-b62c-450f9ed0ce51 req-161d4b9d-9721-4add-8492-e2d1242aa64b service nova] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Received unexpected event network-vif-unplugged-c082b11d-fb01-4def-98b8-6b2966ce364c for instance with vm_state rescued and task_state unrescuing.
Aug 01 21:33:50 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:33:51 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Instance destroyed successfully.
Aug 01 21:33:51 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab865b5c-830a-49a6-927f-b425ffc46172 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Calling os-brick to attach iSCSI Volume {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 21:33:51 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab865b5c-830a-49a6-927f-b425ffc46172 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xnDJlRBb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:33:51 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-ab865b5c-830a-49a6-927f-b425ffc46172 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:33:51 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-ab865b5c-830a-49a6-927f-b425ffc46172 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:33:51 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-ab865b5c-830a-49a6-927f-b425ffc46172 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:33:51 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-ab865b5c-830a-49a6-927f-b425ffc46172 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:33:51 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-ab865b5c-830a-49a6-927f-b425ffc46172 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:33:51 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-ab865b5c-830a-49a6-927f-b425ffc46172 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:33:51 user nova-compute[72586]: INFO os_brick.initiator.connectors.iscsi [None req-ab865b5c-830a-49a6-927f-b425ffc46172 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 21:33:51 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 -p 172.16.0.220:3260 {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:33:51 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:33:51 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b590a4-d2f8-4d45-a751-dd90be6e28c5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:33:51 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab865b5c-830a-49a6-927f-b425ffc46172 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 21:33:51 user nova-compute[72586]:  {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:33:51 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 -p 172.16.0.220:3260 --interface default --op new {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:33:51 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:33:51 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1285d721-0544-4170-ae0d-7ba7a1ded641]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96] added\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:33:51 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab865b5c-830a-49a6-927f-b425ffc46172 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96] added
Aug 01 21:33:51 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:33:51 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:33:51 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:33:51 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0dfbcf-b6cd-4d35-bdec-f394d6139627]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:33:51 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab865b5c-830a-49a6-927f-b425ffc46172 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:33:51 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:33:51 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:33:51 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d96e84-e4d1-4ab3-9397-91399e47c18b]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:33:51 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab865b5c-830a-49a6-927f-b425ffc46172 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:33:51 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xnDJlRBb {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:33:51 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xnDJlRBb" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:33:51 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[937ddd9a-47e6-4f17-a04c-dc3ff2eda69e]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:33:51 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab865b5c-830a-49a6-927f-b425ffc46172 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xnDJlRBb'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:33:51 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:33:51 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:33:51 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb93e7e-813a-49ed-a6e9-a9032dad2be5]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:33:51 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab865b5c-830a-49a6-927f-b425ffc46172 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:33:51 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:33:51 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:33:51 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[34651fb2-45e8-4f7f-a1ea-56485f8d7d8c]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:33:51 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab865b5c-830a-49a6-927f-b425ffc46172 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:33:51 user nova-compute[72586]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 (non-flash)
Aug 01 21:33:51 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:33:51 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab865b5c-830a-49a6-927f-b425ffc46172 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:33:51 user nova-compute[72586]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 (non-flash)
Aug 01 21:33:51 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:33:51 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 -p 172.16.0.220:3260 --login {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:33:51 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:33:51 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[940d3da2-6765-4913-975a-86186e8d975b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:33:51 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab865b5c-830a-49a6-927f-b425ffc46172 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96, portal: 172.16.0.220,3260]
Aug 01 21:33:51 user nova-compute[72586]: Login to [iface: default, target: iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96, portal: 172.16.0.220,3260] successful.
Aug 01 21:33:51 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:33:51 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:33:51 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:33:51 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af3ebfe-89a3-455b-a477-77148c777f55]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:33:51 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab865b5c-830a-49a6-927f-b425ffc46172 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:33:51 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:33:51 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:33:51 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2b78f7-f5bb-4636-a743-d4886fbb6e2d]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:33:51 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab865b5c-830a-49a6-927f-b425ffc46172 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:33:51 user nova-compute[72586]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 (non-flash)
Aug 01 21:33:51 user nova-compute[72586]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 (non-flash)
Aug 01 21:33:51 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:33:51 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab865b5c-830a-49a6-927f-b425ffc46172 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:33:51 user nova-compute[72586]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 (non-flash)
Aug 01 21:33:51 user nova-compute[72586]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 (non-flash)
Aug 01 21:33:51 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:33:51 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-ab865b5c-830a-49a6-927f-b425ffc46172 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:33:51 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab865b5c-830a-49a6-927f-b425ffc46172 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Connected to 172.16.0.220:3260 {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 21:33:51 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-ab865b5c-830a-49a6-927f-b425ffc46172 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] HCTL ('35', '-', '-', 0) found on session 37 with lun 0 {{(pid=72586) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 21:33:51 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-ab865b5c-830a-49a6-927f-b425ffc46172 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72586) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 21:33:51 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:33:51 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:33:51 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff38f0d-5c83-47a6-bd95-b9b5b6ad65d7]: (4, ('- - 0', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:33:51 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-ab865b5c-830a-49a6-927f-b425ffc46172 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:33:51 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab865b5c-830a-49a6-927f-b425ffc46172 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xnDJlRBb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 21:33:52 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:33:52 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:33:52 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:33:52 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:33:52 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-ab865b5c-830a-49a6-927f-b425ffc46172 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:33:52 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab865b5c-830a-49a6-927f-b425ffc46172 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23539396561623365', 'path': '/dev/sdd'} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:33:52 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab865b5c-830a-49a6-927f-b425ffc46172 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539396561623365', 'path': '/dev/sdd'} {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 21:33:52 user nova-compute[72586]: DEBUG nova.objects.instance [None req-ab865b5c-830a-49a6-927f-b425ffc46172 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lazy-loading 'flavor' on Instance uuid 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:33:52 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-ab865b5c-830a-49a6-927f-b425ffc46172 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 21:33:52 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:33:52 user nova-compute[72586]:   <source dev="/dev/sdd"/>
Aug 01 21:33:52 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:33:52 user nova-compute[72586]:   <serial>cbc36d6d-5805-4d7b-bf27-f170dcdd4f96</serial>
Aug 01 21:33:52 user nova-compute[72586]: </disk>
Aug 01 21:33:52 user nova-compute[72586]:  {{(pid=72586) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 21:33:52 user nova-compute[72586]: DEBUG nova.compute.manager [req-75382df9-2b58-43b7-a34f-2f6d12544f22 req-b405b112-1e2a-441d-b053-176974dd2d93 service nova] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Received event network-vif-plugged-c082b11d-fb01-4def-98b8-6b2966ce364c {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:33:52 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-75382df9-2b58-43b7-a34f-2f6d12544f22 req-b405b112-1e2a-441d-b053-176974dd2d93 service nova] Acquiring lock "161fab9d-a7d1-4ea0-b4b9-2afc54040eef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:33:52 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-75382df9-2b58-43b7-a34f-2f6d12544f22 req-b405b112-1e2a-441d-b053-176974dd2d93 service nova] Lock "161fab9d-a7d1-4ea0-b4b9-2afc54040eef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:33:52 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-75382df9-2b58-43b7-a34f-2f6d12544f22 req-b405b112-1e2a-441d-b053-176974dd2d93 service nova] Lock "161fab9d-a7d1-4ea0-b4b9-2afc54040eef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:33:52 user nova-compute[72586]: DEBUG nova.compute.manager [req-75382df9-2b58-43b7-a34f-2f6d12544f22 req-b405b112-1e2a-441d-b053-176974dd2d93 service nova] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] No waiting events found dispatching network-vif-plugged-c082b11d-fb01-4def-98b8-6b2966ce364c {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:33:52 user nova-compute[72586]: WARNING nova.compute.manager [req-75382df9-2b58-43b7-a34f-2f6d12544f22 req-b405b112-1e2a-441d-b053-176974dd2d93 service nova] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Received unexpected event network-vif-plugged-c082b11d-fb01-4def-98b8-6b2966ce364c for instance with vm_state rescued and task_state unrescuing.
Aug 01 21:33:52 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:33:53 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-ab865b5c-830a-49a6-927f-b425ffc46172 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:33:53 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-ab865b5c-830a-49a6-927f-b425ffc46172 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:33:53 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-ab865b5c-830a-49a6-927f-b425ffc46172 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] No VIF found with MAC fa:16:3e:cc:46:65, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:33:53 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-ab865b5c-830a-49a6-927f-b425ffc46172 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.156s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:33:53 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:33:54 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:33:54 user nova-compute[72586]: DEBUG nova.compute.manager [req-f7d4ec56-65d7-489e-afeb-1157814696d8 req-ba6efbd8-acd8-45c4-a94d-860188b4796c service nova] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Received event network-vif-plugged-c082b11d-fb01-4def-98b8-6b2966ce364c {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:33:54 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-f7d4ec56-65d7-489e-afeb-1157814696d8 req-ba6efbd8-acd8-45c4-a94d-860188b4796c service nova] Acquiring lock "161fab9d-a7d1-4ea0-b4b9-2afc54040eef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:33:54 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-f7d4ec56-65d7-489e-afeb-1157814696d8 req-ba6efbd8-acd8-45c4-a94d-860188b4796c service nova] Lock "161fab9d-a7d1-4ea0-b4b9-2afc54040eef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:33:54 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-f7d4ec56-65d7-489e-afeb-1157814696d8 req-ba6efbd8-acd8-45c4-a94d-860188b4796c service nova] Lock "161fab9d-a7d1-4ea0-b4b9-2afc54040eef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:33:54 user nova-compute[72586]: DEBUG nova.compute.manager [req-f7d4ec56-65d7-489e-afeb-1157814696d8 req-ba6efbd8-acd8-45c4-a94d-860188b4796c service nova] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] No waiting events found dispatching network-vif-plugged-c082b11d-fb01-4def-98b8-6b2966ce364c {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:33:54 user nova-compute[72586]: WARNING nova.compute.manager [req-f7d4ec56-65d7-489e-afeb-1157814696d8 req-ba6efbd8-acd8-45c4-a94d-860188b4796c service nova] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Received unexpected event network-vif-plugged-c082b11d-fb01-4def-98b8-6b2966ce364c for instance with vm_state rescued and task_state unrescuing.
Aug 01 21:33:54 user nova-compute[72586]: DEBUG nova.compute.manager [req-f7d4ec56-65d7-489e-afeb-1157814696d8 req-ba6efbd8-acd8-45c4-a94d-860188b4796c service nova] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Received event network-vif-plugged-c082b11d-fb01-4def-98b8-6b2966ce364c {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:33:54 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-f7d4ec56-65d7-489e-afeb-1157814696d8 req-ba6efbd8-acd8-45c4-a94d-860188b4796c service nova] Acquiring lock "161fab9d-a7d1-4ea0-b4b9-2afc54040eef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:33:54 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-f7d4ec56-65d7-489e-afeb-1157814696d8 req-ba6efbd8-acd8-45c4-a94d-860188b4796c service nova] Lock "161fab9d-a7d1-4ea0-b4b9-2afc54040eef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:33:54 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-f7d4ec56-65d7-489e-afeb-1157814696d8 req-ba6efbd8-acd8-45c4-a94d-860188b4796c service nova] Lock "161fab9d-a7d1-4ea0-b4b9-2afc54040eef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:33:54 user nova-compute[72586]: DEBUG nova.compute.manager [req-f7d4ec56-65d7-489e-afeb-1157814696d8 req-ba6efbd8-acd8-45c4-a94d-860188b4796c service nova] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] No waiting events found dispatching network-vif-plugged-c082b11d-fb01-4def-98b8-6b2966ce364c {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:33:54 user nova-compute[72586]: WARNING nova.compute.manager [req-f7d4ec56-65d7-489e-afeb-1157814696d8 req-ba6efbd8-acd8-45c4-a94d-860188b4796c service nova] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Received unexpected event network-vif-plugged-c082b11d-fb01-4def-98b8-6b2966ce364c for instance with vm_state rescued and task_state unrescuing.
Aug 01 21:33:55 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Removed pending event for 161fab9d-a7d1-4ea0-b4b9-2afc54040eef due to event {{(pid=72586) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 21:33:55 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925635.16858, 161fab9d-a7d1-4ea0-b4b9-2afc54040eef => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:33:55 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] VM Resumed (Lifecycle Event)
Aug 01 21:33:55 user nova-compute[72586]: DEBUG nova.compute.manager [None req-09aca45a-4353-4dba-9b78-239f4b45e7c9 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:33:55 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:33:55 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:33:55 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 01 21:33:55 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925635.1733048, 161fab9d-a7d1-4ea0-b4b9-2afc54040eef => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:33:55 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] VM Started (Lifecycle Event)
Aug 01 21:33:55 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:33:55 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:33:55 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:33:56 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:33:59 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:00 user nova-compute[72586]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690925625.426966, f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536 => Stopped> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:34:00 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] VM Stopped (Lifecycle Event)
Aug 01 21:34:00 user nova-compute[72586]: DEBUG nova.compute.manager [None req-39b8883f-caa8-4ab7-9386-21454ba241f0 None None] [instance: f6c4b0c3-49c1-4c1c-b4f2-2fdde4f45536] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:34:00 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:01 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:03 user nova-compute[72586]: DEBUG nova.compute.manager [req-24a0c91c-ae38-4bee-babe-6f58b904ad5d req-e805f76c-fda5-4f47-936e-cd6bdbada245 service nova] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Received event network-changed-5b244939-e725-4cc8-8407-a7dd0bbc7ec4 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:34:03 user nova-compute[72586]: DEBUG nova.compute.manager [req-24a0c91c-ae38-4bee-babe-6f58b904ad5d req-e805f76c-fda5-4f47-936e-cd6bdbada245 service nova] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Refreshing instance network info cache due to event network-changed-5b244939-e725-4cc8-8407-a7dd0bbc7ec4. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:34:03 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-24a0c91c-ae38-4bee-babe-6f58b904ad5d req-e805f76c-fda5-4f47-936e-cd6bdbada245 service nova] Acquiring lock "refresh_cache-0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:34:03 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-24a0c91c-ae38-4bee-babe-6f58b904ad5d req-e805f76c-fda5-4f47-936e-cd6bdbada245 service nova] Acquired lock "refresh_cache-0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:34:03 user nova-compute[72586]: DEBUG nova.network.neutron [req-24a0c91c-ae38-4bee-babe-6f58b904ad5d req-e805f76c-fda5-4f47-936e-cd6bdbada245 service nova] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Refreshing network info cache for port 5b244939-e725-4cc8-8407-a7dd0bbc7ec4 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:34:04 user nova-compute[72586]: DEBUG nova.network.neutron [req-24a0c91c-ae38-4bee-babe-6f58b904ad5d req-e805f76c-fda5-4f47-936e-cd6bdbada245 service nova] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Updated VIF entry in instance network info cache for port 5b244939-e725-4cc8-8407-a7dd0bbc7ec4. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:34:04 user nova-compute[72586]: DEBUG nova.network.neutron [req-24a0c91c-ae38-4bee-babe-6f58b904ad5d req-e805f76c-fda5-4f47-936e-cd6bdbada245 service nova] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Updating instance_info_cache with network_info: [{"id": "5b244939-e725-4cc8-8407-a7dd0bbc7ec4", "address": "fa:16:3e:cc:46:65", "network": {"id": "56c3419f-2c2c-4dda-88d7-ba96e2a689fd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-705071098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ae5f1c56b348de8a03f1a4bcdd9b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b244939-e7", "ovs_interfaceid": "5b244939-e725-4cc8-8407-a7dd0bbc7ec4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:34:04 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-24a0c91c-ae38-4bee-babe-6f58b904ad5d req-e805f76c-fda5-4f47-936e-cd6bdbada245 service nova] Releasing lock "refresh_cache-0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:34:04 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:05 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:05 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:05 user nova-compute[72586]: DEBUG nova.compute.manager [req-d3cf0d39-7c70-4f14-8005-959ae28da09a req-028ee00f-890c-45a4-b97d-98232c31b1b1 service nova] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Received event network-changed-5b244939-e725-4cc8-8407-a7dd0bbc7ec4 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:34:05 user nova-compute[72586]: DEBUG nova.compute.manager [req-d3cf0d39-7c70-4f14-8005-959ae28da09a req-028ee00f-890c-45a4-b97d-98232c31b1b1 service nova] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Refreshing instance network info cache due to event network-changed-5b244939-e725-4cc8-8407-a7dd0bbc7ec4. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:34:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d3cf0d39-7c70-4f14-8005-959ae28da09a req-028ee00f-890c-45a4-b97d-98232c31b1b1 service nova] Acquiring lock "refresh_cache-0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:34:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d3cf0d39-7c70-4f14-8005-959ae28da09a req-028ee00f-890c-45a4-b97d-98232c31b1b1 service nova] Acquired lock "refresh_cache-0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:34:05 user nova-compute[72586]: DEBUG nova.network.neutron [req-d3cf0d39-7c70-4f14-8005-959ae28da09a req-028ee00f-890c-45a4-b97d-98232c31b1b1 service nova] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Refreshing network info cache for port 5b244939-e725-4cc8-8407-a7dd0bbc7ec4 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:34:06 user nova-compute[72586]: DEBUG nova.network.neutron [req-d3cf0d39-7c70-4f14-8005-959ae28da09a req-028ee00f-890c-45a4-b97d-98232c31b1b1 service nova] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Updated VIF entry in instance network info cache for port 5b244939-e725-4cc8-8407-a7dd0bbc7ec4. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:34:06 user nova-compute[72586]: DEBUG nova.network.neutron [req-d3cf0d39-7c70-4f14-8005-959ae28da09a req-028ee00f-890c-45a4-b97d-98232c31b1b1 service nova] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Updating instance_info_cache with network_info: [{"id": "5b244939-e725-4cc8-8407-a7dd0bbc7ec4", "address": "fa:16:3e:cc:46:65", "network": {"id": "56c3419f-2c2c-4dda-88d7-ba96e2a689fd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-705071098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ae5f1c56b348de8a03f1a4bcdd9b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b244939-e7", "ovs_interfaceid": "5b244939-e725-4cc8-8407-a7dd0bbc7ec4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:34:06 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d3cf0d39-7c70-4f14-8005-959ae28da09a req-028ee00f-890c-45a4-b97d-98232c31b1b1 service nova] Releasing lock "refresh_cache-0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:34:07 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Acquiring lock "3ced1426-a20e-4d5f-8250-e789eba6f098" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:34:07 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Lock "3ced1426-a20e-4d5f-8250-e789eba6f098" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:34:07 user nova-compute[72586]: DEBUG nova.compute.manager [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] Starting instance... {{(pid=72586) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 21:34:07 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:34:07 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:34:07 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72586) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 21:34:07 user nova-compute[72586]: INFO nova.compute.claims [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] Claim successful on node user
Aug 01 21:34:07 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:34:07 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:34:07 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.497s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:34:07 user nova-compute[72586]: DEBUG nova.compute.manager [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] Start building networks asynchronously for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 21:34:07 user nova-compute[72586]: DEBUG nova.compute.manager [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] Allocating IP information in the background. {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 21:34:07 user nova-compute[72586]: DEBUG nova.network.neutron [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] allocate_for_instance() {{(pid=72586) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 21:34:07 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 21:34:08 user nova-compute[72586]: DEBUG nova.compute.manager [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] Start building block device mappings for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 21:34:08 user nova-compute[72586]: DEBUG nova.policy [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6cda5cb14a4d463791ae0daa0cb55f31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64482461ec146daab58ef5da8a52ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72586) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 21:34:08 user nova-compute[72586]: DEBUG nova.compute.manager [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] Start spawning the instance on the hypervisor. {{(pid=72586) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 21:34:08 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] Creating instance directory {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 21:34:08 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] Creating image(s)
Aug 01 21:34:08 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Acquiring lock "/opt/stack/data/nova/instances/3ced1426-a20e-4d5f-8250-e789eba6f098/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:34:08 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Lock "/opt/stack/data/nova/instances/3ced1426-a20e-4d5f-8250-e789eba6f098/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:34:08 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Lock "/opt/stack/data/nova/instances/3ced1426-a20e-4d5f-8250-e789eba6f098/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:34:08 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:08 user nova-compute[72586]: DEBUG nova.compute.manager [req-f3c581ae-c27b-4ed6-8033-c92b02ae8b7b req-28a502c2-16e0-49c5-86c8-efbdaeb6fc81 service nova] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Received event network-changed-99688c7a-3e71-49d8-9002-0075560858c9 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:34:08 user nova-compute[72586]: DEBUG nova.compute.manager [req-f3c581ae-c27b-4ed6-8033-c92b02ae8b7b req-28a502c2-16e0-49c5-86c8-efbdaeb6fc81 service nova] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Refreshing instance network info cache due to event network-changed-99688c7a-3e71-49d8-9002-0075560858c9. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:34:08 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-f3c581ae-c27b-4ed6-8033-c92b02ae8b7b req-28a502c2-16e0-49c5-86c8-efbdaeb6fc81 service nova] Acquiring lock "refresh_cache-49c24c77-f102-4aed-8314-b04aad5f6b3a" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:34:08 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-f3c581ae-c27b-4ed6-8033-c92b02ae8b7b req-28a502c2-16e0-49c5-86c8-efbdaeb6fc81 service nova] Acquired lock "refresh_cache-49c24c77-f102-4aed-8314-b04aad5f6b3a" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:34:08 user nova-compute[72586]: DEBUG nova.network.neutron [req-f3c581ae-c27b-4ed6-8033-c92b02ae8b7b req-28a502c2-16e0-49c5-86c8-efbdaeb6fc81 service nova] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Refreshing network info cache for port 99688c7a-3e71-49d8-9002-0075560858c9 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:34:08 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.145s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:08 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Acquiring lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:34:08 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:34:08 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:08 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.152s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:08 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/3ced1426-a20e-4d5f-8250-e789eba6f098/disk 1073741824 {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:08 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/3ced1426-a20e-4d5f-8250-e789eba6f098/disk 1073741824" returned: 0 in 0.053s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:08 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.210s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:34:08 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:08 user nova-compute[72586]: DEBUG nova.network.neutron [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] Successfully created port: 08a5cc80-89c1-46d0-af8f-215233fff7f0 {{(pid=72586) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 21:34:08 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.184s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:08 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3ced1426-a20e-4d5f-8250-e789eba6f098/disk. size=1073741824 {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 21:34:08 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ced1426-a20e-4d5f-8250-e789eba6f098/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:08 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ced1426-a20e-4d5f-8250-e789eba6f098/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:08 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Cannot resize image /opt/stack/data/nova/instances/3ced1426-a20e-4d5f-8250-e789eba6f098/disk to a smaller size. {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 21:34:08 user nova-compute[72586]: DEBUG nova.objects.instance [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Lazy-loading 'migration_context' on Instance uuid 3ced1426-a20e-4d5f-8250-e789eba6f098 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:34:08 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] Created local disks {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 21:34:08 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] Ensure instance console log exists: /opt/stack/data/nova/instances/3ced1426-a20e-4d5f-8250-e789eba6f098/console.log {{(pid=72586) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 21:34:08 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:34:08 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:34:08 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:34:09 user nova-compute[72586]: DEBUG nova.network.neutron [req-f3c581ae-c27b-4ed6-8033-c92b02ae8b7b req-28a502c2-16e0-49c5-86c8-efbdaeb6fc81 service nova] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Updated VIF entry in instance network info cache for port 99688c7a-3e71-49d8-9002-0075560858c9. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:34:09 user nova-compute[72586]: DEBUG nova.network.neutron [req-f3c581ae-c27b-4ed6-8033-c92b02ae8b7b req-28a502c2-16e0-49c5-86c8-efbdaeb6fc81 service nova] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Updating instance_info_cache with network_info: [{"id": "99688c7a-3e71-49d8-9002-0075560858c9", "address": "fa:16:3e:8a:03:a7", "network": {"id": "aab9a541-2149-4c65-b60e-80a1daca6632", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1355256264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19af48ffce7e4703b6d978bc3563680e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99688c7a-3e", "ovs_interfaceid": "99688c7a-3e71-49d8-9002-0075560858c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:34:09 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-f3c581ae-c27b-4ed6-8033-c92b02ae8b7b req-28a502c2-16e0-49c5-86c8-efbdaeb6fc81 service nova] Releasing lock "refresh_cache-49c24c77-f102-4aed-8314-b04aad5f6b3a" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:34:09 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:09 user nova-compute[72586]: DEBUG nova.network.neutron [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] Successfully updated port: 08a5cc80-89c1-46d0-af8f-215233fff7f0 {{(pid=72586) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 21:34:09 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Acquiring lock "refresh_cache-3ced1426-a20e-4d5f-8250-e789eba6f098" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:34:09 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Acquired lock "refresh_cache-3ced1426-a20e-4d5f-8250-e789eba6f098" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:34:09 user nova-compute[72586]: DEBUG nova.network.neutron [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:34:09 user nova-compute[72586]: DEBUG nova.compute.manager [req-1018729d-1d35-4e10-b72e-b746e86dd4df req-fb0f74f9-7337-4930-9df1-735c22aba7ec service nova] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] Received event network-changed-08a5cc80-89c1-46d0-af8f-215233fff7f0 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:34:09 user nova-compute[72586]: DEBUG nova.compute.manager [req-1018729d-1d35-4e10-b72e-b746e86dd4df req-fb0f74f9-7337-4930-9df1-735c22aba7ec service nova] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] Refreshing instance network info cache due to event network-changed-08a5cc80-89c1-46d0-af8f-215233fff7f0. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:34:09 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-1018729d-1d35-4e10-b72e-b746e86dd4df req-fb0f74f9-7337-4930-9df1-735c22aba7ec service nova] Acquiring lock "refresh_cache-3ced1426-a20e-4d5f-8250-e789eba6f098" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:34:09 user nova-compute[72586]: DEBUG nova.network.neutron [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] Instance cache missing network info. {{(pid=72586) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 21:34:10 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Stashing vm_state: active {{(pid=72586) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 01 21:34:10 user nova-compute[72586]: DEBUG nova.network.neutron [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] Updating instance_info_cache with network_info: [{"id": "08a5cc80-89c1-46d0-af8f-215233fff7f0", "address": "fa:16:3e:19:b4:d8", "network": {"id": "810a7784-cf98-4d5b-8850-66293852a067", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1671631489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f64482461ec146daab58ef5da8a52ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a5cc80-89", "ovs_interfaceid": "08a5cc80-89c1-46d0-af8f-215233fff7f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:34:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Releasing lock "refresh_cache-3ced1426-a20e-4d5f-8250-e789eba6f098" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:34:10 user nova-compute[72586]: DEBUG nova.compute.manager [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] Instance network_info: |[{"id": "08a5cc80-89c1-46d0-af8f-215233fff7f0", "address": "fa:16:3e:19:b4:d8", "network": {"id": "810a7784-cf98-4d5b-8850-66293852a067", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1671631489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f64482461ec146daab58ef5da8a52ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a5cc80-89", "ovs_interfaceid": "08a5cc80-89c1-46d0-af8f-215233fff7f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 21:34:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-1018729d-1d35-4e10-b72e-b746e86dd4df req-fb0f74f9-7337-4930-9df1-735c22aba7ec service nova] Acquired lock "refresh_cache-3ced1426-a20e-4d5f-8250-e789eba6f098" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:34:10 user nova-compute[72586]: DEBUG nova.network.neutron [req-1018729d-1d35-4e10-b72e-b746e86dd4df req-fb0f74f9-7337-4930-9df1-735c22aba7ec service nova] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] Refreshing network info cache for port 08a5cc80-89c1-46d0-af8f-215233fff7f0 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:34:10 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] Start _get_guest_xml network_info=[{"id": "08a5cc80-89c1-46d0-af8f-215233fff7f0", "address": "fa:16:3e:19:b4:d8", "network": {"id": "810a7784-cf98-4d5b-8850-66293852a067", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1671631489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f64482461ec146daab58ef5da8a52ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a5cc80-89", "ovs_interfaceid": "08a5cc80-89c1-46d0-af8f-215233fff7f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '0243d46b-6819-42a5-926f-42b71f0c97ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:34:10 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:34:10 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:34:10 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:34:10 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:34:10 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:34:10 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:34:10 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:34:10 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:34:10 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:34:10 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:34:10 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:34:10 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:34:10 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:34:10 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:34:10 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:34:10 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:34:10 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:34:10 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:34:10 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:34:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-344156937',display_name='tempest-VolumesActionsTest-instance-344156937',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-344156937',id=30,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f64482461ec146daab58ef5da8a52ca7',ramdisk_id='',reservation_id='r-j42bwx1y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-684200631',owner_user_name='tempest-VolumesActionsTest-684200631-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:34:08Z,user_data=None,user_id='6cda5cb14a4d463791ae0daa0cb55f31',uuid=3ced1426-a20e-4d5f-8250-e789eba6f098,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08a5cc80-89c1-46d0-af8f-215233fff7f0", "address": "fa:16:3e:19:b4:d8", "network": {"id": "810a7784-cf98-4d5b-8850-66293852a067", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1671631489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f64482461ec146daab58ef5da8a52ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a5cc80-89", "ovs_interfaceid": "08a5cc80-89c1-46d0-af8f-215233fff7f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:34:10 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Converting VIF {"id": "08a5cc80-89c1-46d0-af8f-215233fff7f0", "address": "fa:16:3e:19:b4:d8", "network": {"id": "810a7784-cf98-4d5b-8850-66293852a067", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1671631489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f64482461ec146daab58ef5da8a52ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a5cc80-89", "ovs_interfaceid": "08a5cc80-89c1-46d0-af8f-215233fff7f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:34:10 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:b4:d8,bridge_name='br-int',has_traffic_filtering=True,id=08a5cc80-89c1-46d0-af8f-215233fff7f0,network=Network(810a7784-cf98-4d5b-8850-66293852a067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08a5cc80-89') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:34:10 user nova-compute[72586]: DEBUG nova.objects.instance [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Lazy-loading 'pci_devices' on Instance uuid 3ced1426-a20e-4d5f-8250-e789eba6f098 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:34:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:34:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:34:10 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:34:10 user nova-compute[72586]:   <uuid>3ced1426-a20e-4d5f-8250-e789eba6f098</uuid>
Aug 01 21:34:10 user nova-compute[72586]:   <name>instance-0000001e</name>
Aug 01 21:34:10 user nova-compute[72586]:   <memory>524288</memory>
Aug 01 21:34:10 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:34:10 user nova-compute[72586]:   <metadata>
Aug 01 21:34:10 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:34:10 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:34:10 user nova-compute[72586]:       <nova:name>tempest-VolumesActionsTest-instance-344156937</nova:name>
Aug 01 21:34:10 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:34:10</nova:creationTime>
Aug 01 21:34:10 user nova-compute[72586]:       <nova:flavor name="m1.tiny">
Aug 01 21:34:10 user nova-compute[72586]:         <nova:memory>512</nova:memory>
Aug 01 21:34:10 user nova-compute[72586]:         <nova:disk>1</nova:disk>
Aug 01 21:34:10 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:34:10 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:34:10 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:34:10 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:34:10 user nova-compute[72586]:       <nova:owner>
Aug 01 21:34:10 user nova-compute[72586]:         <nova:user uuid="6cda5cb14a4d463791ae0daa0cb55f31">tempest-VolumesActionsTest-684200631-project-member</nova:user>
Aug 01 21:34:10 user nova-compute[72586]:         <nova:project uuid="f64482461ec146daab58ef5da8a52ca7">tempest-VolumesActionsTest-684200631</nova:project>
Aug 01 21:34:10 user nova-compute[72586]:       </nova:owner>
Aug 01 21:34:10 user nova-compute[72586]:       <nova:root type="image" uuid="0243d46b-6819-42a5-926f-42b71f0c97ad"/>
Aug 01 21:34:10 user nova-compute[72586]:       <nova:ports>
Aug 01 21:34:10 user nova-compute[72586]:         <nova:port uuid="08a5cc80-89c1-46d0-af8f-215233fff7f0">
Aug 01 21:34:10 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 01 21:34:10 user nova-compute[72586]:         </nova:port>
Aug 01 21:34:10 user nova-compute[72586]:       </nova:ports>
Aug 01 21:34:10 user nova-compute[72586]:     </nova:instance>
Aug 01 21:34:10 user nova-compute[72586]:   </metadata>
Aug 01 21:34:10 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:34:10 user nova-compute[72586]:     <system>
Aug 01 21:34:10 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:34:10 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:34:10 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:34:10 user nova-compute[72586]:       <entry name="serial">3ced1426-a20e-4d5f-8250-e789eba6f098</entry>
Aug 01 21:34:10 user nova-compute[72586]:       <entry name="uuid">3ced1426-a20e-4d5f-8250-e789eba6f098</entry>
Aug 01 21:34:10 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:34:10 user nova-compute[72586]:     </system>
Aug 01 21:34:10 user nova-compute[72586]:   </sysinfo>
Aug 01 21:34:10 user nova-compute[72586]:   <os>
Aug 01 21:34:10 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:34:10 user nova-compute[72586]:     <boot dev="hd"/>
Aug 01 21:34:10 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:34:10 user nova-compute[72586]:   </os>
Aug 01 21:34:10 user nova-compute[72586]:   <features>
Aug 01 21:34:10 user nova-compute[72586]:     <acpi/>
Aug 01 21:34:10 user nova-compute[72586]:     <apic/>
Aug 01 21:34:10 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:34:10 user nova-compute[72586]:   </features>
Aug 01 21:34:10 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:34:10 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:34:10 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:34:10 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:34:10 user nova-compute[72586]:   </clock>
Aug 01 21:34:10 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:34:10 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:34:10 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:34:10 user nova-compute[72586]:   </cpu>
Aug 01 21:34:10 user nova-compute[72586]:   <devices>
Aug 01 21:34:10 user nova-compute[72586]:     <disk type="file" device="disk">
Aug 01 21:34:10 user nova-compute[72586]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 21:34:10 user nova-compute[72586]:       <source file="/opt/stack/data/nova/instances/3ced1426-a20e-4d5f-8250-e789eba6f098/disk"/>
Aug 01 21:34:10 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:34:10 user nova-compute[72586]:     </disk>
Aug 01 21:34:10 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:34:10 user nova-compute[72586]:       <mac address="fa:16:3e:19:b4:d8"/>
Aug 01 21:34:10 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:34:10 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:34:10 user nova-compute[72586]:       <target dev="tap08a5cc80-89"/>
Aug 01 21:34:10 user nova-compute[72586]:     </interface>
Aug 01 21:34:10 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:34:10 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/3ced1426-a20e-4d5f-8250-e789eba6f098/console.log" append="off"/>
Aug 01 21:34:10 user nova-compute[72586]:     </serial>
Aug 01 21:34:10 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:34:10 user nova-compute[72586]:     <video>
Aug 01 21:34:10 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:34:10 user nova-compute[72586]:     </video>
Aug 01 21:34:10 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:34:10 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:34:10 user nova-compute[72586]:     </rng>
Aug 01 21:34:10 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:34:10 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:34:10 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:34:10 user nova-compute[72586]:     </memballoon>
Aug 01 21:34:10 user nova-compute[72586]:   </devices>
Aug 01 21:34:10 user nova-compute[72586]: </domain>
Aug 01 21:34:10 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:34:10 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:34:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-344156937',display_name='tempest-VolumesActionsTest-instance-344156937',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-344156937',id=30,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f64482461ec146daab58ef5da8a52ca7',ramdisk_id='',reservation_id='r-j42bwx1y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-684200631',owner_user_name='tempest-VolumesActionsTest-684200631-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:34:08Z,user_data=None,user_id='6cda5cb14a4d463791ae0daa0cb55f31',uuid=3ced1426-a20e-4d5f-8250-e789eba6f098,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08a5cc80-89c1-46d0-af8f-215233fff7f0", "address": "fa:16:3e:19:b4:d8", "network": {"id": "810a7784-cf98-4d5b-8850-66293852a067", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1671631489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f64482461ec146daab58ef5da8a52ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a5cc80-89", "ovs_interfaceid": "08a5cc80-89c1-46d0-af8f-215233fff7f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:34:10 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Converting VIF {"id": "08a5cc80-89c1-46d0-af8f-215233fff7f0", "address": "fa:16:3e:19:b4:d8", "network": {"id": "810a7784-cf98-4d5b-8850-66293852a067", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1671631489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f64482461ec146daab58ef5da8a52ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a5cc80-89", "ovs_interfaceid": "08a5cc80-89c1-46d0-af8f-215233fff7f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:34:10 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:b4:d8,bridge_name='br-int',has_traffic_filtering=True,id=08a5cc80-89c1-46d0-af8f-215233fff7f0,network=Network(810a7784-cf98-4d5b-8850-66293852a067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08a5cc80-89') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:34:10 user nova-compute[72586]: DEBUG os_vif [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:b4:d8,bridge_name='br-int',has_traffic_filtering=True,id=08a5cc80-89c1-46d0-af8f-215233fff7f0,network=Network(810a7784-cf98-4d5b-8850-66293852a067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08a5cc80-89') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:34:10 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:10 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:34:10 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:34:10 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:10 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap08a5cc80-89, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:34:10 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap08a5cc80-89, col_values=(('external_ids', {'iface-id': '08a5cc80-89c1-46d0-af8f-215233fff7f0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:b4:d8', 'vm-uuid': '3ced1426-a20e-4d5f-8250-e789eba6f098'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:34:10 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:10 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:34:10 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:10 user nova-compute[72586]: INFO os_vif [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:b4:d8,bridge_name='br-int',has_traffic_filtering=True,id=08a5cc80-89c1-46d0-af8f-215233fff7f0,network=Network(810a7784-cf98-4d5b-8850-66293852a067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08a5cc80-89')
Aug 01 21:34:10 user nova-compute[72586]: DEBUG nova.objects.instance [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lazy-loading 'pci_requests' on Instance uuid 314f9b05-527c-459d-aca7-acc696ac613f {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:34:10 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72586) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 21:34:10 user nova-compute[72586]: INFO nova.compute.claims [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Claim successful on node user
Aug 01 21:34:10 user nova-compute[72586]: DEBUG nova.objects.instance [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lazy-loading 'resources' on Instance uuid 314f9b05-527c-459d-aca7-acc696ac613f {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:34:10 user nova-compute[72586]: DEBUG nova.objects.instance [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lazy-loading 'pci_devices' on Instance uuid 314f9b05-527c-459d-aca7-acc696ac613f {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:34:10 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:34:10 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] No VIF found with MAC fa:16:3e:19:b4:d8, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:34:10 user nova-compute[72586]: INFO nova.compute.resource_tracker [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Updating resource usage from migration a601a123-f478-4115-afd7-0b4b73b52210
Aug 01 21:34:10 user nova-compute[72586]: DEBUG nova.compute.manager [req-51dfbf65-1699-465e-85f3-95923397ac74 req-88a58e0d-164f-48bc-9c8b-1e99ee176ada service nova] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Received event network-changed-eeebb619-be12-42d7-96f3-e309b6d4cdaf {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:34:10 user nova-compute[72586]: DEBUG nova.compute.manager [req-51dfbf65-1699-465e-85f3-95923397ac74 req-88a58e0d-164f-48bc-9c8b-1e99ee176ada service nova] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Refreshing instance network info cache due to event network-changed-eeebb619-be12-42d7-96f3-e309b6d4cdaf. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:34:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-51dfbf65-1699-465e-85f3-95923397ac74 req-88a58e0d-164f-48bc-9c8b-1e99ee176ada service nova] Acquiring lock "refresh_cache-314f9b05-527c-459d-aca7-acc696ac613f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:34:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-51dfbf65-1699-465e-85f3-95923397ac74 req-88a58e0d-164f-48bc-9c8b-1e99ee176ada service nova] Acquired lock "refresh_cache-314f9b05-527c-459d-aca7-acc696ac613f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:34:10 user nova-compute[72586]: DEBUG nova.network.neutron [req-51dfbf65-1699-465e-85f3-95923397ac74 req-88a58e0d-164f-48bc-9c8b-1e99ee176ada service nova] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Refreshing network info cache for port eeebb619-be12-42d7-96f3-e309b6d4cdaf {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:34:10 user nova-compute[72586]: DEBUG nova.network.neutron [req-1018729d-1d35-4e10-b72e-b746e86dd4df req-fb0f74f9-7337-4930-9df1-735c22aba7ec service nova] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] Updated VIF entry in instance network info cache for port 08a5cc80-89c1-46d0-af8f-215233fff7f0. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:34:10 user nova-compute[72586]: DEBUG nova.network.neutron [req-1018729d-1d35-4e10-b72e-b746e86dd4df req-fb0f74f9-7337-4930-9df1-735c22aba7ec service nova] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] Updating instance_info_cache with network_info: [{"id": "08a5cc80-89c1-46d0-af8f-215233fff7f0", "address": "fa:16:3e:19:b4:d8", "network": {"id": "810a7784-cf98-4d5b-8850-66293852a067", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1671631489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f64482461ec146daab58ef5da8a52ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a5cc80-89", "ovs_interfaceid": "08a5cc80-89c1-46d0-af8f-215233fff7f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:34:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-1018729d-1d35-4e10-b72e-b746e86dd4df req-fb0f74f9-7337-4930-9df1-735c22aba7ec service nova] Releasing lock "refresh_cache-3ced1426-a20e-4d5f-8250-e789eba6f098" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:34:10 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:34:10 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:34:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.563s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:34:10 user nova-compute[72586]: INFO nova.compute.manager [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Migrating
Aug 01 21:34:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Acquiring lock "refresh_cache-314f9b05-527c-459d-aca7-acc696ac613f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:34:11 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Acquiring lock "0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:34:11 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:34:11 user nova-compute[72586]: INFO nova.compute.manager [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Rebooting instance
Aug 01 21:34:11 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Acquiring lock "refresh_cache-0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:34:11 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Acquired lock "refresh_cache-0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:34:11 user nova-compute[72586]: DEBUG nova.network.neutron [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:34:11 user nova-compute[72586]: DEBUG nova.network.neutron [req-51dfbf65-1699-465e-85f3-95923397ac74 req-88a58e0d-164f-48bc-9c8b-1e99ee176ada service nova] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Updated VIF entry in instance network info cache for port eeebb619-be12-42d7-96f3-e309b6d4cdaf. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:34:11 user nova-compute[72586]: DEBUG nova.network.neutron [req-51dfbf65-1699-465e-85f3-95923397ac74 req-88a58e0d-164f-48bc-9c8b-1e99ee176ada service nova] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Updating instance_info_cache with network_info: [{"id": "eeebb619-be12-42d7-96f3-e309b6d4cdaf", "address": "fa:16:3e:5d:69:cd", "network": {"id": "aab9a541-2149-4c65-b60e-80a1daca6632", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1355256264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19af48ffce7e4703b6d978bc3563680e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeebb619-be", "ovs_interfaceid": "eeebb619-be12-42d7-96f3-e309b6d4cdaf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:34:11 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-51dfbf65-1699-465e-85f3-95923397ac74 req-88a58e0d-164f-48bc-9c8b-1e99ee176ada service nova] Releasing lock "refresh_cache-314f9b05-527c-459d-aca7-acc696ac613f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:34:11 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Acquired lock "refresh_cache-314f9b05-527c-459d-aca7-acc696ac613f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:34:11 user nova-compute[72586]: DEBUG nova.network.neutron [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:34:11 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:11 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:11 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:11 user nova-compute[72586]: DEBUG nova.network.neutron [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Updating instance_info_cache with network_info: [{"id": "eeebb619-be12-42d7-96f3-e309b6d4cdaf", "address": "fa:16:3e:5d:69:cd", "network": {"id": "aab9a541-2149-4c65-b60e-80a1daca6632", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1355256264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19af48ffce7e4703b6d978bc3563680e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeebb619-be", "ovs_interfaceid": "eeebb619-be12-42d7-96f3-e309b6d4cdaf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:34:11 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Releasing lock "refresh_cache-314f9b05-527c-459d-aca7-acc696ac613f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:34:11 user nova-compute[72586]: DEBUG nova.network.neutron [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Updating instance_info_cache with network_info: [{"id": "5b244939-e725-4cc8-8407-a7dd0bbc7ec4", "address": "fa:16:3e:cc:46:65", "network": {"id": "56c3419f-2c2c-4dda-88d7-ba96e2a689fd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-705071098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ae5f1c56b348de8a03f1a4bcdd9b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b244939-e7", "ovs_interfaceid": "5b244939-e725-4cc8-8407-a7dd0bbc7ec4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:34:11 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Releasing lock "refresh_cache-0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:34:11 user nova-compute[72586]: DEBUG nova.compute.manager [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:34:11 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Starting migrate_disk_and_power_off {{(pid=72586) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 01 21:34:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:12 user nova-compute[72586]: DEBUG nova.compute.manager [req-e237d880-bad0-4101-a9d8-87c0dcda157c req-b8a14d77-9bc1-48dd-a9d8-43942bab03ce service nova] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Received event network-vif-unplugged-eeebb619-be12-42d7-96f3-e309b6d4cdaf {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:34:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-e237d880-bad0-4101-a9d8-87c0dcda157c req-b8a14d77-9bc1-48dd-a9d8-43942bab03ce service nova] Acquiring lock "314f9b05-527c-459d-aca7-acc696ac613f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:34:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-e237d880-bad0-4101-a9d8-87c0dcda157c req-b8a14d77-9bc1-48dd-a9d8-43942bab03ce service nova] Lock "314f9b05-527c-459d-aca7-acc696ac613f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:34:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-e237d880-bad0-4101-a9d8-87c0dcda157c req-b8a14d77-9bc1-48dd-a9d8-43942bab03ce service nova] Lock "314f9b05-527c-459d-aca7-acc696ac613f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:34:12 user nova-compute[72586]: DEBUG nova.compute.manager [req-e237d880-bad0-4101-a9d8-87c0dcda157c req-b8a14d77-9bc1-48dd-a9d8-43942bab03ce service nova] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] No waiting events found dispatching network-vif-unplugged-eeebb619-be12-42d7-96f3-e309b6d4cdaf {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:34:12 user nova-compute[72586]: WARNING nova.compute.manager [req-e237d880-bad0-4101-a9d8-87c0dcda157c req-b8a14d77-9bc1-48dd-a9d8-43942bab03ce service nova] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Received unexpected event network-vif-unplugged-eeebb619-be12-42d7-96f3-e309b6d4cdaf for instance with vm_state active and task_state resize_migrating.
Aug 01 21:34:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG nova.compute.manager [req-1a1359c8-2034-4f72-9a19-959f1f7331be req-27c312bf-fac7-4dfc-89a2-8a21c74d1cc2 service nova] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] Received event network-vif-plugged-08a5cc80-89c1-46d0-af8f-215233fff7f0 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-1a1359c8-2034-4f72-9a19-959f1f7331be req-27c312bf-fac7-4dfc-89a2-8a21c74d1cc2 service nova] Acquiring lock "3ced1426-a20e-4d5f-8250-e789eba6f098-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-1a1359c8-2034-4f72-9a19-959f1f7331be req-27c312bf-fac7-4dfc-89a2-8a21c74d1cc2 service nova] Lock "3ced1426-a20e-4d5f-8250-e789eba6f098-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-1a1359c8-2034-4f72-9a19-959f1f7331be req-27c312bf-fac7-4dfc-89a2-8a21c74d1cc2 service nova] Lock "3ced1426-a20e-4d5f-8250-e789eba6f098-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG nova.compute.manager [req-1a1359c8-2034-4f72-9a19-959f1f7331be req-27c312bf-fac7-4dfc-89a2-8a21c74d1cc2 service nova] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] No waiting events found dispatching network-vif-plugged-08a5cc80-89c1-46d0-af8f-215233fff7f0 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:34:13 user nova-compute[72586]: WARNING nova.compute.manager [req-1a1359c8-2034-4f72-9a19-959f1f7331be req-27c312bf-fac7-4dfc-89a2-8a21c74d1cc2 service nova] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] Received unexpected event network-vif-plugged-08a5cc80-89c1-46d0-af8f-215233fff7f0 for instance with vm_state building and task_state spawning.
Aug 01 21:34:13 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Instance destroyed successfully.
Aug 01 21:34:13 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:32:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-400634865',display_name='tempest-ServerActionsTestOtherA-server-400634865',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-400634865',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPk4vuGAtPXP/Itqq7TbQ+6Sv+k5bpNQFeCgGdApIPBaVaeUmQBoiJZa5I5091aDIuYBB7Uba3sQDG1YP/kTFSXvqkIW2yu6s2YyWP+iKPKZLzdQkqmU2IfIy2EEsidssA==',key_name='tempest-keypair-400537691',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:32:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='19af48ffce7e4703b6d978bc3563680e',ramdisk_id='',reservation_id='r-0fzqwm4s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-825165282',owner_user_name='tempest-ServerActionsTestOtherA-825165282-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:34:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88d01b1101164c859b19d41e251447a5',uuid=314f9b05-527c-459d-aca7-acc696ac613f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eeebb619-be12-42d7-96f3-e309b6d4cdaf", "address": "fa:16:3e:5d:69:cd", "network": {"id": "aab9a541-2149-4c65-b60e-80a1daca6632", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1355256264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1355256264-network", "vif_mac": "fa:16:3e:5d:69:cd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19af48ffce7e4703b6d978bc3563680e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeebb619-be", "ovs_interfaceid": "eeebb619-be12-42d7-96f3-e309b6d4cdaf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Converting VIF {"id": "eeebb619-be12-42d7-96f3-e309b6d4cdaf", "address": "fa:16:3e:5d:69:cd", "network": {"id": "aab9a541-2149-4c65-b60e-80a1daca6632", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1355256264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1355256264-network", "vif_mac": "fa:16:3e:5d:69:cd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19af48ffce7e4703b6d978bc3563680e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeebb619-be", "ovs_interfaceid": "eeebb619-be12-42d7-96f3-e309b6d4cdaf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:69:cd,bridge_name='br-int',has_traffic_filtering=True,id=eeebb619-be12-42d7-96f3-e309b6d4cdaf,network=Network(aab9a541-2149-4c65-b60e-80a1daca6632),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeebb619-be') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG os_vif [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:69:cd,bridge_name='br-int',has_traffic_filtering=True,id=eeebb619-be12-42d7-96f3-e309b6d4cdaf,network=Network(aab9a541-2149-4c65-b60e-80a1daca6632),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeebb619-be') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeeebb619-be, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:13 user nova-compute[72586]: INFO os_vif [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:69:cd,bridge_name='br-int',has_traffic_filtering=True,id=eeebb619-be12-42d7-96f3-e309b6d4cdaf,network=Network(aab9a541-2149-4c65-b60e-80a1daca6632),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeebb619-be')
Aug 01 21:34:13 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Instance destroyed successfully.
Aug 01 21:34:13 user nova-compute[72586]: DEBUG nova.objects.instance [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lazy-loading 'resources' on Instance uuid 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] calling os-brick to detach iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, {'target_iqns': ['iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'roGchSeU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:34:13 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:34:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843', 0)] {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:31:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-486932535',display_name='tempest-TestMinimumBasicScenario-server-486932535',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-486932535',id=28,image_ref='7666a25e-0535-48eb-95b3-7909d90f3507',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLujS2qMrbfTLmfjrvCC34ccfhBDvh7Itzo7X58DZeJvTyAF9F25vXUHTGj+pY1BDjgMf45Ki5YpDsHtKHkbdasD+FbKu3GDFuEEYGHTNp7IfnciNn/M3BAitR1uYoYOOA==',key_name='tempest-TestMinimumBasicScenario-2086993178',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:31:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f7ae5f1c56b348de8a03f1a4bcdd9b5c',ramdisk_id='',reservation_id='r-m440bki2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7666a25e-0535-48eb-95b3-7909d90f3507',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1119751084',owner_user_name='tempest-TestMinimumBasicScenario-1119751084-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:34:12Z,user_data=None,user_id='fed345b7cf8f44bfa83d45d408a18c4a',uuid=0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b244939-e725-4cc8-8407-a7dd0bbc7ec4", "address": "fa:16:3e:cc:46:65", "network": {"id": "56c3419f-2c2c-4dda-88d7-ba96e2a689fd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-705071098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ae5f1c56b348de8a03f1a4bcdd9b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b244939-e7", "ovs_interfaceid": "5b244939-e725-4cc8-8407-a7dd0bbc7ec4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Converting VIF {"id": "5b244939-e725-4cc8-8407-a7dd0bbc7ec4", "address": "fa:16:3e:cc:46:65", "network": {"id": "56c3419f-2c2c-4dda-88d7-ba96e2a689fd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-705071098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ae5f1c56b348de8a03f1a4bcdd9b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b244939-e7", "ovs_interfaceid": "5b244939-e725-4cc8-8407-a7dd0bbc7ec4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:46:65,bridge_name='br-int',has_traffic_filtering=True,id=5b244939-e725-4cc8-8407-a7dd0bbc7ec4,network=Network(56c3419f-2c2c-4dda-88d7-ba96e2a689fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b244939-e7') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG os_vif [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:46:65,bridge_name='br-int',has_traffic_filtering=True,id=5b244939-e725-4cc8-8407-a7dd0bbc7ec4,network=Network(56c3419f-2c2c-4dda-88d7-ba96e2a689fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b244939-e7') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b244939-e7, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[c767af3b-7e60-4043-b038-64ab5e05e568]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:13 user nova-compute[72586]: INFO os_vif [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:46:65,bridge_name='br-int',has_traffic_filtering=True,id=5b244939-e725-4cc8-8407-a7dd0bbc7ec4,network=Network(56c3419f-2c2c-4dda-88d7-ba96e2a689fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b244939-e7')
Aug 01 21:34:13 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] calling os-brick to detach iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, {'target_iqns': ['iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xnDJlRBb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:34:13 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:34:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f7c6c1-c858-49d5-8c62-61c7176d07cf]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:34:13 user nova-compute[72586]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 (non-flash)
Aug 01 21:34:13 user nova-compute[72586]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 (non-flash)
Aug 01 21:34:13 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:34:13 user nova-compute[72586]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 (non-flash)
Aug 01 21:34:13 user nova-compute[72586]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 (non-flash)
Aug 01 21:34:13 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ee823fe20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843'): ({'sdc'}, set())}) {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Removing single pathed devices sdc {{(pid=72586) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf4d506-d9d1-42e6-a10f-3ff9a2793465]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1fa456-f6c7-4f1f-9c8e-6e6cb706351e]: (4, ('ok\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Flushing IO for device /dev/sdc {{(pid=72586) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[aace2e00-3699-4342-9db0-0a7027922c60]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72586) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[770c5fd8-424f-4fe6-8822-99e427892153]: (4, ('1', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] SCSI volumes sdc have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843')] {{(pid=72586) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3be041-4e92-49b3-a26d-fa202b6fd8d9]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 -p 172.16.0.220:3260 --logout {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7159c5-632f-4135-b225-e9f6ac0d2e75]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843, portal: 172.16.0.220,3260]
Aug 01 21:34:13 user nova-compute[72586]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843, portal: 172.16.0.220,3260] successful.
Aug 01 21:34:13 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 -p 172.16.0.220:3260 --op delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e679a787-c68e-4451-a21a-22fefafb48f3]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] <== disconnect_volume: return (343ms) None {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Disconnected iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.286s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96', 0)] {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d402f0b-b2a4-46b6-8d53-1d3929cb223b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[64aa8ebb-d771-41b4-9e59-15d1ed8b2e31]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:34:13 user nova-compute[72586]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 (non-flash)
Aug 01 21:34:13 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:34:13 user nova-compute[72586]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 (non-flash)
Aug 01 21:34:13 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ee8274a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96'): ({'sdd'}, set())}) {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Removing single pathed devices sdd {{(pid=72586) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1bdcfa-7498-4e8f-9a28-eba500b50377]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2e1eae-ba78-4109-91fd-f6f866c50e20]: (4, ('ok\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Flushing IO for device /dev/sdd {{(pid=72586) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[84570e5c-3041-45c9-8a3c-f074d40f6e1b]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72586) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a8d323-21c1-47d4-8d7c-092aff99bd55]: (4, ('1', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] SCSI volumes sdd have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96')] {{(pid=72586) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a38d8ba-f782-4add-a021-dd8010b670d1]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 -p 172.16.0.220:3260 --logout {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ac2a8a-03d6-4c55-9adf-7649927fee17]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96, portal: 172.16.0.220,3260]
Aug 01 21:34:13 user nova-compute[72586]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96, portal: 172.16.0.220,3260] successful.
Aug 01 21:34:13 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 -p 172.16.0.220:3260 --op delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[422d4e90-dfed-461c-8dad-dde0f0778cb0]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] <== disconnect_volume: return (576ms) None {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Disconnected iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Start _get_guest_xml network_info=[{"id": "5b244939-e725-4cc8-8407-a7dd0bbc7ec4", "address": "fa:16:3e:cc:46:65", "network": {"id": "56c3419f-2c2c-4dda-88d7-ba96e2a689fd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-705071098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ae5f1c56b348de8a03f1a4bcdd9b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b244939-e7", "ovs_interfaceid": "5b244939-e725-4cc8-8407-a7dd0bbc7ec4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7666a25e-0535-48eb-95b3-7909d90f3507,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '7666a25e-0535-48eb-95b3-7909d90f3507'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xnDJlRBb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f', 'attached_at': '', 'detached_at': '', 'volume_id': 'cbc36d6d-5805-4d7b-bf27-f170dcdd4f96', 'serial': 'cbc36d6d-5805-4d7b-bf27-f170dcdd4f96'}, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'd02d8439-a413-4da1-a748-2cd12b3a9c15', 'delete_on_termination': False, 'volume_type': None} {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:34:13 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:34:13 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:34:13 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7666a25e-0535-48eb-95b3-7909d90f3507,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:34:13 user nova-compute[72586]: DEBUG nova.objects.instance [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Calling os-brick to attach iSCSI Volume {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xnDJlRBb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:34:14 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:34:14 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:34:14 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:34:14 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:34:14 user nova-compute[72586]: INFO os_brick.initiator.connectors.iscsi [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 21:34:14 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 -p 172.16.0.220:3260 {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[492c0e08-dcc4-4ee2-bed4-e17589d2e65a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 21:34:14 user nova-compute[72586]:  {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 -p 172.16.0.220:3260 --interface default --op new {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff7b392-1134-4c05-9221-51c1b8643786]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96] added\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96] added
Aug 01 21:34:14 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[3adf2d1a-3811-4d47-aff9-a4c61fbb4d3d]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3af5d7-4016-498d-9805-871468bdef63]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xnDJlRBb {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xnDJlRBb" returned: 0 in 0.024s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e1b8b9-5e1b-4f3d-8679-90a31a761868]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xnDJlRBb'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd99883-ba43-4bea-981d-c5750038d4a2]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae15f4b-e226-4304-bb13-4b61d804d0e8]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:34:14 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:34:14 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 -p 172.16.0.220:3260 --login {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b2c9b4-bb9e-4ec2-a01b-87cadbdee865]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96, portal: 172.16.0.220,3260]
Aug 01 21:34:14 user nova-compute[72586]: Login to [iface: default, target: iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96, portal: 172.16.0.220,3260] successful.
Aug 01 21:34:14 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925654.2793095, 3ced1426-a20e-4d5f-8250-e789eba6f098 => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:34:14 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] VM Resumed (Lifecycle Event)
Aug 01 21:34:14 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG nova.compute.manager [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] Instance event wait completed in 0 seconds for  {{(pid=72586) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] Guest created on hypervisor {{(pid=72586) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 21:34:14 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] Instance spawned successfully.
Aug 01 21:34:14 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa882546-b0b0-4846-9e33-c8a1fb790909]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] Found default for hw_cdrom_bus of ide {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] Found default for hw_disk_bus of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] Found default for hw_input_bus of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] Found default for hw_pointer_model of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] Found default for hw_video_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] Found default for hw_vif_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[2559e447-4718-4531-9ad0-8a3c619590bf]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:34:14 user nova-compute[72586]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 (non-flash)
Aug 01 21:34:14 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:34:14 user nova-compute[72586]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 (non-flash)
Aug 01 21:34:14 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Connected to 172.16.0.220:3260 {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] HCTL ('34', '-', '-', 0) found on session 38 with lun 0 {{(pid=72586) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72586) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 21:34:14 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:34:14 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925654.2807176, 3ced1426-a20e-4d5f-8250-e789eba6f098 => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:34:14 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] VM Started (Lifecycle Event)
Aug 01 21:34:14 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG nova.compute.manager [req-4e829920-b405-40a7-9f7f-1bbe3d1698e6 req-9f100ca1-9f84-4c69-af02-502adabeeacf service nova] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Received event network-vif-plugged-eeebb619-be12-42d7-96f3-e309b6d4cdaf {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-4e829920-b405-40a7-9f7f-1bbe3d1698e6 req-9f100ca1-9f84-4c69-af02-502adabeeacf service nova] Acquiring lock "314f9b05-527c-459d-aca7-acc696ac613f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-4e829920-b405-40a7-9f7f-1bbe3d1698e6 req-9f100ca1-9f84-4c69-af02-502adabeeacf service nova] Lock "314f9b05-527c-459d-aca7-acc696ac613f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-4e829920-b405-40a7-9f7f-1bbe3d1698e6 req-9f100ca1-9f84-4c69-af02-502adabeeacf service nova] Lock "314f9b05-527c-459d-aca7-acc696ac613f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG nova.compute.manager [req-4e829920-b405-40a7-9f7f-1bbe3d1698e6 req-9f100ca1-9f84-4c69-af02-502adabeeacf service nova] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] No waiting events found dispatching network-vif-plugged-eeebb619-be12-42d7-96f3-e309b6d4cdaf {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:34:14 user nova-compute[72586]: WARNING nova.compute.manager [req-4e829920-b405-40a7-9f7f-1bbe3d1698e6 req-9f100ca1-9f84-4c69-af02-502adabeeacf service nova] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Received unexpected event network-vif-plugged-eeebb619-be12-42d7-96f3-e309b6d4cdaf for instance with vm_state active and task_state resize_migrating.
Aug 01 21:34:14 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.025s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d7bac0-97ef-4090-b3d8-da1c1d438119]: (4, ('- - 0', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Searching for a device in session 38 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xnDJlRBb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:34:14 user nova-compute[72586]: INFO nova.compute.manager [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] Took 6.25 seconds to spawn the instance on the hypervisor.
Aug 01 21:34:14 user nova-compute[72586]: DEBUG nova.compute.manager [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:34:14 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:34:14 user nova-compute[72586]: INFO nova.compute.manager [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] Took 7.17 seconds to build instance.
Aug 01 21:34:14 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3437cdd6-fbcf-4efa-b196-a63584e96a6d tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Lock "3ced1426-a20e-4d5f-8250-e789eba6f098" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.295s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG nova.network.neutron [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Port eeebb619-be12-42d7-96f3-e309b6d4cdaf binding to destination host user is already ACTIVE {{(pid=72586) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Acquiring lock "314f9b05-527c-459d-aca7-acc696ac613f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "314f9b05-527c-459d-aca7-acc696ac613f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:34:14 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "314f9b05-527c-459d-aca7-acc696ac613f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:34:15 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Acquiring lock "refresh_cache-314f9b05-527c-459d-aca7-acc696ac613f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:34:15 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Acquired lock "refresh_cache-314f9b05-527c-459d-aca7-acc696ac613f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:34:15 user nova-compute[72586]: DEBUG nova.network.neutron [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:34:15 user nova-compute[72586]: DEBUG nova.compute.manager [req-dfeefa38-ace3-4b0c-8659-701965114691 req-f82e3046-e29d-4943-9a75-723d379ac89c service nova] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] Received event network-vif-plugged-08a5cc80-89c1-46d0-af8f-215233fff7f0 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:34:15 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-dfeefa38-ace3-4b0c-8659-701965114691 req-f82e3046-e29d-4943-9a75-723d379ac89c service nova] Acquiring lock "3ced1426-a20e-4d5f-8250-e789eba6f098-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:34:15 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-dfeefa38-ace3-4b0c-8659-701965114691 req-f82e3046-e29d-4943-9a75-723d379ac89c service nova] Lock "3ced1426-a20e-4d5f-8250-e789eba6f098-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:34:15 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-dfeefa38-ace3-4b0c-8659-701965114691 req-f82e3046-e29d-4943-9a75-723d379ac89c service nova] Lock "3ced1426-a20e-4d5f-8250-e789eba6f098-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:34:15 user nova-compute[72586]: DEBUG nova.compute.manager [req-dfeefa38-ace3-4b0c-8659-701965114691 req-f82e3046-e29d-4943-9a75-723d379ac89c service nova] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] No waiting events found dispatching network-vif-plugged-08a5cc80-89c1-46d0-af8f-215233fff7f0 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:34:15 user nova-compute[72586]: WARNING nova.compute.manager [req-dfeefa38-ace3-4b0c-8659-701965114691 req-f82e3046-e29d-4943-9a75-723d379ac89c service nova] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] Received unexpected event network-vif-plugged-08a5cc80-89c1-46d0-af8f-215233fff7f0 for instance with vm_state active and task_state None.
Aug 01 21:34:15 user nova-compute[72586]: DEBUG nova.compute.manager [req-dfeefa38-ace3-4b0c-8659-701965114691 req-f82e3046-e29d-4943-9a75-723d379ac89c service nova] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Received event network-vif-unplugged-5b244939-e725-4cc8-8407-a7dd0bbc7ec4 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:34:15 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-dfeefa38-ace3-4b0c-8659-701965114691 req-f82e3046-e29d-4943-9a75-723d379ac89c service nova] Acquiring lock "0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:34:15 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-dfeefa38-ace3-4b0c-8659-701965114691 req-f82e3046-e29d-4943-9a75-723d379ac89c service nova] Lock "0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:34:15 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-dfeefa38-ace3-4b0c-8659-701965114691 req-f82e3046-e29d-4943-9a75-723d379ac89c service nova] Lock "0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:34:15 user nova-compute[72586]: DEBUG nova.compute.manager [req-dfeefa38-ace3-4b0c-8659-701965114691 req-f82e3046-e29d-4943-9a75-723d379ac89c service nova] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] No waiting events found dispatching network-vif-unplugged-5b244939-e725-4cc8-8407-a7dd0bbc7ec4 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:34:15 user nova-compute[72586]: WARNING nova.compute.manager [req-dfeefa38-ace3-4b0c-8659-701965114691 req-f82e3046-e29d-4943-9a75-723d379ac89c service nova] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Received unexpected event network-vif-unplugged-5b244939-e725-4cc8-8407-a7dd0bbc7ec4 for instance with vm_state active and task_state reboot_started_hard.
Aug 01 21:34:15 user nova-compute[72586]: DEBUG nova.compute.manager [req-dfeefa38-ace3-4b0c-8659-701965114691 req-f82e3046-e29d-4943-9a75-723d379ac89c service nova] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Received event network-vif-plugged-5b244939-e725-4cc8-8407-a7dd0bbc7ec4 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:34:15 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-dfeefa38-ace3-4b0c-8659-701965114691 req-f82e3046-e29d-4943-9a75-723d379ac89c service nova] Acquiring lock "0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:34:15 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-dfeefa38-ace3-4b0c-8659-701965114691 req-f82e3046-e29d-4943-9a75-723d379ac89c service nova] Lock "0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:34:15 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-dfeefa38-ace3-4b0c-8659-701965114691 req-f82e3046-e29d-4943-9a75-723d379ac89c service nova] Lock "0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:34:15 user nova-compute[72586]: DEBUG nova.compute.manager [req-dfeefa38-ace3-4b0c-8659-701965114691 req-f82e3046-e29d-4943-9a75-723d379ac89c service nova] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] No waiting events found dispatching network-vif-plugged-5b244939-e725-4cc8-8407-a7dd0bbc7ec4 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:34:15 user nova-compute[72586]: WARNING nova.compute.manager [req-dfeefa38-ace3-4b0c-8659-701965114691 req-f82e3046-e29d-4943-9a75-723d379ac89c service nova] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Received unexpected event network-vif-plugged-5b244939-e725-4cc8-8407-a7dd0bbc7ec4 for instance with vm_state active and task_state reboot_started_hard.
Aug 01 21:34:15 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.388s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:34:15 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] <== connect_volume: return (1394ms) {'type': 'block', 'scsi_wwn': '23539396561623365', 'path': '/dev/sdc'} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:34:15 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539396561623365', 'path': '/dev/sdc'} {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 21:34:15 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:31:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-486932535',display_name='tempest-TestMinimumBasicScenario-server-486932535',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-486932535',id=28,image_ref='7666a25e-0535-48eb-95b3-7909d90f3507',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLujS2qMrbfTLmfjrvCC34ccfhBDvh7Itzo7X58DZeJvTyAF9F25vXUHTGj+pY1BDjgMf45Ki5YpDsHtKHkbdasD+FbKu3GDFuEEYGHTNp7IfnciNn/M3BAitR1uYoYOOA==',key_name='tempest-TestMinimumBasicScenario-2086993178',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:31:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f7ae5f1c56b348de8a03f1a4bcdd9b5c',ramdisk_id='',reservation_id='r-m440bki2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7666a25e-0535-48eb-95b3-7909d90f3507',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1119751084',owner_user_name='tempest-TestMinimumBasicScenario-1119751084-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:34:12Z,user_data=None,user_id='fed345b7cf8f44bfa83d45d408a18c4a',uuid=0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b244939-e725-4cc8-8407-a7dd0bbc7ec4", "address": "fa:16:3e:cc:46:65", "network": {"id": "56c3419f-2c2c-4dda-88d7-ba96e2a689fd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-705071098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ae5f1c56b348de8a03f1a4bcdd9b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b244939-e7", "ovs_interfaceid": "5b244939-e725-4cc8-8407-a7dd0bbc7ec4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:34:15 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Converting VIF {"id": "5b244939-e725-4cc8-8407-a7dd0bbc7ec4", "address": "fa:16:3e:cc:46:65", "network": {"id": "56c3419f-2c2c-4dda-88d7-ba96e2a689fd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-705071098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ae5f1c56b348de8a03f1a4bcdd9b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b244939-e7", "ovs_interfaceid": "5b244939-e725-4cc8-8407-a7dd0bbc7ec4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:34:15 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:46:65,bridge_name='br-int',has_traffic_filtering=True,id=5b244939-e725-4cc8-8407-a7dd0bbc7ec4,network=Network(56c3419f-2c2c-4dda-88d7-ba96e2a689fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b244939-e7') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:34:15 user nova-compute[72586]: DEBUG nova.objects.instance [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lazy-loading 'pci_devices' on Instance uuid 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:34:15 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:34:15 user nova-compute[72586]:   <uuid>0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f</uuid>
Aug 01 21:34:15 user nova-compute[72586]:   <name>instance-0000001c</name>
Aug 01 21:34:15 user nova-compute[72586]:   <memory>524288</memory>
Aug 01 21:34:15 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:34:15 user nova-compute[72586]:   <metadata>
Aug 01 21:34:15 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:34:15 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:34:15 user nova-compute[72586]:       <nova:name>tempest-TestMinimumBasicScenario-server-486932535</nova:name>
Aug 01 21:34:15 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:34:13</nova:creationTime>
Aug 01 21:34:15 user nova-compute[72586]:       <nova:flavor name="m1.tiny">
Aug 01 21:34:15 user nova-compute[72586]:         <nova:memory>512</nova:memory>
Aug 01 21:34:15 user nova-compute[72586]:         <nova:disk>1</nova:disk>
Aug 01 21:34:15 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:34:15 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:34:15 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:34:15 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:34:15 user nova-compute[72586]:       <nova:owner>
Aug 01 21:34:15 user nova-compute[72586]:         <nova:user uuid="fed345b7cf8f44bfa83d45d408a18c4a">tempest-TestMinimumBasicScenario-1119751084-project-member</nova:user>
Aug 01 21:34:15 user nova-compute[72586]:         <nova:project uuid="f7ae5f1c56b348de8a03f1a4bcdd9b5c">tempest-TestMinimumBasicScenario-1119751084</nova:project>
Aug 01 21:34:15 user nova-compute[72586]:       </nova:owner>
Aug 01 21:34:15 user nova-compute[72586]:       <nova:root type="image" uuid="7666a25e-0535-48eb-95b3-7909d90f3507"/>
Aug 01 21:34:15 user nova-compute[72586]:       <nova:ports>
Aug 01 21:34:15 user nova-compute[72586]:         <nova:port uuid="5b244939-e725-4cc8-8407-a7dd0bbc7ec4">
Aug 01 21:34:15 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 01 21:34:15 user nova-compute[72586]:         </nova:port>
Aug 01 21:34:15 user nova-compute[72586]:       </nova:ports>
Aug 01 21:34:15 user nova-compute[72586]:     </nova:instance>
Aug 01 21:34:15 user nova-compute[72586]:   </metadata>
Aug 01 21:34:15 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:34:15 user nova-compute[72586]:     <system>
Aug 01 21:34:15 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:34:15 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:34:15 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:34:15 user nova-compute[72586]:       <entry name="serial">0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f</entry>
Aug 01 21:34:15 user nova-compute[72586]:       <entry name="uuid">0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f</entry>
Aug 01 21:34:15 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:34:15 user nova-compute[72586]:     </system>
Aug 01 21:34:15 user nova-compute[72586]:   </sysinfo>
Aug 01 21:34:15 user nova-compute[72586]:   <os>
Aug 01 21:34:15 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:34:15 user nova-compute[72586]:     <boot dev="hd"/>
Aug 01 21:34:15 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:34:15 user nova-compute[72586]:   </os>
Aug 01 21:34:15 user nova-compute[72586]:   <features>
Aug 01 21:34:15 user nova-compute[72586]:     <acpi/>
Aug 01 21:34:15 user nova-compute[72586]:     <apic/>
Aug 01 21:34:15 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:34:15 user nova-compute[72586]:   </features>
Aug 01 21:34:15 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:34:15 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:34:15 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:34:15 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:34:15 user nova-compute[72586]:   </clock>
Aug 01 21:34:15 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:34:15 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:34:15 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:34:15 user nova-compute[72586]:   </cpu>
Aug 01 21:34:15 user nova-compute[72586]:   <devices>
Aug 01 21:34:15 user nova-compute[72586]:     <disk type="file" device="disk">
Aug 01 21:34:15 user nova-compute[72586]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 21:34:15 user nova-compute[72586]:       <source file="/opt/stack/data/nova/instances/0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f/disk"/>
Aug 01 21:34:15 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:34:15 user nova-compute[72586]:     </disk>
Aug 01 21:34:15 user nova-compute[72586]:     <disk type="block" device="disk">
Aug 01 21:34:15 user nova-compute[72586]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:34:15 user nova-compute[72586]:       <source dev="/dev/sdc"/>
Aug 01 21:34:15 user nova-compute[72586]:       <target dev="vdb" bus="virtio"/>
Aug 01 21:34:15 user nova-compute[72586]:       <serial>cbc36d6d-5805-4d7b-bf27-f170dcdd4f96</serial>
Aug 01 21:34:15 user nova-compute[72586]:     </disk>
Aug 01 21:34:15 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:34:15 user nova-compute[72586]:       <mac address="fa:16:3e:cc:46:65"/>
Aug 01 21:34:15 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:34:15 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:34:15 user nova-compute[72586]:       <target dev="tap5b244939-e7"/>
Aug 01 21:34:15 user nova-compute[72586]:     </interface>
Aug 01 21:34:15 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:34:15 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f/console.log" append="off"/>
Aug 01 21:34:15 user nova-compute[72586]:     </serial>
Aug 01 21:34:15 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:34:15 user nova-compute[72586]:     <video>
Aug 01 21:34:15 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:34:15 user nova-compute[72586]:     </video>
Aug 01 21:34:15 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:34:15 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:34:15 user nova-compute[72586]:     </rng>
Aug 01 21:34:15 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:34:15 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:34:15 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:34:15 user nova-compute[72586]:     </memballoon>
Aug 01 21:34:15 user nova-compute[72586]:   </devices>
Aug 01 21:34:15 user nova-compute[72586]: </domain>
Aug 01 21:34:15 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:34:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:15 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:34:15 user nova-compute[72586]: DEBUG nova.objects.instance [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:34:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b4c15f4ad18a8fa36f6467fbeacb2e64b53dd35c --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:15 user nova-compute[72586]: DEBUG nova.network.neutron [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Updating instance_info_cache with network_info: [{"id": "eeebb619-be12-42d7-96f3-e309b6d4cdaf", "address": "fa:16:3e:5d:69:cd", "network": {"id": "aab9a541-2149-4c65-b60e-80a1daca6632", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1355256264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19af48ffce7e4703b6d978bc3563680e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeebb619-be", "ovs_interfaceid": "eeebb619-be12-42d7-96f3-e309b6d4cdaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:34:15 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Releasing lock "refresh_cache-314f9b05-527c-459d-aca7-acc696ac613f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:34:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b4c15f4ad18a8fa36f6467fbeacb2e64b53dd35c --force-share --output=json" returned: 0 in 0.167s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:15 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f/disk. size=1073741824 {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 21:34:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:16 user nova-compute[72586]: DEBUG os_brick.utils [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:34:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:16 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[65dca5f7-623d-4341-a015-6cee55761eaa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4bc202fb9cb\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:34:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:16 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c9ee26-71ad-47a6-926a-9008cc418a1d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:34:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:16 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[30fd13ee-8abc-4bdf-bd0e-61c90a813351]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:34:16 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f83376-d814-4f34-a4b9-9e50a4308ab2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:34:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Running cmd (subprocess): nvme version {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] 'nvme version' failed. Not Retrying. {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:34:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] nvme not present on system {{(pid=72586) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 21:34:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:16 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Cannot resize image /opt/stack/data/nova/instances/0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f/disk to a smaller size. {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 21:34:16 user nova-compute[72586]: DEBUG nova.objects.instance [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lazy-loading 'migration_context' on Instance uuid 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:34:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:34:16 user nova-compute[72586]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 21:34:16 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ef74ec-cd11-4086-91d3-75c28faee028]: (4, '') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:34:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72586) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 21:34:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 21:34:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] LIGHTOS: no hostnqn found. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 21:34:16 user nova-compute[72586]: DEBUG os_brick.utils [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4bc202fb9cb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:34:16 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:31:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-486932535',display_name='tempest-TestMinimumBasicScenario-server-486932535',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-486932535',id=28,image_ref='7666a25e-0535-48eb-95b3-7909d90f3507',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLujS2qMrbfTLmfjrvCC34ccfhBDvh7Itzo7X58DZeJvTyAF9F25vXUHTGj+pY1BDjgMf45Ki5YpDsHtKHkbdasD+FbKu3GDFuEEYGHTNp7IfnciNn/M3BAitR1uYoYOOA==',key_name='tempest-TestMinimumBasicScenario-2086993178',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:31:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='f7ae5f1c56b348de8a03f1a4bcdd9b5c',ramdisk_id='',reservation_id='r-m440bki2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7666a25e-0535-48eb-95b3-7909d90f3507',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1119751084',owner_user_name='tempest-TestMinimumBasicScenario-1119751084-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:34:12Z,user_data=None,user_id='fed345b7cf8f44bfa83d45d408a18c4a',uuid=0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b244939-e725-4cc8-8407-a7dd0bbc7ec4", "address": "fa:16:3e:cc:46:65", "network": {"id": "56c3419f-2c2c-4dda-88d7-ba96e2a689fd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-705071098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ae5f1c56b348de8a03f1a4bcdd9b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b244939-e7", "ovs_interfaceid": "5b244939-e725-4cc8-8407-a7dd0bbc7ec4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:34:16 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Converting VIF {"id": "5b244939-e725-4cc8-8407-a7dd0bbc7ec4", "address": "fa:16:3e:cc:46:65", "network": {"id": "56c3419f-2c2c-4dda-88d7-ba96e2a689fd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-705071098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ae5f1c56b348de8a03f1a4bcdd9b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b244939-e7", "ovs_interfaceid": "5b244939-e725-4cc8-8407-a7dd0bbc7ec4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:34:16 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:46:65,bridge_name='br-int',has_traffic_filtering=True,id=5b244939-e725-4cc8-8407-a7dd0bbc7ec4,network=Network(56c3419f-2c2c-4dda-88d7-ba96e2a689fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b244939-e7') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:34:16 user nova-compute[72586]: DEBUG os_vif [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:46:65,bridge_name='br-int',has_traffic_filtering=True,id=5b244939-e725-4cc8-8407-a7dd0bbc7ec4,network=Network(56c3419f-2c2c-4dda-88d7-ba96e2a689fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b244939-e7') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:34:16 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:16 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:34:16 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:34:16 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:16 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b244939-e7, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:34:16 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5b244939-e7, col_values=(('external_ids', {'iface-id': '5b244939-e725-4cc8-8407-a7dd0bbc7ec4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:46:65', 'vm-uuid': '0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:34:16 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:16 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:34:16 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:16 user nova-compute[72586]: INFO os_vif [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:46:65,bridge_name='br-int',has_traffic_filtering=True,id=5b244939-e725-4cc8-8407-a7dd0bbc7ec4,network=Network(56c3419f-2c2c-4dda-88d7-ba96e2a689fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b244939-e7')
Aug 01 21:34:17 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:17 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:17 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:18 user nova-compute[72586]: DEBUG nova.compute.manager [req-a798e1fd-e396-4a0b-aba7-6141cc6393a1 req-b644efd2-b992-41d4-8dd8-eb12f95f7a65 service nova] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Received event network-vif-plugged-5b244939-e725-4cc8-8407-a7dd0bbc7ec4 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:34:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-a798e1fd-e396-4a0b-aba7-6141cc6393a1 req-b644efd2-b992-41d4-8dd8-eb12f95f7a65 service nova] Acquiring lock "0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:34:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-a798e1fd-e396-4a0b-aba7-6141cc6393a1 req-b644efd2-b992-41d4-8dd8-eb12f95f7a65 service nova] Lock "0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:34:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-a798e1fd-e396-4a0b-aba7-6141cc6393a1 req-b644efd2-b992-41d4-8dd8-eb12f95f7a65 service nova] Lock "0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:34:18 user nova-compute[72586]: DEBUG nova.compute.manager [req-a798e1fd-e396-4a0b-aba7-6141cc6393a1 req-b644efd2-b992-41d4-8dd8-eb12f95f7a65 service nova] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] No waiting events found dispatching network-vif-plugged-5b244939-e725-4cc8-8407-a7dd0bbc7ec4 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:34:18 user nova-compute[72586]: WARNING nova.compute.manager [req-a798e1fd-e396-4a0b-aba7-6141cc6393a1 req-b644efd2-b992-41d4-8dd8-eb12f95f7a65 service nova] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Received unexpected event network-vif-plugged-5b244939-e725-4cc8-8407-a7dd0bbc7ec4 for instance with vm_state active and task_state reboot_started_hard.
Aug 01 21:34:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:20 user nova-compute[72586]: DEBUG nova.compute.manager [req-d0e81239-e35f-4518-ae25-0602ab850b34 req-e26dcb98-dd2c-4332-9bc0-6588db30e2b3 service nova] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Received event network-vif-plugged-5b244939-e725-4cc8-8407-a7dd0bbc7ec4 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:34:20 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d0e81239-e35f-4518-ae25-0602ab850b34 req-e26dcb98-dd2c-4332-9bc0-6588db30e2b3 service nova] Acquiring lock "0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:34:20 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d0e81239-e35f-4518-ae25-0602ab850b34 req-e26dcb98-dd2c-4332-9bc0-6588db30e2b3 service nova] Lock "0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:34:20 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d0e81239-e35f-4518-ae25-0602ab850b34 req-e26dcb98-dd2c-4332-9bc0-6588db30e2b3 service nova] Lock "0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:34:20 user nova-compute[72586]: DEBUG nova.compute.manager [req-d0e81239-e35f-4518-ae25-0602ab850b34 req-e26dcb98-dd2c-4332-9bc0-6588db30e2b3 service nova] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] No waiting events found dispatching network-vif-plugged-5b244939-e725-4cc8-8407-a7dd0bbc7ec4 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:34:20 user nova-compute[72586]: WARNING nova.compute.manager [req-d0e81239-e35f-4518-ae25-0602ab850b34 req-e26dcb98-dd2c-4332-9bc0-6588db30e2b3 service nova] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Received unexpected event network-vif-plugged-5b244939-e725-4cc8-8407-a7dd0bbc7ec4 for instance with vm_state active and task_state reboot_started_hard.
Aug 01 21:34:20 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Removed pending event for 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f due to event {{(pid=72586) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 21:34:20 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925660.2032845, 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:34:20 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] VM Resumed (Lifecycle Event)
Aug 01 21:34:20 user nova-compute[72586]: DEBUG nova.compute.manager [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Instance event wait completed in 0 seconds for  {{(pid=72586) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 21:34:20 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Instance rebooted successfully.
Aug 01 21:34:20 user nova-compute[72586]: DEBUG nova.compute.manager [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:34:20 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:34:20 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:34:20 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 01 21:34:20 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925660.2071242, 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:34:20 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] VM Started (Lifecycle Event)
Aug 01 21:34:20 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:34:20 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:34:20 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-d44183f1-af89-4b22-aef1-a7d901d75ca7 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 9.257s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:34:21 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:21 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:22 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:23 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:34:24 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:26 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:28 user nova-compute[72586]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690925653.2393682, 314f9b05-527c-459d-aca7-acc696ac613f => Stopped> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:34:28 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] VM Stopped (Lifecycle Event)
Aug 01 21:34:28 user nova-compute[72586]: DEBUG nova.compute.manager [None req-7e8e9e5a-8aa4-495e-ba4b-c7d191496fcf None None] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:34:28 user nova-compute[72586]: DEBUG nova.compute.manager [None req-7e8e9e5a-8aa4-495e-ba4b-c7d191496fcf None None] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:34:28 user nova-compute[72586]: INFO nova.compute.manager [None req-7e8e9e5a-8aa4-495e-ba4b-c7d191496fcf None None] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 01 21:34:28 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:34:28 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72586) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 21:34:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:29 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:34:29 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:34:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:34:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:34:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:34:29 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Auditing locally available compute resources for user (node: user) {{(pid=72586) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 21:34:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:30 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:34:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Starting finish_migration {{(pid=72586) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Instance directory exists: not creating {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 01 21:34:31 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Creating image(s)
Aug 01 21:34:31 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Did not create local disks {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Ensure instance console log exists: /opt/stack/data/nova/instances/314f9b05-527c-459d-aca7-acc696ac613f/console.log {{(pid=72586) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Start _get_guest_xml network_info=[{"id": "eeebb619-be12-42d7-96f3-e309b6d4cdaf", "address": "fa:16:3e:5d:69:cd", "network": {"id": "aab9a541-2149-4c65-b60e-80a1daca6632", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1355256264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1355256264-network", "vif_mac": "fa:16:3e:5d:69:cd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19af48ffce7e4703b6d978bc3563680e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeebb619-be", "ovs_interfaceid": "eeebb619-be12-42d7-96f3-e309b6d4cdaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'roGchSeU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '314f9b05-527c-459d-aca7-acc696ac613f', 'attached_at': '2023-08-01T21:34:31.000000', 'detached_at': '', 'volume_id': '594ff51e-685a-4144-8733-decfebb84843', 'serial': '594ff51e-685a-4144-8733-decfebb84843'}, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'e9da36f8-4915-4f5c-b64a-b3b24916675f', 'delete_on_termination': True, 'volume_type': None} {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:34:31 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:34:31 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:34:31 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG nova.objects.instance [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lazy-loading 'vcpu_model' on Instance uuid 314f9b05-527c-459d-aca7-acc696ac613f {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Calling os-brick to attach iSCSI Volume {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'roGchSeU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:34:31 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:34:31 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:34:31 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:34:31 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:34:31 user nova-compute[72586]: INFO os_brick.initiator.connectors.iscsi [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 21:34:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 -p 172.16.0.220:3260 {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[01261291-97c1-4e7f-8193-f3632df15b24]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 21:34:31 user nova-compute[72586]:  {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 -p 172.16.0.220:3260 --interface default --op new {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.037s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccdaa3b0-0bd0-4dc7-9acf-563f1b220306]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843] added\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843] added
Aug 01 21:34:31 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c196f2d-8e8c-4c92-968d-247a1c0f56a4]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78ee838-c807-4c53-86db-776a718f67cd]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v roGchSeU {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v roGchSeU" returned: 0 in 0.023s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef32ea9-ae91-42a7-8cdc-da3214a6092d]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'roGchSeU'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b0d907-2515-4a06-8b35-9ddd09ce42c3/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[073748b4-7023-45ad-96e2-5e58d2d8f07c]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[091ab8c3-6ffe-4eaa-923c-c2c7a08a7709]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:34:31 user nova-compute[72586]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 (non-flash)
Aug 01 21:34:31 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:34:31 user nova-compute[72586]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 (non-flash)
Aug 01 21:34:31 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 -p 172.16.0.220:3260 --login {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b0d907-2515-4a06-8b35-9ddd09ce42c3/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b0d907-2515-4a06-8b35-9ddd09ce42c3/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eda9814-fafa-4d07-8a6d-b4f610ef671b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843, portal: 172.16.0.220,3260]
Aug 01 21:34:31 user nova-compute[72586]: Login to [iface: default, target: iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843, portal: 172.16.0.220,3260] successful.
Aug 01 21:34:31 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.183s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[772e3d78-fbf3-4bed-878e-ae4040adae7c]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b0d907-2515-4a06-8b35-9ddd09ce42c3/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[be189106-bc4b-479f-8094-b87a37a5440a]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:34:31 user nova-compute[72586]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 (non-flash)
Aug 01 21:34:31 user nova-compute[72586]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 (non-flash)
Aug 01 21:34:31 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:34:31 user nova-compute[72586]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 (non-flash)
Aug 01 21:34:31 user nova-compute[72586]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 (non-flash)
Aug 01 21:34:31 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.692s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Connected to 172.16.0.220:3260 {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] HCTL ('35', '-', '-', 0) found on session 39 with lun 0 {{(pid=72586) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72586) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb08bf6c-5dbc-4183-81b8-105e2404fadd]: (4, ('- - 0', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Searching for a device in session 39 and hctl ['35', '*', '*', 0] yield: None {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:32 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.rescue --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.rescue --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:32 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Searching for a device in session 39 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:34:32 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'roGchSeU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 21:34:32 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.732s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:34:32 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] <== connect_volume: return (1733ms) {'type': 'block', 'scsi_wwn': '26636643961363439', 'path': '/dev/sdd'} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:34:32 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636643961363439', 'path': '/dev/sdd'} {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 21:34:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ced1426-a20e-4d5f-8250-e789eba6f098/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:32 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:32:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-400634865',display_name='tempest-ServerActionsTestOtherA-server-400634865',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-400634865',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPk4vuGAtPXP/Itqq7TbQ+6Sv+k5bpNQFeCgGdApIPBaVaeUmQBoiJZa5I5091aDIuYBB7Uba3sQDG1YP/kTFSXvqkIW2yu6s2YyWP+iKPKZLzdQkqmU2IfIy2EEsidssA==',key_name='tempest-keypair-400537691',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:32:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='19af48ffce7e4703b6d978bc3563680e',ramdisk_id='',reservation_id='r-0fzqwm4s',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-825165282',owner_user_name='tempest-ServerActionsTestOtherA-825165282-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:34:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88d01b1101164c859b19d41e251447a5',uuid=314f9b05-527c-459d-aca7-acc696ac613f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eeebb619-be12-42d7-96f3-e309b6d4cdaf", "address": "fa:16:3e:5d:69:cd", "network": {"id": "aab9a541-2149-4c65-b60e-80a1daca6632", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1355256264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1355256264-network", "vif_mac": "fa:16:3e:5d:69:cd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19af48ffce7e4703b6d978bc3563680e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeebb619-be", "ovs_interfaceid": "eeebb619-be12-42d7-96f3-e309b6d4cdaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:34:32 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Converting VIF {"id": "eeebb619-be12-42d7-96f3-e309b6d4cdaf", "address": "fa:16:3e:5d:69:cd", "network": {"id": "aab9a541-2149-4c65-b60e-80a1daca6632", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1355256264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1355256264-network", "vif_mac": "fa:16:3e:5d:69:cd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19af48ffce7e4703b6d978bc3563680e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeebb619-be", "ovs_interfaceid": "eeebb619-be12-42d7-96f3-e309b6d4cdaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:34:32 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:69:cd,bridge_name='br-int',has_traffic_filtering=True,id=eeebb619-be12-42d7-96f3-e309b6d4cdaf,network=Network(aab9a541-2149-4c65-b60e-80a1daca6632),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeebb619-be') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:34:32 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:34:32 user nova-compute[72586]:   <uuid>314f9b05-527c-459d-aca7-acc696ac613f</uuid>
Aug 01 21:34:32 user nova-compute[72586]:   <name>instance-0000001d</name>
Aug 01 21:34:32 user nova-compute[72586]:   <memory>2097152</memory>
Aug 01 21:34:32 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:34:32 user nova-compute[72586]:   <metadata>
Aug 01 21:34:32 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:34:32 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:34:32 user nova-compute[72586]:       <nova:name>tempest-ServerActionsTestOtherA-server-400634865</nova:name>
Aug 01 21:34:32 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:34:31</nova:creationTime>
Aug 01 21:34:32 user nova-compute[72586]:       <nova:flavor name="m1.small">
Aug 01 21:34:32 user nova-compute[72586]:         <nova:memory>2048</nova:memory>
Aug 01 21:34:32 user nova-compute[72586]:         <nova:disk>20</nova:disk>
Aug 01 21:34:32 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:34:32 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:34:32 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:34:32 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:34:32 user nova-compute[72586]:       <nova:owner>
Aug 01 21:34:32 user nova-compute[72586]:         <nova:user uuid="88d01b1101164c859b19d41e251447a5">tempest-ServerActionsTestOtherA-825165282-project-member</nova:user>
Aug 01 21:34:32 user nova-compute[72586]:         <nova:project uuid="19af48ffce7e4703b6d978bc3563680e">tempest-ServerActionsTestOtherA-825165282</nova:project>
Aug 01 21:34:32 user nova-compute[72586]:       </nova:owner>
Aug 01 21:34:32 user nova-compute[72586]:       <nova:ports>
Aug 01 21:34:32 user nova-compute[72586]:         <nova:port uuid="eeebb619-be12-42d7-96f3-e309b6d4cdaf">
Aug 01 21:34:32 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 01 21:34:32 user nova-compute[72586]:         </nova:port>
Aug 01 21:34:32 user nova-compute[72586]:       </nova:ports>
Aug 01 21:34:32 user nova-compute[72586]:     </nova:instance>
Aug 01 21:34:32 user nova-compute[72586]:   </metadata>
Aug 01 21:34:32 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:34:32 user nova-compute[72586]:     <system>
Aug 01 21:34:32 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:34:32 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:34:32 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:34:32 user nova-compute[72586]:       <entry name="serial">314f9b05-527c-459d-aca7-acc696ac613f</entry>
Aug 01 21:34:32 user nova-compute[72586]:       <entry name="uuid">314f9b05-527c-459d-aca7-acc696ac613f</entry>
Aug 01 21:34:32 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:34:32 user nova-compute[72586]:     </system>
Aug 01 21:34:32 user nova-compute[72586]:   </sysinfo>
Aug 01 21:34:32 user nova-compute[72586]:   <os>
Aug 01 21:34:32 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:34:32 user nova-compute[72586]:     <boot dev="hd"/>
Aug 01 21:34:32 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:34:32 user nova-compute[72586]:   </os>
Aug 01 21:34:32 user nova-compute[72586]:   <features>
Aug 01 21:34:32 user nova-compute[72586]:     <acpi/>
Aug 01 21:34:32 user nova-compute[72586]:     <apic/>
Aug 01 21:34:32 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:34:32 user nova-compute[72586]:   </features>
Aug 01 21:34:32 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:34:32 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:34:32 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:34:32 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:34:32 user nova-compute[72586]:   </clock>
Aug 01 21:34:32 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:34:32 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:34:32 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:34:32 user nova-compute[72586]:   </cpu>
Aug 01 21:34:32 user nova-compute[72586]:   <devices>
Aug 01 21:34:32 user nova-compute[72586]:     <disk type="block" device="disk">
Aug 01 21:34:32 user nova-compute[72586]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:34:32 user nova-compute[72586]:       <source dev="/dev/sdd"/>
Aug 01 21:34:32 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:34:32 user nova-compute[72586]:       <serial>594ff51e-685a-4144-8733-decfebb84843</serial>
Aug 01 21:34:32 user nova-compute[72586]:     </disk>
Aug 01 21:34:32 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:34:32 user nova-compute[72586]:       <mac address="fa:16:3e:5d:69:cd"/>
Aug 01 21:34:32 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:34:32 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:34:32 user nova-compute[72586]:       <target dev="tapeeebb619-be"/>
Aug 01 21:34:32 user nova-compute[72586]:     </interface>
Aug 01 21:34:32 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:34:32 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/314f9b05-527c-459d-aca7-acc696ac613f/console.log" append="off"/>
Aug 01 21:34:32 user nova-compute[72586]:     </serial>
Aug 01 21:34:32 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:34:32 user nova-compute[72586]:     <video>
Aug 01 21:34:32 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:34:32 user nova-compute[72586]:     </video>
Aug 01 21:34:32 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:34:32 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:34:32 user nova-compute[72586]:     </rng>
Aug 01 21:34:32 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:34:32 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:34:32 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:34:32 user nova-compute[72586]:     </memballoon>
Aug 01 21:34:32 user nova-compute[72586]:   </devices>
Aug 01 21:34:32 user nova-compute[72586]: </domain>
Aug 01 21:34:32 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:34:32 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:32:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-400634865',display_name='tempest-ServerActionsTestOtherA-server-400634865',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-400634865',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPk4vuGAtPXP/Itqq7TbQ+6Sv+k5bpNQFeCgGdApIPBaVaeUmQBoiJZa5I5091aDIuYBB7Uba3sQDG1YP/kTFSXvqkIW2yu6s2YyWP+iKPKZLzdQkqmU2IfIy2EEsidssA==',key_name='tempest-keypair-400537691',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:32:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='19af48ffce7e4703b6d978bc3563680e',ramdisk_id='',reservation_id='r-0fzqwm4s',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-825165282',owner_user_name='tempest-ServerActionsTestOtherA-825165282-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:34:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88d01b1101164c859b19d41e251447a5',uuid=314f9b05-527c-459d-aca7-acc696ac613f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eeebb619-be12-42d7-96f3-e309b6d4cdaf", "address": "fa:16:3e:5d:69:cd", "network": {"id": "aab9a541-2149-4c65-b60e-80a1daca6632", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1355256264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1355256264-network", "vif_mac": "fa:16:3e:5d:69:cd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19af48ffce7e4703b6d978bc3563680e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeebb619-be", "ovs_interfaceid": "eeebb619-be12-42d7-96f3-e309b6d4cdaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:34:32 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Converting VIF {"id": "eeebb619-be12-42d7-96f3-e309b6d4cdaf", "address": "fa:16:3e:5d:69:cd", "network": {"id": "aab9a541-2149-4c65-b60e-80a1daca6632", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1355256264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1355256264-network", "vif_mac": "fa:16:3e:5d:69:cd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19af48ffce7e4703b6d978bc3563680e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeebb619-be", "ovs_interfaceid": "eeebb619-be12-42d7-96f3-e309b6d4cdaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:34:32 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:69:cd,bridge_name='br-int',has_traffic_filtering=True,id=eeebb619-be12-42d7-96f3-e309b6d4cdaf,network=Network(aab9a541-2149-4c65-b60e-80a1daca6632),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeebb619-be') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:34:32 user nova-compute[72586]: DEBUG os_vif [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:69:cd,bridge_name='br-int',has_traffic_filtering=True,id=eeebb619-be12-42d7-96f3-e309b6d4cdaf,network=Network(aab9a541-2149-4c65-b60e-80a1daca6632),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeebb619-be') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:34:32 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:32 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:34:32 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:34:32 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:32 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeeebb619-be, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:34:32 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapeeebb619-be, col_values=(('external_ids', {'iface-id': 'eeebb619-be12-42d7-96f3-e309b6d4cdaf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:69:cd', 'vm-uuid': '314f9b05-527c-459d-aca7-acc696ac613f'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:34:32 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:32 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:34:32 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:32 user nova-compute[72586]: INFO os_vif [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:69:cd,bridge_name='br-int',has_traffic_filtering=True,id=eeebb619-be12-42d7-96f3-e309b6d4cdaf,network=Network(aab9a541-2149-4c65-b60e-80a1daca6632),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeebb619-be')
Aug 01 21:34:33 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:34:33 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] No VIF found with MAC fa:16:3e:5d:69:cd, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:34:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ced1426-a20e-4d5f-8250-e789eba6f098/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ced1426-a20e-4d5f-8250-e789eba6f098/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ced1426-a20e-4d5f-8250-e789eba6f098/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:34 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:34 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:34 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:34 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:34 user nova-compute[72586]: DEBUG nova.compute.manager [req-2be9f67e-a8ce-4e6e-9958-a438fca16898 req-14327c8d-6114-4770-80e0-3b59893d4072 service nova] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Received event network-vif-plugged-eeebb619-be12-42d7-96f3-e309b6d4cdaf {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:34:34 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-2be9f67e-a8ce-4e6e-9958-a438fca16898 req-14327c8d-6114-4770-80e0-3b59893d4072 service nova] Acquiring lock "314f9b05-527c-459d-aca7-acc696ac613f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:34:34 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-2be9f67e-a8ce-4e6e-9958-a438fca16898 req-14327c8d-6114-4770-80e0-3b59893d4072 service nova] Lock "314f9b05-527c-459d-aca7-acc696ac613f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:34:34 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-2be9f67e-a8ce-4e6e-9958-a438fca16898 req-14327c8d-6114-4770-80e0-3b59893d4072 service nova] Lock "314f9b05-527c-459d-aca7-acc696ac613f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:34:34 user nova-compute[72586]: DEBUG nova.compute.manager [req-2be9f67e-a8ce-4e6e-9958-a438fca16898 req-14327c8d-6114-4770-80e0-3b59893d4072 service nova] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] No waiting events found dispatching network-vif-plugged-eeebb619-be12-42d7-96f3-e309b6d4cdaf {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:34:34 user nova-compute[72586]: WARNING nova.compute.manager [req-2be9f67e-a8ce-4e6e-9958-a438fca16898 req-14327c8d-6114-4770-80e0-3b59893d4072 service nova] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Received unexpected event network-vif-plugged-eeebb619-be12-42d7-96f3-e309b6d4cdaf for instance with vm_state active and task_state resize_finish.
Aug 01 21:34:34 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:34 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:34 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:34 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-81bc4fcc-a630-4770-81ac-f6caea042cdf tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Acquiring lock "f6b0d907-2515-4a06-8b35-9ddd09ce42c3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:34:34 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-81bc4fcc-a630-4770-81ac-f6caea042cdf tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "f6b0d907-2515-4a06-8b35-9ddd09ce42c3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:34:34 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-81bc4fcc-a630-4770-81ac-f6caea042cdf tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Acquiring lock "f6b0d907-2515-4a06-8b35-9ddd09ce42c3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:34:34 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-81bc4fcc-a630-4770-81ac-f6caea042cdf tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "f6b0d907-2515-4a06-8b35-9ddd09ce42c3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:34:34 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-81bc4fcc-a630-4770-81ac-f6caea042cdf tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "f6b0d907-2515-4a06-8b35-9ddd09ce42c3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:34:34 user nova-compute[72586]: INFO nova.compute.manager [None req-81bc4fcc-a630-4770-81ac-f6caea042cdf tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Terminating instance
Aug 01 21:34:34 user nova-compute[72586]: DEBUG nova.compute.manager [None req-81bc4fcc-a630-4770-81ac-f6caea042cdf tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Start destroying the instance on the hypervisor. {{(pid=72586) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 21:34:34 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:34 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:34 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:34:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:37 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925676.7926688, 314f9b05-527c-459d-aca7-acc696ac613f => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:34:37 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] VM Resumed (Lifecycle Event)
Aug 01 21:34:37 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Instance event wait completed in 0 seconds for  {{(pid=72586) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 21:34:37 user nova-compute[72586]: DEBUG nova.compute.manager [req-5e1e160d-a29d-4704-b7d0-f0643f5f068b req-37865a62-50ad-4196-a2d2-1b02fb1a4a99 service nova] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Received event network-vif-unplugged-440ca7d3-e2b8-4edf-9339-bd8d247d5da2 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:34:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-5e1e160d-a29d-4704-b7d0-f0643f5f068b req-37865a62-50ad-4196-a2d2-1b02fb1a4a99 service nova] Acquiring lock "f6b0d907-2515-4a06-8b35-9ddd09ce42c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:34:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-5e1e160d-a29d-4704-b7d0-f0643f5f068b req-37865a62-50ad-4196-a2d2-1b02fb1a4a99 service nova] Lock "f6b0d907-2515-4a06-8b35-9ddd09ce42c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:34:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-5e1e160d-a29d-4704-b7d0-f0643f5f068b req-37865a62-50ad-4196-a2d2-1b02fb1a4a99 service nova] Lock "f6b0d907-2515-4a06-8b35-9ddd09ce42c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:34:37 user nova-compute[72586]: DEBUG nova.compute.manager [req-5e1e160d-a29d-4704-b7d0-f0643f5f068b req-37865a62-50ad-4196-a2d2-1b02fb1a4a99 service nova] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] No waiting events found dispatching network-vif-unplugged-440ca7d3-e2b8-4edf-9339-bd8d247d5da2 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:34:37 user nova-compute[72586]: DEBUG nova.compute.manager [req-5e1e160d-a29d-4704-b7d0-f0643f5f068b req-37865a62-50ad-4196-a2d2-1b02fb1a4a99 service nova] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Received event network-vif-unplugged-440ca7d3-e2b8-4edf-9339-bd8d247d5da2 for instance with task_state deleting. {{(pid=72586) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 21:34:37 user nova-compute[72586]: DEBUG nova.compute.manager [req-2edf6313-4983-4a88-a8ca-d417d3712e39 req-2bbe934e-5cdd-40cb-aeb4-7a8fa5d6b62e service nova] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Received event network-vif-plugged-eeebb619-be12-42d7-96f3-e309b6d4cdaf {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:34:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-2edf6313-4983-4a88-a8ca-d417d3712e39 req-2bbe934e-5cdd-40cb-aeb4-7a8fa5d6b62e service nova] Acquiring lock "314f9b05-527c-459d-aca7-acc696ac613f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:34:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-2edf6313-4983-4a88-a8ca-d417d3712e39 req-2bbe934e-5cdd-40cb-aeb4-7a8fa5d6b62e service nova] Lock "314f9b05-527c-459d-aca7-acc696ac613f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:34:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-2edf6313-4983-4a88-a8ca-d417d3712e39 req-2bbe934e-5cdd-40cb-aeb4-7a8fa5d6b62e service nova] Lock "314f9b05-527c-459d-aca7-acc696ac613f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:34:37 user nova-compute[72586]: DEBUG nova.compute.manager [req-2edf6313-4983-4a88-a8ca-d417d3712e39 req-2bbe934e-5cdd-40cb-aeb4-7a8fa5d6b62e service nova] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] No waiting events found dispatching network-vif-plugged-eeebb619-be12-42d7-96f3-e309b6d4cdaf {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:34:37 user nova-compute[72586]: WARNING nova.compute.manager [req-2edf6313-4983-4a88-a8ca-d417d3712e39 req-2bbe934e-5cdd-40cb-aeb4-7a8fa5d6b62e service nova] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Received unexpected event network-vif-plugged-eeebb619-be12-42d7-96f3-e309b6d4cdaf for instance with vm_state active and task_state resize_finish.
Aug 01 21:34:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Acquiring lock "11ab466b-8caa-4a38-8350-213aa17ee75e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:34:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "11ab466b-8caa-4a38-8350-213aa17ee75e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:34:37 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:34:37 user nova-compute[72586]: DEBUG nova.compute.manager [req-f5216ccb-6fd3-4fa7-8169-c084e726b1d4 req-cc052b0d-5e80-46fa-b6c9-c3df45d66f79 service nova] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Received event network-vif-plugged-440ca7d3-e2b8-4edf-9339-bd8d247d5da2 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:34:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-f5216ccb-6fd3-4fa7-8169-c084e726b1d4 req-cc052b0d-5e80-46fa-b6c9-c3df45d66f79 service nova] Acquiring lock "f6b0d907-2515-4a06-8b35-9ddd09ce42c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:34:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-f5216ccb-6fd3-4fa7-8169-c084e726b1d4 req-cc052b0d-5e80-46fa-b6c9-c3df45d66f79 service nova] Lock "f6b0d907-2515-4a06-8b35-9ddd09ce42c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:34:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-f5216ccb-6fd3-4fa7-8169-c084e726b1d4 req-cc052b0d-5e80-46fa-b6c9-c3df45d66f79 service nova] Lock "f6b0d907-2515-4a06-8b35-9ddd09ce42c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:34:37 user nova-compute[72586]: DEBUG nova.compute.manager [req-f5216ccb-6fd3-4fa7-8169-c084e726b1d4 req-cc052b0d-5e80-46fa-b6c9-c3df45d66f79 service nova] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] No waiting events found dispatching network-vif-plugged-440ca7d3-e2b8-4edf-9339-bd8d247d5da2 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:34:37 user nova-compute[72586]: WARNING nova.compute.manager [req-f5216ccb-6fd3-4fa7-8169-c084e726b1d4 req-cc052b0d-5e80-46fa-b6c9-c3df45d66f79 service nova] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Received unexpected event network-vif-plugged-440ca7d3-e2b8-4edf-9339-bd8d247d5da2 for instance with vm_state active and task_state deleting.
Aug 01 21:34:37 user nova-compute[72586]: DEBUG nova.compute.manager [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Starting instance... {{(pid=72586) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 21:34:37 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Instance destroyed successfully.
Aug 01 21:34:37 user nova-compute[72586]: DEBUG nova.objects.instance [None req-81bc4fcc-a630-4770-81ac-f6caea042cdf tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lazy-loading 'resources' on Instance uuid f6b0d907-2515-4a06-8b35-9ddd09ce42c3 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:34:37 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:34:37 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:34:37 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Hypervisor/Node resource view: name=user free_ram=7723MB free_disk=25.196880340576172GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72586) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 21:34:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:34:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:34:37 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Instance running successfully.
Aug 01 21:34:37 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:34:37 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Failed to set time: agent not configured {{(pid=72586) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 01 21:34:37 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-eed5d394-1e4d-422b-981f-e3b68b42b166 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] finish_migration finished successfully. {{(pid=72586) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 01 21:34:37 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-81bc4fcc-a630-4770-81ac-f6caea042cdf tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:27:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-688014459',display_name='tempest-ServerRescueNegativeTestJSON-server-688014459',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-688014459',id=23,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPKVtErVvQRkpUoC6JoyLuD25FsEWnNM1f53ch2eGXiYFeVUn5ceQanDKFKTGkUOLx9VSoczBggOQHVsTSmyYFizYDPlFPaBAzypHmYYYVCv8QrT9lMXmW/v7nzGDV6aQ==',key_name='tempest-keypair-266379112',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:30:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5b1a1d82f39347119a9fb49fb8e8893f',ramdisk_id='',reservation_id='r-kcmrdcc1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1258600061',owner_user_name='tempest-ServerRescueNegativeTestJSON-1258600061-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:31:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f678ac8999a42c4a383ee8b2976b4cc',uuid=f6b0d907-2515-4a06-8b35-9ddd09ce42c3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "440ca7d3-e2b8-4edf-9339-bd8d247d5da2", "address": "fa:16:3e:29:ff:63", "network": {"id": "d229a8de-7a2b-4dcd-a9ac-44a40349676e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-67691992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b1a1d82f39347119a9fb49fb8e8893f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap440ca7d3-e2", "ovs_interfaceid": "440ca7d3-e2b8-4edf-9339-bd8d247d5da2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:34:37 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-81bc4fcc-a630-4770-81ac-f6caea042cdf tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Converting VIF {"id": "440ca7d3-e2b8-4edf-9339-bd8d247d5da2", "address": "fa:16:3e:29:ff:63", "network": {"id": "d229a8de-7a2b-4dcd-a9ac-44a40349676e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-67691992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b1a1d82f39347119a9fb49fb8e8893f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap440ca7d3-e2", "ovs_interfaceid": "440ca7d3-e2b8-4edf-9339-bd8d247d5da2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:34:37 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-81bc4fcc-a630-4770-81ac-f6caea042cdf tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:29:ff:63,bridge_name='br-int',has_traffic_filtering=True,id=440ca7d3-e2b8-4edf-9339-bd8d247d5da2,network=Network(d229a8de-7a2b-4dcd-a9ac-44a40349676e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap440ca7d3-e2') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:34:37 user nova-compute[72586]: DEBUG os_vif [None req-81bc4fcc-a630-4770-81ac-f6caea042cdf tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:ff:63,bridge_name='br-int',has_traffic_filtering=True,id=440ca7d3-e2b8-4edf-9339-bd8d247d5da2,network=Network(d229a8de-7a2b-4dcd-a9ac-44a40349676e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap440ca7d3-e2') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:34:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap440ca7d3-e2, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:34:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:37 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 01 21:34:37 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925676.7928293, 314f9b05-527c-459d-aca7-acc696ac613f => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:34:37 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] VM Started (Lifecycle Event)
Aug 01 21:34:37 user nova-compute[72586]: INFO os_vif [None req-81bc4fcc-a630-4770-81ac-f6caea042cdf tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:ff:63,bridge_name='br-int',has_traffic_filtering=True,id=440ca7d3-e2b8-4edf-9339-bd8d247d5da2,network=Network(d229a8de-7a2b-4dcd-a9ac-44a40349676e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap440ca7d3-e2')
Aug 01 21:34:37 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-81bc4fcc-a630-4770-81ac-f6caea042cdf tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Deleting instance files /opt/stack/data/nova/instances/f6b0d907-2515-4a06-8b35-9ddd09ce42c3_del
Aug 01 21:34:37 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-81bc4fcc-a630-4770-81ac-f6caea042cdf tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Deletion of /opt/stack/data/nova/instances/f6b0d907-2515-4a06-8b35-9ddd09ce42c3_del complete
Aug 01 21:34:37 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:34:37 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:34:37 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 01 21:34:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:34:37 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Applying migration context for instance 314f9b05-527c-459d-aca7-acc696ac613f as it has an incoming, in-progress migration a601a123-f478-4115-afd7-0b4b73b52210. Migration status is post-migrating {{(pid=72586) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 01 21:34:37 user nova-compute[72586]: INFO nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Updating resource usage from migration a601a123-f478-4115-afd7-0b4b73b52210
Aug 01 21:34:37 user nova-compute[72586]: INFO nova.compute.manager [None req-81bc4fcc-a630-4770-81ac-f6caea042cdf tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Took 2.85 seconds to destroy the instance on the hypervisor.
Aug 01 21:34:37 user nova-compute[72586]: DEBUG oslo.service.loopingcall [None req-81bc4fcc-a630-4770-81ac-f6caea042cdf tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72586) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 21:34:37 user nova-compute[72586]: DEBUG nova.compute.manager [-] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Deallocating network for instance {{(pid=72586) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 21:34:37 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] deallocate_for_instance() {{(pid=72586) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 21:34:37 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 042f0031-1e4d-41d0-8bfa-36001675cfe3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:34:37 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 413c3426-18ad-4a5c-af04-e0e7fc90f050 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:34:37 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 49c24c77-f102-4aed-8314-b04aad5f6b3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:34:37 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance af2de810-b22f-4fa9-835c-c673abd145db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:34:37 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance f6b0d907-2515-4a06-8b35-9ddd09ce42c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:34:37 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 161fab9d-a7d1-4ea0-b4b9-2afc54040eef actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:34:37 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:34:37 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 3ced1426-a20e-4d5f-8250-e789eba6f098 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:34:37 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Migration a601a123-f478-4115-afd7-0b4b73b52210 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 01 21:34:37 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 314f9b05-527c-459d-aca7-acc696ac613f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:34:37 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 11ab466b-8caa-4a38-8350-213aa17ee75e has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 01 21:34:37 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 21:34:37 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 21:34:38 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:34:38 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:34:38 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Compute_service record updated for user:user {{(pid=72586) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 21:34:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.915s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:34:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.648s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:34:38 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72586) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 21:34:38 user nova-compute[72586]: INFO nova.compute.claims [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Claim successful on node user
Aug 01 21:34:38 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:34:38 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:34:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.482s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:34:38 user nova-compute[72586]: DEBUG nova.compute.manager [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Start building networks asynchronously for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 21:34:38 user nova-compute[72586]: DEBUG nova.compute.manager [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Allocating IP information in the background. {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 21:34:38 user nova-compute[72586]: DEBUG nova.network.neutron [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] allocate_for_instance() {{(pid=72586) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 21:34:38 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 21:34:38 user nova-compute[72586]: DEBUG nova.compute.manager [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Start building block device mappings for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 21:34:38 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:34:38 user nova-compute[72586]: DEBUG nova.compute.manager [req-7d2b396c-da38-49c2-8fb3-604cd5deb520 req-8a7871e3-469a-4a97-a55e-5ff56fadb1d7 service nova] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Received event network-vif-deleted-440ca7d3-e2b8-4edf-9339-bd8d247d5da2 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:34:38 user nova-compute[72586]: INFO nova.compute.manager [req-7d2b396c-da38-49c2-8fb3-604cd5deb520 req-8a7871e3-469a-4a97-a55e-5ff56fadb1d7 service nova] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Neutron deleted interface 440ca7d3-e2b8-4edf-9339-bd8d247d5da2; detaching it from the instance and deleting it from the info cache
Aug 01 21:34:38 user nova-compute[72586]: DEBUG nova.network.neutron [req-7d2b396c-da38-49c2-8fb3-604cd5deb520 req-8a7871e3-469a-4a97-a55e-5ff56fadb1d7 service nova] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:34:38 user nova-compute[72586]: DEBUG nova.compute.manager [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Start spawning the instance on the hypervisor. {{(pid=72586) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 21:34:38 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Creating instance directory {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 21:34:38 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Creating image(s)
Aug 01 21:34:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Acquiring lock "/opt/stack/data/nova/instances/11ab466b-8caa-4a38-8350-213aa17ee75e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:34:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "/opt/stack/data/nova/instances/11ab466b-8caa-4a38-8350-213aa17ee75e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:34:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "/opt/stack/data/nova/instances/11ab466b-8caa-4a38-8350-213aa17ee75e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:34:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:38 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Took 1.40 seconds to deallocate network for instance.
Aug 01 21:34:38 user nova-compute[72586]: DEBUG nova.policy [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '50893dc844b44f498e1545aeee794742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99cbab7dfc55429c9b991bf1091a84c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72586) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 21:34:38 user nova-compute[72586]: DEBUG nova.compute.manager [req-7d2b396c-da38-49c2-8fb3-604cd5deb520 req-8a7871e3-469a-4a97-a55e-5ff56fadb1d7 service nova] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Detach interface failed, port_id=440ca7d3-e2b8-4edf-9339-bd8d247d5da2, reason: Instance f6b0d907-2515-4a06-8b35-9ddd09ce42c3 could not be found. {{(pid=72586) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 21:34:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-81bc4fcc-a630-4770-81ac-f6caea042cdf tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:34:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-81bc4fcc-a630-4770-81ac-f6caea042cdf tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:34:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.140s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Acquiring lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:34:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:34:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:39 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:34:39 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:34:39 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Starting heal instance info cache {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 21:34:39 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Rebuilding the list of instances to heal {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 21:34:39 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Skipping network cache update for instance because it is Building. {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 01 21:34:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.199s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/11ab466b-8caa-4a38-8350-213aa17ee75e/disk 1073741824 {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "refresh_cache-042f0031-1e4d-41d0-8bfa-36001675cfe3" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:34:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquired lock "refresh_cache-042f0031-1e4d-41d0-8bfa-36001675cfe3" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:34:39 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Forcefully refreshing network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 21:34:39 user nova-compute[72586]: DEBUG nova.objects.instance [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lazy-loading 'info_cache' on Instance uuid 042f0031-1e4d-41d0-8bfa-36001675cfe3 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:34:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/11ab466b-8caa-4a38-8350-213aa17ee75e/disk 1073741824" returned: 0 in 0.077s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:34:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.141s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:39 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Checking if we can resize image /opt/stack/data/nova/instances/11ab466b-8caa-4a38-8350-213aa17ee75e/disk. size=1073741824 {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 21:34:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ab466b-8caa-4a38-8350-213aa17ee75e/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:34:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:39 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-81bc4fcc-a630-4770-81ac-f6caea042cdf tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:34:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ab466b-8caa-4a38-8350-213aa17ee75e/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:34:39 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Cannot resize image /opt/stack/data/nova/instances/11ab466b-8caa-4a38-8350-213aa17ee75e/disk to a smaller size. {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 21:34:39 user nova-compute[72586]: DEBUG nova.objects.instance [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lazy-loading 'migration_context' on Instance uuid 11ab466b-8caa-4a38-8350-213aa17ee75e {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:34:39 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-81bc4fcc-a630-4770-81ac-f6caea042cdf tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:34:39 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Created local disks {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 21:34:39 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Ensure instance console log exists: /opt/stack/data/nova/instances/11ab466b-8caa-4a38-8350-213aa17ee75e/console.log {{(pid=72586) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 21:34:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:34:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:34:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:34:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-81bc4fcc-a630-4770-81ac-f6caea042cdf tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.667s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:34:39 user nova-compute[72586]: INFO nova.scheduler.client.report [None req-81bc4fcc-a630-4770-81ac-f6caea042cdf tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Deleted allocations for instance f6b0d907-2515-4a06-8b35-9ddd09ce42c3
Aug 01 21:34:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-81bc4fcc-a630-4770-81ac-f6caea042cdf tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "f6b0d907-2515-4a06-8b35-9ddd09ce42c3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.180s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:34:40 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Updating instance_info_cache with network_info: [{"id": "fb56dcd2-b1ea-4992-a896-22f65127a96c", "address": "fa:16:3e:8e:7c:d3", "network": {"id": "d229a8de-7a2b-4dcd-a9ac-44a40349676e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-67691992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b1a1d82f39347119a9fb49fb8e8893f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb56dcd2-b1", "ovs_interfaceid": "fb56dcd2-b1ea-4992-a896-22f65127a96c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:34:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Releasing lock "refresh_cache-042f0031-1e4d-41d0-8bfa-36001675cfe3" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:34:40 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Updated the network info_cache for instance {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 21:34:40 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:34:40 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:34:40 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:34:40 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:41 user nova-compute[72586]: DEBUG nova.network.neutron [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Successfully created port: d70607b2-8e0c-4166-8218-ecbc976d0369 {{(pid=72586) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 21:34:42 user nova-compute[72586]: DEBUG nova.network.neutron [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Successfully updated port: d70607b2-8e0c-4166-8218-ecbc976d0369 {{(pid=72586) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 21:34:42 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Acquiring lock "refresh_cache-11ab466b-8caa-4a38-8350-213aa17ee75e" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:34:42 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Acquired lock "refresh_cache-11ab466b-8caa-4a38-8350-213aa17ee75e" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:34:42 user nova-compute[72586]: DEBUG nova.network.neutron [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:34:42 user nova-compute[72586]: DEBUG nova.compute.manager [req-ecd4281e-0f57-4fa7-8760-d5612a07497f req-071fcd62-5a0f-431c-a984-0e54a8ce2d7f service nova] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Received event network-changed-d70607b2-8e0c-4166-8218-ecbc976d0369 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:34:42 user nova-compute[72586]: DEBUG nova.compute.manager [req-ecd4281e-0f57-4fa7-8760-d5612a07497f req-071fcd62-5a0f-431c-a984-0e54a8ce2d7f service nova] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Refreshing instance network info cache due to event network-changed-d70607b2-8e0c-4166-8218-ecbc976d0369. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:34:42 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ecd4281e-0f57-4fa7-8760-d5612a07497f req-071fcd62-5a0f-431c-a984-0e54a8ce2d7f service nova] Acquiring lock "refresh_cache-11ab466b-8caa-4a38-8350-213aa17ee75e" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:34:42 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:42 user nova-compute[72586]: DEBUG nova.network.neutron [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Instance cache missing network info. {{(pid=72586) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 21:34:42 user nova-compute[72586]: DEBUG nova.network.neutron [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Updating instance_info_cache with network_info: [{"id": "d70607b2-8e0c-4166-8218-ecbc976d0369", "address": "fa:16:3e:76:af:74", "network": {"id": "63b6e8c7-fad0-44bf-a479-9baab6f0d1e3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2101151631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cbab7dfc55429c9b991bf1091a84c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd70607b2-8e", "ovs_interfaceid": "d70607b2-8e0c-4166-8218-ecbc976d0369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:34:42 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Releasing lock "refresh_cache-11ab466b-8caa-4a38-8350-213aa17ee75e" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:34:42 user nova-compute[72586]: DEBUG nova.compute.manager [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Instance network_info: |[{"id": "d70607b2-8e0c-4166-8218-ecbc976d0369", "address": "fa:16:3e:76:af:74", "network": {"id": "63b6e8c7-fad0-44bf-a479-9baab6f0d1e3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2101151631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cbab7dfc55429c9b991bf1091a84c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd70607b2-8e", "ovs_interfaceid": "d70607b2-8e0c-4166-8218-ecbc976d0369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 21:34:42 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ecd4281e-0f57-4fa7-8760-d5612a07497f req-071fcd62-5a0f-431c-a984-0e54a8ce2d7f service nova] Acquired lock "refresh_cache-11ab466b-8caa-4a38-8350-213aa17ee75e" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:34:42 user nova-compute[72586]: DEBUG nova.network.neutron [req-ecd4281e-0f57-4fa7-8760-d5612a07497f req-071fcd62-5a0f-431c-a984-0e54a8ce2d7f service nova] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Refreshing network info cache for port d70607b2-8e0c-4166-8218-ecbc976d0369 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:34:42 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Start _get_guest_xml network_info=[{"id": "d70607b2-8e0c-4166-8218-ecbc976d0369", "address": "fa:16:3e:76:af:74", "network": {"id": "63b6e8c7-fad0-44bf-a479-9baab6f0d1e3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2101151631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cbab7dfc55429c9b991bf1091a84c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd70607b2-8e", "ovs_interfaceid": "d70607b2-8e0c-4166-8218-ecbc976d0369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '0243d46b-6819-42a5-926f-42b71f0c97ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:34:42 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:34:42 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:34:42 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:34:42 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:34:42 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:34:42 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:34:42 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:34:42 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:34:42 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:34:42 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:34:42 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:34:42 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:34:42 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:34:42 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:34:42 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:34:42 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:34:42 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:34:42 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:34:42 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:34:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2094185911',display_name='tempest-AttachVolumeTestJSON-server-2094185911',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2094185911',id=31,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8bY2a+j0kMVaPrfl1MtLxUCVEzM0sy04URPhEHt1a9A1Fyz7ckW9BOF4xfEN78B/F9+N05Diy+kKgMUVPp6Ls9nXPam6BDkRvokPK0ly7jy5lxY/agzzRa/NAHpQoc4w==',key_name='tempest-keypair-809503431',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99cbab7dfc55429c9b991bf1091a84c7',ramdisk_id='',reservation_id='r-mw52zjwf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1420576365',owner_user_name='tempest-AttachVolumeTestJSON-1420576365-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:34:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='50893dc844b44f498e1545aeee794742',uuid=11ab466b-8caa-4a38-8350-213aa17ee75e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d70607b2-8e0c-4166-8218-ecbc976d0369", "address": "fa:16:3e:76:af:74", "network": {"id": "63b6e8c7-fad0-44bf-a479-9baab6f0d1e3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2101151631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cbab7dfc55429c9b991bf1091a84c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd70607b2-8e", "ovs_interfaceid": "d70607b2-8e0c-4166-8218-ecbc976d0369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:34:42 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Converting VIF {"id": "d70607b2-8e0c-4166-8218-ecbc976d0369", "address": "fa:16:3e:76:af:74", "network": {"id": "63b6e8c7-fad0-44bf-a479-9baab6f0d1e3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2101151631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cbab7dfc55429c9b991bf1091a84c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd70607b2-8e", "ovs_interfaceid": "d70607b2-8e0c-4166-8218-ecbc976d0369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:34:42 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:af:74,bridge_name='br-int',has_traffic_filtering=True,id=d70607b2-8e0c-4166-8218-ecbc976d0369,network=Network(63b6e8c7-fad0-44bf-a479-9baab6f0d1e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd70607b2-8e') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:34:42 user nova-compute[72586]: DEBUG nova.objects.instance [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lazy-loading 'pci_devices' on Instance uuid 11ab466b-8caa-4a38-8350-213aa17ee75e {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:34:42 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:34:42 user nova-compute[72586]:   <uuid>11ab466b-8caa-4a38-8350-213aa17ee75e</uuid>
Aug 01 21:34:42 user nova-compute[72586]:   <name>instance-0000001f</name>
Aug 01 21:34:42 user nova-compute[72586]:   <memory>524288</memory>
Aug 01 21:34:42 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:34:42 user nova-compute[72586]:   <metadata>
Aug 01 21:34:42 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:34:42 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:34:42 user nova-compute[72586]:       <nova:name>tempest-AttachVolumeTestJSON-server-2094185911</nova:name>
Aug 01 21:34:42 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:34:42</nova:creationTime>
Aug 01 21:34:42 user nova-compute[72586]:       <nova:flavor name="m1.tiny">
Aug 01 21:34:42 user nova-compute[72586]:         <nova:memory>512</nova:memory>
Aug 01 21:34:42 user nova-compute[72586]:         <nova:disk>1</nova:disk>
Aug 01 21:34:42 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:34:42 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:34:42 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:34:42 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:34:42 user nova-compute[72586]:       <nova:owner>
Aug 01 21:34:42 user nova-compute[72586]:         <nova:user uuid="50893dc844b44f498e1545aeee794742">tempest-AttachVolumeTestJSON-1420576365-project-member</nova:user>
Aug 01 21:34:42 user nova-compute[72586]:         <nova:project uuid="99cbab7dfc55429c9b991bf1091a84c7">tempest-AttachVolumeTestJSON-1420576365</nova:project>
Aug 01 21:34:42 user nova-compute[72586]:       </nova:owner>
Aug 01 21:34:42 user nova-compute[72586]:       <nova:root type="image" uuid="0243d46b-6819-42a5-926f-42b71f0c97ad"/>
Aug 01 21:34:42 user nova-compute[72586]:       <nova:ports>
Aug 01 21:34:42 user nova-compute[72586]:         <nova:port uuid="d70607b2-8e0c-4166-8218-ecbc976d0369">
Aug 01 21:34:42 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 01 21:34:42 user nova-compute[72586]:         </nova:port>
Aug 01 21:34:42 user nova-compute[72586]:       </nova:ports>
Aug 01 21:34:42 user nova-compute[72586]:     </nova:instance>
Aug 01 21:34:42 user nova-compute[72586]:   </metadata>
Aug 01 21:34:42 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:34:42 user nova-compute[72586]:     <system>
Aug 01 21:34:42 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:34:42 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:34:42 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:34:42 user nova-compute[72586]:       <entry name="serial">11ab466b-8caa-4a38-8350-213aa17ee75e</entry>
Aug 01 21:34:42 user nova-compute[72586]:       <entry name="uuid">11ab466b-8caa-4a38-8350-213aa17ee75e</entry>
Aug 01 21:34:42 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:34:42 user nova-compute[72586]:     </system>
Aug 01 21:34:42 user nova-compute[72586]:   </sysinfo>
Aug 01 21:34:42 user nova-compute[72586]:   <os>
Aug 01 21:34:42 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:34:42 user nova-compute[72586]:     <boot dev="hd"/>
Aug 01 21:34:42 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:34:42 user nova-compute[72586]:   </os>
Aug 01 21:34:42 user nova-compute[72586]:   <features>
Aug 01 21:34:42 user nova-compute[72586]:     <acpi/>
Aug 01 21:34:42 user nova-compute[72586]:     <apic/>
Aug 01 21:34:42 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:34:42 user nova-compute[72586]:   </features>
Aug 01 21:34:42 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:34:42 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:34:42 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:34:42 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:34:42 user nova-compute[72586]:   </clock>
Aug 01 21:34:42 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:34:42 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:34:42 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:34:42 user nova-compute[72586]:   </cpu>
Aug 01 21:34:42 user nova-compute[72586]:   <devices>
Aug 01 21:34:42 user nova-compute[72586]:     <disk type="file" device="disk">
Aug 01 21:34:42 user nova-compute[72586]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 21:34:42 user nova-compute[72586]:       <source file="/opt/stack/data/nova/instances/11ab466b-8caa-4a38-8350-213aa17ee75e/disk"/>
Aug 01 21:34:42 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:34:42 user nova-compute[72586]:     </disk>
Aug 01 21:34:42 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:34:42 user nova-compute[72586]:       <mac address="fa:16:3e:76:af:74"/>
Aug 01 21:34:42 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:34:42 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:34:42 user nova-compute[72586]:       <target dev="tapd70607b2-8e"/>
Aug 01 21:34:42 user nova-compute[72586]:     </interface>
Aug 01 21:34:42 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:34:42 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/11ab466b-8caa-4a38-8350-213aa17ee75e/console.log" append="off"/>
Aug 01 21:34:42 user nova-compute[72586]:     </serial>
Aug 01 21:34:42 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:34:42 user nova-compute[72586]:     <video>
Aug 01 21:34:42 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:34:42 user nova-compute[72586]:     </video>
Aug 01 21:34:42 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:34:42 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:34:42 user nova-compute[72586]:     </rng>
Aug 01 21:34:42 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:34:42 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:34:42 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:34:42 user nova-compute[72586]:     </memballoon>
Aug 01 21:34:42 user nova-compute[72586]:   </devices>
Aug 01 21:34:42 user nova-compute[72586]: </domain>
Aug 01 21:34:42 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:34:42 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:34:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2094185911',display_name='tempest-AttachVolumeTestJSON-server-2094185911',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2094185911',id=31,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8bY2a+j0kMVaPrfl1MtLxUCVEzM0sy04URPhEHt1a9A1Fyz7ckW9BOF4xfEN78B/F9+N05Diy+kKgMUVPp6Ls9nXPam6BDkRvokPK0ly7jy5lxY/agzzRa/NAHpQoc4w==',key_name='tempest-keypair-809503431',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99cbab7dfc55429c9b991bf1091a84c7',ramdisk_id='',reservation_id='r-mw52zjwf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1420576365',owner_user_name='tempest-AttachVolumeTestJSON-1420576365-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:34:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='50893dc844b44f498e1545aeee794742',uuid=11ab466b-8caa-4a38-8350-213aa17ee75e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d70607b2-8e0c-4166-8218-ecbc976d0369", "address": "fa:16:3e:76:af:74", "network": {"id": "63b6e8c7-fad0-44bf-a479-9baab6f0d1e3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2101151631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cbab7dfc55429c9b991bf1091a84c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd70607b2-8e", "ovs_interfaceid": "d70607b2-8e0c-4166-8218-ecbc976d0369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:34:42 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Converting VIF {"id": "d70607b2-8e0c-4166-8218-ecbc976d0369", "address": "fa:16:3e:76:af:74", "network": {"id": "63b6e8c7-fad0-44bf-a479-9baab6f0d1e3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2101151631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cbab7dfc55429c9b991bf1091a84c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd70607b2-8e", "ovs_interfaceid": "d70607b2-8e0c-4166-8218-ecbc976d0369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:34:42 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:af:74,bridge_name='br-int',has_traffic_filtering=True,id=d70607b2-8e0c-4166-8218-ecbc976d0369,network=Network(63b6e8c7-fad0-44bf-a479-9baab6f0d1e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd70607b2-8e') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:34:42 user nova-compute[72586]: DEBUG os_vif [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:af:74,bridge_name='br-int',has_traffic_filtering=True,id=d70607b2-8e0c-4166-8218-ecbc976d0369,network=Network(63b6e8c7-fad0-44bf-a479-9baab6f0d1e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd70607b2-8e') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:34:42 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:42 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:34:42 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:34:42 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:42 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd70607b2-8e, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:34:42 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd70607b2-8e, col_values=(('external_ids', {'iface-id': 'd70607b2-8e0c-4166-8218-ecbc976d0369', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:af:74', 'vm-uuid': '11ab466b-8caa-4a38-8350-213aa17ee75e'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:34:42 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:42 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:34:42 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:42 user nova-compute[72586]: INFO os_vif [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:af:74,bridge_name='br-int',has_traffic_filtering=True,id=d70607b2-8e0c-4166-8218-ecbc976d0369,network=Network(63b6e8c7-fad0-44bf-a479-9baab6f0d1e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd70607b2-8e')
Aug 01 21:34:42 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:34:42 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] No VIF found with MAC fa:16:3e:76:af:74, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:34:43 user nova-compute[72586]: DEBUG nova.network.neutron [req-ecd4281e-0f57-4fa7-8760-d5612a07497f req-071fcd62-5a0f-431c-a984-0e54a8ce2d7f service nova] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Updated VIF entry in instance network info cache for port d70607b2-8e0c-4166-8218-ecbc976d0369. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:34:43 user nova-compute[72586]: DEBUG nova.network.neutron [req-ecd4281e-0f57-4fa7-8760-d5612a07497f req-071fcd62-5a0f-431c-a984-0e54a8ce2d7f service nova] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Updating instance_info_cache with network_info: [{"id": "d70607b2-8e0c-4166-8218-ecbc976d0369", "address": "fa:16:3e:76:af:74", "network": {"id": "63b6e8c7-fad0-44bf-a479-9baab6f0d1e3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2101151631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cbab7dfc55429c9b991bf1091a84c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd70607b2-8e", "ovs_interfaceid": "d70607b2-8e0c-4166-8218-ecbc976d0369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:34:43 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ecd4281e-0f57-4fa7-8760-d5612a07497f req-071fcd62-5a0f-431c-a984-0e54a8ce2d7f service nova] Releasing lock "refresh_cache-11ab466b-8caa-4a38-8350-213aa17ee75e" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:34:44 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:44 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:44 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:44 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:45 user nova-compute[72586]: DEBUG nova.compute.manager [req-cda927d6-91b9-44eb-8a9a-c36207f54f55 req-115774b1-555f-4e94-97fb-f0c4009a2000 service nova] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Received event network-vif-plugged-d70607b2-8e0c-4166-8218-ecbc976d0369 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:34:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-cda927d6-91b9-44eb-8a9a-c36207f54f55 req-115774b1-555f-4e94-97fb-f0c4009a2000 service nova] Acquiring lock "11ab466b-8caa-4a38-8350-213aa17ee75e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:34:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-cda927d6-91b9-44eb-8a9a-c36207f54f55 req-115774b1-555f-4e94-97fb-f0c4009a2000 service nova] Lock "11ab466b-8caa-4a38-8350-213aa17ee75e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:34:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-cda927d6-91b9-44eb-8a9a-c36207f54f55 req-115774b1-555f-4e94-97fb-f0c4009a2000 service nova] Lock "11ab466b-8caa-4a38-8350-213aa17ee75e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:34:45 user nova-compute[72586]: DEBUG nova.compute.manager [req-cda927d6-91b9-44eb-8a9a-c36207f54f55 req-115774b1-555f-4e94-97fb-f0c4009a2000 service nova] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] No waiting events found dispatching network-vif-plugged-d70607b2-8e0c-4166-8218-ecbc976d0369 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:34:45 user nova-compute[72586]: WARNING nova.compute.manager [req-cda927d6-91b9-44eb-8a9a-c36207f54f55 req-115774b1-555f-4e94-97fb-f0c4009a2000 service nova] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Received unexpected event network-vif-plugged-d70607b2-8e0c-4166-8218-ecbc976d0369 for instance with vm_state building and task_state spawning.
Aug 01 21:34:45 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:45 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:45 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:46 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:46 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925686.6613328, 11ab466b-8caa-4a38-8350-213aa17ee75e => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:34:46 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] VM Resumed (Lifecycle Event)
Aug 01 21:34:46 user nova-compute[72586]: DEBUG nova.compute.manager [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Instance event wait completed in 0 seconds for  {{(pid=72586) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 21:34:46 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Guest created on hypervisor {{(pid=72586) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 21:34:46 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Instance spawned successfully.
Aug 01 21:34:46 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 21:34:46 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:34:46 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:34:46 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Found default for hw_cdrom_bus of ide {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:34:46 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Found default for hw_disk_bus of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:34:46 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Found default for hw_input_bus of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:34:46 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Found default for hw_pointer_model of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:34:46 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Found default for hw_video_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:34:46 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Found default for hw_vif_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:34:46 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:34:46 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925686.663622, 11ab466b-8caa-4a38-8350-213aa17ee75e => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:34:46 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] VM Started (Lifecycle Event)
Aug 01 21:34:46 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:34:46 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:34:46 user nova-compute[72586]: INFO nova.compute.manager [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Took 7.90 seconds to spawn the instance on the hypervisor.
Aug 01 21:34:46 user nova-compute[72586]: DEBUG nova.compute.manager [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:34:46 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:34:46 user nova-compute[72586]: INFO nova.compute.manager [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Took 9.48 seconds to build instance.
Aug 01 21:34:46 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-919cedb7-e664-4744-a3f4-60fe8c450524 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "11ab466b-8caa-4a38-8350-213aa17ee75e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.780s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:34:47 user nova-compute[72586]: DEBUG nova.compute.manager [req-643784eb-f5ef-436a-8baa-1f48c918a965 req-f4f22e1a-190d-4fd1-8acf-5877e419a6a8 service nova] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Received event network-vif-plugged-d70607b2-8e0c-4166-8218-ecbc976d0369 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:34:47 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-643784eb-f5ef-436a-8baa-1f48c918a965 req-f4f22e1a-190d-4fd1-8acf-5877e419a6a8 service nova] Acquiring lock "11ab466b-8caa-4a38-8350-213aa17ee75e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:34:47 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-643784eb-f5ef-436a-8baa-1f48c918a965 req-f4f22e1a-190d-4fd1-8acf-5877e419a6a8 service nova] Lock "11ab466b-8caa-4a38-8350-213aa17ee75e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:34:47 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-643784eb-f5ef-436a-8baa-1f48c918a965 req-f4f22e1a-190d-4fd1-8acf-5877e419a6a8 service nova] Lock "11ab466b-8caa-4a38-8350-213aa17ee75e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:34:47 user nova-compute[72586]: DEBUG nova.compute.manager [req-643784eb-f5ef-436a-8baa-1f48c918a965 req-f4f22e1a-190d-4fd1-8acf-5877e419a6a8 service nova] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] No waiting events found dispatching network-vif-plugged-d70607b2-8e0c-4166-8218-ecbc976d0369 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:34:47 user nova-compute[72586]: WARNING nova.compute.manager [req-643784eb-f5ef-436a-8baa-1f48c918a965 req-f4f22e1a-190d-4fd1-8acf-5877e419a6a8 service nova] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Received unexpected event network-vif-plugged-d70607b2-8e0c-4166-8218-ecbc976d0369 for instance with vm_state active and task_state None.
Aug 01 21:34:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:49 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:49 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:52 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:52 user nova-compute[72586]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690925675.497225, f6b0d907-2515-4a06-8b35-9ddd09ce42c3 => Stopped> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:34:52 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] VM Stopped (Lifecycle Event)
Aug 01 21:34:52 user nova-compute[72586]: DEBUG nova.compute.manager [None req-de2fff56-c9fa-4919-8710-6429470b0d4b None None] [instance: f6b0d907-2515-4a06-8b35-9ddd09ce42c3] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:34:52 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:54 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:56 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:56 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:57 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:59 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:34:59 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:35:02 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:35:02 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:35:04 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:35:05 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:35:07 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:35:09 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:35:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:35:14 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:35:17 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:35:22 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:35:25 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:35:25 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:35:27 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:35:28 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:35:28 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Cleaning up deleted instances with incomplete migration  {{(pid=72586) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 21:35:29 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:35:30 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:35:30 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:35:30 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72586) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 21:35:31 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:35:31 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:35:31 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:35:31 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:35:31 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:35:31 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Auditing locally available compute resources for user (node: user) {{(pid=72586) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 21:35:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:35:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:35:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:35:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:35:32 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:35:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ab466b-8caa-4a38-8350-213aa17ee75e/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:35:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ab466b-8caa-4a38-8350-213aa17ee75e/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:35:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ab466b-8caa-4a38-8350-213aa17ee75e/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:35:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ab466b-8caa-4a38-8350-213aa17ee75e/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:35:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:35:32 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:35:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:35:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:35:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:35:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:35:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:35:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:35:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:35:33 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:35:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:35:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:35:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:35:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:35:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.rescue --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:35:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:35:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.rescue --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:35:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:35:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:35:34 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:35:34 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:35:34 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:35:34 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ced1426-a20e-4d5f-8250-e789eba6f098/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:35:34 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ced1426-a20e-4d5f-8250-e789eba6f098/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:35:34 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ced1426-a20e-4d5f-8250-e789eba6f098/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:35:34 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ced1426-a20e-4d5f-8250-e789eba6f098/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:35:34 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:35:34 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:35:34 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:35:34 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Hypervisor/Node resource view: name=user free_ram=7595MB free_disk=25.18853759765625GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72586) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 21:35:34 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:35:34 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:35:35 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Applying migration context for instance 314f9b05-527c-459d-aca7-acc696ac613f as it has an incoming, in-progress migration a601a123-f478-4115-afd7-0b4b73b52210. Migration status is finished {{(pid=72586) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 01 21:35:35 user nova-compute[72586]: INFO nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Updating resource usage from migration a601a123-f478-4115-afd7-0b4b73b52210
Aug 01 21:35:35 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 042f0031-1e4d-41d0-8bfa-36001675cfe3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:35:35 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 413c3426-18ad-4a5c-af04-e0e7fc90f050 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:35:35 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 49c24c77-f102-4aed-8314-b04aad5f6b3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:35:35 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance af2de810-b22f-4fa9-835c-c673abd145db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:35:35 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 161fab9d-a7d1-4ea0-b4b9-2afc54040eef actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:35:35 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:35:35 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 3ced1426-a20e-4d5f-8250-e789eba6f098 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:35:35 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Migration a601a123-f478-4115-afd7-0b4b73b52210 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 01 21:35:35 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 314f9b05-527c-459d-aca7-acc696ac613f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:35:35 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 11ab466b-8caa-4a38-8350-213aa17ee75e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:35:35 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 21:35:35 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 21:35:35 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Refreshing inventories for resource provider ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 21:35:35 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Updating ProviderTree inventory for provider ca6775c1-2a64-43f9-9467-372aa0457b1d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 21:35:35 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Updating inventory in ProviderTree for provider ca6775c1-2a64-43f9-9467-372aa0457b1d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 21:35:35 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Refreshing aggregate associations for resource provider ca6775c1-2a64-43f9-9467-372aa0457b1d, aggregates: None {{(pid=72586) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 21:35:35 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Refreshing trait associations for resource provider ca6775c1-2a64-43f9-9467-372aa0457b1d, traits: COMPUTE_NODE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_TRUSTED_CERTS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AMI {{(pid=72586) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 21:35:35 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:35:35 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:35:35 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Compute_service record updated for user:user {{(pid=72586) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 21:35:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.710s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:35:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-547fd551-4da1-4fec-a13c-32719e8beb70 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Acquiring lock "413c3426-18ad-4a5c-af04-e0e7fc90f050" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:35:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-547fd551-4da1-4fec-a13c-32719e8beb70 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "413c3426-18ad-4a5c-af04-e0e7fc90f050" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:35:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-547fd551-4da1-4fec-a13c-32719e8beb70 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Acquiring lock "413c3426-18ad-4a5c-af04-e0e7fc90f050-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:35:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-547fd551-4da1-4fec-a13c-32719e8beb70 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "413c3426-18ad-4a5c-af04-e0e7fc90f050-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:35:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-547fd551-4da1-4fec-a13c-32719e8beb70 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "413c3426-18ad-4a5c-af04-e0e7fc90f050-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:35:35 user nova-compute[72586]: INFO nova.compute.manager [None req-547fd551-4da1-4fec-a13c-32719e8beb70 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Terminating instance
Aug 01 21:35:35 user nova-compute[72586]: DEBUG nova.compute.manager [None req-547fd551-4da1-4fec-a13c-32719e8beb70 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Start destroying the instance on the hypervisor. {{(pid=72586) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 21:35:35 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:35:35 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:35:36 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:35:36 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:35:36 user nova-compute[72586]: DEBUG nova.compute.manager [req-cab68f7c-64a9-4b8d-a95f-0d22015ec952 req-86ec1f94-9903-4723-b197-9e9ee11bb396 service nova] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Received event network-vif-unplugged-38381409-a508-45f7-ad5c-53e84d2d5adb {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:35:36 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-cab68f7c-64a9-4b8d-a95f-0d22015ec952 req-86ec1f94-9903-4723-b197-9e9ee11bb396 service nova] Acquiring lock "413c3426-18ad-4a5c-af04-e0e7fc90f050-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:35:36 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-cab68f7c-64a9-4b8d-a95f-0d22015ec952 req-86ec1f94-9903-4723-b197-9e9ee11bb396 service nova] Lock "413c3426-18ad-4a5c-af04-e0e7fc90f050-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:35:36 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-cab68f7c-64a9-4b8d-a95f-0d22015ec952 req-86ec1f94-9903-4723-b197-9e9ee11bb396 service nova] Lock "413c3426-18ad-4a5c-af04-e0e7fc90f050-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:35:36 user nova-compute[72586]: DEBUG nova.compute.manager [req-cab68f7c-64a9-4b8d-a95f-0d22015ec952 req-86ec1f94-9903-4723-b197-9e9ee11bb396 service nova] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] No waiting events found dispatching network-vif-unplugged-38381409-a508-45f7-ad5c-53e84d2d5adb {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:35:36 user nova-compute[72586]: DEBUG nova.compute.manager [req-cab68f7c-64a9-4b8d-a95f-0d22015ec952 req-86ec1f94-9903-4723-b197-9e9ee11bb396 service nova] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Received event network-vif-unplugged-38381409-a508-45f7-ad5c-53e84d2d5adb for instance with task_state deleting. {{(pid=72586) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 21:35:36 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Instance destroyed successfully.
Aug 01 21:35:36 user nova-compute[72586]: DEBUG nova.objects.instance [None req-547fd551-4da1-4fec-a13c-32719e8beb70 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lazy-loading 'resources' on Instance uuid 413c3426-18ad-4a5c-af04-e0e7fc90f050 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:35:36 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-547fd551-4da1-4fec-a13c-32719e8beb70 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:19:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-472860044',display_name='tempest-ServerRescueNegativeTestJSON-server-472860044',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-472860044',id=3,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:21:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5b1a1d82f39347119a9fb49fb8e8893f',ramdisk_id='',reservation_id='r-vbt2qqk4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1258600061',owner_user_name='tempest-ServerRescueNegativeTestJSON-1258600061-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:21:22Z,user_data=None,user_id='0f678ac8999a42c4a383ee8b2976b4cc',uuid=413c3426-18ad-4a5c-af04-e0e7fc90f050,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "38381409-a508-45f7-ad5c-53e84d2d5adb", "address": "fa:16:3e:73:a7:41", "network": {"id": "d229a8de-7a2b-4dcd-a9ac-44a40349676e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-67691992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b1a1d82f39347119a9fb49fb8e8893f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38381409-a5", "ovs_interfaceid": "38381409-a508-45f7-ad5c-53e84d2d5adb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:35:36 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-547fd551-4da1-4fec-a13c-32719e8beb70 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Converting VIF {"id": "38381409-a508-45f7-ad5c-53e84d2d5adb", "address": "fa:16:3e:73:a7:41", "network": {"id": "d229a8de-7a2b-4dcd-a9ac-44a40349676e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-67691992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b1a1d82f39347119a9fb49fb8e8893f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38381409-a5", "ovs_interfaceid": "38381409-a508-45f7-ad5c-53e84d2d5adb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:35:36 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-547fd551-4da1-4fec-a13c-32719e8beb70 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:a7:41,bridge_name='br-int',has_traffic_filtering=True,id=38381409-a508-45f7-ad5c-53e84d2d5adb,network=Network(d229a8de-7a2b-4dcd-a9ac-44a40349676e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38381409-a5') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:35:36 user nova-compute[72586]: DEBUG os_vif [None req-547fd551-4da1-4fec-a13c-32719e8beb70 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:a7:41,bridge_name='br-int',has_traffic_filtering=True,id=38381409-a508-45f7-ad5c-53e84d2d5adb,network=Network(d229a8de-7a2b-4dcd-a9ac-44a40349676e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38381409-a5') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:35:36 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:35:36 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap38381409-a5, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:35:36 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:35:36 user nova-compute[72586]: INFO os_vif [None req-547fd551-4da1-4fec-a13c-32719e8beb70 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:a7:41,bridge_name='br-int',has_traffic_filtering=True,id=38381409-a508-45f7-ad5c-53e84d2d5adb,network=Network(d229a8de-7a2b-4dcd-a9ac-44a40349676e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38381409-a5')
Aug 01 21:35:36 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-547fd551-4da1-4fec-a13c-32719e8beb70 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Deleting instance files /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050_del
Aug 01 21:35:36 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-547fd551-4da1-4fec-a13c-32719e8beb70 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Deletion of /opt/stack/data/nova/instances/413c3426-18ad-4a5c-af04-e0e7fc90f050_del complete
Aug 01 21:35:36 user nova-compute[72586]: INFO nova.compute.manager [None req-547fd551-4da1-4fec-a13c-32719e8beb70 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 01 21:35:36 user nova-compute[72586]: DEBUG oslo.service.loopingcall [None req-547fd551-4da1-4fec-a13c-32719e8beb70 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72586) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 21:35:36 user nova-compute[72586]: DEBUG nova.compute.manager [-] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Deallocating network for instance {{(pid=72586) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 21:35:36 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] deallocate_for_instance() {{(pid=72586) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 21:35:37 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:35:37 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Took 0.55 seconds to deallocate network for instance.
Aug 01 21:35:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-547fd551-4da1-4fec-a13c-32719e8beb70 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:35:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-547fd551-4da1-4fec-a13c-32719e8beb70 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:35:37 user nova-compute[72586]: DEBUG nova.compute.manager [req-72182b79-d18a-4350-8e30-2396ae402f56 req-2126a14b-3f7f-4aaa-a691-30b88144c4fa service nova] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Received event network-vif-deleted-38381409-a508-45f7-ad5c-53e84d2d5adb {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:35:37 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-547fd551-4da1-4fec-a13c-32719e8beb70 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:35:37 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-547fd551-4da1-4fec-a13c-32719e8beb70 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:35:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-547fd551-4da1-4fec-a13c-32719e8beb70 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.309s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:35:37 user nova-compute[72586]: INFO nova.scheduler.client.report [None req-547fd551-4da1-4fec-a13c-32719e8beb70 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Deleted allocations for instance 413c3426-18ad-4a5c-af04-e0e7fc90f050
Aug 01 21:35:37 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:35:37 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Starting heal instance info cache {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 21:35:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-547fd551-4da1-4fec-a13c-32719e8beb70 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "413c3426-18ad-4a5c-af04-e0e7fc90f050" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.953s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:35:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "refresh_cache-413c3426-18ad-4a5c-af04-e0e7fc90f050" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:35:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquired lock "refresh_cache-413c3426-18ad-4a5c-af04-e0e7fc90f050" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:35:37 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Forcefully refreshing network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 21:35:37 user nova-compute[72586]: DEBUG nova.compute.utils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Can not refresh info_cache because instance was not found {{(pid=72586) refresh_info_cache_for_instance /opt/stack/nova/nova/compute/utils.py:1010}}
Aug 01 21:35:37 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Instance cache missing network info. {{(pid=72586) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 21:35:38 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:35:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Releasing lock "refresh_cache-413c3426-18ad-4a5c-af04-e0e7fc90f050" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:35:38 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Updated the network info_cache for instance {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 21:35:38 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:35:38 user nova-compute[72586]: DEBUG nova.compute.manager [req-0cb3bb7a-2899-4733-8e5c-14876b1972a7 req-cd2405a0-33ec-4412-9950-3560d91f4768 service nova] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Received event network-vif-plugged-38381409-a508-45f7-ad5c-53e84d2d5adb {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:35:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-0cb3bb7a-2899-4733-8e5c-14876b1972a7 req-cd2405a0-33ec-4412-9950-3560d91f4768 service nova] Acquiring lock "413c3426-18ad-4a5c-af04-e0e7fc90f050-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:35:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-0cb3bb7a-2899-4733-8e5c-14876b1972a7 req-cd2405a0-33ec-4412-9950-3560d91f4768 service nova] Lock "413c3426-18ad-4a5c-af04-e0e7fc90f050-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:35:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-0cb3bb7a-2899-4733-8e5c-14876b1972a7 req-cd2405a0-33ec-4412-9950-3560d91f4768 service nova] Lock "413c3426-18ad-4a5c-af04-e0e7fc90f050-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:35:38 user nova-compute[72586]: DEBUG nova.compute.manager [req-0cb3bb7a-2899-4733-8e5c-14876b1972a7 req-cd2405a0-33ec-4412-9950-3560d91f4768 service nova] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] No waiting events found dispatching network-vif-plugged-38381409-a508-45f7-ad5c-53e84d2d5adb {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:35:38 user nova-compute[72586]: WARNING nova.compute.manager [req-0cb3bb7a-2899-4733-8e5c-14876b1972a7 req-cd2405a0-33ec-4412-9950-3560d91f4768 service nova] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Received unexpected event network-vif-plugged-38381409-a508-45f7-ad5c-53e84d2d5adb for instance with vm_state deleted and task_state None.
Aug 01 21:35:38 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:35:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Acquiring lock "63625685-227f-48cc-9cc0-594633e0b8bb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:35:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "63625685-227f-48cc-9cc0-594633e0b8bb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:35:41 user nova-compute[72586]: DEBUG nova.compute.manager [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Starting instance... {{(pid=72586) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 21:35:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:35:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:35:41 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72586) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 21:35:41 user nova-compute[72586]: INFO nova.compute.claims [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Claim successful on node user
Aug 01 21:35:41 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:35:41 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:35:41 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:35:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.428s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:35:41 user nova-compute[72586]: DEBUG nova.compute.manager [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Start building networks asynchronously for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 21:35:41 user nova-compute[72586]: DEBUG nova.compute.manager [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Allocating IP information in the background. {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 21:35:41 user nova-compute[72586]: DEBUG nova.network.neutron [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] allocate_for_instance() {{(pid=72586) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 21:35:42 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 21:35:42 user nova-compute[72586]: DEBUG nova.compute.manager [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Start building block device mappings for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 21:35:42 user nova-compute[72586]: DEBUG nova.policy [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a984642731b9413c97038f65052ab92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d847d04360420c80ea5608d5a2b15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72586) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 21:35:42 user nova-compute[72586]: DEBUG nova.compute.manager [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Start spawning the instance on the hypervisor. {{(pid=72586) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 21:35:42 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Creating instance directory {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 21:35:42 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Creating image(s)
Aug 01 21:35:42 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Acquiring lock "/opt/stack/data/nova/instances/63625685-227f-48cc-9cc0-594633e0b8bb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:35:42 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "/opt/stack/data/nova/instances/63625685-227f-48cc-9cc0-594633e0b8bb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:35:42 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "/opt/stack/data/nova/instances/63625685-227f-48cc-9cc0-594633e0b8bb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:35:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:35:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.137s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:35:42 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Acquiring lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:35:42 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:35:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:35:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.136s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:35:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/63625685-227f-48cc-9cc0-594633e0b8bb/disk 1073741824 {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:35:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/63625685-227f-48cc-9cc0-594633e0b8bb/disk 1073741824" returned: 0 in 0.048s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:35:42 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:35:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:35:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.147s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:35:42 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Checking if we can resize image /opt/stack/data/nova/instances/63625685-227f-48cc-9cc0-594633e0b8bb/disk. size=1073741824 {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 21:35:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63625685-227f-48cc-9cc0-594633e0b8bb/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:35:42 user nova-compute[72586]: DEBUG nova.network.neutron [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Successfully created port: 0508879f-0d7d-40ab-adcb-d51a6743fdf2 {{(pid=72586) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 21:35:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63625685-227f-48cc-9cc0-594633e0b8bb/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:35:42 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Cannot resize image /opt/stack/data/nova/instances/63625685-227f-48cc-9cc0-594633e0b8bb/disk to a smaller size. {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 21:35:42 user nova-compute[72586]: DEBUG nova.objects.instance [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lazy-loading 'migration_context' on Instance uuid 63625685-227f-48cc-9cc0-594633e0b8bb {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:35:42 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Created local disks {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 21:35:42 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Ensure instance console log exists: /opt/stack/data/nova/instances/63625685-227f-48cc-9cc0-594633e0b8bb/console.log {{(pid=72586) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 21:35:42 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:35:42 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:35:42 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:35:42 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:35:43 user nova-compute[72586]: DEBUG nova.network.neutron [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Successfully updated port: 0508879f-0d7d-40ab-adcb-d51a6743fdf2 {{(pid=72586) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 21:35:43 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Acquiring lock "refresh_cache-63625685-227f-48cc-9cc0-594633e0b8bb" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:35:43 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Acquired lock "refresh_cache-63625685-227f-48cc-9cc0-594633e0b8bb" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:35:43 user nova-compute[72586]: DEBUG nova.network.neutron [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:35:43 user nova-compute[72586]: DEBUG nova.compute.manager [req-da898dd6-8c57-4151-b0c0-31fe5f0fd9e3 req-d98830d1-2dc7-4ab6-ae11-bbca5f1988ca service nova] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Received event network-changed-0508879f-0d7d-40ab-adcb-d51a6743fdf2 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:35:43 user nova-compute[72586]: DEBUG nova.compute.manager [req-da898dd6-8c57-4151-b0c0-31fe5f0fd9e3 req-d98830d1-2dc7-4ab6-ae11-bbca5f1988ca service nova] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Refreshing instance network info cache due to event network-changed-0508879f-0d7d-40ab-adcb-d51a6743fdf2. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:35:43 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-da898dd6-8c57-4151-b0c0-31fe5f0fd9e3 req-d98830d1-2dc7-4ab6-ae11-bbca5f1988ca service nova] Acquiring lock "refresh_cache-63625685-227f-48cc-9cc0-594633e0b8bb" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:35:43 user nova-compute[72586]: DEBUG nova.network.neutron [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Instance cache missing network info. {{(pid=72586) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 21:35:43 user nova-compute[72586]: DEBUG nova.network.neutron [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Updating instance_info_cache with network_info: [{"id": "0508879f-0d7d-40ab-adcb-d51a6743fdf2", "address": "fa:16:3e:ac:c9:31", "network": {"id": "86940e5d-852b-48fc-9b0e-858305321349", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1967467603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d847d04360420c80ea5608d5a2b15a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0508879f-0d", "ovs_interfaceid": "0508879f-0d7d-40ab-adcb-d51a6743fdf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:35:43 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Releasing lock "refresh_cache-63625685-227f-48cc-9cc0-594633e0b8bb" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:35:43 user nova-compute[72586]: DEBUG nova.compute.manager [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Instance network_info: |[{"id": "0508879f-0d7d-40ab-adcb-d51a6743fdf2", "address": "fa:16:3e:ac:c9:31", "network": {"id": "86940e5d-852b-48fc-9b0e-858305321349", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1967467603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d847d04360420c80ea5608d5a2b15a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0508879f-0d", "ovs_interfaceid": "0508879f-0d7d-40ab-adcb-d51a6743fdf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 21:35:43 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-da898dd6-8c57-4151-b0c0-31fe5f0fd9e3 req-d98830d1-2dc7-4ab6-ae11-bbca5f1988ca service nova] Acquired lock "refresh_cache-63625685-227f-48cc-9cc0-594633e0b8bb" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:35:43 user nova-compute[72586]: DEBUG nova.network.neutron [req-da898dd6-8c57-4151-b0c0-31fe5f0fd9e3 req-d98830d1-2dc7-4ab6-ae11-bbca5f1988ca service nova] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Refreshing network info cache for port 0508879f-0d7d-40ab-adcb-d51a6743fdf2 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:35:43 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Start _get_guest_xml network_info=[{"id": "0508879f-0d7d-40ab-adcb-d51a6743fdf2", "address": "fa:16:3e:ac:c9:31", "network": {"id": "86940e5d-852b-48fc-9b0e-858305321349", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1967467603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d847d04360420c80ea5608d5a2b15a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0508879f-0d", "ovs_interfaceid": "0508879f-0d7d-40ab-adcb-d51a6743fdf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '0243d46b-6819-42a5-926f-42b71f0c97ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:35:43 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:35:43 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:35:43 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:35:43 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:35:43 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:35:43 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:35:43 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:35:43 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:35:43 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:35:43 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:35:43 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:35:43 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:35:43 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:35:43 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:35:43 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:35:43 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:35:43 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:35:43 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:35:43 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:35:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-425585844',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-425585844',id=32,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88d847d04360420c80ea5608d5a2b15a',ramdisk_id='',reservation_id='r-66i0h2g3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1268085586',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:35:42Z,user_data=None,user_id='a984642731b9413c97038f65052ab92d',uuid=63625685-227f-48cc-9cc0-594633e0b8bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0508879f-0d7d-40ab-adcb-d51a6743fdf2", "address": "fa:16:3e:ac:c9:31", "network": {"id": "86940e5d-852b-48fc-9b0e-858305321349", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1967467603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d847d04360420c80ea5608d5a2b15a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0508879f-0d", "ovs_interfaceid": "0508879f-0d7d-40ab-adcb-d51a6743fdf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:35:43 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Converting VIF {"id": "0508879f-0d7d-40ab-adcb-d51a6743fdf2", "address": "fa:16:3e:ac:c9:31", "network": {"id": "86940e5d-852b-48fc-9b0e-858305321349", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1967467603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d847d04360420c80ea5608d5a2b15a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0508879f-0d", "ovs_interfaceid": "0508879f-0d7d-40ab-adcb-d51a6743fdf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:35:43 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:c9:31,bridge_name='br-int',has_traffic_filtering=True,id=0508879f-0d7d-40ab-adcb-d51a6743fdf2,network=Network(86940e5d-852b-48fc-9b0e-858305321349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0508879f-0d') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:35:43 user nova-compute[72586]: DEBUG nova.objects.instance [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lazy-loading 'pci_devices' on Instance uuid 63625685-227f-48cc-9cc0-594633e0b8bb {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:35:43 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:35:43 user nova-compute[72586]:   <uuid>63625685-227f-48cc-9cc0-594633e0b8bb</uuid>
Aug 01 21:35:43 user nova-compute[72586]:   <name>instance-00000020</name>
Aug 01 21:35:43 user nova-compute[72586]:   <memory>524288</memory>
Aug 01 21:35:43 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:35:43 user nova-compute[72586]:   <metadata>
Aug 01 21:35:43 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:35:43 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:35:43 user nova-compute[72586]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-425585844</nova:name>
Aug 01 21:35:43 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:35:43</nova:creationTime>
Aug 01 21:35:43 user nova-compute[72586]:       <nova:flavor name="m1.tiny">
Aug 01 21:35:43 user nova-compute[72586]:         <nova:memory>512</nova:memory>
Aug 01 21:35:43 user nova-compute[72586]:         <nova:disk>1</nova:disk>
Aug 01 21:35:43 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:35:43 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:35:43 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:35:43 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:35:43 user nova-compute[72586]:       <nova:owner>
Aug 01 21:35:43 user nova-compute[72586]:         <nova:user uuid="a984642731b9413c97038f65052ab92d">tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member</nova:user>
Aug 01 21:35:43 user nova-compute[72586]:         <nova:project uuid="88d847d04360420c80ea5608d5a2b15a">tempest-ServerBootFromVolumeStableRescueTest-1268085586</nova:project>
Aug 01 21:35:43 user nova-compute[72586]:       </nova:owner>
Aug 01 21:35:43 user nova-compute[72586]:       <nova:root type="image" uuid="0243d46b-6819-42a5-926f-42b71f0c97ad"/>
Aug 01 21:35:43 user nova-compute[72586]:       <nova:ports>
Aug 01 21:35:43 user nova-compute[72586]:         <nova:port uuid="0508879f-0d7d-40ab-adcb-d51a6743fdf2">
Aug 01 21:35:43 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 01 21:35:43 user nova-compute[72586]:         </nova:port>
Aug 01 21:35:43 user nova-compute[72586]:       </nova:ports>
Aug 01 21:35:43 user nova-compute[72586]:     </nova:instance>
Aug 01 21:35:43 user nova-compute[72586]:   </metadata>
Aug 01 21:35:43 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:35:43 user nova-compute[72586]:     <system>
Aug 01 21:35:43 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:35:43 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:35:43 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:35:43 user nova-compute[72586]:       <entry name="serial">63625685-227f-48cc-9cc0-594633e0b8bb</entry>
Aug 01 21:35:43 user nova-compute[72586]:       <entry name="uuid">63625685-227f-48cc-9cc0-594633e0b8bb</entry>
Aug 01 21:35:43 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:35:43 user nova-compute[72586]:     </system>
Aug 01 21:35:43 user nova-compute[72586]:   </sysinfo>
Aug 01 21:35:43 user nova-compute[72586]:   <os>
Aug 01 21:35:43 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:35:43 user nova-compute[72586]:     <boot dev="hd"/>
Aug 01 21:35:43 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:35:43 user nova-compute[72586]:   </os>
Aug 01 21:35:43 user nova-compute[72586]:   <features>
Aug 01 21:35:43 user nova-compute[72586]:     <acpi/>
Aug 01 21:35:43 user nova-compute[72586]:     <apic/>
Aug 01 21:35:43 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:35:43 user nova-compute[72586]:   </features>
Aug 01 21:35:43 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:35:43 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:35:43 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:35:43 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:35:43 user nova-compute[72586]:   </clock>
Aug 01 21:35:43 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:35:43 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:35:43 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:35:43 user nova-compute[72586]:   </cpu>
Aug 01 21:35:43 user nova-compute[72586]:   <devices>
Aug 01 21:35:43 user nova-compute[72586]:     <disk type="file" device="disk">
Aug 01 21:35:43 user nova-compute[72586]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 21:35:43 user nova-compute[72586]:       <source file="/opt/stack/data/nova/instances/63625685-227f-48cc-9cc0-594633e0b8bb/disk"/>
Aug 01 21:35:43 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:35:43 user nova-compute[72586]:     </disk>
Aug 01 21:35:43 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:35:43 user nova-compute[72586]:       <mac address="fa:16:3e:ac:c9:31"/>
Aug 01 21:35:43 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:35:43 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:35:43 user nova-compute[72586]:       <target dev="tap0508879f-0d"/>
Aug 01 21:35:43 user nova-compute[72586]:     </interface>
Aug 01 21:35:43 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:35:43 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/63625685-227f-48cc-9cc0-594633e0b8bb/console.log" append="off"/>
Aug 01 21:35:43 user nova-compute[72586]:     </serial>
Aug 01 21:35:43 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:35:43 user nova-compute[72586]:     <video>
Aug 01 21:35:43 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:35:43 user nova-compute[72586]:     </video>
Aug 01 21:35:43 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:35:43 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:35:43 user nova-compute[72586]:     </rng>
Aug 01 21:35:43 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:35:43 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:35:43 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:35:43 user nova-compute[72586]:     </memballoon>
Aug 01 21:35:43 user nova-compute[72586]:   </devices>
Aug 01 21:35:43 user nova-compute[72586]: </domain>
Aug 01 21:35:43 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:35:43 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:35:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-425585844',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-425585844',id=32,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88d847d04360420c80ea5608d5a2b15a',ramdisk_id='',reservation_id='r-66i0h2g3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1268085586',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:35:42Z,user_data=None,user_id='a984642731b9413c97038f65052ab92d',uuid=63625685-227f-48cc-9cc0-594633e0b8bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0508879f-0d7d-40ab-adcb-d51a6743fdf2", "address": "fa:16:3e:ac:c9:31", "network": {"id": "86940e5d-852b-48fc-9b0e-858305321349", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1967467603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d847d04360420c80ea5608d5a2b15a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0508879f-0d", "ovs_interfaceid": "0508879f-0d7d-40ab-adcb-d51a6743fdf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:35:43 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Converting VIF {"id": "0508879f-0d7d-40ab-adcb-d51a6743fdf2", "address": "fa:16:3e:ac:c9:31", "network": {"id": "86940e5d-852b-48fc-9b0e-858305321349", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1967467603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d847d04360420c80ea5608d5a2b15a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0508879f-0d", "ovs_interfaceid": "0508879f-0d7d-40ab-adcb-d51a6743fdf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:35:43 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:c9:31,bridge_name='br-int',has_traffic_filtering=True,id=0508879f-0d7d-40ab-adcb-d51a6743fdf2,network=Network(86940e5d-852b-48fc-9b0e-858305321349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0508879f-0d') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:35:43 user nova-compute[72586]: DEBUG os_vif [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:c9:31,bridge_name='br-int',has_traffic_filtering=True,id=0508879f-0d7d-40ab-adcb-d51a6743fdf2,network=Network(86940e5d-852b-48fc-9b0e-858305321349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0508879f-0d') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:35:43 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:35:43 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:35:43 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:35:43 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:35:43 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0508879f-0d, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:35:43 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0508879f-0d, col_values=(('external_ids', {'iface-id': '0508879f-0d7d-40ab-adcb-d51a6743fdf2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:c9:31', 'vm-uuid': '63625685-227f-48cc-9cc0-594633e0b8bb'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:35:43 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:35:43 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:35:43 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:35:43 user nova-compute[72586]: INFO os_vif [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:c9:31,bridge_name='br-int',has_traffic_filtering=True,id=0508879f-0d7d-40ab-adcb-d51a6743fdf2,network=Network(86940e5d-852b-48fc-9b0e-858305321349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0508879f-0d')
Aug 01 21:35:44 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:35:44 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] No VIF found with MAC fa:16:3e:ac:c9:31, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:35:44 user nova-compute[72586]: DEBUG nova.network.neutron [req-da898dd6-8c57-4151-b0c0-31fe5f0fd9e3 req-d98830d1-2dc7-4ab6-ae11-bbca5f1988ca service nova] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Updated VIF entry in instance network info cache for port 0508879f-0d7d-40ab-adcb-d51a6743fdf2. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:35:44 user nova-compute[72586]: DEBUG nova.network.neutron [req-da898dd6-8c57-4151-b0c0-31fe5f0fd9e3 req-d98830d1-2dc7-4ab6-ae11-bbca5f1988ca service nova] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Updating instance_info_cache with network_info: [{"id": "0508879f-0d7d-40ab-adcb-d51a6743fdf2", "address": "fa:16:3e:ac:c9:31", "network": {"id": "86940e5d-852b-48fc-9b0e-858305321349", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1967467603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d847d04360420c80ea5608d5a2b15a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0508879f-0d", "ovs_interfaceid": "0508879f-0d7d-40ab-adcb-d51a6743fdf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:35:44 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-da898dd6-8c57-4151-b0c0-31fe5f0fd9e3 req-d98830d1-2dc7-4ab6-ae11-bbca5f1988ca service nova] Releasing lock "refresh_cache-63625685-227f-48cc-9cc0-594633e0b8bb" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:35:45 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:35:45 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:35:45 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:35:45 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:35:45 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:35:45 user nova-compute[72586]: DEBUG nova.compute.manager [req-0aae19d3-09c9-4a25-8493-b936c9206ede req-4c9b754a-39aa-4731-9176-54828450c30f service nova] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Received event network-vif-plugged-0508879f-0d7d-40ab-adcb-d51a6743fdf2 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:35:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-0aae19d3-09c9-4a25-8493-b936c9206ede req-4c9b754a-39aa-4731-9176-54828450c30f service nova] Acquiring lock "63625685-227f-48cc-9cc0-594633e0b8bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:35:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-0aae19d3-09c9-4a25-8493-b936c9206ede req-4c9b754a-39aa-4731-9176-54828450c30f service nova] Lock "63625685-227f-48cc-9cc0-594633e0b8bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:35:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-0aae19d3-09c9-4a25-8493-b936c9206ede req-4c9b754a-39aa-4731-9176-54828450c30f service nova] Lock "63625685-227f-48cc-9cc0-594633e0b8bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:35:45 user nova-compute[72586]: DEBUG nova.compute.manager [req-0aae19d3-09c9-4a25-8493-b936c9206ede req-4c9b754a-39aa-4731-9176-54828450c30f service nova] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] No waiting events found dispatching network-vif-plugged-0508879f-0d7d-40ab-adcb-d51a6743fdf2 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:35:45 user nova-compute[72586]: WARNING nova.compute.manager [req-0aae19d3-09c9-4a25-8493-b936c9206ede req-4c9b754a-39aa-4731-9176-54828450c30f service nova] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Received unexpected event network-vif-plugged-0508879f-0d7d-40ab-adcb-d51a6743fdf2 for instance with vm_state building and task_state spawning.
Aug 01 21:35:47 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925747.4254658, 63625685-227f-48cc-9cc0-594633e0b8bb => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:35:47 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] VM Resumed (Lifecycle Event)
Aug 01 21:35:47 user nova-compute[72586]: DEBUG nova.compute.manager [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Instance event wait completed in 0 seconds for  {{(pid=72586) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 21:35:47 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Guest created on hypervisor {{(pid=72586) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 21:35:47 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Instance spawned successfully.
Aug 01 21:35:47 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 21:35:47 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:35:47 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:35:47 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Found default for hw_cdrom_bus of ide {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:35:47 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Found default for hw_disk_bus of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:35:47 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Found default for hw_input_bus of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:35:47 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Found default for hw_pointer_model of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:35:47 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Found default for hw_video_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:35:47 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Found default for hw_vif_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:35:47 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:35:47 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925747.427459, 63625685-227f-48cc-9cc0-594633e0b8bb => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:35:47 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] VM Started (Lifecycle Event)
Aug 01 21:35:47 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:35:47 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:35:47 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:35:47 user nova-compute[72586]: INFO nova.compute.manager [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Took 5.37 seconds to spawn the instance on the hypervisor.
Aug 01 21:35:47 user nova-compute[72586]: DEBUG nova.compute.manager [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:35:47 user nova-compute[72586]: INFO nova.compute.manager [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Took 6.12 seconds to build instance.
Aug 01 21:35:47 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-e4c381ce-e964-47c4-a7d1-00b03e8f17e4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "63625685-227f-48cc-9cc0-594633e0b8bb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.232s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:35:47 user nova-compute[72586]: DEBUG nova.compute.manager [req-17b7c2b2-83a5-4788-a4db-f488d2870068 req-832a2591-a58f-45f6-8cce-2d4751ef9a6e service nova] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Received event network-vif-plugged-0508879f-0d7d-40ab-adcb-d51a6743fdf2 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:35:47 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-17b7c2b2-83a5-4788-a4db-f488d2870068 req-832a2591-a58f-45f6-8cce-2d4751ef9a6e service nova] Acquiring lock "63625685-227f-48cc-9cc0-594633e0b8bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:35:47 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-17b7c2b2-83a5-4788-a4db-f488d2870068 req-832a2591-a58f-45f6-8cce-2d4751ef9a6e service nova] Lock "63625685-227f-48cc-9cc0-594633e0b8bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:35:47 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-17b7c2b2-83a5-4788-a4db-f488d2870068 req-832a2591-a58f-45f6-8cce-2d4751ef9a6e service nova] Lock "63625685-227f-48cc-9cc0-594633e0b8bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:35:47 user nova-compute[72586]: DEBUG nova.compute.manager [req-17b7c2b2-83a5-4788-a4db-f488d2870068 req-832a2591-a58f-45f6-8cce-2d4751ef9a6e service nova] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] No waiting events found dispatching network-vif-plugged-0508879f-0d7d-40ab-adcb-d51a6743fdf2 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:35:47 user nova-compute[72586]: WARNING nova.compute.manager [req-17b7c2b2-83a5-4788-a4db-f488d2870068 req-832a2591-a58f-45f6-8cce-2d4751ef9a6e service nova] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Received unexpected event network-vif-plugged-0508879f-0d7d-40ab-adcb-d51a6743fdf2 for instance with vm_state active and task_state None.
Aug 01 21:35:48 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:35:49 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:35:50 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:35:50 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Cleaning up deleted instances {{(pid=72586) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 21:35:50 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] There are 0 instances to clean {{(pid=72586) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 21:35:50 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:35:51 user nova-compute[72586]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690925736.5640144, 413c3426-18ad-4a5c-af04-e0e7fc90f050 => Stopped> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:35:51 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] VM Stopped (Lifecycle Event)
Aug 01 21:35:51 user nova-compute[72586]: DEBUG nova.compute.manager [None req-ed6e4f26-e69b-49b3-979b-3ddd109de1b6 None None] [instance: 413c3426-18ad-4a5c-af04-e0e7fc90f050] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:35:53 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:35:55 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._sync_power_states {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:35:55 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Triggering sync for uuid 042f0031-1e4d-41d0-8bfa-36001675cfe3 {{(pid=72586) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 21:35:55 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Triggering sync for uuid 49c24c77-f102-4aed-8314-b04aad5f6b3a {{(pid=72586) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 21:35:55 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Triggering sync for uuid af2de810-b22f-4fa9-835c-c673abd145db {{(pid=72586) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 21:35:55 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Triggering sync for uuid 161fab9d-a7d1-4ea0-b4b9-2afc54040eef {{(pid=72586) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 21:35:55 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Triggering sync for uuid 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f {{(pid=72586) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 21:35:55 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Triggering sync for uuid 314f9b05-527c-459d-aca7-acc696ac613f {{(pid=72586) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 21:35:55 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Triggering sync for uuid 3ced1426-a20e-4d5f-8250-e789eba6f098 {{(pid=72586) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 21:35:55 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Triggering sync for uuid 11ab466b-8caa-4a38-8350-213aa17ee75e {{(pid=72586) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 21:35:55 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Triggering sync for uuid 63625685-227f-48cc-9cc0-594633e0b8bb {{(pid=72586) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 21:35:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "042f0031-1e4d-41d0-8bfa-36001675cfe3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:35:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "042f0031-1e4d-41d0-8bfa-36001675cfe3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:35:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "49c24c77-f102-4aed-8314-b04aad5f6b3a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:35:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "49c24c77-f102-4aed-8314-b04aad5f6b3a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:35:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "af2de810-b22f-4fa9-835c-c673abd145db" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:35:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "af2de810-b22f-4fa9-835c-c673abd145db" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:35:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "161fab9d-a7d1-4ea0-b4b9-2afc54040eef" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:35:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "161fab9d-a7d1-4ea0-b4b9-2afc54040eef" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:35:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:35:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:35:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "314f9b05-527c-459d-aca7-acc696ac613f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:35:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "314f9b05-527c-459d-aca7-acc696ac613f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:35:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "3ced1426-a20e-4d5f-8250-e789eba6f098" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:35:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "3ced1426-a20e-4d5f-8250-e789eba6f098" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:35:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "11ab466b-8caa-4a38-8350-213aa17ee75e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:35:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "11ab466b-8caa-4a38-8350-213aa17ee75e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:35:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "63625685-227f-48cc-9cc0-594633e0b8bb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:35:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "63625685-227f-48cc-9cc0-594633e0b8bb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:35:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "49c24c77-f102-4aed-8314-b04aad5f6b3a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:35:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "042f0031-1e4d-41d0-8bfa-36001675cfe3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:35:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "af2de810-b22f-4fa9-835c-c673abd145db" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.052s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:35:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "161fab9d-a7d1-4ea0-b4b9-2afc54040eef" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.052s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:35:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:35:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "314f9b05-527c-459d-aca7-acc696ac613f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.060s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:35:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "3ced1426-a20e-4d5f-8250-e789eba6f098" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.062s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:35:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "11ab466b-8caa-4a38-8350-213aa17ee75e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.067s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:35:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "63625685-227f-48cc-9cc0-594633e0b8bb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.074s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:35:58 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:35:59 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-41446c69-04bc-4f78-814e-5fa20b101f0b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Acquiring lock "314f9b05-527c-459d-aca7-acc696ac613f" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:35:59 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-41446c69-04bc-4f78-814e-5fa20b101f0b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "314f9b05-527c-459d-aca7-acc696ac613f" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:35:59 user nova-compute[72586]: DEBUG nova.compute.manager [None req-41446c69-04bc-4f78-814e-5fa20b101f0b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Going to confirm migration 2 {{(pid=72586) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 01 21:36:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-41446c69-04bc-4f78-814e-5fa20b101f0b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Acquiring lock "refresh_cache-314f9b05-527c-459d-aca7-acc696ac613f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:36:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-41446c69-04bc-4f78-814e-5fa20b101f0b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Acquired lock "refresh_cache-314f9b05-527c-459d-aca7-acc696ac613f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:36:00 user nova-compute[72586]: DEBUG nova.network.neutron [None req-41446c69-04bc-4f78-814e-5fa20b101f0b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:36:00 user nova-compute[72586]: DEBUG nova.objects.instance [None req-41446c69-04bc-4f78-814e-5fa20b101f0b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lazy-loading 'info_cache' on Instance uuid 314f9b05-527c-459d-aca7-acc696ac613f {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:36:00 user nova-compute[72586]: DEBUG nova.network.neutron [None req-41446c69-04bc-4f78-814e-5fa20b101f0b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Updating instance_info_cache with network_info: [{"id": "eeebb619-be12-42d7-96f3-e309b6d4cdaf", "address": "fa:16:3e:5d:69:cd", "network": {"id": "aab9a541-2149-4c65-b60e-80a1daca6632", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1355256264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19af48ffce7e4703b6d978bc3563680e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeebb619-be", "ovs_interfaceid": "eeebb619-be12-42d7-96f3-e309b6d4cdaf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:36:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-41446c69-04bc-4f78-814e-5fa20b101f0b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Releasing lock "refresh_cache-314f9b05-527c-459d-aca7-acc696ac613f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:36:00 user nova-compute[72586]: DEBUG nova.objects.instance [None req-41446c69-04bc-4f78-814e-5fa20b101f0b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lazy-loading 'migration_context' on Instance uuid 314f9b05-527c-459d-aca7-acc696ac613f {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:36:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-41446c69-04bc-4f78-814e-5fa20b101f0b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:36:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-41446c69-04bc-4f78-814e-5fa20b101f0b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:36:01 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-41446c69-04bc-4f78-814e-5fa20b101f0b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:36:01 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-41446c69-04bc-4f78-814e-5fa20b101f0b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:36:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-41446c69-04bc-4f78-814e-5fa20b101f0b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.401s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:36:01 user nova-compute[72586]: INFO nova.scheduler.client.report [None req-41446c69-04bc-4f78-814e-5fa20b101f0b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Deleted allocation for migration a601a123-f478-4115-afd7-0b4b73b52210
Aug 01 21:36:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-41446c69-04bc-4f78-814e-5fa20b101f0b tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "314f9b05-527c-459d-aca7-acc696ac613f" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.533s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:36:03 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:36:03 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:36:03 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72586) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 21:36:03 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72586) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 21:36:03 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72586) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 21:36:03 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:36:04 user nova-compute[72586]: DEBUG nova.compute.manager [req-315bbd16-b6a1-4d44-9ab2-2009d171f089 req-510cdef7-b32c-499c-9199-d4c278fe5093 service nova] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Received event network-changed-5b244939-e725-4cc8-8407-a7dd0bbc7ec4 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:36:04 user nova-compute[72586]: DEBUG nova.compute.manager [req-315bbd16-b6a1-4d44-9ab2-2009d171f089 req-510cdef7-b32c-499c-9199-d4c278fe5093 service nova] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Refreshing instance network info cache due to event network-changed-5b244939-e725-4cc8-8407-a7dd0bbc7ec4. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:36:04 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-315bbd16-b6a1-4d44-9ab2-2009d171f089 req-510cdef7-b32c-499c-9199-d4c278fe5093 service nova] Acquiring lock "refresh_cache-0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:36:04 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-315bbd16-b6a1-4d44-9ab2-2009d171f089 req-510cdef7-b32c-499c-9199-d4c278fe5093 service nova] Acquired lock "refresh_cache-0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:36:04 user nova-compute[72586]: DEBUG nova.network.neutron [req-315bbd16-b6a1-4d44-9ab2-2009d171f089 req-510cdef7-b32c-499c-9199-d4c278fe5093 service nova] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Refreshing network info cache for port 5b244939-e725-4cc8-8407-a7dd0bbc7ec4 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:36:04 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:36:04 user nova-compute[72586]: DEBUG nova.network.neutron [req-315bbd16-b6a1-4d44-9ab2-2009d171f089 req-510cdef7-b32c-499c-9199-d4c278fe5093 service nova] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Updated VIF entry in instance network info cache for port 5b244939-e725-4cc8-8407-a7dd0bbc7ec4. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:36:04 user nova-compute[72586]: DEBUG nova.network.neutron [req-315bbd16-b6a1-4d44-9ab2-2009d171f089 req-510cdef7-b32c-499c-9199-d4c278fe5093 service nova] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Updating instance_info_cache with network_info: [{"id": "5b244939-e725-4cc8-8407-a7dd0bbc7ec4", "address": "fa:16:3e:cc:46:65", "network": {"id": "56c3419f-2c2c-4dda-88d7-ba96e2a689fd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-705071098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ae5f1c56b348de8a03f1a4bcdd9b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b244939-e7", "ovs_interfaceid": "5b244939-e725-4cc8-8407-a7dd0bbc7ec4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:36:04 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-315bbd16-b6a1-4d44-9ab2-2009d171f089 req-510cdef7-b32c-499c-9199-d4c278fe5093 service nova] Releasing lock "refresh_cache-0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:36:05 user nova-compute[72586]: DEBUG nova.compute.manager [req-a2eb5236-d014-4ff5-b544-babb25be1408 req-01ee14b5-6f37-4af3-a7a1-c809d39922a5 service nova] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Received event network-changed-5b244939-e725-4cc8-8407-a7dd0bbc7ec4 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:36:05 user nova-compute[72586]: DEBUG nova.compute.manager [req-a2eb5236-d014-4ff5-b544-babb25be1408 req-01ee14b5-6f37-4af3-a7a1-c809d39922a5 service nova] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Refreshing instance network info cache due to event network-changed-5b244939-e725-4cc8-8407-a7dd0bbc7ec4. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:36:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-a2eb5236-d014-4ff5-b544-babb25be1408 req-01ee14b5-6f37-4af3-a7a1-c809d39922a5 service nova] Acquiring lock "refresh_cache-0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:36:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-a2eb5236-d014-4ff5-b544-babb25be1408 req-01ee14b5-6f37-4af3-a7a1-c809d39922a5 service nova] Acquired lock "refresh_cache-0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:36:05 user nova-compute[72586]: DEBUG nova.network.neutron [req-a2eb5236-d014-4ff5-b544-babb25be1408 req-01ee14b5-6f37-4af3-a7a1-c809d39922a5 service nova] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Refreshing network info cache for port 5b244939-e725-4cc8-8407-a7dd0bbc7ec4 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:36:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9afe6f45-7b92-435f-9db8-4322377a6586 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Acquiring lock "0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:36:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9afe6f45-7b92-435f-9db8-4322377a6586 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:36:05 user nova-compute[72586]: INFO nova.compute.manager [None req-9afe6f45-7b92-435f-9db8-4322377a6586 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Detaching volume cbc36d6d-5805-4d7b-bf27-f170dcdd4f96
Aug 01 21:36:05 user nova-compute[72586]: INFO nova.virt.block_device [None req-9afe6f45-7b92-435f-9db8-4322377a6586 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Attempting to driver detach volume cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 from mountpoint /dev/vdb
Aug 01 21:36:05 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-9afe6f45-7b92-435f-9db8-4322377a6586 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Attempting to detach device vdb from instance 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f from the persistent domain config. {{(pid=72586) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 21:36:05 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-9afe6f45-7b92-435f-9db8-4322377a6586 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 21:36:05 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:36:05 user nova-compute[72586]:   <source dev="/dev/sdc"/>
Aug 01 21:36:05 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:36:05 user nova-compute[72586]:   <serial>cbc36d6d-5805-4d7b-bf27-f170dcdd4f96</serial>
Aug 01 21:36:05 user nova-compute[72586]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 01 21:36:05 user nova-compute[72586]: </disk>
Aug 01 21:36:05 user nova-compute[72586]:  {{(pid=72586) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 21:36:05 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-9afe6f45-7b92-435f-9db8-4322377a6586 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Successfully detached device vdb from instance 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f from the persistent domain config.
Aug 01 21:36:05 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-9afe6f45-7b92-435f-9db8-4322377a6586 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f from the live domain config. {{(pid=72586) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 21:36:05 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-9afe6f45-7b92-435f-9db8-4322377a6586 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 21:36:05 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:36:05 user nova-compute[72586]:   <source dev="/dev/sdc"/>
Aug 01 21:36:05 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:36:05 user nova-compute[72586]:   <serial>cbc36d6d-5805-4d7b-bf27-f170dcdd4f96</serial>
Aug 01 21:36:05 user nova-compute[72586]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 01 21:36:05 user nova-compute[72586]: </disk>
Aug 01 21:36:05 user nova-compute[72586]:  {{(pid=72586) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 21:36:05 user nova-compute[72586]: DEBUG nova.network.neutron [req-a2eb5236-d014-4ff5-b544-babb25be1408 req-01ee14b5-6f37-4af3-a7a1-c809d39922a5 service nova] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Updated VIF entry in instance network info cache for port 5b244939-e725-4cc8-8407-a7dd0bbc7ec4. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:36:05 user nova-compute[72586]: DEBUG nova.network.neutron [req-a2eb5236-d014-4ff5-b544-babb25be1408 req-01ee14b5-6f37-4af3-a7a1-c809d39922a5 service nova] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Updating instance_info_cache with network_info: [{"id": "5b244939-e725-4cc8-8407-a7dd0bbc7ec4", "address": "fa:16:3e:cc:46:65", "network": {"id": "56c3419f-2c2c-4dda-88d7-ba96e2a689fd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-705071098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ae5f1c56b348de8a03f1a4bcdd9b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b244939-e7", "ovs_interfaceid": "5b244939-e725-4cc8-8407-a7dd0bbc7ec4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:36:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-a2eb5236-d014-4ff5-b544-babb25be1408 req-01ee14b5-6f37-4af3-a7a1-c809d39922a5 service nova] Releasing lock "refresh_cache-0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:36:06 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Received event <DeviceRemovedEvent: 1690925766.0143762, 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72586) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 21:36:06 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-9afe6f45-7b92-435f-9db8-4322377a6586 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f {{(pid=72586) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 21:36:06 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-9afe6f45-7b92-435f-9db8-4322377a6586 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Successfully detached device vdb from instance 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f from the live domain config.
Aug 01 21:36:06 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9afe6f45-7b92-435f-9db8-4322377a6586 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] calling os-brick to detach iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 21:36:06 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-9afe6f45-7b92-435f-9db8-4322377a6586 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, {'target_iqns': ['iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xnDJlRBb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:36:06 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-9afe6f45-7b92-435f-9db8-4322377a6586 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:36:06 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-9afe6f45-7b92-435f-9db8-4322377a6586 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:36:06 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-9afe6f45-7b92-435f-9db8-4322377a6586 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:36:06 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-9afe6f45-7b92-435f-9db8-4322377a6586 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96', 0)] {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 21:36:06 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:36:06 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:36:06 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d15d94-211c-47ca-9330-c6a52c6f720a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:36:06 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:36:06 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:36:06 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3a900b-2a92-428f-9e3d-b15b7300d9d0]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:36:06 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-9afe6f45-7b92-435f-9db8-4322377a6586 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:36:06 user nova-compute[72586]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 (non-flash)
Aug 01 21:36:06 user nova-compute[72586]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 (non-flash)
Aug 01 21:36:06 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:36:06 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-9afe6f45-7b92-435f-9db8-4322377a6586 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:36:06 user nova-compute[72586]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 (non-flash)
Aug 01 21:36:06 user nova-compute[72586]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 (non-flash)
Aug 01 21:36:06 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:36:06 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-9afe6f45-7b92-435f-9db8-4322377a6586 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ed02693f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96'): ({'sdc'}, set())}) {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 21:36:06 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-9afe6f45-7b92-435f-9db8-4322377a6586 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Removing single pathed devices sdc {{(pid=72586) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 21:36:06 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:36:06 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:36:06 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3677cba-df4d-4076-ae55-bbbe1fe8913a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:36:06 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:36:06 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:36:06 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[28590d8e-2e5c-47f6-a3ed-044d8bb1e8c9]: (4, ('ok\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:36:06 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-9afe6f45-7b92-435f-9db8-4322377a6586 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Flushing IO for device /dev/sdc {{(pid=72586) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 21:36:06 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:36:06 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:36:06 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe74333-e252-48ff-8a01-6bfb516a4b40]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:36:06 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-9afe6f45-7b92-435f-9db8-4322377a6586 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72586) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 21:36:06 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:36:06 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.033s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:36:06 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08db435-af62-458f-8d21-34011b90cb2b]: (4, ('1', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:36:06 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-9afe6f45-7b92-435f-9db8-4322377a6586 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 21:36:06 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-9afe6f45-7b92-435f-9db8-4322377a6586 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] SCSI volumes sdc have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 21:36:06 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-9afe6f45-7b92-435f-9db8-4322377a6586 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96')] {{(pid=72586) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 21:36:06 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:36:06 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:36:06 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1a16e5-0170-44a8-bf11-b0dcd69c0c25]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:36:06 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-9afe6f45-7b92-435f-9db8-4322377a6586 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:36:06 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 -p 172.16.0.220:3260 --logout {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:36:06 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:36:06 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[4743b113-dd4a-4d36-a3fc-bbad253eb0c9]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:36:06 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-9afe6f45-7b92-435f-9db8-4322377a6586 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96, portal: 172.16.0.220,3260]
Aug 01 21:36:06 user nova-compute[72586]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96, portal: 172.16.0.220,3260] successful.
Aug 01 21:36:06 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:36:06 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 -p 172.16.0.220:3260 --op delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:36:06 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbc36d6d-5805-4d7b-bf27-f170dcdd4f96 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:36:06 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[80df8718-9196-4972-8d74-d9c0d5b15ac3]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:36:06 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-9afe6f45-7b92-435f-9db8-4322377a6586 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:36:06 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-9afe6f45-7b92-435f-9db8-4322377a6586 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:36:06 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-9afe6f45-7b92-435f-9db8-4322377a6586 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] <== disconnect_volume: return (291ms) None {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:36:06 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9afe6f45-7b92-435f-9db8-4322377a6586 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Disconnected iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 21:36:07 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-6b2b5e26-50e1-4bd2-8834-6121940225af tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Acquiring lock "3ced1426-a20e-4d5f-8250-e789eba6f098" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:36:07 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-6b2b5e26-50e1-4bd2-8834-6121940225af tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Lock "3ced1426-a20e-4d5f-8250-e789eba6f098" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:36:07 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-6b2b5e26-50e1-4bd2-8834-6121940225af tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Acquiring lock "3ced1426-a20e-4d5f-8250-e789eba6f098-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:36:07 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-6b2b5e26-50e1-4bd2-8834-6121940225af tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Lock "3ced1426-a20e-4d5f-8250-e789eba6f098-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:36:07 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-6b2b5e26-50e1-4bd2-8834-6121940225af tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Lock "3ced1426-a20e-4d5f-8250-e789eba6f098-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:36:07 user nova-compute[72586]: INFO nova.compute.manager [None req-6b2b5e26-50e1-4bd2-8834-6121940225af tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] Terminating instance
Aug 01 21:36:07 user nova-compute[72586]: DEBUG nova.compute.manager [None req-6b2b5e26-50e1-4bd2-8834-6121940225af tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] Start destroying the instance on the hypervisor. {{(pid=72586) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 21:36:07 user nova-compute[72586]: DEBUG nova.objects.instance [None req-9afe6f45-7b92-435f-9db8-4322377a6586 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lazy-loading 'flavor' on Instance uuid 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:36:07 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:36:07 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:36:07 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9afe6f45-7b92-435f-9db8-4322377a6586 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.760s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:36:07 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:36:07 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:36:07 user nova-compute[72586]: DEBUG nova.compute.manager [req-ddfc1595-0dfd-46c0-85f4-4d206322ffb5 req-9a41104f-58aa-41c1-8fcc-a07dde36c6f5 service nova] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] Received event network-vif-unplugged-08a5cc80-89c1-46d0-af8f-215233fff7f0 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:36:07 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ddfc1595-0dfd-46c0-85f4-4d206322ffb5 req-9a41104f-58aa-41c1-8fcc-a07dde36c6f5 service nova] Acquiring lock "3ced1426-a20e-4d5f-8250-e789eba6f098-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:36:07 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ddfc1595-0dfd-46c0-85f4-4d206322ffb5 req-9a41104f-58aa-41c1-8fcc-a07dde36c6f5 service nova] Lock "3ced1426-a20e-4d5f-8250-e789eba6f098-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:36:07 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ddfc1595-0dfd-46c0-85f4-4d206322ffb5 req-9a41104f-58aa-41c1-8fcc-a07dde36c6f5 service nova] Lock "3ced1426-a20e-4d5f-8250-e789eba6f098-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:36:07 user nova-compute[72586]: DEBUG nova.compute.manager [req-ddfc1595-0dfd-46c0-85f4-4d206322ffb5 req-9a41104f-58aa-41c1-8fcc-a07dde36c6f5 service nova] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] No waiting events found dispatching network-vif-unplugged-08a5cc80-89c1-46d0-af8f-215233fff7f0 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:36:07 user nova-compute[72586]: DEBUG nova.compute.manager [req-ddfc1595-0dfd-46c0-85f4-4d206322ffb5 req-9a41104f-58aa-41c1-8fcc-a07dde36c6f5 service nova] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] Received event network-vif-unplugged-08a5cc80-89c1-46d0-af8f-215233fff7f0 for instance with task_state deleting. {{(pid=72586) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 21:36:07 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] Instance destroyed successfully.
Aug 01 21:36:07 user nova-compute[72586]: DEBUG nova.objects.instance [None req-6b2b5e26-50e1-4bd2-8834-6121940225af tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Lazy-loading 'resources' on Instance uuid 3ced1426-a20e-4d5f-8250-e789eba6f098 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:36:07 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-6b2b5e26-50e1-4bd2-8834-6121940225af tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:34:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-344156937',display_name='tempest-VolumesActionsTest-instance-344156937',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-344156937',id=30,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:34:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f64482461ec146daab58ef5da8a52ca7',ramdisk_id='',reservation_id='r-j42bwx1y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-684200631',owner_user_name='tempest-VolumesActionsTest-684200631-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:34:15Z,user_data=None,user_id='6cda5cb14a4d463791ae0daa0cb55f31',uuid=3ced1426-a20e-4d5f-8250-e789eba6f098,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08a5cc80-89c1-46d0-af8f-215233fff7f0", "address": "fa:16:3e:19:b4:d8", "network": {"id": "810a7784-cf98-4d5b-8850-66293852a067", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1671631489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f64482461ec146daab58ef5da8a52ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a5cc80-89", "ovs_interfaceid": "08a5cc80-89c1-46d0-af8f-215233fff7f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:36:07 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-6b2b5e26-50e1-4bd2-8834-6121940225af tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Converting VIF {"id": "08a5cc80-89c1-46d0-af8f-215233fff7f0", "address": "fa:16:3e:19:b4:d8", "network": {"id": "810a7784-cf98-4d5b-8850-66293852a067", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1671631489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f64482461ec146daab58ef5da8a52ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a5cc80-89", "ovs_interfaceid": "08a5cc80-89c1-46d0-af8f-215233fff7f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:36:07 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-6b2b5e26-50e1-4bd2-8834-6121940225af tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:b4:d8,bridge_name='br-int',has_traffic_filtering=True,id=08a5cc80-89c1-46d0-af8f-215233fff7f0,network=Network(810a7784-cf98-4d5b-8850-66293852a067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08a5cc80-89') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:36:07 user nova-compute[72586]: DEBUG os_vif [None req-6b2b5e26-50e1-4bd2-8834-6121940225af tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:b4:d8,bridge_name='br-int',has_traffic_filtering=True,id=08a5cc80-89c1-46d0-af8f-215233fff7f0,network=Network(810a7784-cf98-4d5b-8850-66293852a067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08a5cc80-89') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:36:07 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:36:07 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap08a5cc80-89, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:36:07 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:36:07 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:36:07 user nova-compute[72586]: INFO os_vif [None req-6b2b5e26-50e1-4bd2-8834-6121940225af tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:b4:d8,bridge_name='br-int',has_traffic_filtering=True,id=08a5cc80-89c1-46d0-af8f-215233fff7f0,network=Network(810a7784-cf98-4d5b-8850-66293852a067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08a5cc80-89')
Aug 01 21:36:07 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-6b2b5e26-50e1-4bd2-8834-6121940225af tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] Deleting instance files /opt/stack/data/nova/instances/3ced1426-a20e-4d5f-8250-e789eba6f098_del
Aug 01 21:36:07 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-6b2b5e26-50e1-4bd2-8834-6121940225af tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] Deletion of /opt/stack/data/nova/instances/3ced1426-a20e-4d5f-8250-e789eba6f098_del complete
Aug 01 21:36:07 user nova-compute[72586]: INFO nova.compute.manager [None req-6b2b5e26-50e1-4bd2-8834-6121940225af tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] Took 0.75 seconds to destroy the instance on the hypervisor.
Aug 01 21:36:07 user nova-compute[72586]: DEBUG oslo.service.loopingcall [None req-6b2b5e26-50e1-4bd2-8834-6121940225af tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72586) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 21:36:07 user nova-compute[72586]: DEBUG nova.compute.manager [-] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] Deallocating network for instance {{(pid=72586) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 21:36:07 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] deallocate_for_instance() {{(pid=72586) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 21:36:08 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:36:08 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] Took 0.73 seconds to deallocate network for instance.
Aug 01 21:36:08 user nova-compute[72586]: DEBUG nova.compute.manager [req-6f4ebe34-d9c5-439f-9e93-be520495f32c req-4c829d49-72d7-4939-bec3-2fadcff77029 service nova] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] Received event network-vif-deleted-08a5cc80-89c1-46d0-af8f-215233fff7f0 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:36:08 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-6b2b5e26-50e1-4bd2-8834-6121940225af tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:36:08 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-6b2b5e26-50e1-4bd2-8834-6121940225af tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:36:08 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-6b2b5e26-50e1-4bd2-8834-6121940225af tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:36:08 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-6b2b5e26-50e1-4bd2-8834-6121940225af tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:36:08 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-6b2b5e26-50e1-4bd2-8834-6121940225af tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.381s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:36:09 user nova-compute[72586]: INFO nova.scheduler.client.report [None req-6b2b5e26-50e1-4bd2-8834-6121940225af tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Deleted allocations for instance 3ced1426-a20e-4d5f-8250-e789eba6f098
Aug 01 21:36:09 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-6b2b5e26-50e1-4bd2-8834-6121940225af tempest-VolumesActionsTest-684200631 tempest-VolumesActionsTest-684200631-project-member] Lock "3ced1426-a20e-4d5f-8250-e789eba6f098" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.049s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:36:09 user nova-compute[72586]: DEBUG nova.compute.manager [req-337e30e2-06c8-4e8b-b0fc-9df4db99bc50 req-8f34b020-7c4e-4d19-a3a6-ab216160813e service nova] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] Received event network-vif-plugged-08a5cc80-89c1-46d0-af8f-215233fff7f0 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:36:09 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-337e30e2-06c8-4e8b-b0fc-9df4db99bc50 req-8f34b020-7c4e-4d19-a3a6-ab216160813e service nova] Acquiring lock "3ced1426-a20e-4d5f-8250-e789eba6f098-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:36:09 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-337e30e2-06c8-4e8b-b0fc-9df4db99bc50 req-8f34b020-7c4e-4d19-a3a6-ab216160813e service nova] Lock "3ced1426-a20e-4d5f-8250-e789eba6f098-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:36:09 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-337e30e2-06c8-4e8b-b0fc-9df4db99bc50 req-8f34b020-7c4e-4d19-a3a6-ab216160813e service nova] Lock "3ced1426-a20e-4d5f-8250-e789eba6f098-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:36:09 user nova-compute[72586]: DEBUG nova.compute.manager [req-337e30e2-06c8-4e8b-b0fc-9df4db99bc50 req-8f34b020-7c4e-4d19-a3a6-ab216160813e service nova] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] No waiting events found dispatching network-vif-plugged-08a5cc80-89c1-46d0-af8f-215233fff7f0 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:36:09 user nova-compute[72586]: WARNING nova.compute.manager [req-337e30e2-06c8-4e8b-b0fc-9df4db99bc50 req-8f34b020-7c4e-4d19-a3a6-ab216160813e service nova] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] Received unexpected event network-vif-plugged-08a5cc80-89c1-46d0-af8f-215233fff7f0 for instance with vm_state deleted and task_state None.
Aug 01 21:36:09 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:36:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:36:14 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:36:17 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:36:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:36:22 user nova-compute[72586]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690925767.6699955, 3ced1426-a20e-4d5f-8250-e789eba6f098 => Stopped> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:36:22 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] VM Stopped (Lifecycle Event)
Aug 01 21:36:22 user nova-compute[72586]: DEBUG nova.compute.manager [None req-2cf322e4-490a-4fd3-945b-4b9f50242a56 None None] [instance: 3ced1426-a20e-4d5f-8250-e789eba6f098] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:36:22 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:36:25 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:36:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-dfe5e412-bd65-4108-afb5-c97d7966a8f3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Acquiring lock "042f0031-1e4d-41d0-8bfa-36001675cfe3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:36:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-dfe5e412-bd65-4108-afb5-c97d7966a8f3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "042f0031-1e4d-41d0-8bfa-36001675cfe3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:36:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-dfe5e412-bd65-4108-afb5-c97d7966a8f3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Acquiring lock "042f0031-1e4d-41d0-8bfa-36001675cfe3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:36:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-dfe5e412-bd65-4108-afb5-c97d7966a8f3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "042f0031-1e4d-41d0-8bfa-36001675cfe3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:36:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-dfe5e412-bd65-4108-afb5-c97d7966a8f3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "042f0031-1e4d-41d0-8bfa-36001675cfe3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:36:26 user nova-compute[72586]: INFO nova.compute.manager [None req-dfe5e412-bd65-4108-afb5-c97d7966a8f3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Terminating instance
Aug 01 21:36:26 user nova-compute[72586]: DEBUG nova.compute.manager [None req-dfe5e412-bd65-4108-afb5-c97d7966a8f3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Start destroying the instance on the hypervisor. {{(pid=72586) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 21:36:26 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:36:26 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:36:26 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:36:26 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:36:26 user nova-compute[72586]: DEBUG nova.compute.manager [req-b99b3051-07bb-438a-854a-3cfd1a044e51 req-e42bd65b-2344-4f09-b037-e4f7f873ddb8 service nova] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Received event network-vif-unplugged-fb56dcd2-b1ea-4992-a896-22f65127a96c {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:36:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-b99b3051-07bb-438a-854a-3cfd1a044e51 req-e42bd65b-2344-4f09-b037-e4f7f873ddb8 service nova] Acquiring lock "042f0031-1e4d-41d0-8bfa-36001675cfe3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:36:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-b99b3051-07bb-438a-854a-3cfd1a044e51 req-e42bd65b-2344-4f09-b037-e4f7f873ddb8 service nova] Lock "042f0031-1e4d-41d0-8bfa-36001675cfe3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:36:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-b99b3051-07bb-438a-854a-3cfd1a044e51 req-e42bd65b-2344-4f09-b037-e4f7f873ddb8 service nova] Lock "042f0031-1e4d-41d0-8bfa-36001675cfe3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:36:26 user nova-compute[72586]: DEBUG nova.compute.manager [req-b99b3051-07bb-438a-854a-3cfd1a044e51 req-e42bd65b-2344-4f09-b037-e4f7f873ddb8 service nova] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] No waiting events found dispatching network-vif-unplugged-fb56dcd2-b1ea-4992-a896-22f65127a96c {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:36:26 user nova-compute[72586]: DEBUG nova.compute.manager [req-b99b3051-07bb-438a-854a-3cfd1a044e51 req-e42bd65b-2344-4f09-b037-e4f7f873ddb8 service nova] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Received event network-vif-unplugged-fb56dcd2-b1ea-4992-a896-22f65127a96c for instance with task_state deleting. {{(pid=72586) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 21:36:26 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Instance destroyed successfully.
Aug 01 21:36:26 user nova-compute[72586]: DEBUG nova.objects.instance [None req-dfe5e412-bd65-4108-afb5-c97d7966a8f3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lazy-loading 'resources' on Instance uuid 042f0031-1e4d-41d0-8bfa-36001675cfe3 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:36:27 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-dfe5e412-bd65-4108-afb5-c97d7966a8f3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:19:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1034962218',display_name='tempest-ServerRescueNegativeTestJSON-server-1034962218',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1034962218',id=1,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:24:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5b1a1d82f39347119a9fb49fb8e8893f',ramdisk_id='',reservation_id='r-9jvsak0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1258600061',owner_user_name='tempest-ServerRescueNegativeTestJSON-1258600061-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:26:07Z,user_data=None,user_id='0f678ac8999a42c4a383ee8b2976b4cc',uuid=042f0031-1e4d-41d0-8bfa-36001675cfe3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb56dcd2-b1ea-4992-a896-22f65127a96c", "address": "fa:16:3e:8e:7c:d3", "network": {"id": "d229a8de-7a2b-4dcd-a9ac-44a40349676e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-67691992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b1a1d82f39347119a9fb49fb8e8893f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb56dcd2-b1", "ovs_interfaceid": "fb56dcd2-b1ea-4992-a896-22f65127a96c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:36:27 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-dfe5e412-bd65-4108-afb5-c97d7966a8f3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Converting VIF {"id": "fb56dcd2-b1ea-4992-a896-22f65127a96c", "address": "fa:16:3e:8e:7c:d3", "network": {"id": "d229a8de-7a2b-4dcd-a9ac-44a40349676e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-67691992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b1a1d82f39347119a9fb49fb8e8893f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb56dcd2-b1", "ovs_interfaceid": "fb56dcd2-b1ea-4992-a896-22f65127a96c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:36:27 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-dfe5e412-bd65-4108-afb5-c97d7966a8f3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:7c:d3,bridge_name='br-int',has_traffic_filtering=True,id=fb56dcd2-b1ea-4992-a896-22f65127a96c,network=Network(d229a8de-7a2b-4dcd-a9ac-44a40349676e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb56dcd2-b1') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:36:27 user nova-compute[72586]: DEBUG os_vif [None req-dfe5e412-bd65-4108-afb5-c97d7966a8f3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:7c:d3,bridge_name='br-int',has_traffic_filtering=True,id=fb56dcd2-b1ea-4992-a896-22f65127a96c,network=Network(d229a8de-7a2b-4dcd-a9ac-44a40349676e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb56dcd2-b1') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:36:27 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:36:27 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfb56dcd2-b1, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:36:27 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:36:27 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:36:27 user nova-compute[72586]: INFO os_vif [None req-dfe5e412-bd65-4108-afb5-c97d7966a8f3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:7c:d3,bridge_name='br-int',has_traffic_filtering=True,id=fb56dcd2-b1ea-4992-a896-22f65127a96c,network=Network(d229a8de-7a2b-4dcd-a9ac-44a40349676e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb56dcd2-b1')
Aug 01 21:36:27 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-dfe5e412-bd65-4108-afb5-c97d7966a8f3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Deleting instance files /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3_del
Aug 01 21:36:27 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-dfe5e412-bd65-4108-afb5-c97d7966a8f3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Deletion of /opt/stack/data/nova/instances/042f0031-1e4d-41d0-8bfa-36001675cfe3_del complete
Aug 01 21:36:27 user nova-compute[72586]: INFO nova.compute.manager [None req-dfe5e412-bd65-4108-afb5-c97d7966a8f3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Took 0.65 seconds to destroy the instance on the hypervisor.
Aug 01 21:36:27 user nova-compute[72586]: DEBUG oslo.service.loopingcall [None req-dfe5e412-bd65-4108-afb5-c97d7966a8f3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72586) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 21:36:27 user nova-compute[72586]: DEBUG nova.compute.manager [-] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Deallocating network for instance {{(pid=72586) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 21:36:27 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] deallocate_for_instance() {{(pid=72586) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 21:36:27 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:36:27 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Took 0.51 seconds to deallocate network for instance.
Aug 01 21:36:27 user nova-compute[72586]: DEBUG nova.compute.manager [req-e7e6b237-faa7-4ad1-a56d-a39222706eb1 req-8be1c053-ab2e-4694-b641-a280ceed8f8b service nova] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Received event network-vif-deleted-fb56dcd2-b1ea-4992-a896-22f65127a96c {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:36:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-dfe5e412-bd65-4108-afb5-c97d7966a8f3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:36:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-dfe5e412-bd65-4108-afb5-c97d7966a8f3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:36:27 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-dfe5e412-bd65-4108-afb5-c97d7966a8f3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:36:27 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-dfe5e412-bd65-4108-afb5-c97d7966a8f3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:36:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-dfe5e412-bd65-4108-afb5-c97d7966a8f3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.294s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:36:27 user nova-compute[72586]: INFO nova.scheduler.client.report [None req-dfe5e412-bd65-4108-afb5-c97d7966a8f3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Deleted allocations for instance 042f0031-1e4d-41d0-8bfa-36001675cfe3
Aug 01 21:36:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-dfe5e412-bd65-4108-afb5-c97d7966a8f3 tempest-ServerRescueNegativeTestJSON-1258600061 tempest-ServerRescueNegativeTestJSON-1258600061-project-member] Lock "042f0031-1e4d-41d0-8bfa-36001675cfe3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.633s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:36:29 user nova-compute[72586]: DEBUG nova.compute.manager [req-a184c3ef-a26a-4b8b-9a07-7fd59dd460c5 req-680a004f-874a-48f0-a71b-67f22d4f3ec0 service nova] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Received event network-vif-plugged-fb56dcd2-b1ea-4992-a896-22f65127a96c {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:36:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-a184c3ef-a26a-4b8b-9a07-7fd59dd460c5 req-680a004f-874a-48f0-a71b-67f22d4f3ec0 service nova] Acquiring lock "042f0031-1e4d-41d0-8bfa-36001675cfe3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:36:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-a184c3ef-a26a-4b8b-9a07-7fd59dd460c5 req-680a004f-874a-48f0-a71b-67f22d4f3ec0 service nova] Lock "042f0031-1e4d-41d0-8bfa-36001675cfe3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:36:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-a184c3ef-a26a-4b8b-9a07-7fd59dd460c5 req-680a004f-874a-48f0-a71b-67f22d4f3ec0 service nova] Lock "042f0031-1e4d-41d0-8bfa-36001675cfe3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:36:29 user nova-compute[72586]: DEBUG nova.compute.manager [req-a184c3ef-a26a-4b8b-9a07-7fd59dd460c5 req-680a004f-874a-48f0-a71b-67f22d4f3ec0 service nova] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] No waiting events found dispatching network-vif-plugged-fb56dcd2-b1ea-4992-a896-22f65127a96c {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:36:29 user nova-compute[72586]: WARNING nova.compute.manager [req-a184c3ef-a26a-4b8b-9a07-7fd59dd460c5 req-680a004f-874a-48f0-a71b-67f22d4f3ec0 service nova] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Received unexpected event network-vif-plugged-fb56dcd2-b1ea-4992-a896-22f65127a96c for instance with vm_state deleted and task_state None.
Aug 01 21:36:29 user nova-compute[72586]: DEBUG nova.compute.manager [req-a184c3ef-a26a-4b8b-9a07-7fd59dd460c5 req-680a004f-874a-48f0-a71b-67f22d4f3ec0 service nova] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Received event network-changed-d70607b2-8e0c-4166-8218-ecbc976d0369 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:36:29 user nova-compute[72586]: DEBUG nova.compute.manager [req-a184c3ef-a26a-4b8b-9a07-7fd59dd460c5 req-680a004f-874a-48f0-a71b-67f22d4f3ec0 service nova] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Refreshing instance network info cache due to event network-changed-d70607b2-8e0c-4166-8218-ecbc976d0369. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:36:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-a184c3ef-a26a-4b8b-9a07-7fd59dd460c5 req-680a004f-874a-48f0-a71b-67f22d4f3ec0 service nova] Acquiring lock "refresh_cache-11ab466b-8caa-4a38-8350-213aa17ee75e" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:36:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-a184c3ef-a26a-4b8b-9a07-7fd59dd460c5 req-680a004f-874a-48f0-a71b-67f22d4f3ec0 service nova] Acquired lock "refresh_cache-11ab466b-8caa-4a38-8350-213aa17ee75e" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:36:29 user nova-compute[72586]: DEBUG nova.network.neutron [req-a184c3ef-a26a-4b8b-9a07-7fd59dd460c5 req-680a004f-874a-48f0-a71b-67f22d4f3ec0 service nova] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Refreshing network info cache for port d70607b2-8e0c-4166-8218-ecbc976d0369 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:36:29 user nova-compute[72586]: DEBUG nova.network.neutron [req-a184c3ef-a26a-4b8b-9a07-7fd59dd460c5 req-680a004f-874a-48f0-a71b-67f22d4f3ec0 service nova] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Updated VIF entry in instance network info cache for port d70607b2-8e0c-4166-8218-ecbc976d0369. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:36:29 user nova-compute[72586]: DEBUG nova.network.neutron [req-a184c3ef-a26a-4b8b-9a07-7fd59dd460c5 req-680a004f-874a-48f0-a71b-67f22d4f3ec0 service nova] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Updating instance_info_cache with network_info: [{"id": "d70607b2-8e0c-4166-8218-ecbc976d0369", "address": "fa:16:3e:76:af:74", "network": {"id": "63b6e8c7-fad0-44bf-a479-9baab6f0d1e3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2101151631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cbab7dfc55429c9b991bf1091a84c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd70607b2-8e", "ovs_interfaceid": "d70607b2-8e0c-4166-8218-ecbc976d0369", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:36:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-a184c3ef-a26a-4b8b-9a07-7fd59dd460c5 req-680a004f-874a-48f0-a71b-67f22d4f3ec0 service nova] Releasing lock "refresh_cache-11ab466b-8caa-4a38-8350-213aa17ee75e" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:36:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:36:29 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:36:31 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-08512c25-3920-463c-bc15-dc72ca797900 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Acquiring lock "11ab466b-8caa-4a38-8350-213aa17ee75e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:36:31 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-08512c25-3920-463c-bc15-dc72ca797900 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "11ab466b-8caa-4a38-8350-213aa17ee75e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:36:31 user nova-compute[72586]: DEBUG nova.objects.instance [None req-08512c25-3920-463c-bc15-dc72ca797900 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lazy-loading 'flavor' on Instance uuid 11ab466b-8caa-4a38-8350-213aa17ee75e {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:36:31 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-08512c25-3920-463c-bc15-dc72ca797900 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "11ab466b-8caa-4a38-8350-213aa17ee75e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:36:31 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:36:31 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:36:31 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:36:31 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72586) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 21:36:31 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-08512c25-3920-463c-bc15-dc72ca797900 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Acquiring lock "11ab466b-8caa-4a38-8350-213aa17ee75e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:36:31 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-08512c25-3920-463c-bc15-dc72ca797900 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "11ab466b-8caa-4a38-8350-213aa17ee75e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:36:31 user nova-compute[72586]: INFO nova.compute.manager [None req-08512c25-3920-463c-bc15-dc72ca797900 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Attaching volume 8cfe922d-8f30-47f4-9bba-6396ad979f5d to /dev/vdb
Aug 01 21:36:32 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:36:32 user nova-compute[72586]: DEBUG os_brick.utils [None req-08512c25-3920-463c-bc15-dc72ca797900 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:36:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:36:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:36:32 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1ee969-0692-483e-9947-da2e7f7773fa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4bc202fb9cb\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:36:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:36:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:36:32 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ace40e-f627-4376-b3bb-e77ed3759b0e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:36:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:36:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:36:32 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[14224061-63d4-4db5-8faf-ba7fc7a2464b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:36:32 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[245a4e60-7ce4-4f7c-b195-c55aaaa2a42a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:36:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-08512c25-3920-463c-bc15-dc72ca797900 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Running cmd (subprocess): nvme version {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:36:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-08512c25-3920-463c-bc15-dc72ca797900 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] 'nvme version' failed. Not Retrying. {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:36:32 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.nvmeof [None req-08512c25-3920-463c-bc15-dc72ca797900 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] nvme not present on system {{(pid=72586) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 21:36:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:36:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:36:32 user nova-compute[72586]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 21:36:32 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2ed33f-11ce-4d83-9ec4-670cb539b26d]: (4, '') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:36:32 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-08512c25-3920-463c-bc15-dc72ca797900 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72586) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 21:36:32 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-08512c25-3920-463c-bc15-dc72ca797900 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 21:36:32 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-08512c25-3920-463c-bc15-dc72ca797900 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] LIGHTOS: no hostnqn found. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 21:36:32 user nova-compute[72586]: DEBUG os_brick.utils [None req-08512c25-3920-463c-bc15-dc72ca797900 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4bc202fb9cb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:36:32 user nova-compute[72586]: DEBUG nova.virt.block_device [None req-08512c25-3920-463c-bc15-dc72ca797900 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Updating existing volume attachment record: 982d15cf-fde3-49ed-9a8c-9a9a8b215257 {{(pid=72586) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 21:36:32 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:36:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:36:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:36:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:36:32 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Auditing locally available compute resources for user (node: user) {{(pid=72586) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 21:36:33 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:36:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ab466b-8caa-4a38-8350-213aa17ee75e/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:36:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ab466b-8caa-4a38-8350-213aa17ee75e/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:36:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ab466b-8caa-4a38-8350-213aa17ee75e/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:36:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ab466b-8caa-4a38-8350-213aa17ee75e/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:36:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:36:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:36:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:36:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:36:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:36:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:36:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:36:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:36:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:36:34 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:36:34 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:36:34 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:36:34 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63625685-227f-48cc-9cc0-594633e0b8bb/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:36:34 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63625685-227f-48cc-9cc0-594633e0b8bb/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:36:34 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63625685-227f-48cc-9cc0-594633e0b8bb/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:36:34 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63625685-227f-48cc-9cc0-594633e0b8bb/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:36:34 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:36:34 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:36:34 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:36:34 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:36:34 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Hypervisor/Node resource view: name=user free_ram=7883MB free_disk=25.23373794555664GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72586) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 21:36:34 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:36:34 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:36:35 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 49c24c77-f102-4aed-8314-b04aad5f6b3a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:36:35 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance af2de810-b22f-4fa9-835c-c673abd145db actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:36:35 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 161fab9d-a7d1-4ea0-b4b9-2afc54040eef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:36:35 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:36:35 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 314f9b05-527c-459d-aca7-acc696ac613f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:36:35 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 11ab466b-8caa-4a38-8350-213aa17ee75e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:36:35 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 63625685-227f-48cc-9cc0-594633e0b8bb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:36:35 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 21:36:35 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 21:36:35 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:36:35 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:36:35 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Compute_service record updated for user:user {{(pid=72586) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 21:36:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.362s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:36:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:36:37 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:36:37 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Starting heal instance info cache {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 21:36:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "refresh_cache-49c24c77-f102-4aed-8314-b04aad5f6b3a" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:36:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquired lock "refresh_cache-49c24c77-f102-4aed-8314-b04aad5f6b3a" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:36:37 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Forcefully refreshing network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 21:36:37 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Updating instance_info_cache with network_info: [{"id": "99688c7a-3e71-49d8-9002-0075560858c9", "address": "fa:16:3e:8a:03:a7", "network": {"id": "aab9a541-2149-4c65-b60e-80a1daca6632", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1355256264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19af48ffce7e4703b6d978bc3563680e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99688c7a-3e", "ovs_interfaceid": "99688c7a-3e71-49d8-9002-0075560858c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:36:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Releasing lock "refresh_cache-49c24c77-f102-4aed-8314-b04aad5f6b3a" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:36:37 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Updated the network info_cache for instance {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 21:36:37 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:36:38 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:36:39 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08512c25-3920-463c-bc15-dc72ca797900 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Calling os-brick to attach iSCSI Volume {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 21:36:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-08512c25-3920-463c-bc15-dc72ca797900 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XhuyFReN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:36:39 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-08512c25-3920-463c-bc15-dc72ca797900 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:36:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-08512c25-3920-463c-bc15-dc72ca797900 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:36:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-08512c25-3920-463c-bc15-dc72ca797900 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:36:39 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-08512c25-3920-463c-bc15-dc72ca797900 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:36:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-08512c25-3920-463c-bc15-dc72ca797900 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:36:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-08512c25-3920-463c-bc15-dc72ca797900 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:36:39 user nova-compute[72586]: INFO os_brick.initiator.connectors.iscsi [None req-08512c25-3920-463c-bc15-dc72ca797900 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 21:36:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d -p 172.16.0.220:3260 {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:36:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:36:39 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[5858128b-e658-4584-b8ca-a1a881308b0e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:36:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-08512c25-3920-463c-bc15-dc72ca797900 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 21:36:39 user nova-compute[72586]:  {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:36:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d -p 172.16.0.220:3260 --interface default --op new {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:36:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:36:39 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[308474ae-dd4e-4015-8406-32f74304e20e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d] added\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:36:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-08512c25-3920-463c-bc15-dc72ca797900 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d] added
Aug 01 21:36:39 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:36:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:36:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:36:39 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[364ad510-439c-4388-bbd8-135d50eafe18]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:36:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-08512c25-3920-463c-bc15-dc72ca797900 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:36:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:36:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:36:39 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9e235a-726f-4b9c-bc84-97817c26e220]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:36:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-08512c25-3920-463c-bc15-dc72ca797900 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:36:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XhuyFReN {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:36:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XhuyFReN" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:36:39 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a9b74a-6b07-4ded-9ce5-c7f5c310616d]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:36:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-08512c25-3920-463c-bc15-dc72ca797900 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XhuyFReN'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:36:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:36:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:36:39 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3e1346-cd3b-4d65-9e42-a0c262922168]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:36:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-08512c25-3920-463c-bc15-dc72ca797900 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:36:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:36:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:36:39 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ecd83be-4db1-44f3-a848-d92ee9fb3da1]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:36:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-08512c25-3920-463c-bc15-dc72ca797900 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:36:39 user nova-compute[72586]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 (non-flash)
Aug 01 21:36:39 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:36:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-08512c25-3920-463c-bc15-dc72ca797900 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:36:39 user nova-compute[72586]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 (non-flash)
Aug 01 21:36:39 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:36:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d -p 172.16.0.220:3260 --login {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:36:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:36:39 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e9e317-a91b-4fe2-a7ff-cd04ede8a491]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:36:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-08512c25-3920-463c-bc15-dc72ca797900 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d, portal: 172.16.0.220,3260]
Aug 01 21:36:39 user nova-compute[72586]: Login to [iface: default, target: iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d, portal: 172.16.0.220,3260] successful.
Aug 01 21:36:39 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:36:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:36:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:36:39 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d078ca-ffa1-4ccc-b4c0-a5389d23030d]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:36:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-08512c25-3920-463c-bc15-dc72ca797900 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:36:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:36:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:36:39 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b0e9d9-1027-4481-941e-d344310088b2]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:36:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-08512c25-3920-463c-bc15-dc72ca797900 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:36:39 user nova-compute[72586]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 (non-flash)
Aug 01 21:36:39 user nova-compute[72586]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d (non-flash)
Aug 01 21:36:39 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:36:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-08512c25-3920-463c-bc15-dc72ca797900 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:36:39 user nova-compute[72586]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 (non-flash)
Aug 01 21:36:39 user nova-compute[72586]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d (non-flash)
Aug 01 21:36:39 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:36:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-08512c25-3920-463c-bc15-dc72ca797900 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:36:39 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-08512c25-3920-463c-bc15-dc72ca797900 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Connected to 172.16.0.220:3260 {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 21:36:39 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-08512c25-3920-463c-bc15-dc72ca797900 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] HCTL ('34', '-', '-', 0) found on session 40 with lun 0 {{(pid=72586) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 21:36:39 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-08512c25-3920-463c-bc15-dc72ca797900 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72586) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 21:36:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:36:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:36:39 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d52dcb-9015-48e9-96ea-6536b7ea8c0a]: (4, ('- - 0', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:36:39 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-08512c25-3920-463c-bc15-dc72ca797900 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: None {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:36:40 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-08512c25-3920-463c-bc15-dc72ca797900 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:36:40 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-08512c25-3920-463c-bc15-dc72ca797900 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XhuyFReN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 21:36:40 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-08512c25-3920-463c-bc15-dc72ca797900 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:36:40 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-08512c25-3920-463c-bc15-dc72ca797900 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '26336613038363263', 'path': '/dev/sdc'} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:36:40 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08512c25-3920-463c-bc15-dc72ca797900 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26336613038363263', 'path': '/dev/sdc'} {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 21:36:40 user nova-compute[72586]: DEBUG nova.objects.instance [None req-08512c25-3920-463c-bc15-dc72ca797900 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lazy-loading 'flavor' on Instance uuid 11ab466b-8caa-4a38-8350-213aa17ee75e {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:36:40 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-08512c25-3920-463c-bc15-dc72ca797900 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 21:36:40 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:36:40 user nova-compute[72586]:   <source dev="/dev/sdc"/>
Aug 01 21:36:40 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:36:40 user nova-compute[72586]:   <serial>8cfe922d-8f30-47f4-9bba-6396ad979f5d</serial>
Aug 01 21:36:40 user nova-compute[72586]: </disk>
Aug 01 21:36:40 user nova-compute[72586]:  {{(pid=72586) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 21:36:41 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-08512c25-3920-463c-bc15-dc72ca797900 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:36:41 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-08512c25-3920-463c-bc15-dc72ca797900 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:36:41 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-08512c25-3920-463c-bc15-dc72ca797900 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] No VIF found with MAC fa:16:3e:76:af:74, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:36:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-08512c25-3920-463c-bc15-dc72ca797900 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "11ab466b-8caa-4a38-8350-213aa17ee75e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.367s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:36:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-04839a33-6584-4a10-95bf-108e2100346c tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Acquiring lock "11ab466b-8caa-4a38-8350-213aa17ee75e" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:36:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-04839a33-6584-4a10-95bf-108e2100346c tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "11ab466b-8caa-4a38-8350-213aa17ee75e" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:36:41 user nova-compute[72586]: DEBUG nova.compute.manager [None req-04839a33-6584-4a10-95bf-108e2100346c tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:36:41 user nova-compute[72586]: DEBUG nova.compute.manager [None req-04839a33-6584-4a10-95bf-108e2100346c tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72586) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 01 21:36:41 user nova-compute[72586]: DEBUG nova.objects.instance [None req-04839a33-6584-4a10-95bf-108e2100346c tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lazy-loading 'flavor' on Instance uuid 11ab466b-8caa-4a38-8350-213aa17ee75e {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:36:41 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:36:41 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:36:41 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:36:41 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:36:41 user nova-compute[72586]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690925786.9908874, 042f0031-1e4d-41d0-8bfa-36001675cfe3 => Stopped> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:36:41 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] VM Stopped (Lifecycle Event)
Aug 01 21:36:42 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:36:42 user nova-compute[72586]: DEBUG nova.compute.manager [req-92cb64e8-d7cc-474c-8186-1f4ba29eca5d req-aaf5dc99-31a9-46cd-92e8-b9c6cd30ca28 service nova] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Received event network-vif-unplugged-d70607b2-8e0c-4166-8218-ecbc976d0369 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:36:42 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-92cb64e8-d7cc-474c-8186-1f4ba29eca5d req-aaf5dc99-31a9-46cd-92e8-b9c6cd30ca28 service nova] Acquiring lock "11ab466b-8caa-4a38-8350-213aa17ee75e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:36:42 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-92cb64e8-d7cc-474c-8186-1f4ba29eca5d req-aaf5dc99-31a9-46cd-92e8-b9c6cd30ca28 service nova] Lock "11ab466b-8caa-4a38-8350-213aa17ee75e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:36:42 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-92cb64e8-d7cc-474c-8186-1f4ba29eca5d req-aaf5dc99-31a9-46cd-92e8-b9c6cd30ca28 service nova] Lock "11ab466b-8caa-4a38-8350-213aa17ee75e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:36:42 user nova-compute[72586]: DEBUG nova.compute.manager [req-92cb64e8-d7cc-474c-8186-1f4ba29eca5d req-aaf5dc99-31a9-46cd-92e8-b9c6cd30ca28 service nova] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] No waiting events found dispatching network-vif-unplugged-d70607b2-8e0c-4166-8218-ecbc976d0369 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:36:42 user nova-compute[72586]: WARNING nova.compute.manager [req-92cb64e8-d7cc-474c-8186-1f4ba29eca5d req-aaf5dc99-31a9-46cd-92e8-b9c6cd30ca28 service nova] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Received unexpected event network-vif-unplugged-d70607b2-8e0c-4166-8218-ecbc976d0369 for instance with vm_state active and task_state powering-off.
Aug 01 21:36:42 user nova-compute[72586]: DEBUG nova.compute.manager [None req-c3b6e968-43f6-4c6f-a917-5a990e2741cc None None] [instance: 042f0031-1e4d-41d0-8bfa-36001675cfe3] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:36:42 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:36:42 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Instance destroyed successfully.
Aug 01 21:36:42 user nova-compute[72586]: DEBUG nova.compute.manager [None req-04839a33-6584-4a10-95bf-108e2100346c tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:36:42 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-04839a33-6584-4a10-95bf-108e2100346c tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "11ab466b-8caa-4a38-8350-213aa17ee75e" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.842s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:36:44 user nova-compute[72586]: DEBUG nova.compute.manager [req-6565b88c-4f8c-480a-9c36-78d7feb2510b req-bf31fcf0-ea30-4713-9e3f-61493cd22615 service nova] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Received event network-vif-plugged-d70607b2-8e0c-4166-8218-ecbc976d0369 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:36:44 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-6565b88c-4f8c-480a-9c36-78d7feb2510b req-bf31fcf0-ea30-4713-9e3f-61493cd22615 service nova] Acquiring lock "11ab466b-8caa-4a38-8350-213aa17ee75e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:36:44 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-6565b88c-4f8c-480a-9c36-78d7feb2510b req-bf31fcf0-ea30-4713-9e3f-61493cd22615 service nova] Lock "11ab466b-8caa-4a38-8350-213aa17ee75e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:36:44 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-6565b88c-4f8c-480a-9c36-78d7feb2510b req-bf31fcf0-ea30-4713-9e3f-61493cd22615 service nova] Lock "11ab466b-8caa-4a38-8350-213aa17ee75e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:36:44 user nova-compute[72586]: DEBUG nova.compute.manager [req-6565b88c-4f8c-480a-9c36-78d7feb2510b req-bf31fcf0-ea30-4713-9e3f-61493cd22615 service nova] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] No waiting events found dispatching network-vif-plugged-d70607b2-8e0c-4166-8218-ecbc976d0369 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:36:44 user nova-compute[72586]: WARNING nova.compute.manager [req-6565b88c-4f8c-480a-9c36-78d7feb2510b req-bf31fcf0-ea30-4713-9e3f-61493cd22615 service nova] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Received unexpected event network-vif-plugged-d70607b2-8e0c-4166-8218-ecbc976d0369 for instance with vm_state stopped and task_state None.
Aug 01 21:36:44 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:36:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:36:52 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:36:57 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:36:57 user nova-compute[72586]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690925802.4965281, 11ab466b-8caa-4a38-8350-213aa17ee75e => Stopped> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:36:57 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] VM Stopped (Lifecycle Event)
Aug 01 21:36:57 user nova-compute[72586]: DEBUG nova.compute.manager [None req-8f0271b1-90a5-4394-a78e-8e85b280e95d None None] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:36:57 user nova-compute[72586]: DEBUG nova.compute.manager [None req-8f0271b1-90a5-4394-a78e-8e85b280e95d None None] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:36:59 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:37:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-6580cb36-3dc5-4ca3-a869-e1fb5ed9b017 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Acquiring lock "0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:37:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-6580cb36-3dc5-4ca3-a869-e1fb5ed9b017 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:37:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-6580cb36-3dc5-4ca3-a869-e1fb5ed9b017 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Acquiring lock "0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:37:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-6580cb36-3dc5-4ca3-a869-e1fb5ed9b017 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:37:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-6580cb36-3dc5-4ca3-a869-e1fb5ed9b017 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:37:00 user nova-compute[72586]: INFO nova.compute.manager [None req-6580cb36-3dc5-4ca3-a869-e1fb5ed9b017 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Terminating instance
Aug 01 21:37:00 user nova-compute[72586]: DEBUG nova.compute.manager [None req-6580cb36-3dc5-4ca3-a869-e1fb5ed9b017 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Start destroying the instance on the hypervisor. {{(pid=72586) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 21:37:00 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:37:00 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:37:00 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:37:00 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:37:00 user nova-compute[72586]: DEBUG nova.compute.manager [req-b1937e15-af03-48bd-927f-20843b9f4d20 req-77f1b4c2-4cec-4d4c-a488-8a0a77a90372 service nova] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Received event network-vif-unplugged-5b244939-e725-4cc8-8407-a7dd0bbc7ec4 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:37:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-b1937e15-af03-48bd-927f-20843b9f4d20 req-77f1b4c2-4cec-4d4c-a488-8a0a77a90372 service nova] Acquiring lock "0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:37:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-b1937e15-af03-48bd-927f-20843b9f4d20 req-77f1b4c2-4cec-4d4c-a488-8a0a77a90372 service nova] Lock "0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:37:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-b1937e15-af03-48bd-927f-20843b9f4d20 req-77f1b4c2-4cec-4d4c-a488-8a0a77a90372 service nova] Lock "0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:37:00 user nova-compute[72586]: DEBUG nova.compute.manager [req-b1937e15-af03-48bd-927f-20843b9f4d20 req-77f1b4c2-4cec-4d4c-a488-8a0a77a90372 service nova] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] No waiting events found dispatching network-vif-unplugged-5b244939-e725-4cc8-8407-a7dd0bbc7ec4 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:37:00 user nova-compute[72586]: DEBUG nova.compute.manager [req-b1937e15-af03-48bd-927f-20843b9f4d20 req-77f1b4c2-4cec-4d4c-a488-8a0a77a90372 service nova] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Received event network-vif-unplugged-5b244939-e725-4cc8-8407-a7dd0bbc7ec4 for instance with task_state deleting. {{(pid=72586) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 21:37:00 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Instance destroyed successfully.
Aug 01 21:37:00 user nova-compute[72586]: DEBUG nova.objects.instance [None req-6580cb36-3dc5-4ca3-a869-e1fb5ed9b017 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lazy-loading 'resources' on Instance uuid 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:37:00 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-6580cb36-3dc5-4ca3-a869-e1fb5ed9b017 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:31:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-486932535',display_name='tempest-TestMinimumBasicScenario-server-486932535',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-486932535',id=28,image_ref='7666a25e-0535-48eb-95b3-7909d90f3507',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLujS2qMrbfTLmfjrvCC34ccfhBDvh7Itzo7X58DZeJvTyAF9F25vXUHTGj+pY1BDjgMf45Ki5YpDsHtKHkbdasD+FbKu3GDFuEEYGHTNp7IfnciNn/M3BAitR1uYoYOOA==',key_name='tempest-TestMinimumBasicScenario-2086993178',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:31:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f7ae5f1c56b348de8a03f1a4bcdd9b5c',ramdisk_id='',reservation_id='r-m440bki2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7666a25e-0535-48eb-95b3-7909d90f3507',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1119751084',owner_user_name='tempest-TestMinimumBasicScenario-1119751084-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:34:20Z,user_data=None,user_id='fed345b7cf8f44bfa83d45d408a18c4a',uuid=0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b244939-e725-4cc8-8407-a7dd0bbc7ec4", "address": "fa:16:3e:cc:46:65", "network": {"id": "56c3419f-2c2c-4dda-88d7-ba96e2a689fd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-705071098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ae5f1c56b348de8a03f1a4bcdd9b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b244939-e7", "ovs_interfaceid": "5b244939-e725-4cc8-8407-a7dd0bbc7ec4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:37:00 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-6580cb36-3dc5-4ca3-a869-e1fb5ed9b017 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Converting VIF {"id": "5b244939-e725-4cc8-8407-a7dd0bbc7ec4", "address": "fa:16:3e:cc:46:65", "network": {"id": "56c3419f-2c2c-4dda-88d7-ba96e2a689fd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-705071098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ae5f1c56b348de8a03f1a4bcdd9b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b244939-e7", "ovs_interfaceid": "5b244939-e725-4cc8-8407-a7dd0bbc7ec4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:37:00 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-6580cb36-3dc5-4ca3-a869-e1fb5ed9b017 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:46:65,bridge_name='br-int',has_traffic_filtering=True,id=5b244939-e725-4cc8-8407-a7dd0bbc7ec4,network=Network(56c3419f-2c2c-4dda-88d7-ba96e2a689fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b244939-e7') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:37:00 user nova-compute[72586]: DEBUG os_vif [None req-6580cb36-3dc5-4ca3-a869-e1fb5ed9b017 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:46:65,bridge_name='br-int',has_traffic_filtering=True,id=5b244939-e725-4cc8-8407-a7dd0bbc7ec4,network=Network(56c3419f-2c2c-4dda-88d7-ba96e2a689fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b244939-e7') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:37:00 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:37:00 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b244939-e7, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:37:00 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:37:00 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:37:00 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:37:00 user nova-compute[72586]: INFO os_vif [None req-6580cb36-3dc5-4ca3-a869-e1fb5ed9b017 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:46:65,bridge_name='br-int',has_traffic_filtering=True,id=5b244939-e725-4cc8-8407-a7dd0bbc7ec4,network=Network(56c3419f-2c2c-4dda-88d7-ba96e2a689fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b244939-e7')
Aug 01 21:37:00 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-6580cb36-3dc5-4ca3-a869-e1fb5ed9b017 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Deleting instance files /opt/stack/data/nova/instances/0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f_del
Aug 01 21:37:00 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-6580cb36-3dc5-4ca3-a869-e1fb5ed9b017 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Deletion of /opt/stack/data/nova/instances/0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f_del complete
Aug 01 21:37:01 user nova-compute[72586]: INFO nova.compute.manager [None req-6580cb36-3dc5-4ca3-a869-e1fb5ed9b017 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 01 21:37:01 user nova-compute[72586]: DEBUG oslo.service.loopingcall [None req-6580cb36-3dc5-4ca3-a869-e1fb5ed9b017 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72586) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 21:37:01 user nova-compute[72586]: DEBUG nova.compute.manager [-] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Deallocating network for instance {{(pid=72586) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 21:37:01 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] deallocate_for_instance() {{(pid=72586) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 21:37:02 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:37:02 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Took 1.04 seconds to deallocate network for instance.
Aug 01 21:37:02 user nova-compute[72586]: DEBUG nova.compute.manager [req-530228d6-9cad-4bb8-bf5d-2a4433e7db4b req-02f94bdf-9b5f-4f8d-a727-6b638faef7d3 service nova] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Received event network-vif-deleted-5b244939-e725-4cc8-8407-a7dd0bbc7ec4 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:37:02 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-6580cb36-3dc5-4ca3-a869-e1fb5ed9b017 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:37:02 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-6580cb36-3dc5-4ca3-a869-e1fb5ed9b017 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:37:02 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-6580cb36-3dc5-4ca3-a869-e1fb5ed9b017 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:37:02 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-6580cb36-3dc5-4ca3-a869-e1fb5ed9b017 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:37:02 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-6580cb36-3dc5-4ca3-a869-e1fb5ed9b017 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.322s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:37:02 user nova-compute[72586]: INFO nova.scheduler.client.report [None req-6580cb36-3dc5-4ca3-a869-e1fb5ed9b017 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Deleted allocations for instance 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f
Aug 01 21:37:02 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-6580cb36-3dc5-4ca3-a869-e1fb5ed9b017 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.447s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:37:02 user nova-compute[72586]: DEBUG nova.compute.manager [req-612e0723-5add-48f9-8c04-7e61d9bf07d7 req-dafbce98-6f26-4ede-83c9-42566c81b10f service nova] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Received event network-vif-plugged-5b244939-e725-4cc8-8407-a7dd0bbc7ec4 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:37:02 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-612e0723-5add-48f9-8c04-7e61d9bf07d7 req-dafbce98-6f26-4ede-83c9-42566c81b10f service nova] Acquiring lock "0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:37:02 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-612e0723-5add-48f9-8c04-7e61d9bf07d7 req-dafbce98-6f26-4ede-83c9-42566c81b10f service nova] Lock "0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:37:02 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-612e0723-5add-48f9-8c04-7e61d9bf07d7 req-dafbce98-6f26-4ede-83c9-42566c81b10f service nova] Lock "0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:37:02 user nova-compute[72586]: DEBUG nova.compute.manager [req-612e0723-5add-48f9-8c04-7e61d9bf07d7 req-dafbce98-6f26-4ede-83c9-42566c81b10f service nova] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] No waiting events found dispatching network-vif-plugged-5b244939-e725-4cc8-8407-a7dd0bbc7ec4 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:37:02 user nova-compute[72586]: WARNING nova.compute.manager [req-612e0723-5add-48f9-8c04-7e61d9bf07d7 req-dafbce98-6f26-4ede-83c9-42566c81b10f service nova] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Received unexpected event network-vif-plugged-5b244939-e725-4cc8-8407-a7dd0bbc7ec4 for instance with vm_state deleted and task_state None.
Aug 01 21:37:05 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:37:10 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:37:15 user nova-compute[72586]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690925820.952656, 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f => Stopped> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:37:15 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] VM Stopped (Lifecycle Event)
Aug 01 21:37:15 user nova-compute[72586]: DEBUG nova.compute.manager [None req-b324e600-4d74-4072-8d1b-c67e863d610e None None] [instance: 0363f43a-5ce9-4fc2-b47d-32ec1ec51e0f] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:37:15 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:37:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:37:20 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:37:25 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:37:25 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:37:27 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:37:28 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:37:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:37:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Acquiring lock "8ee464b0-f75e-4f30-9838-74bca9619a07" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:37:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Lock "8ee464b0-f75e-4f30-9838-74bca9619a07" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:37:29 user nova-compute[72586]: DEBUG nova.compute.manager [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] Starting instance... {{(pid=72586) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 21:37:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:37:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:37:29 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72586) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 21:37:29 user nova-compute[72586]: INFO nova.compute.claims [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] Claim successful on node user
Aug 01 21:37:30 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:37:30 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:37:30 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.357s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:37:30 user nova-compute[72586]: DEBUG nova.compute.manager [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] Start building networks asynchronously for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 21:37:30 user nova-compute[72586]: DEBUG nova.compute.manager [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] Allocating IP information in the background. {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 21:37:30 user nova-compute[72586]: DEBUG nova.network.neutron [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] allocate_for_instance() {{(pid=72586) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 21:37:30 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 21:37:30 user nova-compute[72586]: DEBUG nova.compute.manager [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] Start building block device mappings for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 21:37:30 user nova-compute[72586]: DEBUG nova.policy [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '49d631f793a54e4cbf086cbf89696834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2896d39f80af4e07869d3b1acfba1d8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72586) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 21:37:30 user nova-compute[72586]: DEBUG nova.compute.manager [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] Start spawning the instance on the hypervisor. {{(pid=72586) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 21:37:30 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] Creating instance directory {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 21:37:30 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] Creating image(s)
Aug 01 21:37:30 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Acquiring lock "/opt/stack/data/nova/instances/8ee464b0-f75e-4f30-9838-74bca9619a07/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:37:30 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Lock "/opt/stack/data/nova/instances/8ee464b0-f75e-4f30-9838-74bca9619a07/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:37:30 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Lock "/opt/stack/data/nova/instances/8ee464b0-f75e-4f30-9838-74bca9619a07/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:37:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:37:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.162s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:37:30 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Acquiring lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:37:30 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:37:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:37:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.184s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:37:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/8ee464b0-f75e-4f30-9838-74bca9619a07/disk 1073741824 {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:37:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/8ee464b0-f75e-4f30-9838-74bca9619a07/disk 1073741824" returned: 0 in 0.072s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:37:30 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:37:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:37:30 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:37:31 user nova-compute[72586]: DEBUG nova.network.neutron [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] Successfully created port: 37f8d809-78f6-45fa-a4e8-db8e816f6f6e {{(pid=72586) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 21:37:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.169s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:37:31 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8ee464b0-f75e-4f30-9838-74bca9619a07/disk. size=1073741824 {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 21:37:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee464b0-f75e-4f30-9838-74bca9619a07/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:37:31 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee464b0-f75e-4f30-9838-74bca9619a07/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:37:31 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Cannot resize image /opt/stack/data/nova/instances/8ee464b0-f75e-4f30-9838-74bca9619a07/disk to a smaller size. {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 21:37:31 user nova-compute[72586]: DEBUG nova.objects.instance [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Lazy-loading 'migration_context' on Instance uuid 8ee464b0-f75e-4f30-9838-74bca9619a07 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:37:31 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] Created local disks {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 21:37:31 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] Ensure instance console log exists: /opt/stack/data/nova/instances/8ee464b0-f75e-4f30-9838-74bca9619a07/console.log {{(pid=72586) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 21:37:31 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:37:31 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:37:31 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:37:31 user nova-compute[72586]: DEBUG nova.network.neutron [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] Successfully updated port: 37f8d809-78f6-45fa-a4e8-db8e816f6f6e {{(pid=72586) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 21:37:31 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Acquiring lock "refresh_cache-8ee464b0-f75e-4f30-9838-74bca9619a07" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:37:31 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Acquired lock "refresh_cache-8ee464b0-f75e-4f30-9838-74bca9619a07" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:37:31 user nova-compute[72586]: DEBUG nova.network.neutron [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:37:31 user nova-compute[72586]: DEBUG nova.compute.manager [req-1f72534d-133a-46d9-b923-6577c2c5ebd9 req-9c4193e9-8b76-411f-a346-1d3f8b6ec6f2 service nova] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] Received event network-changed-37f8d809-78f6-45fa-a4e8-db8e816f6f6e {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:37:31 user nova-compute[72586]: DEBUG nova.compute.manager [req-1f72534d-133a-46d9-b923-6577c2c5ebd9 req-9c4193e9-8b76-411f-a346-1d3f8b6ec6f2 service nova] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] Refreshing instance network info cache due to event network-changed-37f8d809-78f6-45fa-a4e8-db8e816f6f6e. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:37:31 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-1f72534d-133a-46d9-b923-6577c2c5ebd9 req-9c4193e9-8b76-411f-a346-1d3f8b6ec6f2 service nova] Acquiring lock "refresh_cache-8ee464b0-f75e-4f30-9838-74bca9619a07" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:37:31 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:37:31 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:37:31 user nova-compute[72586]: DEBUG nova.network.neutron [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] Instance cache missing network info. {{(pid=72586) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 21:37:32 user nova-compute[72586]: DEBUG nova.network.neutron [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] Updating instance_info_cache with network_info: [{"id": "37f8d809-78f6-45fa-a4e8-db8e816f6f6e", "address": "fa:16:3e:96:29:2e", "network": {"id": "e687eacc-3080-46db-b577-5efb36856dce", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1089459024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2896d39f80af4e07869d3b1acfba1d8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f8d809-78", "ovs_interfaceid": "37f8d809-78f6-45fa-a4e8-db8e816f6f6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:37:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Releasing lock "refresh_cache-8ee464b0-f75e-4f30-9838-74bca9619a07" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:37:32 user nova-compute[72586]: DEBUG nova.compute.manager [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] Instance network_info: |[{"id": "37f8d809-78f6-45fa-a4e8-db8e816f6f6e", "address": "fa:16:3e:96:29:2e", "network": {"id": "e687eacc-3080-46db-b577-5efb36856dce", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1089459024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2896d39f80af4e07869d3b1acfba1d8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f8d809-78", "ovs_interfaceid": "37f8d809-78f6-45fa-a4e8-db8e816f6f6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 21:37:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-1f72534d-133a-46d9-b923-6577c2c5ebd9 req-9c4193e9-8b76-411f-a346-1d3f8b6ec6f2 service nova] Acquired lock "refresh_cache-8ee464b0-f75e-4f30-9838-74bca9619a07" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:37:32 user nova-compute[72586]: DEBUG nova.network.neutron [req-1f72534d-133a-46d9-b923-6577c2c5ebd9 req-9c4193e9-8b76-411f-a346-1d3f8b6ec6f2 service nova] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] Refreshing network info cache for port 37f8d809-78f6-45fa-a4e8-db8e816f6f6e {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:37:32 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] Start _get_guest_xml network_info=[{"id": "37f8d809-78f6-45fa-a4e8-db8e816f6f6e", "address": "fa:16:3e:96:29:2e", "network": {"id": "e687eacc-3080-46db-b577-5efb36856dce", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1089459024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2896d39f80af4e07869d3b1acfba1d8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f8d809-78", "ovs_interfaceid": "37f8d809-78f6-45fa-a4e8-db8e816f6f6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '0243d46b-6819-42a5-926f-42b71f0c97ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:37:32 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:37:32 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:37:32 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:37:32 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:37:32 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:37:32 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:37:32 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:37:32 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:37:32 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:37:32 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:37:32 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:37:32 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:37:32 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:37:32 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:37:32 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:37:32 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:37:32 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:37:32 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:37:32 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:37:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-212400468',display_name='tempest-ServersNegativeTestJSON-server-212400468',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-212400468',id=33,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2896d39f80af4e07869d3b1acfba1d8b',ramdisk_id='',reservation_id='r-zuyfio31',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2014666022',owner_user_name='tempest-ServersNegativeTestJSON-2014666022-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:37:30Z,user_data=None,user_id='49d631f793a54e4cbf086cbf89696834',uuid=8ee464b0-f75e-4f30-9838-74bca9619a07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37f8d809-78f6-45fa-a4e8-db8e816f6f6e", "address": "fa:16:3e:96:29:2e", "network": {"id": "e687eacc-3080-46db-b577-5efb36856dce", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1089459024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2896d39f80af4e07869d3b1acfba1d8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f8d809-78", "ovs_interfaceid": "37f8d809-78f6-45fa-a4e8-db8e816f6f6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:37:32 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Converting VIF {"id": "37f8d809-78f6-45fa-a4e8-db8e816f6f6e", "address": "fa:16:3e:96:29:2e", "network": {"id": "e687eacc-3080-46db-b577-5efb36856dce", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1089459024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2896d39f80af4e07869d3b1acfba1d8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f8d809-78", "ovs_interfaceid": "37f8d809-78f6-45fa-a4e8-db8e816f6f6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:37:32 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:29:2e,bridge_name='br-int',has_traffic_filtering=True,id=37f8d809-78f6-45fa-a4e8-db8e816f6f6e,network=Network(e687eacc-3080-46db-b577-5efb36856dce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37f8d809-78') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:37:32 user nova-compute[72586]: DEBUG nova.objects.instance [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Lazy-loading 'pci_devices' on Instance uuid 8ee464b0-f75e-4f30-9838-74bca9619a07 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:37:32 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:37:32 user nova-compute[72586]:   <uuid>8ee464b0-f75e-4f30-9838-74bca9619a07</uuid>
Aug 01 21:37:32 user nova-compute[72586]:   <name>instance-00000021</name>
Aug 01 21:37:32 user nova-compute[72586]:   <memory>524288</memory>
Aug 01 21:37:32 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:37:32 user nova-compute[72586]:   <metadata>
Aug 01 21:37:32 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:37:32 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:37:32 user nova-compute[72586]:       <nova:name>tempest-ServersNegativeTestJSON-server-212400468</nova:name>
Aug 01 21:37:32 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:37:32</nova:creationTime>
Aug 01 21:37:32 user nova-compute[72586]:       <nova:flavor name="m1.tiny">
Aug 01 21:37:32 user nova-compute[72586]:         <nova:memory>512</nova:memory>
Aug 01 21:37:32 user nova-compute[72586]:         <nova:disk>1</nova:disk>
Aug 01 21:37:32 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:37:32 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:37:32 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:37:32 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:37:32 user nova-compute[72586]:       <nova:owner>
Aug 01 21:37:32 user nova-compute[72586]:         <nova:user uuid="49d631f793a54e4cbf086cbf89696834">tempest-ServersNegativeTestJSON-2014666022-project-member</nova:user>
Aug 01 21:37:32 user nova-compute[72586]:         <nova:project uuid="2896d39f80af4e07869d3b1acfba1d8b">tempest-ServersNegativeTestJSON-2014666022</nova:project>
Aug 01 21:37:32 user nova-compute[72586]:       </nova:owner>
Aug 01 21:37:32 user nova-compute[72586]:       <nova:root type="image" uuid="0243d46b-6819-42a5-926f-42b71f0c97ad"/>
Aug 01 21:37:32 user nova-compute[72586]:       <nova:ports>
Aug 01 21:37:32 user nova-compute[72586]:         <nova:port uuid="37f8d809-78f6-45fa-a4e8-db8e816f6f6e">
Aug 01 21:37:32 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 01 21:37:32 user nova-compute[72586]:         </nova:port>
Aug 01 21:37:32 user nova-compute[72586]:       </nova:ports>
Aug 01 21:37:32 user nova-compute[72586]:     </nova:instance>
Aug 01 21:37:32 user nova-compute[72586]:   </metadata>
Aug 01 21:37:32 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:37:32 user nova-compute[72586]:     <system>
Aug 01 21:37:32 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:37:32 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:37:32 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:37:32 user nova-compute[72586]:       <entry name="serial">8ee464b0-f75e-4f30-9838-74bca9619a07</entry>
Aug 01 21:37:32 user nova-compute[72586]:       <entry name="uuid">8ee464b0-f75e-4f30-9838-74bca9619a07</entry>
Aug 01 21:37:32 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:37:32 user nova-compute[72586]:     </system>
Aug 01 21:37:32 user nova-compute[72586]:   </sysinfo>
Aug 01 21:37:32 user nova-compute[72586]:   <os>
Aug 01 21:37:32 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:37:32 user nova-compute[72586]:     <boot dev="hd"/>
Aug 01 21:37:32 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:37:32 user nova-compute[72586]:   </os>
Aug 01 21:37:32 user nova-compute[72586]:   <features>
Aug 01 21:37:32 user nova-compute[72586]:     <acpi/>
Aug 01 21:37:32 user nova-compute[72586]:     <apic/>
Aug 01 21:37:32 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:37:32 user nova-compute[72586]:   </features>
Aug 01 21:37:32 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:37:32 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:37:32 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:37:32 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:37:32 user nova-compute[72586]:   </clock>
Aug 01 21:37:32 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:37:32 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:37:32 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:37:32 user nova-compute[72586]:   </cpu>
Aug 01 21:37:32 user nova-compute[72586]:   <devices>
Aug 01 21:37:32 user nova-compute[72586]:     <disk type="file" device="disk">
Aug 01 21:37:32 user nova-compute[72586]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 21:37:32 user nova-compute[72586]:       <source file="/opt/stack/data/nova/instances/8ee464b0-f75e-4f30-9838-74bca9619a07/disk"/>
Aug 01 21:37:32 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:37:32 user nova-compute[72586]:     </disk>
Aug 01 21:37:32 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:37:32 user nova-compute[72586]:       <mac address="fa:16:3e:96:29:2e"/>
Aug 01 21:37:32 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:37:32 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:37:32 user nova-compute[72586]:       <target dev="tap37f8d809-78"/>
Aug 01 21:37:32 user nova-compute[72586]:     </interface>
Aug 01 21:37:32 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:37:32 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/8ee464b0-f75e-4f30-9838-74bca9619a07/console.log" append="off"/>
Aug 01 21:37:32 user nova-compute[72586]:     </serial>
Aug 01 21:37:32 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:37:32 user nova-compute[72586]:     <video>
Aug 01 21:37:32 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:37:32 user nova-compute[72586]:     </video>
Aug 01 21:37:32 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:37:32 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:37:32 user nova-compute[72586]:     </rng>
Aug 01 21:37:32 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:37:32 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:37:32 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:37:32 user nova-compute[72586]:     </memballoon>
Aug 01 21:37:32 user nova-compute[72586]:   </devices>
Aug 01 21:37:32 user nova-compute[72586]: </domain>
Aug 01 21:37:32 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:37:32 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:37:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-212400468',display_name='tempest-ServersNegativeTestJSON-server-212400468',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-212400468',id=33,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2896d39f80af4e07869d3b1acfba1d8b',ramdisk_id='',reservation_id='r-zuyfio31',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2014666022',owner_user_name='tempest-ServersNegativeTestJSON-2014666022-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:37:30Z,user_data=None,user_id='49d631f793a54e4cbf086cbf89696834',uuid=8ee464b0-f75e-4f30-9838-74bca9619a07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37f8d809-78f6-45fa-a4e8-db8e816f6f6e", "address": "fa:16:3e:96:29:2e", "network": {"id": "e687eacc-3080-46db-b577-5efb36856dce", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1089459024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2896d39f80af4e07869d3b1acfba1d8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f8d809-78", "ovs_interfaceid": "37f8d809-78f6-45fa-a4e8-db8e816f6f6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:37:32 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Converting VIF {"id": "37f8d809-78f6-45fa-a4e8-db8e816f6f6e", "address": "fa:16:3e:96:29:2e", "network": {"id": "e687eacc-3080-46db-b577-5efb36856dce", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1089459024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2896d39f80af4e07869d3b1acfba1d8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f8d809-78", "ovs_interfaceid": "37f8d809-78f6-45fa-a4e8-db8e816f6f6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:37:32 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:29:2e,bridge_name='br-int',has_traffic_filtering=True,id=37f8d809-78f6-45fa-a4e8-db8e816f6f6e,network=Network(e687eacc-3080-46db-b577-5efb36856dce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37f8d809-78') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:37:32 user nova-compute[72586]: DEBUG os_vif [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:29:2e,bridge_name='br-int',has_traffic_filtering=True,id=37f8d809-78f6-45fa-a4e8-db8e816f6f6e,network=Network(e687eacc-3080-46db-b577-5efb36856dce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37f8d809-78') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:37:32 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:37:32 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:37:32 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:37:32 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:37:32 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37f8d809-78, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:37:32 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap37f8d809-78, col_values=(('external_ids', {'iface-id': '37f8d809-78f6-45fa-a4e8-db8e816f6f6e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:29:2e', 'vm-uuid': '8ee464b0-f75e-4f30-9838-74bca9619a07'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:37:32 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:37:32 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:37:32 user nova-compute[72586]: INFO os_vif [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:29:2e,bridge_name='br-int',has_traffic_filtering=True,id=37f8d809-78f6-45fa-a4e8-db8e816f6f6e,network=Network(e687eacc-3080-46db-b577-5efb36856dce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37f8d809-78')
Aug 01 21:37:32 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:37:32 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] No VIF found with MAC fa:16:3e:96:29:2e, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:37:32 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5396b0e9-b7fe-4d8d-9409-3b1c5002d264 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:37:32 user nova-compute[72586]: INFO nova.compute.manager [None req-5396b0e9-b7fe-4d8d-9409-3b1c5002d264 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] instance snapshotting
Aug 01 21:37:32 user nova-compute[72586]: DEBUG nova.network.neutron [req-1f72534d-133a-46d9-b923-6577c2c5ebd9 req-9c4193e9-8b76-411f-a346-1d3f8b6ec6f2 service nova] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] Updated VIF entry in instance network info cache for port 37f8d809-78f6-45fa-a4e8-db8e816f6f6e. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:37:32 user nova-compute[72586]: DEBUG nova.network.neutron [req-1f72534d-133a-46d9-b923-6577c2c5ebd9 req-9c4193e9-8b76-411f-a346-1d3f8b6ec6f2 service nova] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] Updating instance_info_cache with network_info: [{"id": "37f8d809-78f6-45fa-a4e8-db8e816f6f6e", "address": "fa:16:3e:96:29:2e", "network": {"id": "e687eacc-3080-46db-b577-5efb36856dce", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1089459024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2896d39f80af4e07869d3b1acfba1d8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f8d809-78", "ovs_interfaceid": "37f8d809-78f6-45fa-a4e8-db8e816f6f6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:37:32 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-5396b0e9-b7fe-4d8d-9409-3b1c5002d264 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Beginning live snapshot process
Aug 01 21:37:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-1f72534d-133a-46d9-b923-6577c2c5ebd9 req-9c4193e9-8b76-411f-a346-1d3f8b6ec6f2 service nova] Releasing lock "refresh_cache-8ee464b0-f75e-4f30-9838-74bca9619a07" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:37:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5396b0e9-b7fe-4d8d-9409-3b1c5002d264 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63625685-227f-48cc-9cc0-594633e0b8bb/disk --force-share --output=json -f qcow2 {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:37:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5396b0e9-b7fe-4d8d-9409-3b1c5002d264 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63625685-227f-48cc-9cc0-594633e0b8bb/disk --force-share --output=json -f qcow2" returned: 0 in 0.137s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:37:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5396b0e9-b7fe-4d8d-9409-3b1c5002d264 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63625685-227f-48cc-9cc0-594633e0b8bb/disk --force-share --output=json -f qcow2 {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:37:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5396b0e9-b7fe-4d8d-9409-3b1c5002d264 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63625685-227f-48cc-9cc0-594633e0b8bb/disk --force-share --output=json -f qcow2" returned: 0 in 0.139s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:37:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5396b0e9-b7fe-4d8d-9409-3b1c5002d264 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:37:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5396b0e9-b7fe-4d8d-9409-3b1c5002d264 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.148s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:37:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5396b0e9-b7fe-4d8d-9409-3b1c5002d264 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpweaw_q6m/e6ae48cce1854b4ba071229b3e2cfbab.delta 1073741824 {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:37:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5396b0e9-b7fe-4d8d-9409-3b1c5002d264 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpweaw_q6m/e6ae48cce1854b4ba071229b3e2cfbab.delta 1073741824" returned: 0 in 0.068s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:37:33 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-5396b0e9-b7fe-4d8d-9409-3b1c5002d264 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 01 21:37:33 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:37:33 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:37:33 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:37:33 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:37:33 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:37:33 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72586) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 21:37:34 user nova-compute[72586]: DEBUG nova.compute.manager [req-f6b7b7c7-2a1e-46b9-b41b-b99ae79dcd6c req-e45ad152-dd5f-4ae3-b48e-9f4a8037aac7 service nova] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] Received event network-vif-plugged-37f8d809-78f6-45fa-a4e8-db8e816f6f6e {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:37:34 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-f6b7b7c7-2a1e-46b9-b41b-b99ae79dcd6c req-e45ad152-dd5f-4ae3-b48e-9f4a8037aac7 service nova] Acquiring lock "8ee464b0-f75e-4f30-9838-74bca9619a07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:37:34 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-f6b7b7c7-2a1e-46b9-b41b-b99ae79dcd6c req-e45ad152-dd5f-4ae3-b48e-9f4a8037aac7 service nova] Lock "8ee464b0-f75e-4f30-9838-74bca9619a07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:37:34 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-f6b7b7c7-2a1e-46b9-b41b-b99ae79dcd6c req-e45ad152-dd5f-4ae3-b48e-9f4a8037aac7 service nova] Lock "8ee464b0-f75e-4f30-9838-74bca9619a07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:37:34 user nova-compute[72586]: DEBUG nova.compute.manager [req-f6b7b7c7-2a1e-46b9-b41b-b99ae79dcd6c req-e45ad152-dd5f-4ae3-b48e-9f4a8037aac7 service nova] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] No waiting events found dispatching network-vif-plugged-37f8d809-78f6-45fa-a4e8-db8e816f6f6e {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:37:34 user nova-compute[72586]: WARNING nova.compute.manager [req-f6b7b7c7-2a1e-46b9-b41b-b99ae79dcd6c req-e45ad152-dd5f-4ae3-b48e-9f4a8037aac7 service nova] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] Received unexpected event network-vif-plugged-37f8d809-78f6-45fa-a4e8-db8e816f6f6e for instance with vm_state building and task_state spawning.
Aug 01 21:37:34 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:37:34 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:37:34 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:37:34 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:37:34 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:37:34 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-5396b0e9-b7fe-4d8d-9409-3b1c5002d264 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72586) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 21:37:34 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:37:34 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:37:34 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Starting heal instance info cache {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 21:37:34 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-5396b0e9-b7fe-4d8d-9409-3b1c5002d264 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] COPY block job progress, current cursor: 47579136 final cursor: 75497472 {{(pid=72586) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 21:37:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "refresh_cache-af2de810-b22f-4fa9-835c-c673abd145db" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:37:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquired lock "refresh_cache-af2de810-b22f-4fa9-835c-c673abd145db" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:37:35 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Forcefully refreshing network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 21:37:35 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-5396b0e9-b7fe-4d8d-9409-3b1c5002d264 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72586) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 21:37:35 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-5396b0e9-b7fe-4d8d-9409-3b1c5002d264 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 01 21:37:35 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Updating instance_info_cache with network_info: [{"id": "b3d7d993-0a45-40ab-8cdd-e3eb06183294", "address": "fa:16:3e:29:af:12", "network": {"id": "86940e5d-852b-48fc-9b0e-858305321349", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1967467603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d847d04360420c80ea5608d5a2b15a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3d7d993-0a", "ovs_interfaceid": "b3d7d993-0a45-40ab-8cdd-e3eb06183294", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:37:35 user nova-compute[72586]: DEBUG nova.privsep.utils [None req-5396b0e9-b7fe-4d8d-9409-3b1c5002d264 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72586) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 21:37:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5396b0e9-b7fe-4d8d-9409-3b1c5002d264 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpweaw_q6m/e6ae48cce1854b4ba071229b3e2cfbab.delta /opt/stack/data/nova/instances/snapshots/tmpweaw_q6m/e6ae48cce1854b4ba071229b3e2cfbab {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:37:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Releasing lock "refresh_cache-af2de810-b22f-4fa9-835c-c673abd145db" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:37:35 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Updated the network info_cache for instance {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 21:37:35 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:37:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:37:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:37:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:37:35 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Auditing locally available compute resources for user (node: user) {{(pid=72586) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 21:37:35 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:37:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ab466b-8caa-4a38-8350-213aa17ee75e/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:37:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ab466b-8caa-4a38-8350-213aa17ee75e/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:37:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ab466b-8caa-4a38-8350-213aa17ee75e/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:37:36 user nova-compute[72586]: DEBUG nova.compute.manager [req-5bf93918-a374-4eba-929c-0b4c9a8af909 req-1e4355f1-7f45-4c33-bdf8-e543aecf7cf5 service nova] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] Received event network-vif-plugged-37f8d809-78f6-45fa-a4e8-db8e816f6f6e {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:37:36 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-5bf93918-a374-4eba-929c-0b4c9a8af909 req-1e4355f1-7f45-4c33-bdf8-e543aecf7cf5 service nova] Acquiring lock "8ee464b0-f75e-4f30-9838-74bca9619a07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:37:36 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-5bf93918-a374-4eba-929c-0b4c9a8af909 req-1e4355f1-7f45-4c33-bdf8-e543aecf7cf5 service nova] Lock "8ee464b0-f75e-4f30-9838-74bca9619a07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:37:36 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-5bf93918-a374-4eba-929c-0b4c9a8af909 req-1e4355f1-7f45-4c33-bdf8-e543aecf7cf5 service nova] Lock "8ee464b0-f75e-4f30-9838-74bca9619a07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:37:36 user nova-compute[72586]: DEBUG nova.compute.manager [req-5bf93918-a374-4eba-929c-0b4c9a8af909 req-1e4355f1-7f45-4c33-bdf8-e543aecf7cf5 service nova] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] No waiting events found dispatching network-vif-plugged-37f8d809-78f6-45fa-a4e8-db8e816f6f6e {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:37:36 user nova-compute[72586]: WARNING nova.compute.manager [req-5bf93918-a374-4eba-929c-0b4c9a8af909 req-1e4355f1-7f45-4c33-bdf8-e543aecf7cf5 service nova] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] Received unexpected event network-vif-plugged-37f8d809-78f6-45fa-a4e8-db8e816f6f6e for instance with vm_state building and task_state spawning.
Aug 01 21:37:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5396b0e9-b7fe-4d8d-9409-3b1c5002d264 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpweaw_q6m/e6ae48cce1854b4ba071229b3e2cfbab.delta /opt/stack/data/nova/instances/snapshots/tmpweaw_q6m/e6ae48cce1854b4ba071229b3e2cfbab" returned: 0 in 0.642s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:37:36 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-5396b0e9-b7fe-4d8d-9409-3b1c5002d264 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Snapshot extracted, beginning image upload
Aug 01 21:37:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ab466b-8caa-4a38-8350-213aa17ee75e/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:37:36 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:37:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:37:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:37:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:37:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:37:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:37:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:37:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:37:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:37:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee464b0-f75e-4f30-9838-74bca9619a07/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:37:37 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925857.0893793, 8ee464b0-f75e-4f30-9838-74bca9619a07 => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:37:37 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] VM Resumed (Lifecycle Event)
Aug 01 21:37:37 user nova-compute[72586]: DEBUG nova.compute.manager [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] Instance event wait completed in 0 seconds for  {{(pid=72586) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 21:37:37 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] Guest created on hypervisor {{(pid=72586) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 21:37:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee464b0-f75e-4f30-9838-74bca9619a07/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:37:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee464b0-f75e-4f30-9838-74bca9619a07/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:37:37 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:37:37 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] Instance spawned successfully.
Aug 01 21:37:37 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 21:37:37 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:37:37 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] Found default for hw_cdrom_bus of ide {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:37:37 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] Found default for hw_disk_bus of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:37:37 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] Found default for hw_input_bus of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:37:37 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] Found default for hw_pointer_model of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:37:37 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] Found default for hw_video_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:37:37 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] Found default for hw_vif_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:37:37 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:37:37 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925857.1056294, 8ee464b0-f75e-4f30-9838-74bca9619a07 => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:37:37 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] VM Started (Lifecycle Event)
Aug 01 21:37:37 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:37:37 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:37:37 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:37:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee464b0-f75e-4f30-9838-74bca9619a07/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:37:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63625685-227f-48cc-9cc0-594633e0b8bb/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:37:37 user nova-compute[72586]: INFO nova.compute.manager [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] Took 6.91 seconds to spawn the instance on the hypervisor.
Aug 01 21:37:37 user nova-compute[72586]: DEBUG nova.compute.manager [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:37:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:37:37 user nova-compute[72586]: INFO nova.compute.manager [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] Took 7.59 seconds to build instance.
Aug 01 21:37:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63625685-227f-48cc-9cc0-594633e0b8bb/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:37:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63625685-227f-48cc-9cc0-594633e0b8bb/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:37:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f9195752-aad9-4672-a6d3-e7561dd3b0ca tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Lock "8ee464b0-f75e-4f30-9838-74bca9619a07" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.724s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:37:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63625685-227f-48cc-9cc0-594633e0b8bb/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:37:37 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:37:38 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:37:38 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:37:38 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Hypervisor/Node resource view: name=user free_ram=8265MB free_disk=25.22882843017578GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72586) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 21:37:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:37:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:37:38 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 49c24c77-f102-4aed-8314-b04aad5f6b3a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:37:38 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance af2de810-b22f-4fa9-835c-c673abd145db actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:37:38 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 161fab9d-a7d1-4ea0-b4b9-2afc54040eef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:37:38 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 314f9b05-527c-459d-aca7-acc696ac613f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:37:38 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 11ab466b-8caa-4a38-8350-213aa17ee75e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:37:38 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 63625685-227f-48cc-9cc0-594633e0b8bb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:37:38 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 8ee464b0-f75e-4f30-9838-74bca9619a07 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:37:38 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 21:37:38 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 21:37:38 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:37:38 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:37:38 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Compute_service record updated for user:user {{(pid=72586) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 21:37:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.552s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:37:39 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-5396b0e9-b7fe-4d8d-9409-3b1c5002d264 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Snapshot image upload complete
Aug 01 21:37:39 user nova-compute[72586]: INFO nova.compute.manager [None req-5396b0e9-b7fe-4d8d-9409-3b1c5002d264 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Took 6.45 seconds to snapshot the instance on the hypervisor.
Aug 01 21:37:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:37:40 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:37:40 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:37:40 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:37:42 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:37:42 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:37:44 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:37:44 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:37:44 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:37:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:37:51 user nova-compute[72586]: INFO nova.compute.manager [None req-554f7353-7cd9-43fe-b8b6-5a19444b5f4d tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Get console output
Aug 01 21:37:51 user nova-compute[72586]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 01 21:37:52 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:37:54 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Acquiring lock "965244cc-71e5-43f9-8d22-62843bac3f52" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:37:54 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "965244cc-71e5-43f9-8d22-62843bac3f52" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:37:54 user nova-compute[72586]: DEBUG nova.compute.manager [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Starting instance... {{(pid=72586) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 21:37:54 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:37:54 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:37:54 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72586) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 21:37:54 user nova-compute[72586]: INFO nova.compute.claims [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Claim successful on node user
Aug 01 21:37:54 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:37:55 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:37:55 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:37:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.335s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:37:55 user nova-compute[72586]: DEBUG nova.compute.manager [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Start building networks asynchronously for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 21:37:55 user nova-compute[72586]: DEBUG nova.compute.manager [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Allocating IP information in the background. {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 21:37:55 user nova-compute[72586]: DEBUG nova.network.neutron [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] allocate_for_instance() {{(pid=72586) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 21:37:55 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 21:37:55 user nova-compute[72586]: DEBUG nova.compute.manager [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Start building block device mappings for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 21:37:55 user nova-compute[72586]: DEBUG nova.policy [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fed345b7cf8f44bfa83d45d408a18c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ae5f1c56b348de8a03f1a4bcdd9b5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72586) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 21:37:55 user nova-compute[72586]: DEBUG nova.compute.manager [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Start spawning the instance on the hypervisor. {{(pid=72586) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 21:37:55 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Creating instance directory {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 21:37:55 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Creating image(s)
Aug 01 21:37:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Acquiring lock "/opt/stack/data/nova/instances/965244cc-71e5-43f9-8d22-62843bac3f52/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:37:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "/opt/stack/data/nova/instances/965244cc-71e5-43f9-8d22-62843bac3f52/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:37:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "/opt/stack/data/nova/instances/965244cc-71e5-43f9-8d22-62843bac3f52/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:37:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Acquiring lock "1abfc712f2676c281ed5204e1d05e6a731788b26" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:37:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "1abfc712f2676c281ed5204e1d05e6a731788b26" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:37:55 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1abfc712f2676c281ed5204e1d05e6a731788b26.part --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:37:55 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1abfc712f2676c281ed5204e1d05e6a731788b26.part --force-share --output=json" returned: 0 in 0.144s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:37:55 user nova-compute[72586]: DEBUG nova.virt.images [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] 0ab99c22-dd5c-42f9-b2d5-7be61771c605 was qcow2, converting to raw {{(pid=72586) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 21:37:55 user nova-compute[72586]: DEBUG nova.privsep.utils [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72586) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 21:37:55 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1abfc712f2676c281ed5204e1d05e6a731788b26.part /opt/stack/data/nova/instances/_base/1abfc712f2676c281ed5204e1d05e6a731788b26.converted {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:37:56 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1abfc712f2676c281ed5204e1d05e6a731788b26.part /opt/stack/data/nova/instances/_base/1abfc712f2676c281ed5204e1d05e6a731788b26.converted" returned: 0 in 0.506s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:37:56 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1abfc712f2676c281ed5204e1d05e6a731788b26.converted --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:37:56 user nova-compute[72586]: DEBUG nova.network.neutron [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Successfully created port: bf319273-ff82-45b9-8365-061755ed7b35 {{(pid=72586) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 21:37:56 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1abfc712f2676c281ed5204e1d05e6a731788b26.converted --force-share --output=json" returned: 0 in 0.138s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:37:56 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "1abfc712f2676c281ed5204e1d05e6a731788b26" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.153s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:37:56 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1abfc712f2676c281ed5204e1d05e6a731788b26 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:37:56 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1abfc712f2676c281ed5204e1d05e6a731788b26 --force-share --output=json" returned: 0 in 0.131s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:37:56 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Acquiring lock "1abfc712f2676c281ed5204e1d05e6a731788b26" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:37:56 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "1abfc712f2676c281ed5204e1d05e6a731788b26" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:37:56 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1abfc712f2676c281ed5204e1d05e6a731788b26 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:37:56 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1abfc712f2676c281ed5204e1d05e6a731788b26 --force-share --output=json" returned: 0 in 0.131s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:37:56 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1abfc712f2676c281ed5204e1d05e6a731788b26,backing_fmt=raw /opt/stack/data/nova/instances/965244cc-71e5-43f9-8d22-62843bac3f52/disk 1073741824 {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:37:56 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1abfc712f2676c281ed5204e1d05e6a731788b26,backing_fmt=raw /opt/stack/data/nova/instances/965244cc-71e5-43f9-8d22-62843bac3f52/disk 1073741824" returned: 0 in 0.054s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:37:56 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "1abfc712f2676c281ed5204e1d05e6a731788b26" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:37:56 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1abfc712f2676c281ed5204e1d05e6a731788b26 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:37:56 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1abfc712f2676c281ed5204e1d05e6a731788b26 --force-share --output=json" returned: 0 in 0.146s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:37:56 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Checking if we can resize image /opt/stack/data/nova/instances/965244cc-71e5-43f9-8d22-62843bac3f52/disk. size=1073741824 {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 21:37:56 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/965244cc-71e5-43f9-8d22-62843bac3f52/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:37:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/965244cc-71e5-43f9-8d22-62843bac3f52/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:37:57 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Cannot resize image /opt/stack/data/nova/instances/965244cc-71e5-43f9-8d22-62843bac3f52/disk to a smaller size. {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 21:37:57 user nova-compute[72586]: DEBUG nova.objects.instance [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lazy-loading 'migration_context' on Instance uuid 965244cc-71e5-43f9-8d22-62843bac3f52 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:37:57 user nova-compute[72586]: DEBUG nova.network.neutron [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Successfully updated port: bf319273-ff82-45b9-8365-061755ed7b35 {{(pid=72586) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 21:37:57 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Created local disks {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 21:37:57 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Ensure instance console log exists: /opt/stack/data/nova/instances/965244cc-71e5-43f9-8d22-62843bac3f52/console.log {{(pid=72586) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 21:37:57 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:37:57 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:37:57 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:37:57 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Acquiring lock "refresh_cache-965244cc-71e5-43f9-8d22-62843bac3f52" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:37:57 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Acquired lock "refresh_cache-965244cc-71e5-43f9-8d22-62843bac3f52" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:37:57 user nova-compute[72586]: DEBUG nova.network.neutron [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:37:57 user nova-compute[72586]: DEBUG nova.compute.manager [req-b684535b-ab6b-49df-932a-e0566c82c819 req-e8c66faa-d483-44b6-a869-4fc22604c6e8 service nova] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Received event network-changed-bf319273-ff82-45b9-8365-061755ed7b35 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:37:57 user nova-compute[72586]: DEBUG nova.compute.manager [req-b684535b-ab6b-49df-932a-e0566c82c819 req-e8c66faa-d483-44b6-a869-4fc22604c6e8 service nova] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Refreshing instance network info cache due to event network-changed-bf319273-ff82-45b9-8365-061755ed7b35. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:37:57 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-b684535b-ab6b-49df-932a-e0566c82c819 req-e8c66faa-d483-44b6-a869-4fc22604c6e8 service nova] Acquiring lock "refresh_cache-965244cc-71e5-43f9-8d22-62843bac3f52" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:37:57 user nova-compute[72586]: DEBUG nova.network.neutron [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Instance cache missing network info. {{(pid=72586) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 21:37:57 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:37:57 user nova-compute[72586]: DEBUG nova.network.neutron [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Updating instance_info_cache with network_info: [{"id": "bf319273-ff82-45b9-8365-061755ed7b35", "address": "fa:16:3e:02:f6:65", "network": {"id": "56c3419f-2c2c-4dda-88d7-ba96e2a689fd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-705071098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ae5f1c56b348de8a03f1a4bcdd9b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf319273-ff", "ovs_interfaceid": "bf319273-ff82-45b9-8365-061755ed7b35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:37:57 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Releasing lock "refresh_cache-965244cc-71e5-43f9-8d22-62843bac3f52" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:37:57 user nova-compute[72586]: DEBUG nova.compute.manager [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Instance network_info: |[{"id": "bf319273-ff82-45b9-8365-061755ed7b35", "address": "fa:16:3e:02:f6:65", "network": {"id": "56c3419f-2c2c-4dda-88d7-ba96e2a689fd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-705071098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ae5f1c56b348de8a03f1a4bcdd9b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf319273-ff", "ovs_interfaceid": "bf319273-ff82-45b9-8365-061755ed7b35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 21:37:57 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-b684535b-ab6b-49df-932a-e0566c82c819 req-e8c66faa-d483-44b6-a869-4fc22604c6e8 service nova] Acquired lock "refresh_cache-965244cc-71e5-43f9-8d22-62843bac3f52" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:37:57 user nova-compute[72586]: DEBUG nova.network.neutron [req-b684535b-ab6b-49df-932a-e0566c82c819 req-e8c66faa-d483-44b6-a869-4fc22604c6e8 service nova] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Refreshing network info cache for port bf319273-ff82-45b9-8365-061755ed7b35 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:37:57 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Start _get_guest_xml network_info=[{"id": "bf319273-ff82-45b9-8365-061755ed7b35", "address": "fa:16:3e:02:f6:65", "network": {"id": "56c3419f-2c2c-4dda-88d7-ba96e2a689fd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-705071098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ae5f1c56b348de8a03f1a4bcdd9b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf319273-ff", "ovs_interfaceid": "bf319273-ff82-45b9-8365-061755ed7b35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:37:52Z,direct_url=<?>,disk_format='qcow2',id=0ab99c22-dd5c-42f9-b2d5-7be61771c605,min_disk=0,min_ram=0,name='tempest-scenario-img--808196585',owner='f7ae5f1c56b348de8a03f1a4bcdd9b5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:37:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '0ab99c22-dd5c-42f9-b2d5-7be61771c605'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:37:57 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:37:57 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:37:57 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:37:57 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:37:57 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:37:57 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:37:57 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:37:57 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:37:52Z,direct_url=<?>,disk_format='qcow2',id=0ab99c22-dd5c-42f9-b2d5-7be61771c605,min_disk=0,min_ram=0,name='tempest-scenario-img--808196585',owner='f7ae5f1c56b348de8a03f1a4bcdd9b5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:37:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:37:57 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:37:57 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:37:57 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:37:57 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:37:57 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:37:57 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:37:57 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:37:57 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:37:57 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:37:57 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:37:57 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:37:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-103888368',display_name='tempest-TestMinimumBasicScenario-server-103888368',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-103888368',id=34,image_ref='0ab99c22-dd5c-42f9-b2d5-7be61771c605',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBdI9vS4xIEypRmtEbKNWWvQt8cCTtKirHSxaCIW1WH3QFF0GUP/pt1xfCy8JKvpqhKZIQ07Fe4YmMFFuV/eB7M40q94xaDzbsl2IN/zZfR9MH0p1FSPWcf1+VB6TwiUoQ==',key_name='tempest-TestMinimumBasicScenario-877343528',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7ae5f1c56b348de8a03f1a4bcdd9b5c',ramdisk_id='',reservation_id='r-9nlc064p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0ab99c22-dd5c-42f9-b2d5-7be61771c605',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1119751084',owner_user_name='tempest-TestMinimumBasicScenario-1119751084-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:37:55Z,user_data=None,user_id='fed345b7cf8f44bfa83d45d408a18c4a',uuid=965244cc-71e5-43f9-8d22-62843bac3f52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf319273-ff82-45b9-8365-061755ed7b35", "address": "fa:16:3e:02:f6:65", "network": {"id": "56c3419f-2c2c-4dda-88d7-ba96e2a689fd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-705071098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ae5f1c56b348de8a03f1a4bcdd9b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf319273-ff", "ovs_interfaceid": "bf319273-ff82-45b9-8365-061755ed7b35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:37:57 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Converting VIF {"id": "bf319273-ff82-45b9-8365-061755ed7b35", "address": "fa:16:3e:02:f6:65", "network": {"id": "56c3419f-2c2c-4dda-88d7-ba96e2a689fd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-705071098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ae5f1c56b348de8a03f1a4bcdd9b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf319273-ff", "ovs_interfaceid": "bf319273-ff82-45b9-8365-061755ed7b35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:37:57 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:f6:65,bridge_name='br-int',has_traffic_filtering=True,id=bf319273-ff82-45b9-8365-061755ed7b35,network=Network(56c3419f-2c2c-4dda-88d7-ba96e2a689fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf319273-ff') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:37:57 user nova-compute[72586]: DEBUG nova.objects.instance [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lazy-loading 'pci_devices' on Instance uuid 965244cc-71e5-43f9-8d22-62843bac3f52 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:37:57 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:37:57 user nova-compute[72586]:   <uuid>965244cc-71e5-43f9-8d22-62843bac3f52</uuid>
Aug 01 21:37:57 user nova-compute[72586]:   <name>instance-00000022</name>
Aug 01 21:37:57 user nova-compute[72586]:   <memory>524288</memory>
Aug 01 21:37:57 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:37:57 user nova-compute[72586]:   <metadata>
Aug 01 21:37:57 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:37:57 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:37:57 user nova-compute[72586]:       <nova:name>tempest-TestMinimumBasicScenario-server-103888368</nova:name>
Aug 01 21:37:57 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:37:57</nova:creationTime>
Aug 01 21:37:57 user nova-compute[72586]:       <nova:flavor name="m1.tiny">
Aug 01 21:37:57 user nova-compute[72586]:         <nova:memory>512</nova:memory>
Aug 01 21:37:57 user nova-compute[72586]:         <nova:disk>1</nova:disk>
Aug 01 21:37:57 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:37:57 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:37:57 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:37:57 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:37:57 user nova-compute[72586]:       <nova:owner>
Aug 01 21:37:57 user nova-compute[72586]:         <nova:user uuid="fed345b7cf8f44bfa83d45d408a18c4a">tempest-TestMinimumBasicScenario-1119751084-project-member</nova:user>
Aug 01 21:37:57 user nova-compute[72586]:         <nova:project uuid="f7ae5f1c56b348de8a03f1a4bcdd9b5c">tempest-TestMinimumBasicScenario-1119751084</nova:project>
Aug 01 21:37:57 user nova-compute[72586]:       </nova:owner>
Aug 01 21:37:57 user nova-compute[72586]:       <nova:root type="image" uuid="0ab99c22-dd5c-42f9-b2d5-7be61771c605"/>
Aug 01 21:37:57 user nova-compute[72586]:       <nova:ports>
Aug 01 21:37:57 user nova-compute[72586]:         <nova:port uuid="bf319273-ff82-45b9-8365-061755ed7b35">
Aug 01 21:37:57 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 01 21:37:57 user nova-compute[72586]:         </nova:port>
Aug 01 21:37:57 user nova-compute[72586]:       </nova:ports>
Aug 01 21:37:57 user nova-compute[72586]:     </nova:instance>
Aug 01 21:37:57 user nova-compute[72586]:   </metadata>
Aug 01 21:37:57 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:37:57 user nova-compute[72586]:     <system>
Aug 01 21:37:57 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:37:57 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:37:57 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:37:57 user nova-compute[72586]:       <entry name="serial">965244cc-71e5-43f9-8d22-62843bac3f52</entry>
Aug 01 21:37:57 user nova-compute[72586]:       <entry name="uuid">965244cc-71e5-43f9-8d22-62843bac3f52</entry>
Aug 01 21:37:57 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:37:57 user nova-compute[72586]:     </system>
Aug 01 21:37:57 user nova-compute[72586]:   </sysinfo>
Aug 01 21:37:57 user nova-compute[72586]:   <os>
Aug 01 21:37:57 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:37:57 user nova-compute[72586]:     <boot dev="hd"/>
Aug 01 21:37:57 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:37:57 user nova-compute[72586]:   </os>
Aug 01 21:37:57 user nova-compute[72586]:   <features>
Aug 01 21:37:57 user nova-compute[72586]:     <acpi/>
Aug 01 21:37:57 user nova-compute[72586]:     <apic/>
Aug 01 21:37:57 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:37:57 user nova-compute[72586]:   </features>
Aug 01 21:37:57 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:37:57 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:37:57 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:37:57 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:37:57 user nova-compute[72586]:   </clock>
Aug 01 21:37:57 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:37:57 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:37:57 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:37:57 user nova-compute[72586]:   </cpu>
Aug 01 21:37:57 user nova-compute[72586]:   <devices>
Aug 01 21:37:57 user nova-compute[72586]:     <disk type="file" device="disk">
Aug 01 21:37:57 user nova-compute[72586]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 21:37:57 user nova-compute[72586]:       <source file="/opt/stack/data/nova/instances/965244cc-71e5-43f9-8d22-62843bac3f52/disk"/>
Aug 01 21:37:57 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:37:57 user nova-compute[72586]:     </disk>
Aug 01 21:37:57 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:37:57 user nova-compute[72586]:       <mac address="fa:16:3e:02:f6:65"/>
Aug 01 21:37:57 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:37:57 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:37:57 user nova-compute[72586]:       <target dev="tapbf319273-ff"/>
Aug 01 21:37:57 user nova-compute[72586]:     </interface>
Aug 01 21:37:57 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:37:57 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/965244cc-71e5-43f9-8d22-62843bac3f52/console.log" append="off"/>
Aug 01 21:37:57 user nova-compute[72586]:     </serial>
Aug 01 21:37:57 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:37:57 user nova-compute[72586]:     <video>
Aug 01 21:37:57 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:37:57 user nova-compute[72586]:     </video>
Aug 01 21:37:57 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:37:57 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:37:57 user nova-compute[72586]:     </rng>
Aug 01 21:37:57 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:37:57 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:37:57 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:37:57 user nova-compute[72586]:     </memballoon>
Aug 01 21:37:57 user nova-compute[72586]:   </devices>
Aug 01 21:37:57 user nova-compute[72586]: </domain>
Aug 01 21:37:57 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:37:57 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:37:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-103888368',display_name='tempest-TestMinimumBasicScenario-server-103888368',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-103888368',id=34,image_ref='0ab99c22-dd5c-42f9-b2d5-7be61771c605',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBdI9vS4xIEypRmtEbKNWWvQt8cCTtKirHSxaCIW1WH3QFF0GUP/pt1xfCy8JKvpqhKZIQ07Fe4YmMFFuV/eB7M40q94xaDzbsl2IN/zZfR9MH0p1FSPWcf1+VB6TwiUoQ==',key_name='tempest-TestMinimumBasicScenario-877343528',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7ae5f1c56b348de8a03f1a4bcdd9b5c',ramdisk_id='',reservation_id='r-9nlc064p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0ab99c22-dd5c-42f9-b2d5-7be61771c605',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1119751084',owner_user_name='tempest-TestMinimumBasicScenario-1119751084-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:37:55Z,user_data=None,user_id='fed345b7cf8f44bfa83d45d408a18c4a',uuid=965244cc-71e5-43f9-8d22-62843bac3f52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf319273-ff82-45b9-8365-061755ed7b35", "address": "fa:16:3e:02:f6:65", "network": {"id": "56c3419f-2c2c-4dda-88d7-ba96e2a689fd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-705071098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ae5f1c56b348de8a03f1a4bcdd9b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf319273-ff", "ovs_interfaceid": "bf319273-ff82-45b9-8365-061755ed7b35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:37:57 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Converting VIF {"id": "bf319273-ff82-45b9-8365-061755ed7b35", "address": "fa:16:3e:02:f6:65", "network": {"id": "56c3419f-2c2c-4dda-88d7-ba96e2a689fd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-705071098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ae5f1c56b348de8a03f1a4bcdd9b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf319273-ff", "ovs_interfaceid": "bf319273-ff82-45b9-8365-061755ed7b35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:37:57 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:f6:65,bridge_name='br-int',has_traffic_filtering=True,id=bf319273-ff82-45b9-8365-061755ed7b35,network=Network(56c3419f-2c2c-4dda-88d7-ba96e2a689fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf319273-ff') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:37:57 user nova-compute[72586]: DEBUG os_vif [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:f6:65,bridge_name='br-int',has_traffic_filtering=True,id=bf319273-ff82-45b9-8365-061755ed7b35,network=Network(56c3419f-2c2c-4dda-88d7-ba96e2a689fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf319273-ff') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:37:57 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:37:57 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:37:57 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:37:57 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:37:57 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbf319273-ff, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:37:57 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbf319273-ff, col_values=(('external_ids', {'iface-id': 'bf319273-ff82-45b9-8365-061755ed7b35', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:f6:65', 'vm-uuid': '965244cc-71e5-43f9-8d22-62843bac3f52'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:37:57 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:37:57 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:37:57 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:37:57 user nova-compute[72586]: INFO os_vif [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:f6:65,bridge_name='br-int',has_traffic_filtering=True,id=bf319273-ff82-45b9-8365-061755ed7b35,network=Network(56c3419f-2c2c-4dda-88d7-ba96e2a689fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf319273-ff')
Aug 01 21:37:57 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:37:57 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] No VIF found with MAC fa:16:3e:02:f6:65, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:37:57 user nova-compute[72586]: DEBUG nova.network.neutron [req-b684535b-ab6b-49df-932a-e0566c82c819 req-e8c66faa-d483-44b6-a869-4fc22604c6e8 service nova] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Updated VIF entry in instance network info cache for port bf319273-ff82-45b9-8365-061755ed7b35. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:37:57 user nova-compute[72586]: DEBUG nova.network.neutron [req-b684535b-ab6b-49df-932a-e0566c82c819 req-e8c66faa-d483-44b6-a869-4fc22604c6e8 service nova] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Updating instance_info_cache with network_info: [{"id": "bf319273-ff82-45b9-8365-061755ed7b35", "address": "fa:16:3e:02:f6:65", "network": {"id": "56c3419f-2c2c-4dda-88d7-ba96e2a689fd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-705071098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ae5f1c56b348de8a03f1a4bcdd9b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf319273-ff", "ovs_interfaceid": "bf319273-ff82-45b9-8365-061755ed7b35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:37:57 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-b684535b-ab6b-49df-932a-e0566c82c819 req-e8c66faa-d483-44b6-a869-4fc22604c6e8 service nova] Releasing lock "refresh_cache-965244cc-71e5-43f9-8d22-62843bac3f52" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:37:58 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:37:58 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:37:58 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:37:59 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:37:59 user nova-compute[72586]: DEBUG nova.compute.manager [req-01f4a9d4-bfa1-491a-8fa8-f8c0135d8879 req-4cfbc270-6d3d-4b81-9e2f-2223e06bd0f9 service nova] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Received event network-vif-plugged-bf319273-ff82-45b9-8365-061755ed7b35 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:37:59 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-01f4a9d4-bfa1-491a-8fa8-f8c0135d8879 req-4cfbc270-6d3d-4b81-9e2f-2223e06bd0f9 service nova] Acquiring lock "965244cc-71e5-43f9-8d22-62843bac3f52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:37:59 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-01f4a9d4-bfa1-491a-8fa8-f8c0135d8879 req-4cfbc270-6d3d-4b81-9e2f-2223e06bd0f9 service nova] Lock "965244cc-71e5-43f9-8d22-62843bac3f52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:37:59 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-01f4a9d4-bfa1-491a-8fa8-f8c0135d8879 req-4cfbc270-6d3d-4b81-9e2f-2223e06bd0f9 service nova] Lock "965244cc-71e5-43f9-8d22-62843bac3f52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:37:59 user nova-compute[72586]: DEBUG nova.compute.manager [req-01f4a9d4-bfa1-491a-8fa8-f8c0135d8879 req-4cfbc270-6d3d-4b81-9e2f-2223e06bd0f9 service nova] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] No waiting events found dispatching network-vif-plugged-bf319273-ff82-45b9-8365-061755ed7b35 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:37:59 user nova-compute[72586]: WARNING nova.compute.manager [req-01f4a9d4-bfa1-491a-8fa8-f8c0135d8879 req-4cfbc270-6d3d-4b81-9e2f-2223e06bd0f9 service nova] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Received unexpected event network-vif-plugged-bf319273-ff82-45b9-8365-061755ed7b35 for instance with vm_state building and task_state spawning.
Aug 01 21:37:59 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:37:59 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:37:59 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:37:59 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:37:59 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:38:01 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925881.1477742, 965244cc-71e5-43f9-8d22-62843bac3f52 => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:38:01 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] VM Resumed (Lifecycle Event)
Aug 01 21:38:01 user nova-compute[72586]: DEBUG nova.compute.manager [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Instance event wait completed in 0 seconds for  {{(pid=72586) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 21:38:01 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Guest created on hypervisor {{(pid=72586) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 21:38:01 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Instance spawned successfully.
Aug 01 21:38:01 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 21:38:01 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:38:01 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:38:01 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Found default for hw_cdrom_bus of ide {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:38:01 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Found default for hw_disk_bus of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:38:01 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Found default for hw_input_bus of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:38:01 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Found default for hw_pointer_model of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:38:01 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Found default for hw_video_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:38:01 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Found default for hw_vif_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:38:01 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:38:01 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925881.1483874, 965244cc-71e5-43f9-8d22-62843bac3f52 => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:38:01 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] VM Started (Lifecycle Event)
Aug 01 21:38:01 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:38:01 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:38:01 user nova-compute[72586]: DEBUG nova.compute.manager [req-bbc0c068-d9ce-4705-b839-f5c9bf4ef5b9 req-029e8bf6-42ee-4d06-93a4-69f4d4128039 service nova] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Received event network-vif-plugged-bf319273-ff82-45b9-8365-061755ed7b35 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:38:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-bbc0c068-d9ce-4705-b839-f5c9bf4ef5b9 req-029e8bf6-42ee-4d06-93a4-69f4d4128039 service nova] Acquiring lock "965244cc-71e5-43f9-8d22-62843bac3f52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:38:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-bbc0c068-d9ce-4705-b839-f5c9bf4ef5b9 req-029e8bf6-42ee-4d06-93a4-69f4d4128039 service nova] Lock "965244cc-71e5-43f9-8d22-62843bac3f52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:38:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-bbc0c068-d9ce-4705-b839-f5c9bf4ef5b9 req-029e8bf6-42ee-4d06-93a4-69f4d4128039 service nova] Lock "965244cc-71e5-43f9-8d22-62843bac3f52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:38:01 user nova-compute[72586]: DEBUG nova.compute.manager [req-bbc0c068-d9ce-4705-b839-f5c9bf4ef5b9 req-029e8bf6-42ee-4d06-93a4-69f4d4128039 service nova] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] No waiting events found dispatching network-vif-plugged-bf319273-ff82-45b9-8365-061755ed7b35 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:38:01 user nova-compute[72586]: WARNING nova.compute.manager [req-bbc0c068-d9ce-4705-b839-f5c9bf4ef5b9 req-029e8bf6-42ee-4d06-93a4-69f4d4128039 service nova] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Received unexpected event network-vif-plugged-bf319273-ff82-45b9-8365-061755ed7b35 for instance with vm_state building and task_state spawning.
Aug 01 21:38:01 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:38:01 user nova-compute[72586]: INFO nova.compute.manager [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Took 6.00 seconds to spawn the instance on the hypervisor.
Aug 01 21:38:01 user nova-compute[72586]: DEBUG nova.compute.manager [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:38:01 user nova-compute[72586]: INFO nova.compute.manager [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Took 6.68 seconds to build instance.
Aug 01 21:38:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-2cdc5633-3f82-4d5f-a998-00b7acd2eea9 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "965244cc-71e5-43f9-8d22-62843bac3f52" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.140s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:38:02 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:38:04 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:38:07 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:38:09 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:38:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:38:14 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:38:17 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:38:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:38:22 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:38:24 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:38:27 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:38:28 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:38:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:38:32 user nova-compute[72586]: DEBUG nova.objects.instance [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lazy-loading 'flavor' on Instance uuid 11ab466b-8caa-4a38-8350-213aa17ee75e {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:38:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Acquiring lock "refresh_cache-11ab466b-8caa-4a38-8350-213aa17ee75e" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:38:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Acquired lock "refresh_cache-11ab466b-8caa-4a38-8350-213aa17ee75e" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:38:32 user nova-compute[72586]: DEBUG nova.network.neutron [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:38:32 user nova-compute[72586]: DEBUG nova.objects.instance [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lazy-loading 'info_cache' on Instance uuid 11ab466b-8caa-4a38-8350-213aa17ee75e {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:38:32 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:38:32 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG nova.network.neutron [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Updating instance_info_cache with network_info: [{"id": "d70607b2-8e0c-4166-8218-ecbc976d0369", "address": "fa:16:3e:76:af:74", "network": {"id": "63b6e8c7-fad0-44bf-a479-9baab6f0d1e3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2101151631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cbab7dfc55429c9b991bf1091a84c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd70607b2-8e", "ovs_interfaceid": "d70607b2-8e0c-4166-8218-ecbc976d0369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Releasing lock "refresh_cache-11ab466b-8caa-4a38-8350-213aa17ee75e" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:38:33 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Instance destroyed successfully.
Aug 01 21:38:33 user nova-compute[72586]: DEBUG nova.objects.instance [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lazy-loading 'resources' on Instance uuid 11ab466b-8caa-4a38-8350-213aa17ee75e {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:34:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2094185911',display_name='tempest-AttachVolumeTestJSON-server-2094185911',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2094185911',id=31,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8bY2a+j0kMVaPrfl1MtLxUCVEzM0sy04URPhEHt1a9A1Fyz7ckW9BOF4xfEN78B/F9+N05Diy+kKgMUVPp6Ls9nXPam6BDkRvokPK0ly7jy5lxY/agzzRa/NAHpQoc4w==',key_name='tempest-keypair-809503431',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:34:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='99cbab7dfc55429c9b991bf1091a84c7',ramdisk_id='',reservation_id='r-mw52zjwf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1420576365',owner_user_name='tempest-AttachVolumeTestJSON-1420576365-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:36:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='50893dc844b44f498e1545aeee794742',uuid=11ab466b-8caa-4a38-8350-213aa17ee75e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d70607b2-8e0c-4166-8218-ecbc976d0369", "address": "fa:16:3e:76:af:74", "network": {"id": "63b6e8c7-fad0-44bf-a479-9baab6f0d1e3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2101151631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cbab7dfc55429c9b991bf1091a84c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd70607b2-8e", "ovs_interfaceid": "d70607b2-8e0c-4166-8218-ecbc976d0369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Converting VIF {"id": "d70607b2-8e0c-4166-8218-ecbc976d0369", "address": "fa:16:3e:76:af:74", "network": {"id": "63b6e8c7-fad0-44bf-a479-9baab6f0d1e3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2101151631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cbab7dfc55429c9b991bf1091a84c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd70607b2-8e", "ovs_interfaceid": "d70607b2-8e0c-4166-8218-ecbc976d0369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:af:74,bridge_name='br-int',has_traffic_filtering=True,id=d70607b2-8e0c-4166-8218-ecbc976d0369,network=Network(63b6e8c7-fad0-44bf-a479-9baab6f0d1e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd70607b2-8e') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG os_vif [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:af:74,bridge_name='br-int',has_traffic_filtering=True,id=d70607b2-8e0c-4166-8218-ecbc976d0369,network=Network(63b6e8c7-fad0-44bf-a479-9baab6f0d1e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd70607b2-8e') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd70607b2-8e, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:38:33 user nova-compute[72586]: INFO os_vif [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:af:74,bridge_name='br-int',has_traffic_filtering=True,id=d70607b2-8e0c-4166-8218-ecbc976d0369,network=Network(63b6e8c7-fad0-44bf-a479-9baab6f0d1e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd70607b2-8e')
Aug 01 21:38:33 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] calling os-brick to detach iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, {'target_iqns': ['iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XhuyFReN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:38:33 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:38:33 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d', 0)] {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1920ab1c-36cd-4e33-93e2-8825e30cb409]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf295b1-487c-465b-b1cd-f5ecb9d31e04]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:38:33 user nova-compute[72586]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 (non-flash)
Aug 01 21:38:33 user nova-compute[72586]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d (non-flash)
Aug 01 21:38:33 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:38:33 user nova-compute[72586]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 (non-flash)
Aug 01 21:38:33 user nova-compute[72586]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d (non-flash)
Aug 01 21:38:33 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ed02cd750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d'): ({'sdc'}, set())}) {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Removing single pathed devices sdc {{(pid=72586) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1988692c-1117-488e-b2c2-b1fd572b01f0]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[6376a848-9ef0-4dc0-85e9-526806759a3e]: (4, ('ok\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Flushing IO for device /dev/sdc {{(pid=72586) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb0d6c5-bf52-4cfb-a6cc-fe2663b0e72a]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72586) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b97e16-411a-4339-b2cc-05e965ffa5e7]: (4, ('1', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] SCSI volumes sdc have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d')] {{(pid=72586) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d5914d-6c5d-4cf2-a266-32d39eb3ba51]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d -p 172.16.0.220:3260 --logout {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1bc0405-062b-4b36-ac1a-5e3b3cbbb545]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d, portal: 172.16.0.220,3260]
Aug 01 21:38:33 user nova-compute[72586]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d, portal: 172.16.0.220,3260] successful.
Aug 01 21:38:33 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d -p 172.16.0.220:3260 --op delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f051f8-950a-40d2-865a-2d0b7fa70339]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] <== disconnect_volume: return (272ms) None {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Disconnected iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Start _get_guest_xml network_info=[{"id": "d70607b2-8e0c-4166-8218-ecbc976d0369", "address": "fa:16:3e:76:af:74", "network": {"id": "63b6e8c7-fad0-44bf-a479-9baab6f0d1e3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2101151631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cbab7dfc55429c9b991bf1091a84c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd70607b2-8e", "ovs_interfaceid": "d70607b2-8e0c-4166-8218-ecbc976d0369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '0243d46b-6819-42a5-926f-42b71f0c97ad'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XhuyFReN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '11ab466b-8caa-4a38-8350-213aa17ee75e', 'attached_at': '', 'detached_at': '', 'volume_id': '8cfe922d-8f30-47f4-9bba-6396ad979f5d', 'serial': '8cfe922d-8f30-47f4-9bba-6396ad979f5d'}, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '982d15cf-fde3-49ed-9a8c-9a9a8b215257', 'delete_on_termination': False, 'volume_type': None} {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG nova.objects.instance [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lazy-loading 'numa_topology' on Instance uuid 11ab466b-8caa-4a38-8350-213aa17ee75e {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:38:33 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:38:33 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:38:33 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG nova.objects.instance [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lazy-loading 'vcpu_model' on Instance uuid 11ab466b-8caa-4a38-8350-213aa17ee75e {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Calling os-brick to attach iSCSI Volume {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XhuyFReN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:38:33 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:38:33 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:38:33 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:38:33 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:38:33 user nova-compute[72586]: INFO os_brick.initiator.connectors.iscsi [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 21:38:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d -p 172.16.0.220:3260 {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3b0f92-cd4d-4602-8cb7-a9227f21209a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 21:38:33 user nova-compute[72586]:  {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d -p 172.16.0.220:3260 --interface default --op new {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb4cbff-e26d-46f0-ae51-9d634e9ecf5e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d] added\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d] added
Aug 01 21:38:33 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.063s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba9354b-bd50-4c71-98ec-7d4543de81bc]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9feae9de-7424-4bd5-8623-bfa6ced82e05]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XhuyFReN {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XhuyFReN" returned: 0 in 0.029s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee3c703-41a7-40a6-bdbe-f7f916f559e9]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XhuyFReN'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2215de-2f4d-46b4-85c5-2c4f67c9b2e9]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09b9d1c-f4c4-4507-a645-4bf8897e16da]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:38:33 user nova-compute[72586]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 (non-flash)
Aug 01 21:38:33 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:38:33 user nova-compute[72586]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 (non-flash)
Aug 01 21:38:33 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d -p 172.16.0.220:3260 --login {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2247c3f-1f32-4357-baa3-c0e11dfc744c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d, portal: 172.16.0.220,3260]
Aug 01 21:38:33 user nova-compute[72586]: Login to [iface: default, target: iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d, portal: 172.16.0.220,3260] successful.
Aug 01 21:38:33 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd83c44-55a4-440d-b60a-638b0f6793f9]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39ba6b6-3bf5-443d-8ee5-b07dd093f0b4]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:38:33 user nova-compute[72586]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 (non-flash)
Aug 01 21:38:33 user nova-compute[72586]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d (non-flash)
Aug 01 21:38:33 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:38:33 user nova-compute[72586]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 (non-flash)
Aug 01 21:38:33 user nova-compute[72586]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d (non-flash)
Aug 01 21:38:33 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Connected to 172.16.0.220:3260 {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] HCTL ('34', '-', '-', 0) found on session 41 with lun 0 {{(pid=72586) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72586) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:38:33 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72586) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 21:38:34 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.144s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:38:34 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfca979d-3fc7-4c8f-8a92-417ffb3ea6f8]: (4, ('- - 0', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:38:34 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:38:34 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XhuyFReN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 21:38:34 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:38:34 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:38:34 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:38:34 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:38:34 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:38:34 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Auditing locally available compute resources for user (node: user) {{(pid=72586) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 21:38:35 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.494s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:38:35 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] <== connect_volume: return (1495ms) {'type': 'block', 'scsi_wwn': '26336613038363263', 'path': '/dev/sdc'} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:38:35 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26336613038363263', 'path': '/dev/sdc'} {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 21:38:35 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:38:35 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:34:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2094185911',display_name='tempest-AttachVolumeTestJSON-server-2094185911',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2094185911',id=31,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8bY2a+j0kMVaPrfl1MtLxUCVEzM0sy04URPhEHt1a9A1Fyz7ckW9BOF4xfEN78B/F9+N05Diy+kKgMUVPp6Ls9nXPam6BDkRvokPK0ly7jy5lxY/agzzRa/NAHpQoc4w==',key_name='tempest-keypair-809503431',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:34:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='99cbab7dfc55429c9b991bf1091a84c7',ramdisk_id='',reservation_id='r-mw52zjwf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1420576365',owner_user_name='tempest-AttachVolumeTestJSON-1420576365-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:36:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='50893dc844b44f498e1545aeee794742',uuid=11ab466b-8caa-4a38-8350-213aa17ee75e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d70607b2-8e0c-4166-8218-ecbc976d0369", "address": "fa:16:3e:76:af:74", "network": {"id": "63b6e8c7-fad0-44bf-a479-9baab6f0d1e3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2101151631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cbab7dfc55429c9b991bf1091a84c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd70607b2-8e", "ovs_interfaceid": "d70607b2-8e0c-4166-8218-ecbc976d0369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:38:35 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Converting VIF {"id": "d70607b2-8e0c-4166-8218-ecbc976d0369", "address": "fa:16:3e:76:af:74", "network": {"id": "63b6e8c7-fad0-44bf-a479-9baab6f0d1e3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2101151631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cbab7dfc55429c9b991bf1091a84c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd70607b2-8e", "ovs_interfaceid": "d70607b2-8e0c-4166-8218-ecbc976d0369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:38:35 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:af:74,bridge_name='br-int',has_traffic_filtering=True,id=d70607b2-8e0c-4166-8218-ecbc976d0369,network=Network(63b6e8c7-fad0-44bf-a479-9baab6f0d1e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd70607b2-8e') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:38:35 user nova-compute[72586]: DEBUG nova.objects.instance [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lazy-loading 'pci_devices' on Instance uuid 11ab466b-8caa-4a38-8350-213aa17ee75e {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:38:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:38:35 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:38:35 user nova-compute[72586]:   <uuid>11ab466b-8caa-4a38-8350-213aa17ee75e</uuid>
Aug 01 21:38:35 user nova-compute[72586]:   <name>instance-0000001f</name>
Aug 01 21:38:35 user nova-compute[72586]:   <memory>524288</memory>
Aug 01 21:38:35 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:38:35 user nova-compute[72586]:   <metadata>
Aug 01 21:38:35 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:38:35 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:38:35 user nova-compute[72586]:       <nova:name>tempest-AttachVolumeTestJSON-server-2094185911</nova:name>
Aug 01 21:38:35 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:38:33</nova:creationTime>
Aug 01 21:38:35 user nova-compute[72586]:       <nova:flavor name="m1.tiny">
Aug 01 21:38:35 user nova-compute[72586]:         <nova:memory>512</nova:memory>
Aug 01 21:38:35 user nova-compute[72586]:         <nova:disk>1</nova:disk>
Aug 01 21:38:35 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:38:35 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:38:35 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:38:35 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:38:35 user nova-compute[72586]:       <nova:owner>
Aug 01 21:38:35 user nova-compute[72586]:         <nova:user uuid="50893dc844b44f498e1545aeee794742">tempest-AttachVolumeTestJSON-1420576365-project-member</nova:user>
Aug 01 21:38:35 user nova-compute[72586]:         <nova:project uuid="99cbab7dfc55429c9b991bf1091a84c7">tempest-AttachVolumeTestJSON-1420576365</nova:project>
Aug 01 21:38:35 user nova-compute[72586]:       </nova:owner>
Aug 01 21:38:35 user nova-compute[72586]:       <nova:root type="image" uuid="0243d46b-6819-42a5-926f-42b71f0c97ad"/>
Aug 01 21:38:35 user nova-compute[72586]:       <nova:ports>
Aug 01 21:38:35 user nova-compute[72586]:         <nova:port uuid="d70607b2-8e0c-4166-8218-ecbc976d0369">
Aug 01 21:38:35 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 01 21:38:35 user nova-compute[72586]:         </nova:port>
Aug 01 21:38:35 user nova-compute[72586]:       </nova:ports>
Aug 01 21:38:35 user nova-compute[72586]:     </nova:instance>
Aug 01 21:38:35 user nova-compute[72586]:   </metadata>
Aug 01 21:38:35 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:38:35 user nova-compute[72586]:     <system>
Aug 01 21:38:35 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:38:35 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:38:35 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:38:35 user nova-compute[72586]:       <entry name="serial">11ab466b-8caa-4a38-8350-213aa17ee75e</entry>
Aug 01 21:38:35 user nova-compute[72586]:       <entry name="uuid">11ab466b-8caa-4a38-8350-213aa17ee75e</entry>
Aug 01 21:38:35 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:38:35 user nova-compute[72586]:     </system>
Aug 01 21:38:35 user nova-compute[72586]:   </sysinfo>
Aug 01 21:38:35 user nova-compute[72586]:   <os>
Aug 01 21:38:35 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:38:35 user nova-compute[72586]:     <boot dev="hd"/>
Aug 01 21:38:35 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:38:35 user nova-compute[72586]:   </os>
Aug 01 21:38:35 user nova-compute[72586]:   <features>
Aug 01 21:38:35 user nova-compute[72586]:     <acpi/>
Aug 01 21:38:35 user nova-compute[72586]:     <apic/>
Aug 01 21:38:35 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:38:35 user nova-compute[72586]:   </features>
Aug 01 21:38:35 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:38:35 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:38:35 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:38:35 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:38:35 user nova-compute[72586]:   </clock>
Aug 01 21:38:35 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:38:35 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:38:35 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:38:35 user nova-compute[72586]:   </cpu>
Aug 01 21:38:35 user nova-compute[72586]:   <devices>
Aug 01 21:38:35 user nova-compute[72586]:     <disk type="file" device="disk">
Aug 01 21:38:35 user nova-compute[72586]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 21:38:35 user nova-compute[72586]:       <source file="/opt/stack/data/nova/instances/11ab466b-8caa-4a38-8350-213aa17ee75e/disk"/>
Aug 01 21:38:35 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:38:35 user nova-compute[72586]:     </disk>
Aug 01 21:38:35 user nova-compute[72586]:     <disk type="block" device="disk">
Aug 01 21:38:35 user nova-compute[72586]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:38:35 user nova-compute[72586]:       <source dev="/dev/sdc"/>
Aug 01 21:38:35 user nova-compute[72586]:       <target dev="vdb" bus="virtio"/>
Aug 01 21:38:35 user nova-compute[72586]:       <serial>8cfe922d-8f30-47f4-9bba-6396ad979f5d</serial>
Aug 01 21:38:35 user nova-compute[72586]:     </disk>
Aug 01 21:38:35 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:38:35 user nova-compute[72586]:       <mac address="fa:16:3e:76:af:74"/>
Aug 01 21:38:35 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:38:35 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:38:35 user nova-compute[72586]:       <target dev="tapd70607b2-8e"/>
Aug 01 21:38:35 user nova-compute[72586]:     </interface>
Aug 01 21:38:35 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:38:35 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/11ab466b-8caa-4a38-8350-213aa17ee75e/console.log" append="off"/>
Aug 01 21:38:35 user nova-compute[72586]:     </serial>
Aug 01 21:38:35 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:38:35 user nova-compute[72586]:     <video>
Aug 01 21:38:35 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:38:35 user nova-compute[72586]:     </video>
Aug 01 21:38:35 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:38:35 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:38:35 user nova-compute[72586]:     </rng>
Aug 01 21:38:35 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:38:35 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:38:35 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:38:35 user nova-compute[72586]:     </memballoon>
Aug 01 21:38:35 user nova-compute[72586]:   </devices>
Aug 01 21:38:35 user nova-compute[72586]: </domain>
Aug 01 21:38:35 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:38:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ab466b-8caa-4a38-8350-213aa17ee75e/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:38:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:38:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:38:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ab466b-8caa-4a38-8350-213aa17ee75e/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:38:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ab466b-8caa-4a38-8350-213aa17ee75e/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:38:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:38:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:38:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ab466b-8caa-4a38-8350-213aa17ee75e/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:38:35 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:38:35 user nova-compute[72586]: DEBUG nova.objects.instance [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lazy-loading 'trusted_certs' on Instance uuid 11ab466b-8caa-4a38-8350-213aa17ee75e {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:38:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:38:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:38:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:38:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.134s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:38:35 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Checking if we can resize image /opt/stack/data/nova/instances/11ab466b-8caa-4a38-8350-213aa17ee75e/disk. size=1073741824 {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 21:38:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ab466b-8caa-4a38-8350-213aa17ee75e/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:38:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:38:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee464b0-f75e-4f30-9838-74bca9619a07/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:38:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ab466b-8caa-4a38-8350-213aa17ee75e/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:38:35 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Cannot resize image /opt/stack/data/nova/instances/11ab466b-8caa-4a38-8350-213aa17ee75e/disk to a smaller size. {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 21:38:35 user nova-compute[72586]: DEBUG nova.objects.instance [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lazy-loading 'migration_context' on Instance uuid 11ab466b-8caa-4a38-8350-213aa17ee75e {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:38:35 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:34:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2094185911',display_name='tempest-AttachVolumeTestJSON-server-2094185911',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2094185911',id=31,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8bY2a+j0kMVaPrfl1MtLxUCVEzM0sy04URPhEHt1a9A1Fyz7ckW9BOF4xfEN78B/F9+N05Diy+kKgMUVPp6Ls9nXPam6BDkRvokPK0ly7jy5lxY/agzzRa/NAHpQoc4w==',key_name='tempest-keypair-809503431',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:34:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='99cbab7dfc55429c9b991bf1091a84c7',ramdisk_id='',reservation_id='r-mw52zjwf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1420576365',owner_user_name='tempest-AttachVolumeTestJSON-1420576365-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:36:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='50893dc844b44f498e1545aeee794742',uuid=11ab466b-8caa-4a38-8350-213aa17ee75e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d70607b2-8e0c-4166-8218-ecbc976d0369", "address": "fa:16:3e:76:af:74", "network": {"id": "63b6e8c7-fad0-44bf-a479-9baab6f0d1e3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2101151631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cbab7dfc55429c9b991bf1091a84c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd70607b2-8e", "ovs_interfaceid": "d70607b2-8e0c-4166-8218-ecbc976d0369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:38:35 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Converting VIF {"id": "d70607b2-8e0c-4166-8218-ecbc976d0369", "address": "fa:16:3e:76:af:74", "network": {"id": "63b6e8c7-fad0-44bf-a479-9baab6f0d1e3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2101151631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cbab7dfc55429c9b991bf1091a84c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd70607b2-8e", "ovs_interfaceid": "d70607b2-8e0c-4166-8218-ecbc976d0369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:38:35 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:af:74,bridge_name='br-int',has_traffic_filtering=True,id=d70607b2-8e0c-4166-8218-ecbc976d0369,network=Network(63b6e8c7-fad0-44bf-a479-9baab6f0d1e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd70607b2-8e') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:38:35 user nova-compute[72586]: DEBUG os_vif [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:af:74,bridge_name='br-int',has_traffic_filtering=True,id=d70607b2-8e0c-4166-8218-ecbc976d0369,network=Network(63b6e8c7-fad0-44bf-a479-9baab6f0d1e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd70607b2-8e') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:38:35 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:38:35 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:38:35 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:38:35 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:38:35 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd70607b2-8e, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:38:35 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd70607b2-8e, col_values=(('external_ids', {'iface-id': 'd70607b2-8e0c-4166-8218-ecbc976d0369', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:af:74', 'vm-uuid': '11ab466b-8caa-4a38-8350-213aa17ee75e'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:38:35 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:38:35 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:38:35 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:38:35 user nova-compute[72586]: INFO os_vif [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:af:74,bridge_name='br-int',has_traffic_filtering=True,id=d70607b2-8e0c-4166-8218-ecbc976d0369,network=Network(63b6e8c7-fad0-44bf-a479-9baab6f0d1e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd70607b2-8e')
Aug 01 21:38:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee464b0-f75e-4f30-9838-74bca9619a07/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:38:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee464b0-f75e-4f30-9838-74bca9619a07/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:38:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee464b0-f75e-4f30-9838-74bca9619a07/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:38:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63625685-227f-48cc-9cc0-594633e0b8bb/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:38:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63625685-227f-48cc-9cc0-594633e0b8bb/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:38:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63625685-227f-48cc-9cc0-594633e0b8bb/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:38:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63625685-227f-48cc-9cc0-594633e0b8bb/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:38:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/965244cc-71e5-43f9-8d22-62843bac3f52/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:38:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/965244cc-71e5-43f9-8d22-62843bac3f52/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:38:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/965244cc-71e5-43f9-8d22-62843bac3f52/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:38:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/965244cc-71e5-43f9-8d22-62843bac3f52/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:38:36 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:38:36 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:38:36 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:38:36 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Hypervisor/Node resource view: name=user free_ram=7964MB free_disk=25.105884552001953GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72586) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 21:38:36 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:38:36 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:38:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:38:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:38:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:38:37 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 49c24c77-f102-4aed-8314-b04aad5f6b3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:38:37 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance af2de810-b22f-4fa9-835c-c673abd145db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:38:37 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 161fab9d-a7d1-4ea0-b4b9-2afc54040eef actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:38:37 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 314f9b05-527c-459d-aca7-acc696ac613f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:38:37 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 11ab466b-8caa-4a38-8350-213aa17ee75e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:38:37 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 63625685-227f-48cc-9cc0-594633e0b8bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:38:37 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 8ee464b0-f75e-4f30-9838-74bca9619a07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:38:37 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 965244cc-71e5-43f9-8d22-62843bac3f52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:38:37 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 21:38:37 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 21:38:37 user nova-compute[72586]: DEBUG nova.compute.manager [req-968d3136-e387-4589-b2ce-4ecdbd7a1db2 req-4f042613-d3c7-4b5f-922d-fa6956bd1808 service nova] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Received event network-vif-plugged-d70607b2-8e0c-4166-8218-ecbc976d0369 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:38:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-968d3136-e387-4589-b2ce-4ecdbd7a1db2 req-4f042613-d3c7-4b5f-922d-fa6956bd1808 service nova] Acquiring lock "11ab466b-8caa-4a38-8350-213aa17ee75e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:38:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-968d3136-e387-4589-b2ce-4ecdbd7a1db2 req-4f042613-d3c7-4b5f-922d-fa6956bd1808 service nova] Lock "11ab466b-8caa-4a38-8350-213aa17ee75e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:38:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-968d3136-e387-4589-b2ce-4ecdbd7a1db2 req-4f042613-d3c7-4b5f-922d-fa6956bd1808 service nova] Lock "11ab466b-8caa-4a38-8350-213aa17ee75e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:38:37 user nova-compute[72586]: DEBUG nova.compute.manager [req-968d3136-e387-4589-b2ce-4ecdbd7a1db2 req-4f042613-d3c7-4b5f-922d-fa6956bd1808 service nova] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] No waiting events found dispatching network-vif-plugged-d70607b2-8e0c-4166-8218-ecbc976d0369 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:38:37 user nova-compute[72586]: WARNING nova.compute.manager [req-968d3136-e387-4589-b2ce-4ecdbd7a1db2 req-4f042613-d3c7-4b5f-922d-fa6956bd1808 service nova] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Received unexpected event network-vif-plugged-d70607b2-8e0c-4166-8218-ecbc976d0369 for instance with vm_state stopped and task_state powering-on.
Aug 01 21:38:37 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:38:37 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:38:37 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Compute_service record updated for user:user {{(pid=72586) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 21:38:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.483s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:38:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:38:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:38:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:38:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:38:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:38:39 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925919.174663, 11ab466b-8caa-4a38-8350-213aa17ee75e => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:38:39 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] VM Resumed (Lifecycle Event)
Aug 01 21:38:39 user nova-compute[72586]: DEBUG nova.compute.manager [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Instance event wait completed in 0 seconds for  {{(pid=72586) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 21:38:39 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Instance rebooted successfully.
Aug 01 21:38:39 user nova-compute[72586]: DEBUG nova.compute.manager [None req-368edb3f-377b-484a-b13f-f0ab27311bcf tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:38:39 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:38:39 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:38:39 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 01 21:38:39 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925919.1795099, 11ab466b-8caa-4a38-8350-213aa17ee75e => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:38:39 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] VM Started (Lifecycle Event)
Aug 01 21:38:39 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:38:39 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:38:39 user nova-compute[72586]: DEBUG nova.compute.manager [req-bf039d65-ac66-41b9-a50e-a6bd1091627f req-0f786751-3ed2-4929-a800-6cfceaeb74c4 service nova] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Received event network-vif-plugged-d70607b2-8e0c-4166-8218-ecbc976d0369 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:38:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-bf039d65-ac66-41b9-a50e-a6bd1091627f req-0f786751-3ed2-4929-a800-6cfceaeb74c4 service nova] Acquiring lock "11ab466b-8caa-4a38-8350-213aa17ee75e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:38:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-bf039d65-ac66-41b9-a50e-a6bd1091627f req-0f786751-3ed2-4929-a800-6cfceaeb74c4 service nova] Lock "11ab466b-8caa-4a38-8350-213aa17ee75e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:38:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-bf039d65-ac66-41b9-a50e-a6bd1091627f req-0f786751-3ed2-4929-a800-6cfceaeb74c4 service nova] Lock "11ab466b-8caa-4a38-8350-213aa17ee75e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:38:39 user nova-compute[72586]: DEBUG nova.compute.manager [req-bf039d65-ac66-41b9-a50e-a6bd1091627f req-0f786751-3ed2-4929-a800-6cfceaeb74c4 service nova] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] No waiting events found dispatching network-vif-plugged-d70607b2-8e0c-4166-8218-ecbc976d0369 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:38:39 user nova-compute[72586]: WARNING nova.compute.manager [req-bf039d65-ac66-41b9-a50e-a6bd1091627f req-0f786751-3ed2-4929-a800-6cfceaeb74c4 service nova] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Received unexpected event network-vif-plugged-d70607b2-8e0c-4166-8218-ecbc976d0369 for instance with vm_state active and task_state None.
Aug 01 21:38:39 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:38:39 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Starting heal instance info cache {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 21:38:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "refresh_cache-161fab9d-a7d1-4ea0-b4b9-2afc54040eef" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:38:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquired lock "refresh_cache-161fab9d-a7d1-4ea0-b4b9-2afc54040eef" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:38:39 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Forcefully refreshing network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 21:38:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:38:40 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Updating instance_info_cache with network_info: [{"id": "c082b11d-fb01-4def-98b8-6b2966ce364c", "address": "fa:16:3e:b6:24:7c", "network": {"id": "86940e5d-852b-48fc-9b0e-858305321349", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1967467603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d847d04360420c80ea5608d5a2b15a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc082b11d-fb", "ovs_interfaceid": "c082b11d-fb01-4def-98b8-6b2966ce364c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:38:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Releasing lock "refresh_cache-161fab9d-a7d1-4ea0-b4b9-2afc54040eef" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:38:40 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Updated the network info_cache for instance {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 21:38:40 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:38:40 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:38:40 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:38:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Acquiring lock "178d26d5-3570-442f-9268-21cd73cccfc7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:38:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "178d26d5-3570-442f-9268-21cd73cccfc7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:38:41 user nova-compute[72586]: DEBUG nova.compute.manager [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Starting instance... {{(pid=72586) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 21:38:42 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:38:42 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:38:42 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72586) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 21:38:42 user nova-compute[72586]: INFO nova.compute.claims [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Claim successful on node user
Aug 01 21:38:42 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:38:42 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:38:42 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.425s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:38:42 user nova-compute[72586]: DEBUG nova.compute.manager [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Start building networks asynchronously for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 21:38:42 user nova-compute[72586]: DEBUG nova.compute.manager [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Allocating IP information in the background. {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 21:38:42 user nova-compute[72586]: DEBUG nova.network.neutron [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] allocate_for_instance() {{(pid=72586) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 21:38:42 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 21:38:42 user nova-compute[72586]: DEBUG nova.compute.manager [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Start building block device mappings for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 21:38:42 user nova-compute[72586]: INFO nova.virt.block_device [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Booting with volume-backed-image 0243d46b-6819-42a5-926f-42b71f0c97ad at /dev/vda
Aug 01 21:38:42 user nova-compute[72586]: DEBUG nova.policy [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a984642731b9413c97038f65052ab92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d847d04360420c80ea5608d5a2b15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72586) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 21:38:43 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:38:43 user nova-compute[72586]: DEBUG nova.network.neutron [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Successfully created port: 9bddd744-887b-44bf-aacf-d7606c470f70 {{(pid=72586) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 21:38:44 user nova-compute[72586]: DEBUG nova.network.neutron [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Successfully updated port: 9bddd744-887b-44bf-aacf-d7606c470f70 {{(pid=72586) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 21:38:44 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Acquiring lock "refresh_cache-178d26d5-3570-442f-9268-21cd73cccfc7" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:38:44 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Acquired lock "refresh_cache-178d26d5-3570-442f-9268-21cd73cccfc7" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:38:44 user nova-compute[72586]: DEBUG nova.network.neutron [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:38:44 user nova-compute[72586]: DEBUG nova.compute.manager [req-418fc8cb-2b7a-462f-8a31-8cea3923aa7d req-b68671fe-b6a6-436e-9475-7bf7c6117d6c service nova] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Received event network-changed-9bddd744-887b-44bf-aacf-d7606c470f70 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:38:44 user nova-compute[72586]: DEBUG nova.compute.manager [req-418fc8cb-2b7a-462f-8a31-8cea3923aa7d req-b68671fe-b6a6-436e-9475-7bf7c6117d6c service nova] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Refreshing instance network info cache due to event network-changed-9bddd744-887b-44bf-aacf-d7606c470f70. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:38:44 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-418fc8cb-2b7a-462f-8a31-8cea3923aa7d req-b68671fe-b6a6-436e-9475-7bf7c6117d6c service nova] Acquiring lock "refresh_cache-178d26d5-3570-442f-9268-21cd73cccfc7" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:38:44 user nova-compute[72586]: DEBUG nova.network.neutron [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Instance cache missing network info. {{(pid=72586) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 21:38:44 user nova-compute[72586]: DEBUG nova.network.neutron [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Updating instance_info_cache with network_info: [{"id": "9bddd744-887b-44bf-aacf-d7606c470f70", "address": "fa:16:3e:50:53:8c", "network": {"id": "86940e5d-852b-48fc-9b0e-858305321349", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1967467603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d847d04360420c80ea5608d5a2b15a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bddd744-88", "ovs_interfaceid": "9bddd744-887b-44bf-aacf-d7606c470f70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:38:44 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Releasing lock "refresh_cache-178d26d5-3570-442f-9268-21cd73cccfc7" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:38:44 user nova-compute[72586]: DEBUG nova.compute.manager [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Instance network_info: |[{"id": "9bddd744-887b-44bf-aacf-d7606c470f70", "address": "fa:16:3e:50:53:8c", "network": {"id": "86940e5d-852b-48fc-9b0e-858305321349", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1967467603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d847d04360420c80ea5608d5a2b15a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bddd744-88", "ovs_interfaceid": "9bddd744-887b-44bf-aacf-d7606c470f70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 21:38:44 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-418fc8cb-2b7a-462f-8a31-8cea3923aa7d req-b68671fe-b6a6-436e-9475-7bf7c6117d6c service nova] Acquired lock "refresh_cache-178d26d5-3570-442f-9268-21cd73cccfc7" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:38:44 user nova-compute[72586]: DEBUG nova.network.neutron [req-418fc8cb-2b7a-462f-8a31-8cea3923aa7d req-b68671fe-b6a6-436e-9475-7bf7c6117d6c service nova] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Refreshing network info cache for port 9bddd744-887b-44bf-aacf-d7606c470f70 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:38:45 user nova-compute[72586]: DEBUG nova.network.neutron [req-418fc8cb-2b7a-462f-8a31-8cea3923aa7d req-b68671fe-b6a6-436e-9475-7bf7c6117d6c service nova] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Updated VIF entry in instance network info cache for port 9bddd744-887b-44bf-aacf-d7606c470f70. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:38:45 user nova-compute[72586]: DEBUG nova.network.neutron [req-418fc8cb-2b7a-462f-8a31-8cea3923aa7d req-b68671fe-b6a6-436e-9475-7bf7c6117d6c service nova] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Updating instance_info_cache with network_info: [{"id": "9bddd744-887b-44bf-aacf-d7606c470f70", "address": "fa:16:3e:50:53:8c", "network": {"id": "86940e5d-852b-48fc-9b0e-858305321349", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1967467603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d847d04360420c80ea5608d5a2b15a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bddd744-88", "ovs_interfaceid": "9bddd744-887b-44bf-aacf-d7606c470f70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:38:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-418fc8cb-2b7a-462f-8a31-8cea3923aa7d req-b68671fe-b6a6-436e-9475-7bf7c6117d6c service nova] Releasing lock "refresh_cache-178d26d5-3570-442f-9268-21cd73cccfc7" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:38:45 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:38:50 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:38:51 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a003f0c7-837b-4eca-8b8c-e85843a37431 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Acquiring lock "314f9b05-527c-459d-aca7-acc696ac613f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:38:51 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a003f0c7-837b-4eca-8b8c-e85843a37431 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "314f9b05-527c-459d-aca7-acc696ac613f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:38:51 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a003f0c7-837b-4eca-8b8c-e85843a37431 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Acquiring lock "314f9b05-527c-459d-aca7-acc696ac613f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:38:51 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a003f0c7-837b-4eca-8b8c-e85843a37431 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "314f9b05-527c-459d-aca7-acc696ac613f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:38:51 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a003f0c7-837b-4eca-8b8c-e85843a37431 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "314f9b05-527c-459d-aca7-acc696ac613f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:38:51 user nova-compute[72586]: INFO nova.compute.manager [None req-a003f0c7-837b-4eca-8b8c-e85843a37431 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Terminating instance
Aug 01 21:38:51 user nova-compute[72586]: DEBUG nova.compute.manager [None req-a003f0c7-837b-4eca-8b8c-e85843a37431 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Start destroying the instance on the hypervisor. {{(pid=72586) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 21:38:52 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:38:52 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:38:52 user nova-compute[72586]: DEBUG nova.compute.manager [req-0b300ea4-94a5-4592-a65f-c623e8884a53 req-c0fc48f2-227b-4209-ad73-1cac132f264e service nova] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Received event network-vif-unplugged-eeebb619-be12-42d7-96f3-e309b6d4cdaf {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:38:52 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-0b300ea4-94a5-4592-a65f-c623e8884a53 req-c0fc48f2-227b-4209-ad73-1cac132f264e service nova] Acquiring lock "314f9b05-527c-459d-aca7-acc696ac613f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:38:52 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-0b300ea4-94a5-4592-a65f-c623e8884a53 req-c0fc48f2-227b-4209-ad73-1cac132f264e service nova] Lock "314f9b05-527c-459d-aca7-acc696ac613f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:38:52 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-0b300ea4-94a5-4592-a65f-c623e8884a53 req-c0fc48f2-227b-4209-ad73-1cac132f264e service nova] Lock "314f9b05-527c-459d-aca7-acc696ac613f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:38:52 user nova-compute[72586]: DEBUG nova.compute.manager [req-0b300ea4-94a5-4592-a65f-c623e8884a53 req-c0fc48f2-227b-4209-ad73-1cac132f264e service nova] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] No waiting events found dispatching network-vif-unplugged-eeebb619-be12-42d7-96f3-e309b6d4cdaf {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:38:52 user nova-compute[72586]: DEBUG nova.compute.manager [req-0b300ea4-94a5-4592-a65f-c623e8884a53 req-c0fc48f2-227b-4209-ad73-1cac132f264e service nova] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Received event network-vif-unplugged-eeebb619-be12-42d7-96f3-e309b6d4cdaf for instance with task_state deleting. {{(pid=72586) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 21:38:52 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:38:52 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:38:52 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Instance destroyed successfully.
Aug 01 21:38:52 user nova-compute[72586]: DEBUG nova.objects.instance [None req-a003f0c7-837b-4eca-8b8c-e85843a37431 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lazy-loading 'resources' on Instance uuid 314f9b05-527c-459d-aca7-acc696ac613f {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:38:52 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-a003f0c7-837b-4eca-8b8c-e85843a37431 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:32:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-400634865',display_name='tempest-ServerActionsTestOtherA-server-400634865',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-400634865',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPk4vuGAtPXP/Itqq7TbQ+6Sv+k5bpNQFeCgGdApIPBaVaeUmQBoiJZa5I5091aDIuYBB7Uba3sQDG1YP/kTFSXvqkIW2yu6s2YyWP+iKPKZLzdQkqmU2IfIy2EEsidssA==',key_name='tempest-keypair-400537691',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:34:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='19af48ffce7e4703b6d978bc3563680e',ramdisk_id='',reservation_id='r-0fzqwm4s',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-825165282',owner_user_name='tempest-ServerActionsTestOtherA-825165282-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:36:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88d01b1101164c859b19d41e251447a5',uuid=314f9b05-527c-459d-aca7-acc696ac613f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eeebb619-be12-42d7-96f3-e309b6d4cdaf", "address": "fa:16:3e:5d:69:cd", "network": {"id": "aab9a541-2149-4c65-b60e-80a1daca6632", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1355256264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19af48ffce7e4703b6d978bc3563680e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeebb619-be", "ovs_interfaceid": "eeebb619-be12-42d7-96f3-e309b6d4cdaf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:38:52 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-a003f0c7-837b-4eca-8b8c-e85843a37431 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Converting VIF {"id": "eeebb619-be12-42d7-96f3-e309b6d4cdaf", "address": "fa:16:3e:5d:69:cd", "network": {"id": "aab9a541-2149-4c65-b60e-80a1daca6632", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1355256264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19af48ffce7e4703b6d978bc3563680e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeebb619-be", "ovs_interfaceid": "eeebb619-be12-42d7-96f3-e309b6d4cdaf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:38:52 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-a003f0c7-837b-4eca-8b8c-e85843a37431 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:69:cd,bridge_name='br-int',has_traffic_filtering=True,id=eeebb619-be12-42d7-96f3-e309b6d4cdaf,network=Network(aab9a541-2149-4c65-b60e-80a1daca6632),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeebb619-be') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:38:52 user nova-compute[72586]: DEBUG os_vif [None req-a003f0c7-837b-4eca-8b8c-e85843a37431 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:69:cd,bridge_name='br-int',has_traffic_filtering=True,id=eeebb619-be12-42d7-96f3-e309b6d4cdaf,network=Network(aab9a541-2149-4c65-b60e-80a1daca6632),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeebb619-be') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:38:52 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:38:52 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeeebb619-be, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:38:52 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:38:52 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:38:52 user nova-compute[72586]: INFO os_vif [None req-a003f0c7-837b-4eca-8b8c-e85843a37431 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:69:cd,bridge_name='br-int',has_traffic_filtering=True,id=eeebb619-be12-42d7-96f3-e309b6d4cdaf,network=Network(aab9a541-2149-4c65-b60e-80a1daca6632),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeebb619-be')
Aug 01 21:38:52 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a003f0c7-837b-4eca-8b8c-e85843a37431 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] calling os-brick to detach iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 21:38:52 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-a003f0c7-837b-4eca-8b8c-e85843a37431 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, {'target_iqns': ['iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'roGchSeU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:38:52 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-a003f0c7-837b-4eca-8b8c-e85843a37431 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:38:52 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-a003f0c7-837b-4eca-8b8c-e85843a37431 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:38:52 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-a003f0c7-837b-4eca-8b8c-e85843a37431 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:38:52 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-a003f0c7-837b-4eca-8b8c-e85843a37431 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843', 0)] {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 21:38:52 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:38:52 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:38:52 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64f557b-ad89-4133-8f1a-39bc54493235]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:38:52 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:38:52 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:38:52 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ca8200-02a7-4d50-aae8-b23fc7554ae0]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:38:52 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-a003f0c7-837b-4eca-8b8c-e85843a37431 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:38:52 user nova-compute[72586]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 (non-flash)
Aug 01 21:38:52 user nova-compute[72586]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d (non-flash)
Aug 01 21:38:52 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:38:52 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-a003f0c7-837b-4eca-8b8c-e85843a37431 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:38:52 user nova-compute[72586]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 (non-flash)
Aug 01 21:38:52 user nova-compute[72586]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d (non-flash)
Aug 01 21:38:52 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:38:52 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-a003f0c7-837b-4eca-8b8c-e85843a37431 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ed0787d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843'): ({'sdd'}, set())}) {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 21:38:52 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-a003f0c7-837b-4eca-8b8c-e85843a37431 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Removing single pathed devices sdd {{(pid=72586) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 21:38:52 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:38:52 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:38:52 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0ed9d0-d84e-45fe-a783-0f35008b2072]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:38:52 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:38:52 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:38:52 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[810e4d7f-254f-49e5-a8c1-243f2d735536]: (4, ('ok\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:38:52 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-a003f0c7-837b-4eca-8b8c-e85843a37431 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Flushing IO for device /dev/sdd {{(pid=72586) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 21:38:52 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:38:52 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.054s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:38:52 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[249afd53-937b-4f9b-8208-9b9e5d6dc5fd]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:38:52 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-a003f0c7-837b-4eca-8b8c-e85843a37431 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72586) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 21:38:52 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:38:53 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:38:53 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[878f3596-08f2-4ce9-9921-4147b58f1a27]: (4, ('1', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:38:53 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-a003f0c7-837b-4eca-8b8c-e85843a37431 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 21:38:53 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-a003f0c7-837b-4eca-8b8c-e85843a37431 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] SCSI volumes sdd have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 21:38:53 user nova-compute[72586]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26636643961363439', '/dev/disk/by-id/scsi-1SCST_BIOce52f91a-f6d9a649bda9d3e6', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_ce52f91a') {{(pid=83581) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 01 21:38:53 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[c826c141-ea71-4aeb-8936-eeb041f78595]: (4, None) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:38:53 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-a003f0c7-837b-4eca-8b8c-e85843a37431 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843')] {{(pid=72586) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 21:38:53 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:38:53 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:38:53 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6b636a-ddbf-43fb-9429-b2511c6de9df]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:38:53 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-a003f0c7-837b-4eca-8b8c-e85843a37431 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:38:53 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 -p 172.16.0.220:3260 --logout {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:38:53 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:38:53 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1c10d5-7eea-4d55-b042-700e779258e7]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:38:53 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-a003f0c7-837b-4eca-8b8c-e85843a37431 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843, portal: 172.16.0.220,3260]
Aug 01 21:38:53 user nova-compute[72586]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843, portal: 172.16.0.220,3260] successful.
Aug 01 21:38:53 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:38:53 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 -p 172.16.0.220:3260 --op delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:38:53 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:594ff51e-685a-4144-8733-decfebb84843 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:38:53 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f64440f-be65-4c72-9888-354684e92154]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:38:53 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-a003f0c7-837b-4eca-8b8c-e85843a37431 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:38:53 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-a003f0c7-837b-4eca-8b8c-e85843a37431 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:38:53 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-a003f0c7-837b-4eca-8b8c-e85843a37431 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] <== disconnect_volume: return (345ms) None {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:38:53 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a003f0c7-837b-4eca-8b8c-e85843a37431 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Disconnected iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 21:38:53 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-a003f0c7-837b-4eca-8b8c-e85843a37431 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Deleting instance files /opt/stack/data/nova/instances/314f9b05-527c-459d-aca7-acc696ac613f_del
Aug 01 21:38:53 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-a003f0c7-837b-4eca-8b8c-e85843a37431 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Deletion of /opt/stack/data/nova/instances/314f9b05-527c-459d-aca7-acc696ac613f_del complete
Aug 01 21:38:53 user nova-compute[72586]: INFO nova.compute.manager [None req-a003f0c7-837b-4eca-8b8c-e85843a37431 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Took 1.28 seconds to destroy the instance on the hypervisor.
Aug 01 21:38:53 user nova-compute[72586]: DEBUG oslo.service.loopingcall [None req-a003f0c7-837b-4eca-8b8c-e85843a37431 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72586) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 21:38:53 user nova-compute[72586]: DEBUG nova.compute.manager [-] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Deallocating network for instance {{(pid=72586) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 21:38:53 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] deallocate_for_instance() {{(pid=72586) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 21:38:53 user nova-compute[72586]: DEBUG os_brick.utils [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:38:53 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:38:53 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:38:53 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff04aa2-bfbe-422e-88a8-e0cf18c1b892]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4bc202fb9cb\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:38:53 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:38:53 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:38:53 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a78e6a-4594-42d2-b579-c7f8b9e373f0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:38:53 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:38:53 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:38:53 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[92bb9bb2-d801-4459-b1c7-9634f3e0c66f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:38:53 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a40c5a-1306-4c2e-b583-2c3aec58c253]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:38:53 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Running cmd (subprocess): nvme version {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:38:53 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] 'nvme version' failed. Not Retrying. {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:38:53 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.nvmeof [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] nvme not present on system {{(pid=72586) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 21:38:53 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:38:53 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:38:53 user nova-compute[72586]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 21:38:53 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6f3334-2880-420e-85ec-d9165e846204]: (4, '') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:38:53 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72586) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 21:38:53 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 21:38:53 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] LIGHTOS: no hostnqn found. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 21:38:53 user nova-compute[72586]: DEBUG os_brick.utils [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4bc202fb9cb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:38:53 user nova-compute[72586]: DEBUG nova.virt.block_device [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Updating existing volume attachment record: f1cd0544-600e-4a25-a046-705d3583237f {{(pid=72586) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 21:38:54 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:38:54 user nova-compute[72586]: DEBUG nova.compute.manager [req-00591115-dab6-40ec-85d2-6404e8ebd523 req-20454b94-998f-47bc-8a3c-b8e69979c344 service nova] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Received event network-vif-deleted-eeebb619-be12-42d7-96f3-e309b6d4cdaf {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:38:54 user nova-compute[72586]: INFO nova.compute.manager [req-00591115-dab6-40ec-85d2-6404e8ebd523 req-20454b94-998f-47bc-8a3c-b8e69979c344 service nova] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Neutron deleted interface eeebb619-be12-42d7-96f3-e309b6d4cdaf; detaching it from the instance and deleting it from the info cache
Aug 01 21:38:54 user nova-compute[72586]: DEBUG nova.network.neutron [req-00591115-dab6-40ec-85d2-6404e8ebd523 req-20454b94-998f-47bc-8a3c-b8e69979c344 service nova] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:38:54 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Took 1.02 seconds to deallocate network for instance.
Aug 01 21:38:54 user nova-compute[72586]: DEBUG nova.compute.manager [req-560cb414-2ccd-4e34-a9b4-a8f176050eb8 req-e4fe6941-2dcc-46c3-a6f6-808aeb87f945 service nova] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Received event network-vif-plugged-eeebb619-be12-42d7-96f3-e309b6d4cdaf {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:38:54 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-560cb414-2ccd-4e34-a9b4-a8f176050eb8 req-e4fe6941-2dcc-46c3-a6f6-808aeb87f945 service nova] Acquiring lock "314f9b05-527c-459d-aca7-acc696ac613f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:38:54 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-560cb414-2ccd-4e34-a9b4-a8f176050eb8 req-e4fe6941-2dcc-46c3-a6f6-808aeb87f945 service nova] Lock "314f9b05-527c-459d-aca7-acc696ac613f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:38:54 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-560cb414-2ccd-4e34-a9b4-a8f176050eb8 req-e4fe6941-2dcc-46c3-a6f6-808aeb87f945 service nova] Lock "314f9b05-527c-459d-aca7-acc696ac613f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:38:54 user nova-compute[72586]: DEBUG nova.compute.manager [req-560cb414-2ccd-4e34-a9b4-a8f176050eb8 req-e4fe6941-2dcc-46c3-a6f6-808aeb87f945 service nova] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] No waiting events found dispatching network-vif-plugged-eeebb619-be12-42d7-96f3-e309b6d4cdaf {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:38:54 user nova-compute[72586]: WARNING nova.compute.manager [req-560cb414-2ccd-4e34-a9b4-a8f176050eb8 req-e4fe6941-2dcc-46c3-a6f6-808aeb87f945 service nova] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Received unexpected event network-vif-plugged-eeebb619-be12-42d7-96f3-e309b6d4cdaf for instance with vm_state active and task_state deleting.
Aug 01 21:38:54 user nova-compute[72586]: DEBUG nova.compute.manager [req-00591115-dab6-40ec-85d2-6404e8ebd523 req-20454b94-998f-47bc-8a3c-b8e69979c344 service nova] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Detach interface failed, port_id=eeebb619-be12-42d7-96f3-e309b6d4cdaf, reason: Instance 314f9b05-527c-459d-aca7-acc696ac613f could not be found. {{(pid=72586) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 21:38:54 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:38:55 user nova-compute[72586]: INFO nova.compute.manager [None req-a003f0c7-837b-4eca-8b8c-e85843a37431 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Took 0.77 seconds to detach 1 volumes for instance.
Aug 01 21:38:55 user nova-compute[72586]: DEBUG nova.compute.manager [None req-a003f0c7-837b-4eca-8b8c-e85843a37431 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Deleting volume: 594ff51e-685a-4144-8733-decfebb84843 {{(pid=72586) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 01 21:38:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a003f0c7-837b-4eca-8b8c-e85843a37431 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:38:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a003f0c7-837b-4eca-8b8c-e85843a37431 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:38:55 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-a003f0c7-837b-4eca-8b8c-e85843a37431 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:38:55 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-a003f0c7-837b-4eca-8b8c-e85843a37431 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:38:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a003f0c7-837b-4eca-8b8c-e85843a37431 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.392s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:38:55 user nova-compute[72586]: INFO nova.scheduler.client.report [None req-a003f0c7-837b-4eca-8b8c-e85843a37431 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Deleted allocations for instance 314f9b05-527c-459d-aca7-acc696ac613f
Aug 01 21:38:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a003f0c7-837b-4eca-8b8c-e85843a37431 tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "314f9b05-527c-459d-aca7-acc696ac613f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.897s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:38:57 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:38:59 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG nova.compute.manager [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Start spawning the instance on the hypervisor. {{(pid=72586) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Creating instance directory {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 21:39:01 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Creating image(s)
Aug 01 21:39:01 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Did not create local disks {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Ensure instance console log exists: /opt/stack/data/nova/instances/178d26d5-3570-442f-9268-21cd73cccfc7/console.log {{(pid=72586) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Start _get_guest_xml network_info=[{"id": "9bddd744-887b-44bf-aacf-d7606c470f70", "address": "fa:16:3e:50:53:8c", "network": {"id": "86940e5d-852b-48fc-9b0e-858305321349", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1967467603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d847d04360420c80ea5608d5a2b15a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bddd744-88", "ovs_interfaceid": "9bddd744-887b-44bf-aacf-d7606c470f70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Dfqvdwst', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '178d26d5-3570-442f-9268-21cd73cccfc7', 'attached_at': '', 'detached_at': '', 'volume_id': 'b89d79f8-7470-41bf-80e3-b41c398493ec', 'serial': 'b89d79f8-7470-41bf-80e3-b41c398493ec'}, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'f1cd0544-600e-4a25-a046-705d3583237f', 'delete_on_termination': False, 'volume_type': None} {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:39:01 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:39:01 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:39:01 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Calling os-brick to attach iSCSI Volume {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Dfqvdwst', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:39:01 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:39:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:39:01 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:39:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:39:01 user nova-compute[72586]: INFO os_brick.initiator.connectors.iscsi [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 21:39:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec -p 172.16.0.220:3260 {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[18132611-bf3d-4c32-8c71-c48a8c59d8f4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 21:39:01 user nova-compute[72586]:  {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec -p 172.16.0.220:3260 --interface default --op new {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea921d27-6463-4c6a-af88-dc448fca8e02]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec] added\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec] added
Aug 01 21:39:01 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc39de09-9ccd-4eba-b638-f212a2471cd6]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[137f63f6-143c-4c80-8250-d8554c17c40c]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Dfqvdwst {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Dfqvdwst" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[206ae3a9-f262-4390-ab7c-694c382aef04]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'Dfqvdwst'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72a9e8b-1488-47fe-b87d-3a77a1e10869]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7ff984-31fc-4849-9696-c34d897db156]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:39:01 user nova-compute[72586]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d (non-flash)
Aug 01 21:39:01 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:39:01 user nova-compute[72586]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d (non-flash)
Aug 01 21:39:01 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec -p 172.16.0.220:3260 --login {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b723fb25-5cba-4adf-b01b-803a7768e58a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec, portal: 172.16.0.220,3260]
Aug 01 21:39:01 user nova-compute[72586]: Login to [iface: default, target: iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec, portal: 172.16.0.220,3260] successful.
Aug 01 21:39:01 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ef634c-98b7-4224-970b-52ff62e8e616]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[97855df4-5bff-4f23-8c6c-764ac2e84c44]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:39:01 user nova-compute[72586]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d (non-flash)
Aug 01 21:39:01 user nova-compute[72586]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec (non-flash)
Aug 01 21:39:01 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:39:01 user nova-compute[72586]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d (non-flash)
Aug 01 21:39:01 user nova-compute[72586]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec (non-flash)
Aug 01 21:39:01 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Connected to 172.16.0.220:3260 {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] HCTL ('35', '-', '-', 0) found on session 42 with lun 0 {{(pid=72586) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72586) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe26654-df76-448d-bac2-4b3962ef674a]: (4, ('- - 0', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:39:01 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Searching for a device in session 42 and hctl ['35', '*', '*', 0] yield: None {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:39:02 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Searching for a device in session 42 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:39:02 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Dfqvdwst', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 21:39:02 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:39:02 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '26634633333623461', 'path': '/dev/sdd'} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:39:02 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634633333623461', 'path': '/dev/sdd'} {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 21:39:02 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:38:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1421463273',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1421463273',id=35,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88d847d04360420c80ea5608d5a2b15a',ramdisk_id='',reservation_id='r-emch0wow',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1268085586',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:38:43Z,user_data=None,user_id='a984642731b9413c97038f65052ab92d',uuid=178d26d5-3570-442f-9268-21cd73cccfc7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9bddd744-887b-44bf-aacf-d7606c470f70", "address": "fa:16:3e:50:53:8c", "network": {"id": "86940e5d-852b-48fc-9b0e-858305321349", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1967467603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d847d04360420c80ea5608d5a2b15a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bddd744-88", "ovs_interfaceid": "9bddd744-887b-44bf-aacf-d7606c470f70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:39:02 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Converting VIF {"id": "9bddd744-887b-44bf-aacf-d7606c470f70", "address": "fa:16:3e:50:53:8c", "network": {"id": "86940e5d-852b-48fc-9b0e-858305321349", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1967467603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d847d04360420c80ea5608d5a2b15a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bddd744-88", "ovs_interfaceid": "9bddd744-887b-44bf-aacf-d7606c470f70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:39:02 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:53:8c,bridge_name='br-int',has_traffic_filtering=True,id=9bddd744-887b-44bf-aacf-d7606c470f70,network=Network(86940e5d-852b-48fc-9b0e-858305321349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bddd744-88') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:39:02 user nova-compute[72586]: DEBUG nova.objects.instance [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lazy-loading 'pci_devices' on Instance uuid 178d26d5-3570-442f-9268-21cd73cccfc7 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:39:02 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:39:02 user nova-compute[72586]:   <uuid>178d26d5-3570-442f-9268-21cd73cccfc7</uuid>
Aug 01 21:39:02 user nova-compute[72586]:   <name>instance-00000023</name>
Aug 01 21:39:02 user nova-compute[72586]:   <memory>524288</memory>
Aug 01 21:39:02 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:39:02 user nova-compute[72586]:   <metadata>
Aug 01 21:39:02 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:39:02 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:39:02 user nova-compute[72586]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1421463273</nova:name>
Aug 01 21:39:02 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:39:01</nova:creationTime>
Aug 01 21:39:02 user nova-compute[72586]:       <nova:flavor name="m1.tiny">
Aug 01 21:39:02 user nova-compute[72586]:         <nova:memory>512</nova:memory>
Aug 01 21:39:02 user nova-compute[72586]:         <nova:disk>1</nova:disk>
Aug 01 21:39:02 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:39:02 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:39:02 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:39:02 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:39:02 user nova-compute[72586]:       <nova:owner>
Aug 01 21:39:02 user nova-compute[72586]:         <nova:user uuid="a984642731b9413c97038f65052ab92d">tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member</nova:user>
Aug 01 21:39:02 user nova-compute[72586]:         <nova:project uuid="88d847d04360420c80ea5608d5a2b15a">tempest-ServerBootFromVolumeStableRescueTest-1268085586</nova:project>
Aug 01 21:39:02 user nova-compute[72586]:       </nova:owner>
Aug 01 21:39:02 user nova-compute[72586]:       <nova:root type="image" uuid="0243d46b-6819-42a5-926f-42b71f0c97ad"/>
Aug 01 21:39:02 user nova-compute[72586]:       <nova:ports>
Aug 01 21:39:02 user nova-compute[72586]:         <nova:port uuid="9bddd744-887b-44bf-aacf-d7606c470f70">
Aug 01 21:39:02 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 01 21:39:02 user nova-compute[72586]:         </nova:port>
Aug 01 21:39:02 user nova-compute[72586]:       </nova:ports>
Aug 01 21:39:02 user nova-compute[72586]:     </nova:instance>
Aug 01 21:39:02 user nova-compute[72586]:   </metadata>
Aug 01 21:39:02 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:39:02 user nova-compute[72586]:     <system>
Aug 01 21:39:02 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:39:02 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:39:02 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:39:02 user nova-compute[72586]:       <entry name="serial">178d26d5-3570-442f-9268-21cd73cccfc7</entry>
Aug 01 21:39:02 user nova-compute[72586]:       <entry name="uuid">178d26d5-3570-442f-9268-21cd73cccfc7</entry>
Aug 01 21:39:02 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:39:02 user nova-compute[72586]:     </system>
Aug 01 21:39:02 user nova-compute[72586]:   </sysinfo>
Aug 01 21:39:02 user nova-compute[72586]:   <os>
Aug 01 21:39:02 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:39:02 user nova-compute[72586]:     <boot dev="hd"/>
Aug 01 21:39:02 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:39:02 user nova-compute[72586]:   </os>
Aug 01 21:39:02 user nova-compute[72586]:   <features>
Aug 01 21:39:02 user nova-compute[72586]:     <acpi/>
Aug 01 21:39:02 user nova-compute[72586]:     <apic/>
Aug 01 21:39:02 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:39:02 user nova-compute[72586]:   </features>
Aug 01 21:39:02 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:39:02 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:39:02 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:39:02 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:39:02 user nova-compute[72586]:   </clock>
Aug 01 21:39:02 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:39:02 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:39:02 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:39:02 user nova-compute[72586]:   </cpu>
Aug 01 21:39:02 user nova-compute[72586]:   <devices>
Aug 01 21:39:02 user nova-compute[72586]:     <disk type="block" device="disk">
Aug 01 21:39:02 user nova-compute[72586]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:39:02 user nova-compute[72586]:       <source dev="/dev/sdd"/>
Aug 01 21:39:02 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:39:02 user nova-compute[72586]:       <serial>b89d79f8-7470-41bf-80e3-b41c398493ec</serial>
Aug 01 21:39:02 user nova-compute[72586]:     </disk>
Aug 01 21:39:02 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:39:02 user nova-compute[72586]:       <mac address="fa:16:3e:50:53:8c"/>
Aug 01 21:39:02 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:39:02 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:39:02 user nova-compute[72586]:       <target dev="tap9bddd744-88"/>
Aug 01 21:39:02 user nova-compute[72586]:     </interface>
Aug 01 21:39:02 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:39:02 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/178d26d5-3570-442f-9268-21cd73cccfc7/console.log" append="off"/>
Aug 01 21:39:02 user nova-compute[72586]:     </serial>
Aug 01 21:39:02 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:39:02 user nova-compute[72586]:     <video>
Aug 01 21:39:02 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:39:02 user nova-compute[72586]:     </video>
Aug 01 21:39:02 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:39:02 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:39:02 user nova-compute[72586]:     </rng>
Aug 01 21:39:02 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:39:02 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:39:02 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:39:02 user nova-compute[72586]:     </memballoon>
Aug 01 21:39:02 user nova-compute[72586]:   </devices>
Aug 01 21:39:02 user nova-compute[72586]: </domain>
Aug 01 21:39:02 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:39:02 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:38:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1421463273',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1421463273',id=35,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88d847d04360420c80ea5608d5a2b15a',ramdisk_id='',reservation_id='r-emch0wow',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1268085586',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:38:43Z,user_data=None,user_id='a984642731b9413c97038f65052ab92d',uuid=178d26d5-3570-442f-9268-21cd73cccfc7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9bddd744-887b-44bf-aacf-d7606c470f70", "address": "fa:16:3e:50:53:8c", "network": {"id": "86940e5d-852b-48fc-9b0e-858305321349", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1967467603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d847d04360420c80ea5608d5a2b15a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bddd744-88", "ovs_interfaceid": "9bddd744-887b-44bf-aacf-d7606c470f70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:39:02 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Converting VIF {"id": "9bddd744-887b-44bf-aacf-d7606c470f70", "address": "fa:16:3e:50:53:8c", "network": {"id": "86940e5d-852b-48fc-9b0e-858305321349", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1967467603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d847d04360420c80ea5608d5a2b15a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bddd744-88", "ovs_interfaceid": "9bddd744-887b-44bf-aacf-d7606c470f70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:39:02 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:53:8c,bridge_name='br-int',has_traffic_filtering=True,id=9bddd744-887b-44bf-aacf-d7606c470f70,network=Network(86940e5d-852b-48fc-9b0e-858305321349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bddd744-88') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:39:02 user nova-compute[72586]: DEBUG os_vif [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:53:8c,bridge_name='br-int',has_traffic_filtering=True,id=9bddd744-887b-44bf-aacf-d7606c470f70,network=Network(86940e5d-852b-48fc-9b0e-858305321349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bddd744-88') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:39:02 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:39:02 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:39:02 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:39:02 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:39:02 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9bddd744-88, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:39:02 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9bddd744-88, col_values=(('external_ids', {'iface-id': '9bddd744-887b-44bf-aacf-d7606c470f70', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:53:8c', 'vm-uuid': '178d26d5-3570-442f-9268-21cd73cccfc7'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:39:02 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:39:02 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:39:02 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:39:02 user nova-compute[72586]: INFO os_vif [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:53:8c,bridge_name='br-int',has_traffic_filtering=True,id=9bddd744-887b-44bf-aacf-d7606c470f70,network=Network(86940e5d-852b-48fc-9b0e-858305321349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bddd744-88')
Aug 01 21:39:02 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:39:02 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] No VIF found with MAC fa:16:3e:50:53:8c, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:39:04 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:39:04 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:39:04 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:39:04 user nova-compute[72586]: DEBUG nova.compute.manager [req-6daf4b15-8020-447d-9ab3-96342f2a07e9 req-5ea7c722-f842-478a-9fef-4d85b5d06c86 service nova] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Received event network-vif-plugged-9bddd744-887b-44bf-aacf-d7606c470f70 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:39:04 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-6daf4b15-8020-447d-9ab3-96342f2a07e9 req-5ea7c722-f842-478a-9fef-4d85b5d06c86 service nova] Acquiring lock "178d26d5-3570-442f-9268-21cd73cccfc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:39:04 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-6daf4b15-8020-447d-9ab3-96342f2a07e9 req-5ea7c722-f842-478a-9fef-4d85b5d06c86 service nova] Lock "178d26d5-3570-442f-9268-21cd73cccfc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:39:04 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-6daf4b15-8020-447d-9ab3-96342f2a07e9 req-5ea7c722-f842-478a-9fef-4d85b5d06c86 service nova] Lock "178d26d5-3570-442f-9268-21cd73cccfc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:39:04 user nova-compute[72586]: DEBUG nova.compute.manager [req-6daf4b15-8020-447d-9ab3-96342f2a07e9 req-5ea7c722-f842-478a-9fef-4d85b5d06c86 service nova] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] No waiting events found dispatching network-vif-plugged-9bddd744-887b-44bf-aacf-d7606c470f70 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:39:04 user nova-compute[72586]: WARNING nova.compute.manager [req-6daf4b15-8020-447d-9ab3-96342f2a07e9 req-5ea7c722-f842-478a-9fef-4d85b5d06c86 service nova] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Received unexpected event network-vif-plugged-9bddd744-887b-44bf-aacf-d7606c470f70 for instance with vm_state building and task_state spawning.
Aug 01 21:39:04 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:39:04 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:39:06 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925946.4507885, 178d26d5-3570-442f-9268-21cd73cccfc7 => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:39:06 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] VM Resumed (Lifecycle Event)
Aug 01 21:39:06 user nova-compute[72586]: DEBUG nova.compute.manager [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Instance event wait completed in 0 seconds for  {{(pid=72586) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 21:39:06 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Guest created on hypervisor {{(pid=72586) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 21:39:06 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Instance spawned successfully.
Aug 01 21:39:06 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 21:39:06 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:39:06 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:39:06 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Found default for hw_cdrom_bus of ide {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:39:06 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Found default for hw_disk_bus of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:39:06 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Found default for hw_input_bus of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:39:06 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Found default for hw_pointer_model of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:39:06 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Found default for hw_video_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:39:06 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Found default for hw_vif_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:39:06 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:39:06 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925946.4521258, 178d26d5-3570-442f-9268-21cd73cccfc7 => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:39:06 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] VM Started (Lifecycle Event)
Aug 01 21:39:06 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:39:06 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:39:06 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:39:06 user nova-compute[72586]: INFO nova.compute.manager [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Took 5.23 seconds to spawn the instance on the hypervisor.
Aug 01 21:39:06 user nova-compute[72586]: DEBUG nova.compute.manager [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:39:06 user nova-compute[72586]: DEBUG nova.compute.manager [req-08b0a1bf-b5b9-4db0-92db-987cbb8f521f req-224731d7-b408-42c8-8cfa-0b8ab05b6c7b service nova] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Received event network-vif-plugged-9bddd744-887b-44bf-aacf-d7606c470f70 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:39:06 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-08b0a1bf-b5b9-4db0-92db-987cbb8f521f req-224731d7-b408-42c8-8cfa-0b8ab05b6c7b service nova] Acquiring lock "178d26d5-3570-442f-9268-21cd73cccfc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:39:06 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-08b0a1bf-b5b9-4db0-92db-987cbb8f521f req-224731d7-b408-42c8-8cfa-0b8ab05b6c7b service nova] Lock "178d26d5-3570-442f-9268-21cd73cccfc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:39:06 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-08b0a1bf-b5b9-4db0-92db-987cbb8f521f req-224731d7-b408-42c8-8cfa-0b8ab05b6c7b service nova] Lock "178d26d5-3570-442f-9268-21cd73cccfc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:39:06 user nova-compute[72586]: DEBUG nova.compute.manager [req-08b0a1bf-b5b9-4db0-92db-987cbb8f521f req-224731d7-b408-42c8-8cfa-0b8ab05b6c7b service nova] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] No waiting events found dispatching network-vif-plugged-9bddd744-887b-44bf-aacf-d7606c470f70 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:39:06 user nova-compute[72586]: WARNING nova.compute.manager [req-08b0a1bf-b5b9-4db0-92db-987cbb8f521f req-224731d7-b408-42c8-8cfa-0b8ab05b6c7b service nova] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Received unexpected event network-vif-plugged-9bddd744-887b-44bf-aacf-d7606c470f70 for instance with vm_state building and task_state spawning.
Aug 01 21:39:06 user nova-compute[72586]: INFO nova.compute.manager [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Took 24.69 seconds to build instance.
Aug 01 21:39:06 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-be65dbbc-372f-4309-b668-bb8f7f9dc820 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "178d26d5-3570-442f-9268-21cd73cccfc7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.893s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:39:07 user nova-compute[72586]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690925932.7799728, 314f9b05-527c-459d-aca7-acc696ac613f => Stopped> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:39:07 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] VM Stopped (Lifecycle Event)
Aug 01 21:39:07 user nova-compute[72586]: DEBUG nova.compute.manager [None req-11e4f1a5-c58f-4485-acff-97ef1b211a0d None None] [instance: 314f9b05-527c-459d-aca7-acc696ac613f] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:39:07 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:39:09 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:39:11 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:39:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:39:13 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:39:14 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:39:17 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:39:17 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:39:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:39:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:39:20 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Acquiring lock "b436dd23-122a-4da5-9fa7-1d658909b16e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:39:20 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Lock "b436dd23-122a-4da5-9fa7-1d658909b16e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:39:20 user nova-compute[72586]: DEBUG nova.compute.manager [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] Starting instance... {{(pid=72586) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 21:39:20 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:39:20 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:39:20 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72586) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 21:39:20 user nova-compute[72586]: INFO nova.compute.claims [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] Claim successful on node user
Aug 01 21:39:21 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:39:21 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:39:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.375s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:39:21 user nova-compute[72586]: DEBUG nova.compute.manager [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] Start building networks asynchronously for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 21:39:21 user nova-compute[72586]: DEBUG nova.compute.manager [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] Allocating IP information in the background. {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 21:39:21 user nova-compute[72586]: DEBUG nova.network.neutron [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] allocate_for_instance() {{(pid=72586) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 21:39:21 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 21:39:21 user nova-compute[72586]: DEBUG nova.compute.manager [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] Start building block device mappings for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 21:39:21 user nova-compute[72586]: DEBUG nova.policy [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '49d631f793a54e4cbf086cbf89696834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2896d39f80af4e07869d3b1acfba1d8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72586) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 21:39:21 user nova-compute[72586]: DEBUG nova.compute.manager [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] Start spawning the instance on the hypervisor. {{(pid=72586) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 21:39:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] Creating instance directory {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 21:39:21 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] Creating image(s)
Aug 01 21:39:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Acquiring lock "/opt/stack/data/nova/instances/b436dd23-122a-4da5-9fa7-1d658909b16e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:39:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Lock "/opt/stack/data/nova/instances/b436dd23-122a-4da5-9fa7-1d658909b16e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:39:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Lock "/opt/stack/data/nova/instances/b436dd23-122a-4da5-9fa7-1d658909b16e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:39:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:39:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.142s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:39:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Acquiring lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:39:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:39:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:39:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.140s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:39:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/b436dd23-122a-4da5-9fa7-1d658909b16e/disk 1073741824 {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:39:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/b436dd23-122a-4da5-9fa7-1d658909b16e/disk 1073741824" returned: 0 in 0.053s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:39:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.199s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:39:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:39:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.140s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:39:21 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b436dd23-122a-4da5-9fa7-1d658909b16e/disk. size=1073741824 {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 21:39:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b436dd23-122a-4da5-9fa7-1d658909b16e/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:39:21 user nova-compute[72586]: DEBUG nova.network.neutron [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] Successfully created port: a6a850af-8cd3-4b83-b79e-3259b6e8655c {{(pid=72586) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 21:39:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b436dd23-122a-4da5-9fa7-1d658909b16e/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:39:22 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Cannot resize image /opt/stack/data/nova/instances/b436dd23-122a-4da5-9fa7-1d658909b16e/disk to a smaller size. {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 21:39:22 user nova-compute[72586]: DEBUG nova.objects.instance [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Lazy-loading 'migration_context' on Instance uuid b436dd23-122a-4da5-9fa7-1d658909b16e {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:39:22 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] Created local disks {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 21:39:22 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] Ensure instance console log exists: /opt/stack/data/nova/instances/b436dd23-122a-4da5-9fa7-1d658909b16e/console.log {{(pid=72586) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 21:39:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:39:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:39:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:39:22 user nova-compute[72586]: DEBUG nova.network.neutron [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] Successfully updated port: a6a850af-8cd3-4b83-b79e-3259b6e8655c {{(pid=72586) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 21:39:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Acquiring lock "refresh_cache-b436dd23-122a-4da5-9fa7-1d658909b16e" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:39:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Acquired lock "refresh_cache-b436dd23-122a-4da5-9fa7-1d658909b16e" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:39:22 user nova-compute[72586]: DEBUG nova.network.neutron [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:39:22 user nova-compute[72586]: DEBUG nova.compute.manager [req-070e0959-3111-4731-aed4-067e55470db7 req-5a5b56f4-f62a-43df-9cfc-e8b31702fa2b service nova] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] Received event network-changed-a6a850af-8cd3-4b83-b79e-3259b6e8655c {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:39:22 user nova-compute[72586]: DEBUG nova.compute.manager [req-070e0959-3111-4731-aed4-067e55470db7 req-5a5b56f4-f62a-43df-9cfc-e8b31702fa2b service nova] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] Refreshing instance network info cache due to event network-changed-a6a850af-8cd3-4b83-b79e-3259b6e8655c. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:39:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-070e0959-3111-4731-aed4-067e55470db7 req-5a5b56f4-f62a-43df-9cfc-e8b31702fa2b service nova] Acquiring lock "refresh_cache-b436dd23-122a-4da5-9fa7-1d658909b16e" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:39:22 user nova-compute[72586]: DEBUG nova.network.neutron [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] Instance cache missing network info. {{(pid=72586) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 21:39:22 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:39:23 user nova-compute[72586]: DEBUG nova.network.neutron [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] Updating instance_info_cache with network_info: [{"id": "a6a850af-8cd3-4b83-b79e-3259b6e8655c", "address": "fa:16:3e:49:18:f2", "network": {"id": "e687eacc-3080-46db-b577-5efb36856dce", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1089459024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2896d39f80af4e07869d3b1acfba1d8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6a850af-8c", "ovs_interfaceid": "a6a850af-8cd3-4b83-b79e-3259b6e8655c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:39:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Releasing lock "refresh_cache-b436dd23-122a-4da5-9fa7-1d658909b16e" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:39:23 user nova-compute[72586]: DEBUG nova.compute.manager [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] Instance network_info: |[{"id": "a6a850af-8cd3-4b83-b79e-3259b6e8655c", "address": "fa:16:3e:49:18:f2", "network": {"id": "e687eacc-3080-46db-b577-5efb36856dce", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1089459024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2896d39f80af4e07869d3b1acfba1d8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6a850af-8c", "ovs_interfaceid": "a6a850af-8cd3-4b83-b79e-3259b6e8655c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 21:39:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-070e0959-3111-4731-aed4-067e55470db7 req-5a5b56f4-f62a-43df-9cfc-e8b31702fa2b service nova] Acquired lock "refresh_cache-b436dd23-122a-4da5-9fa7-1d658909b16e" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:39:23 user nova-compute[72586]: DEBUG nova.network.neutron [req-070e0959-3111-4731-aed4-067e55470db7 req-5a5b56f4-f62a-43df-9cfc-e8b31702fa2b service nova] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] Refreshing network info cache for port a6a850af-8cd3-4b83-b79e-3259b6e8655c {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:39:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] Start _get_guest_xml network_info=[{"id": "a6a850af-8cd3-4b83-b79e-3259b6e8655c", "address": "fa:16:3e:49:18:f2", "network": {"id": "e687eacc-3080-46db-b577-5efb36856dce", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1089459024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2896d39f80af4e07869d3b1acfba1d8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6a850af-8c", "ovs_interfaceid": "a6a850af-8cd3-4b83-b79e-3259b6e8655c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '0243d46b-6819-42a5-926f-42b71f0c97ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:39:23 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:39:23 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:39:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:39:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:39:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:39:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:39:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:39:23 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:39:23 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:39:23 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:39:23 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:39:23 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:39:23 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:39:23 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:39:23 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:39:23 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:39:23 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:39:23 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:39:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:39:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-245976474',display_name='tempest-ServersNegativeTestJSON-server-245976474',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-245976474',id=36,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2896d39f80af4e07869d3b1acfba1d8b',ramdisk_id='',reservation_id='r-nes3j6g7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2014666022',owner_user_name='tempest-ServersNegativeTestJSON-2014666022-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:39:21Z,user_data=None,user_id='49d631f793a54e4cbf086cbf89696834',uuid=b436dd23-122a-4da5-9fa7-1d658909b16e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6a850af-8cd3-4b83-b79e-3259b6e8655c", "address": "fa:16:3e:49:18:f2", "network": {"id": "e687eacc-3080-46db-b577-5efb36856dce", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1089459024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2896d39f80af4e07869d3b1acfba1d8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6a850af-8c", "ovs_interfaceid": "a6a850af-8cd3-4b83-b79e-3259b6e8655c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:39:23 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Converting VIF {"id": "a6a850af-8cd3-4b83-b79e-3259b6e8655c", "address": "fa:16:3e:49:18:f2", "network": {"id": "e687eacc-3080-46db-b577-5efb36856dce", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1089459024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2896d39f80af4e07869d3b1acfba1d8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6a850af-8c", "ovs_interfaceid": "a6a850af-8cd3-4b83-b79e-3259b6e8655c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:39:23 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:18:f2,bridge_name='br-int',has_traffic_filtering=True,id=a6a850af-8cd3-4b83-b79e-3259b6e8655c,network=Network(e687eacc-3080-46db-b577-5efb36856dce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6a850af-8c') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:39:23 user nova-compute[72586]: DEBUG nova.objects.instance [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Lazy-loading 'pci_devices' on Instance uuid b436dd23-122a-4da5-9fa7-1d658909b16e {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:39:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:39:23 user nova-compute[72586]:   <uuid>b436dd23-122a-4da5-9fa7-1d658909b16e</uuid>
Aug 01 21:39:23 user nova-compute[72586]:   <name>instance-00000024</name>
Aug 01 21:39:23 user nova-compute[72586]:   <memory>524288</memory>
Aug 01 21:39:23 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:39:23 user nova-compute[72586]:   <metadata>
Aug 01 21:39:23 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:39:23 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:39:23 user nova-compute[72586]:       <nova:name>tempest-ServersNegativeTestJSON-server-245976474</nova:name>
Aug 01 21:39:23 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:39:23</nova:creationTime>
Aug 01 21:39:23 user nova-compute[72586]:       <nova:flavor name="m1.tiny">
Aug 01 21:39:23 user nova-compute[72586]:         <nova:memory>512</nova:memory>
Aug 01 21:39:23 user nova-compute[72586]:         <nova:disk>1</nova:disk>
Aug 01 21:39:23 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:39:23 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:39:23 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:39:23 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:39:23 user nova-compute[72586]:       <nova:owner>
Aug 01 21:39:23 user nova-compute[72586]:         <nova:user uuid="49d631f793a54e4cbf086cbf89696834">tempest-ServersNegativeTestJSON-2014666022-project-member</nova:user>
Aug 01 21:39:23 user nova-compute[72586]:         <nova:project uuid="2896d39f80af4e07869d3b1acfba1d8b">tempest-ServersNegativeTestJSON-2014666022</nova:project>
Aug 01 21:39:23 user nova-compute[72586]:       </nova:owner>
Aug 01 21:39:23 user nova-compute[72586]:       <nova:root type="image" uuid="0243d46b-6819-42a5-926f-42b71f0c97ad"/>
Aug 01 21:39:23 user nova-compute[72586]:       <nova:ports>
Aug 01 21:39:23 user nova-compute[72586]:         <nova:port uuid="a6a850af-8cd3-4b83-b79e-3259b6e8655c">
Aug 01 21:39:23 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 01 21:39:23 user nova-compute[72586]:         </nova:port>
Aug 01 21:39:23 user nova-compute[72586]:       </nova:ports>
Aug 01 21:39:23 user nova-compute[72586]:     </nova:instance>
Aug 01 21:39:23 user nova-compute[72586]:   </metadata>
Aug 01 21:39:23 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:39:23 user nova-compute[72586]:     <system>
Aug 01 21:39:23 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:39:23 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:39:23 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:39:23 user nova-compute[72586]:       <entry name="serial">b436dd23-122a-4da5-9fa7-1d658909b16e</entry>
Aug 01 21:39:23 user nova-compute[72586]:       <entry name="uuid">b436dd23-122a-4da5-9fa7-1d658909b16e</entry>
Aug 01 21:39:23 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:39:23 user nova-compute[72586]:     </system>
Aug 01 21:39:23 user nova-compute[72586]:   </sysinfo>
Aug 01 21:39:23 user nova-compute[72586]:   <os>
Aug 01 21:39:23 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:39:23 user nova-compute[72586]:     <boot dev="hd"/>
Aug 01 21:39:23 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:39:23 user nova-compute[72586]:   </os>
Aug 01 21:39:23 user nova-compute[72586]:   <features>
Aug 01 21:39:23 user nova-compute[72586]:     <acpi/>
Aug 01 21:39:23 user nova-compute[72586]:     <apic/>
Aug 01 21:39:23 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:39:23 user nova-compute[72586]:   </features>
Aug 01 21:39:23 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:39:23 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:39:23 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:39:23 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:39:23 user nova-compute[72586]:   </clock>
Aug 01 21:39:23 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:39:23 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:39:23 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:39:23 user nova-compute[72586]:   </cpu>
Aug 01 21:39:23 user nova-compute[72586]:   <devices>
Aug 01 21:39:23 user nova-compute[72586]:     <disk type="file" device="disk">
Aug 01 21:39:23 user nova-compute[72586]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 21:39:23 user nova-compute[72586]:       <source file="/opt/stack/data/nova/instances/b436dd23-122a-4da5-9fa7-1d658909b16e/disk"/>
Aug 01 21:39:23 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:39:23 user nova-compute[72586]:     </disk>
Aug 01 21:39:23 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:39:23 user nova-compute[72586]:       <mac address="fa:16:3e:49:18:f2"/>
Aug 01 21:39:23 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:39:23 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:39:23 user nova-compute[72586]:       <target dev="tapa6a850af-8c"/>
Aug 01 21:39:23 user nova-compute[72586]:     </interface>
Aug 01 21:39:23 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:39:23 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/b436dd23-122a-4da5-9fa7-1d658909b16e/console.log" append="off"/>
Aug 01 21:39:23 user nova-compute[72586]:     </serial>
Aug 01 21:39:23 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:39:23 user nova-compute[72586]:     <video>
Aug 01 21:39:23 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:39:23 user nova-compute[72586]:     </video>
Aug 01 21:39:23 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:39:23 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:39:23 user nova-compute[72586]:     </rng>
Aug 01 21:39:23 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:39:23 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:39:23 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:39:23 user nova-compute[72586]:     </memballoon>
Aug 01 21:39:23 user nova-compute[72586]:   </devices>
Aug 01 21:39:23 user nova-compute[72586]: </domain>
Aug 01 21:39:23 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:39:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:39:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-245976474',display_name='tempest-ServersNegativeTestJSON-server-245976474',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-245976474',id=36,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2896d39f80af4e07869d3b1acfba1d8b',ramdisk_id='',reservation_id='r-nes3j6g7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2014666022',owner_user_name='tempest-ServersNegativeTestJSON-2014666022-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:39:21Z,user_data=None,user_id='49d631f793a54e4cbf086cbf89696834',uuid=b436dd23-122a-4da5-9fa7-1d658909b16e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6a850af-8cd3-4b83-b79e-3259b6e8655c", "address": "fa:16:3e:49:18:f2", "network": {"id": "e687eacc-3080-46db-b577-5efb36856dce", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1089459024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2896d39f80af4e07869d3b1acfba1d8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6a850af-8c", "ovs_interfaceid": "a6a850af-8cd3-4b83-b79e-3259b6e8655c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:39:23 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Converting VIF {"id": "a6a850af-8cd3-4b83-b79e-3259b6e8655c", "address": "fa:16:3e:49:18:f2", "network": {"id": "e687eacc-3080-46db-b577-5efb36856dce", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1089459024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2896d39f80af4e07869d3b1acfba1d8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6a850af-8c", "ovs_interfaceid": "a6a850af-8cd3-4b83-b79e-3259b6e8655c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:39:23 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:18:f2,bridge_name='br-int',has_traffic_filtering=True,id=a6a850af-8cd3-4b83-b79e-3259b6e8655c,network=Network(e687eacc-3080-46db-b577-5efb36856dce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6a850af-8c') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:39:23 user nova-compute[72586]: DEBUG os_vif [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:18:f2,bridge_name='br-int',has_traffic_filtering=True,id=a6a850af-8cd3-4b83-b79e-3259b6e8655c,network=Network(e687eacc-3080-46db-b577-5efb36856dce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6a850af-8c') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:39:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:39:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:39:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:39:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:39:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa6a850af-8c, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:39:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa6a850af-8c, col_values=(('external_ids', {'iface-id': 'a6a850af-8cd3-4b83-b79e-3259b6e8655c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:18:f2', 'vm-uuid': 'b436dd23-122a-4da5-9fa7-1d658909b16e'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:39:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:39:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:39:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:39:23 user nova-compute[72586]: INFO os_vif [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:18:f2,bridge_name='br-int',has_traffic_filtering=True,id=a6a850af-8cd3-4b83-b79e-3259b6e8655c,network=Network(e687eacc-3080-46db-b577-5efb36856dce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6a850af-8c')
Aug 01 21:39:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:39:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] No VIF found with MAC fa:16:3e:49:18:f2, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:39:23 user nova-compute[72586]: DEBUG nova.network.neutron [req-070e0959-3111-4731-aed4-067e55470db7 req-5a5b56f4-f62a-43df-9cfc-e8b31702fa2b service nova] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] Updated VIF entry in instance network info cache for port a6a850af-8cd3-4b83-b79e-3259b6e8655c. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:39:23 user nova-compute[72586]: DEBUG nova.network.neutron [req-070e0959-3111-4731-aed4-067e55470db7 req-5a5b56f4-f62a-43df-9cfc-e8b31702fa2b service nova] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] Updating instance_info_cache with network_info: [{"id": "a6a850af-8cd3-4b83-b79e-3259b6e8655c", "address": "fa:16:3e:49:18:f2", "network": {"id": "e687eacc-3080-46db-b577-5efb36856dce", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1089459024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2896d39f80af4e07869d3b1acfba1d8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6a850af-8c", "ovs_interfaceid": "a6a850af-8cd3-4b83-b79e-3259b6e8655c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:39:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-070e0959-3111-4731-aed4-067e55470db7 req-5a5b56f4-f62a-43df-9cfc-e8b31702fa2b service nova] Releasing lock "refresh_cache-b436dd23-122a-4da5-9fa7-1d658909b16e" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:39:24 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:39:24 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:39:24 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:39:24 user nova-compute[72586]: DEBUG nova.compute.manager [req-5f8fd325-4fe6-4f94-b311-13a80ce48e92 req-124348d2-5f43-48a2-8ddb-ec0622a15bf1 service nova] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] Received event network-vif-plugged-a6a850af-8cd3-4b83-b79e-3259b6e8655c {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:39:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-5f8fd325-4fe6-4f94-b311-13a80ce48e92 req-124348d2-5f43-48a2-8ddb-ec0622a15bf1 service nova] Acquiring lock "b436dd23-122a-4da5-9fa7-1d658909b16e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:39:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-5f8fd325-4fe6-4f94-b311-13a80ce48e92 req-124348d2-5f43-48a2-8ddb-ec0622a15bf1 service nova] Lock "b436dd23-122a-4da5-9fa7-1d658909b16e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:39:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-5f8fd325-4fe6-4f94-b311-13a80ce48e92 req-124348d2-5f43-48a2-8ddb-ec0622a15bf1 service nova] Lock "b436dd23-122a-4da5-9fa7-1d658909b16e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:39:24 user nova-compute[72586]: DEBUG nova.compute.manager [req-5f8fd325-4fe6-4f94-b311-13a80ce48e92 req-124348d2-5f43-48a2-8ddb-ec0622a15bf1 service nova] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] No waiting events found dispatching network-vif-plugged-a6a850af-8cd3-4b83-b79e-3259b6e8655c {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:39:24 user nova-compute[72586]: WARNING nova.compute.manager [req-5f8fd325-4fe6-4f94-b311-13a80ce48e92 req-124348d2-5f43-48a2-8ddb-ec0622a15bf1 service nova] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] Received unexpected event network-vif-plugged-a6a850af-8cd3-4b83-b79e-3259b6e8655c for instance with vm_state building and task_state spawning.
Aug 01 21:39:24 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:39:24 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:39:26 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925966.677806, b436dd23-122a-4da5-9fa7-1d658909b16e => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:39:26 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] VM Resumed (Lifecycle Event)
Aug 01 21:39:26 user nova-compute[72586]: DEBUG nova.compute.manager [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] Instance event wait completed in 0 seconds for  {{(pid=72586) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 21:39:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] Guest created on hypervisor {{(pid=72586) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 21:39:26 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] Instance spawned successfully.
Aug 01 21:39:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 21:39:26 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:39:26 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:39:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] Found default for hw_cdrom_bus of ide {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:39:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] Found default for hw_disk_bus of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:39:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] Found default for hw_input_bus of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:39:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] Found default for hw_pointer_model of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:39:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] Found default for hw_video_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:39:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] Found default for hw_vif_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:39:26 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:39:26 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925966.6807632, b436dd23-122a-4da5-9fa7-1d658909b16e => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:39:26 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] VM Started (Lifecycle Event)
Aug 01 21:39:26 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:39:26 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:39:26 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:39:26 user nova-compute[72586]: INFO nova.compute.manager [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] Took 5.36 seconds to spawn the instance on the hypervisor.
Aug 01 21:39:26 user nova-compute[72586]: DEBUG nova.compute.manager [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:39:26 user nova-compute[72586]: DEBUG nova.compute.manager [req-a60e1ae1-8bc5-4c92-bd80-37c63f13c690 req-db5d07bc-49fe-4108-af79-c8d9dbe841d6 service nova] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] Received event network-vif-plugged-a6a850af-8cd3-4b83-b79e-3259b6e8655c {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:39:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-a60e1ae1-8bc5-4c92-bd80-37c63f13c690 req-db5d07bc-49fe-4108-af79-c8d9dbe841d6 service nova] Acquiring lock "b436dd23-122a-4da5-9fa7-1d658909b16e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:39:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-a60e1ae1-8bc5-4c92-bd80-37c63f13c690 req-db5d07bc-49fe-4108-af79-c8d9dbe841d6 service nova] Lock "b436dd23-122a-4da5-9fa7-1d658909b16e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:39:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-a60e1ae1-8bc5-4c92-bd80-37c63f13c690 req-db5d07bc-49fe-4108-af79-c8d9dbe841d6 service nova] Lock "b436dd23-122a-4da5-9fa7-1d658909b16e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:39:26 user nova-compute[72586]: DEBUG nova.compute.manager [req-a60e1ae1-8bc5-4c92-bd80-37c63f13c690 req-db5d07bc-49fe-4108-af79-c8d9dbe841d6 service nova] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] No waiting events found dispatching network-vif-plugged-a6a850af-8cd3-4b83-b79e-3259b6e8655c {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:39:26 user nova-compute[72586]: WARNING nova.compute.manager [req-a60e1ae1-8bc5-4c92-bd80-37c63f13c690 req-db5d07bc-49fe-4108-af79-c8d9dbe841d6 service nova] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] Received unexpected event network-vif-plugged-a6a850af-8cd3-4b83-b79e-3259b6e8655c for instance with vm_state building and task_state spawning.
Aug 01 21:39:26 user nova-compute[72586]: INFO nova.compute.manager [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] Took 6.08 seconds to build instance.
Aug 01 21:39:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9d5f7ab0-cdfb-4ae3-b12c-1b4154d4be12 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Lock "b436dd23-122a-4da5-9fa7-1d658909b16e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.177s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:39:28 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:39:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:39:29 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:39:32 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:39:33 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:39:33 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Acquiring lock "aa164378-4fb3-46f3-9368-ddf76b39f18f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:39:33 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "aa164378-4fb3-46f3-9368-ddf76b39f18f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:39:33 user nova-compute[72586]: DEBUG nova.compute.manager [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] Starting instance... {{(pid=72586) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 21:39:33 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:39:33 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:39:33 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72586) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 21:39:33 user nova-compute[72586]: INFO nova.compute.claims [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] Claim successful on node user
Aug 01 21:39:33 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:39:33 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:39:34 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:39:34 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.402s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:39:34 user nova-compute[72586]: DEBUG nova.compute.manager [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] Start building networks asynchronously for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 21:39:34 user nova-compute[72586]: DEBUG nova.compute.manager [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] Allocating IP information in the background. {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 21:39:34 user nova-compute[72586]: DEBUG nova.network.neutron [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] allocate_for_instance() {{(pid=72586) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 21:39:34 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 21:39:34 user nova-compute[72586]: DEBUG nova.compute.manager [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] Start building block device mappings for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 21:39:34 user nova-compute[72586]: INFO nova.virt.block_device [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] Booting with volume snapshot 6dbbb835-6a4c-4c57-9504-8acd38241361 at /dev/vda
Aug 01 21:39:34 user nova-compute[72586]: DEBUG nova.policy [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '76cd0d9d973b410ca4ff08fc7630fbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a631250d39c34afca47a1fa2817e627e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72586) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 21:39:34 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:39:34 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:39:34 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:39:34 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72586) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 21:39:34 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:39:34 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:39:34 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:39:34 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:39:34 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Auditing locally available compute resources for user (node: user) {{(pid=72586) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 21:39:34 user nova-compute[72586]: DEBUG nova.network.neutron [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] Successfully created port: 4136b652-b3ca-4e1a-aaec-3f782a13cf2e {{(pid=72586) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 21:39:35 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:39:35 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:39:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ab466b-8caa-4a38-8350-213aa17ee75e/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:39:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ab466b-8caa-4a38-8350-213aa17ee75e/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:39:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ab466b-8caa-4a38-8350-213aa17ee75e/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:39:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ab466b-8caa-4a38-8350-213aa17ee75e/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:39:35 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:39:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:39:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:39:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:39:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:39:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b436dd23-122a-4da5-9fa7-1d658909b16e/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:39:35 user nova-compute[72586]: DEBUG nova.network.neutron [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] Successfully updated port: 4136b652-b3ca-4e1a-aaec-3f782a13cf2e {{(pid=72586) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 21:39:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Acquiring lock "refresh_cache-aa164378-4fb3-46f3-9368-ddf76b39f18f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:39:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Acquired lock "refresh_cache-aa164378-4fb3-46f3-9368-ddf76b39f18f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:39:35 user nova-compute[72586]: DEBUG nova.network.neutron [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:39:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b436dd23-122a-4da5-9fa7-1d658909b16e/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:39:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b436dd23-122a-4da5-9fa7-1d658909b16e/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:39:35 user nova-compute[72586]: DEBUG nova.compute.manager [req-ebe6117f-366b-4bff-a316-04f6c8a3ceca req-09d7bc67-dada-456a-ae5e-04d714269a37 service nova] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] Received event network-changed-4136b652-b3ca-4e1a-aaec-3f782a13cf2e {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:39:35 user nova-compute[72586]: DEBUG nova.compute.manager [req-ebe6117f-366b-4bff-a316-04f6c8a3ceca req-09d7bc67-dada-456a-ae5e-04d714269a37 service nova] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] Refreshing instance network info cache due to event network-changed-4136b652-b3ca-4e1a-aaec-3f782a13cf2e. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:39:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ebe6117f-366b-4bff-a316-04f6c8a3ceca req-09d7bc67-dada-456a-ae5e-04d714269a37 service nova] Acquiring lock "refresh_cache-aa164378-4fb3-46f3-9368-ddf76b39f18f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:39:35 user nova-compute[72586]: DEBUG nova.network.neutron [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] Instance cache missing network info. {{(pid=72586) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 21:39:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b436dd23-122a-4da5-9fa7-1d658909b16e/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:39:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:39:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:39:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:39:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:39:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee464b0-f75e-4f30-9838-74bca9619a07/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:39:36 user nova-compute[72586]: DEBUG nova.network.neutron [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] Updating instance_info_cache with network_info: [{"id": "4136b652-b3ca-4e1a-aaec-3f782a13cf2e", "address": "fa:16:3e:01:52:76", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4136b652-b3", "ovs_interfaceid": "4136b652-b3ca-4e1a-aaec-3f782a13cf2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:39:36 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Releasing lock "refresh_cache-aa164378-4fb3-46f3-9368-ddf76b39f18f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:39:36 user nova-compute[72586]: DEBUG nova.compute.manager [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] Instance network_info: |[{"id": "4136b652-b3ca-4e1a-aaec-3f782a13cf2e", "address": "fa:16:3e:01:52:76", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4136b652-b3", "ovs_interfaceid": "4136b652-b3ca-4e1a-aaec-3f782a13cf2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 21:39:36 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ebe6117f-366b-4bff-a316-04f6c8a3ceca req-09d7bc67-dada-456a-ae5e-04d714269a37 service nova] Acquired lock "refresh_cache-aa164378-4fb3-46f3-9368-ddf76b39f18f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:39:36 user nova-compute[72586]: DEBUG nova.network.neutron [req-ebe6117f-366b-4bff-a316-04f6c8a3ceca req-09d7bc67-dada-456a-ae5e-04d714269a37 service nova] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] Refreshing network info cache for port 4136b652-b3ca-4e1a-aaec-3f782a13cf2e {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:39:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee464b0-f75e-4f30-9838-74bca9619a07/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:39:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee464b0-f75e-4f30-9838-74bca9619a07/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:39:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee464b0-f75e-4f30-9838-74bca9619a07/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:39:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63625685-227f-48cc-9cc0-594633e0b8bb/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:39:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63625685-227f-48cc-9cc0-594633e0b8bb/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:39:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63625685-227f-48cc-9cc0-594633e0b8bb/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:39:36 user nova-compute[72586]: DEBUG nova.network.neutron [req-ebe6117f-366b-4bff-a316-04f6c8a3ceca req-09d7bc67-dada-456a-ae5e-04d714269a37 service nova] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] Updated VIF entry in instance network info cache for port 4136b652-b3ca-4e1a-aaec-3f782a13cf2e. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:39:36 user nova-compute[72586]: DEBUG nova.network.neutron [req-ebe6117f-366b-4bff-a316-04f6c8a3ceca req-09d7bc67-dada-456a-ae5e-04d714269a37 service nova] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] Updating instance_info_cache with network_info: [{"id": "4136b652-b3ca-4e1a-aaec-3f782a13cf2e", "address": "fa:16:3e:01:52:76", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4136b652-b3", "ovs_interfaceid": "4136b652-b3ca-4e1a-aaec-3f782a13cf2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:39:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63625685-227f-48cc-9cc0-594633e0b8bb/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:39:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/965244cc-71e5-43f9-8d22-62843bac3f52/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:39:36 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ebe6117f-366b-4bff-a316-04f6c8a3ceca req-09d7bc67-dada-456a-ae5e-04d714269a37 service nova] Releasing lock "refresh_cache-aa164378-4fb3-46f3-9368-ddf76b39f18f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:39:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/965244cc-71e5-43f9-8d22-62843bac3f52/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:39:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/965244cc-71e5-43f9-8d22-62843bac3f52/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:39:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/965244cc-71e5-43f9-8d22-62843bac3f52/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:39:37 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:39:37 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:39:37 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Hypervisor/Node resource view: name=user free_ram=7649MB free_disk=25.099502563476562GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72586) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 21:39:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:39:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:39:37 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 49c24c77-f102-4aed-8314-b04aad5f6b3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:39:37 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance af2de810-b22f-4fa9-835c-c673abd145db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:39:37 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 161fab9d-a7d1-4ea0-b4b9-2afc54040eef actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:39:37 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 11ab466b-8caa-4a38-8350-213aa17ee75e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:39:37 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 63625685-227f-48cc-9cc0-594633e0b8bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:39:37 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 8ee464b0-f75e-4f30-9838-74bca9619a07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:39:37 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 965244cc-71e5-43f9-8d22-62843bac3f52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:39:37 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 178d26d5-3570-442f-9268-21cd73cccfc7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:39:37 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance b436dd23-122a-4da5-9fa7-1d658909b16e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:39:37 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance aa164378-4fb3-46f3-9368-ddf76b39f18f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:39:37 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 21:39:37 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 21:39:38 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:39:38 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:39:38 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Compute_service record updated for user:user {{(pid=72586) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 21:39:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.415s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:39:38 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:39:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:39:40 user nova-compute[72586]: DEBUG os_brick.utils [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:39:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:39:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:39:40 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5d90d7-adf3-4e06-8fb0-e6cad79ab4d8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4bc202fb9cb\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:39:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:39:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:39:40 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[3882ea1c-21da-41a6-99af-1ff4e174d7cb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:39:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:39:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.028s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:39:40 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4bea3e6-7850-44f9-8560-021337fe8142]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:39:40 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[51561571-fcf7-4bc5-a2f6-96011769bc2e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:39:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Running cmd (subprocess): nvme version {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:39:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] 'nvme version' failed. Not Retrying. {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:39:40 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] nvme not present on system {{(pid=72586) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 21:39:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:39:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:39:40 user nova-compute[72586]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 21:39:40 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bdcbd6d-1ad6-4fee-b34b-409ad6bd79ce]: (4, '') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:39:40 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72586) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 21:39:40 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 21:39:40 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] LIGHTOS: no hostnqn found. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 21:39:40 user nova-compute[72586]: DEBUG os_brick.utils [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4bc202fb9cb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:39:40 user nova-compute[72586]: DEBUG nova.virt.block_device [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] Updating existing volume attachment record: 376bcce6-ed05-45f7-b8f4-dd6d9caf2be6 {{(pid=72586) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 21:39:42 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:39:42 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Starting heal instance info cache {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 21:39:42 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Didn't find any instances for network info cache update. {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 21:39:42 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:39:42 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:39:43 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:39:43 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:39:44 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:39:47 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5c874a8c-5d14-4276-95dd-3653318bacbb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Acquiring lock "49c24c77-f102-4aed-8314-b04aad5f6b3a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:39:47 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5c874a8c-5d14-4276-95dd-3653318bacbb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "49c24c77-f102-4aed-8314-b04aad5f6b3a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:39:47 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5c874a8c-5d14-4276-95dd-3653318bacbb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Acquiring lock "49c24c77-f102-4aed-8314-b04aad5f6b3a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:39:47 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5c874a8c-5d14-4276-95dd-3653318bacbb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "49c24c77-f102-4aed-8314-b04aad5f6b3a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:39:47 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5c874a8c-5d14-4276-95dd-3653318bacbb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "49c24c77-f102-4aed-8314-b04aad5f6b3a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:39:47 user nova-compute[72586]: INFO nova.compute.manager [None req-5c874a8c-5d14-4276-95dd-3653318bacbb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Terminating instance
Aug 01 21:39:47 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5c874a8c-5d14-4276-95dd-3653318bacbb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Start destroying the instance on the hypervisor. {{(pid=72586) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 21:39:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:39:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:39:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:39:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:39:47 user nova-compute[72586]: DEBUG nova.compute.manager [req-455cfd55-830e-425c-8016-a0f6c3c162de req-e86bd971-0a83-4279-8616-2c7a3631e0f3 service nova] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Received event network-vif-unplugged-99688c7a-3e71-49d8-9002-0075560858c9 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:39:47 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-455cfd55-830e-425c-8016-a0f6c3c162de req-e86bd971-0a83-4279-8616-2c7a3631e0f3 service nova] Acquiring lock "49c24c77-f102-4aed-8314-b04aad5f6b3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:39:47 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-455cfd55-830e-425c-8016-a0f6c3c162de req-e86bd971-0a83-4279-8616-2c7a3631e0f3 service nova] Lock "49c24c77-f102-4aed-8314-b04aad5f6b3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:39:47 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-455cfd55-830e-425c-8016-a0f6c3c162de req-e86bd971-0a83-4279-8616-2c7a3631e0f3 service nova] Lock "49c24c77-f102-4aed-8314-b04aad5f6b3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:39:47 user nova-compute[72586]: DEBUG nova.compute.manager [req-455cfd55-830e-425c-8016-a0f6c3c162de req-e86bd971-0a83-4279-8616-2c7a3631e0f3 service nova] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] No waiting events found dispatching network-vif-unplugged-99688c7a-3e71-49d8-9002-0075560858c9 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:39:47 user nova-compute[72586]: DEBUG nova.compute.manager [req-455cfd55-830e-425c-8016-a0f6c3c162de req-e86bd971-0a83-4279-8616-2c7a3631e0f3 service nova] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Received event network-vif-unplugged-99688c7a-3e71-49d8-9002-0075560858c9 for instance with task_state deleting. {{(pid=72586) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 21:39:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:39:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:39:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:39:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:39:48 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Instance destroyed successfully.
Aug 01 21:39:48 user nova-compute[72586]: DEBUG nova.objects.instance [None req-5c874a8c-5d14-4276-95dd-3653318bacbb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lazy-loading 'resources' on Instance uuid 49c24c77-f102-4aed-8314-b04aad5f6b3a {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:39:48 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-5c874a8c-5d14-4276-95dd-3653318bacbb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T21:23:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-117058961',display_name='tempest-ServerActionsTestOtherA-server-809986017',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-117058961',id=15,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPk4vuGAtPXP/Itqq7TbQ+6Sv+k5bpNQFeCgGdApIPBaVaeUmQBoiJZa5I5091aDIuYBB7Uba3sQDG1YP/kTFSXvqkIW2yu6s2YyWP+iKPKZLzdQkqmU2IfIy2EEsidssA==',key_name='tempest-keypair-400537691',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:27:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='19af48ffce7e4703b6d978bc3563680e',ramdisk_id='',reservation_id='r-xq54880a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-825165282',owner_user_name='tempest-ServerActionsTestOtherA-825165282-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:27:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88d01b1101164c859b19d41e251447a5',uuid=49c24c77-f102-4aed-8314-b04aad5f6b3a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "99688c7a-3e71-49d8-9002-0075560858c9", "address": "fa:16:3e:8a:03:a7", "network": {"id": "aab9a541-2149-4c65-b60e-80a1daca6632", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1355256264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19af48ffce7e4703b6d978bc3563680e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99688c7a-3e", "ovs_interfaceid": "99688c7a-3e71-49d8-9002-0075560858c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:39:48 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-5c874a8c-5d14-4276-95dd-3653318bacbb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Converting VIF {"id": "99688c7a-3e71-49d8-9002-0075560858c9", "address": "fa:16:3e:8a:03:a7", "network": {"id": "aab9a541-2149-4c65-b60e-80a1daca6632", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1355256264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19af48ffce7e4703b6d978bc3563680e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99688c7a-3e", "ovs_interfaceid": "99688c7a-3e71-49d8-9002-0075560858c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:39:48 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-5c874a8c-5d14-4276-95dd-3653318bacbb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8a:03:a7,bridge_name='br-int',has_traffic_filtering=True,id=99688c7a-3e71-49d8-9002-0075560858c9,network=Network(aab9a541-2149-4c65-b60e-80a1daca6632),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99688c7a-3e') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:39:48 user nova-compute[72586]: DEBUG os_vif [None req-5c874a8c-5d14-4276-95dd-3653318bacbb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:03:a7,bridge_name='br-int',has_traffic_filtering=True,id=99688c7a-3e71-49d8-9002-0075560858c9,network=Network(aab9a541-2149-4c65-b60e-80a1daca6632),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99688c7a-3e') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:39:48 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:39:48 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap99688c7a-3e, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:39:48 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:39:48 user nova-compute[72586]: INFO os_vif [None req-5c874a8c-5d14-4276-95dd-3653318bacbb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:03:a7,bridge_name='br-int',has_traffic_filtering=True,id=99688c7a-3e71-49d8-9002-0075560858c9,network=Network(aab9a541-2149-4c65-b60e-80a1daca6632),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99688c7a-3e')
Aug 01 21:39:48 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-5c874a8c-5d14-4276-95dd-3653318bacbb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Deleting instance files /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a_del
Aug 01 21:39:48 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-5c874a8c-5d14-4276-95dd-3653318bacbb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Deletion of /opt/stack/data/nova/instances/49c24c77-f102-4aed-8314-b04aad5f6b3a_del complete
Aug 01 21:39:48 user nova-compute[72586]: INFO nova.compute.manager [None req-5c874a8c-5d14-4276-95dd-3653318bacbb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Took 1.04 seconds to destroy the instance on the hypervisor.
Aug 01 21:39:48 user nova-compute[72586]: DEBUG oslo.service.loopingcall [None req-5c874a8c-5d14-4276-95dd-3653318bacbb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72586) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 21:39:48 user nova-compute[72586]: DEBUG nova.compute.manager [-] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Deallocating network for instance {{(pid=72586) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 21:39:48 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] deallocate_for_instance() {{(pid=72586) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 21:39:48 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:39:48 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:39:48 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:39:48 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:39:48 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:39:48 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:39:48 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:39:48 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Took 0.62 seconds to deallocate network for instance.
Aug 01 21:39:48 user nova-compute[72586]: DEBUG nova.compute.manager [req-b60a8f18-0361-4464-85a6-a61411d88c93 req-a4b8fd42-c15a-4927-be17-99df62c61915 service nova] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Received event network-vif-deleted-99688c7a-3e71-49d8-9002-0075560858c9 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:39:48 user nova-compute[72586]: INFO nova.compute.manager [req-b60a8f18-0361-4464-85a6-a61411d88c93 req-a4b8fd42-c15a-4927-be17-99df62c61915 service nova] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Neutron deleted interface 99688c7a-3e71-49d8-9002-0075560858c9; detaching it from the instance and deleting it from the info cache
Aug 01 21:39:48 user nova-compute[72586]: DEBUG nova.network.neutron [req-b60a8f18-0361-4464-85a6-a61411d88c93 req-a4b8fd42-c15a-4927-be17-99df62c61915 service nova] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:39:48 user nova-compute[72586]: DEBUG nova.compute.manager [req-b60a8f18-0361-4464-85a6-a61411d88c93 req-a4b8fd42-c15a-4927-be17-99df62c61915 service nova] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Detach interface failed, port_id=99688c7a-3e71-49d8-9002-0075560858c9, reason: Instance 49c24c77-f102-4aed-8314-b04aad5f6b3a could not be found. {{(pid=72586) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 21:39:48 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5c874a8c-5d14-4276-95dd-3653318bacbb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:39:48 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5c874a8c-5d14-4276-95dd-3653318bacbb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:39:49 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-5c874a8c-5d14-4276-95dd-3653318bacbb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:39:49 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5c874a8c-5d14-4276-95dd-3653318bacbb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:39:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5c874a8c-5d14-4276-95dd-3653318bacbb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.359s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:39:49 user nova-compute[72586]: INFO nova.scheduler.client.report [None req-5c874a8c-5d14-4276-95dd-3653318bacbb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Deleted allocations for instance 49c24c77-f102-4aed-8314-b04aad5f6b3a
Aug 01 21:39:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5c874a8c-5d14-4276-95dd-3653318bacbb tempest-ServerActionsTestOtherA-825165282 tempest-ServerActionsTestOtherA-825165282-project-member] Lock "49c24c77-f102-4aed-8314-b04aad5f6b3a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.246s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:39:49 user nova-compute[72586]: DEBUG nova.compute.manager [req-9203251f-5a72-434b-88da-f4de55a7694c req-d728b15a-dc8e-4b07-9f6a-0799f9f5b305 service nova] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Received event network-vif-plugged-99688c7a-3e71-49d8-9002-0075560858c9 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:39:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-9203251f-5a72-434b-88da-f4de55a7694c req-d728b15a-dc8e-4b07-9f6a-0799f9f5b305 service nova] Acquiring lock "49c24c77-f102-4aed-8314-b04aad5f6b3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:39:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-9203251f-5a72-434b-88da-f4de55a7694c req-d728b15a-dc8e-4b07-9f6a-0799f9f5b305 service nova] Lock "49c24c77-f102-4aed-8314-b04aad5f6b3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:39:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-9203251f-5a72-434b-88da-f4de55a7694c req-d728b15a-dc8e-4b07-9f6a-0799f9f5b305 service nova] Lock "49c24c77-f102-4aed-8314-b04aad5f6b3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:39:49 user nova-compute[72586]: DEBUG nova.compute.manager [req-9203251f-5a72-434b-88da-f4de55a7694c req-d728b15a-dc8e-4b07-9f6a-0799f9f5b305 service nova] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] No waiting events found dispatching network-vif-plugged-99688c7a-3e71-49d8-9002-0075560858c9 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:39:49 user nova-compute[72586]: WARNING nova.compute.manager [req-9203251f-5a72-434b-88da-f4de55a7694c req-d728b15a-dc8e-4b07-9f6a-0799f9f5b305 service nova] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Received unexpected event network-vif-plugged-99688c7a-3e71-49d8-9002-0075560858c9 for instance with vm_state deleted and task_state None.
Aug 01 21:39:49 user nova-compute[72586]: DEBUG nova.compute.manager [req-9203251f-5a72-434b-88da-f4de55a7694c req-d728b15a-dc8e-4b07-9f6a-0799f9f5b305 service nova] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Received event network-vif-plugged-99688c7a-3e71-49d8-9002-0075560858c9 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:39:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-9203251f-5a72-434b-88da-f4de55a7694c req-d728b15a-dc8e-4b07-9f6a-0799f9f5b305 service nova] Acquiring lock "49c24c77-f102-4aed-8314-b04aad5f6b3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:39:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-9203251f-5a72-434b-88da-f4de55a7694c req-d728b15a-dc8e-4b07-9f6a-0799f9f5b305 service nova] Lock "49c24c77-f102-4aed-8314-b04aad5f6b3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:39:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-9203251f-5a72-434b-88da-f4de55a7694c req-d728b15a-dc8e-4b07-9f6a-0799f9f5b305 service nova] Lock "49c24c77-f102-4aed-8314-b04aad5f6b3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:39:49 user nova-compute[72586]: DEBUG nova.compute.manager [req-9203251f-5a72-434b-88da-f4de55a7694c req-d728b15a-dc8e-4b07-9f6a-0799f9f5b305 service nova] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] No waiting events found dispatching network-vif-plugged-99688c7a-3e71-49d8-9002-0075560858c9 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:39:49 user nova-compute[72586]: WARNING nova.compute.manager [req-9203251f-5a72-434b-88da-f4de55a7694c req-d728b15a-dc8e-4b07-9f6a-0799f9f5b305 service nova] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Received unexpected event network-vif-plugged-99688c7a-3e71-49d8-9002-0075560858c9 for instance with vm_state deleted and task_state None.
Aug 01 21:39:49 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG nova.compute.manager [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] Start spawning the instance on the hypervisor. {{(pid=72586) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] Creating instance directory {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 21:39:50 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] Creating image(s)
Aug 01 21:39:50 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] Did not create local disks {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] Ensure instance console log exists: /opt/stack/data/nova/instances/aa164378-4fb3-46f3-9368-ddf76b39f18f/console.log {{(pid=72586) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] Start _get_guest_xml network_info=[{"id": "4136b652-b3ca-4e1a-aaec-3f782a13cf2e", "address": "fa:16:3e:01:52:76", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4136b652-b3", "ovs_interfaceid": "4136b652-b3ca-4e1a-aaec-3f782a13cf2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9808c58b-62a7-4877-98c3-cb8a860f02bf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zWoTFcIe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'aa164378-4fb3-46f3-9368-ddf76b39f18f', 'attached_at': '', 'detached_at': '', 'volume_id': '9808c58b-62a7-4877-98c3-cb8a860f02bf', 'serial': '9808c58b-62a7-4877-98c3-cb8a860f02bf'}, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '376bcce6-ed05-45f7-b8f4-dd6d9caf2be6', 'delete_on_termination': True, 'volume_type': None} {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:39:50 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:39:50 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:39:50 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] Calling os-brick to attach iSCSI Volume {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9808c58b-62a7-4877-98c3-cb8a860f02bf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zWoTFcIe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:39:50 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:39:50 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:39:50 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:39:50 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9808c58b-62a7-4877-98c3-cb8a860f02bf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9808c58b-62a7-4877-98c3-cb8a860f02bf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:39:50 user nova-compute[72586]: INFO os_brick.initiator.connectors.iscsi [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 21:39:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9808c58b-62a7-4877-98c3-cb8a860f02bf -p 172.16.0.220:3260 {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9808c58b-62a7-4877-98c3-cb8a860f02bf -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f63b467-b89e-41e8-9519-848299cf8921]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 21:39:50 user nova-compute[72586]:  {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9808c58b-62a7-4877-98c3-cb8a860f02bf -p 172.16.0.220:3260 --interface default --op new {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9808c58b-62a7-4877-98c3-cb8a860f02bf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa4017d4-2e1a-4a7d-8acb-92460523916e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9808c58b-62a7-4877-98c3-cb8a860f02bf] added\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9808c58b-62a7-4877-98c3-cb8a860f02bf] added
Aug 01 21:39:50 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9808c58b-62a7-4877-98c3-cb8a860f02bf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9808c58b-62a7-4877-98c3-cb8a860f02bf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[055a1df7-46c0-477f-a318-82e0ed89f73f]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9808c58b-62a7-4877-98c3-cb8a860f02bf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9808c58b-62a7-4877-98c3-cb8a860f02bf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd81525-c533-4e96-9bc0-630c9255cf2d]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9808c58b-62a7-4877-98c3-cb8a860f02bf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zWoTFcIe {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9808c58b-62a7-4877-98c3-cb8a860f02bf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zWoTFcIe" returned: 0 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e0fe06-97f8-4038-b5ed-584190c6639c]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zWoTFcIe'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9808c58b-62a7-4877-98c3-cb8a860f02bf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9808c58b-62a7-4877-98c3-cb8a860f02bf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1f92b9-f584-4081-825d-f2f9f34d6325]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb47be97-b5e3-4773-8972-a797896c662e]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:39:50 user nova-compute[72586]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d (non-flash)
Aug 01 21:39:50 user nova-compute[72586]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec (non-flash)
Aug 01 21:39:50 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:39:50 user nova-compute[72586]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d (non-flash)
Aug 01 21:39:50 user nova-compute[72586]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec (non-flash)
Aug 01 21:39:50 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9808c58b-62a7-4877-98c3-cb8a860f02bf -p 172.16.0.220:3260 --login {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9808c58b-62a7-4877-98c3-cb8a860f02bf -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d83a2d0-22cf-42cb-810c-1132a7c1d0c3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9808c58b-62a7-4877-98c3-cb8a860f02bf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9808c58b-62a7-4877-98c3-cb8a860f02bf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9808c58b-62a7-4877-98c3-cb8a860f02bf, portal: 172.16.0.220,3260]
Aug 01 21:39:50 user nova-compute[72586]: Login to [iface: default, target: iqn.2010-10.org.openstack:9808c58b-62a7-4877-98c3-cb8a860f02bf, portal: 172.16.0.220,3260] successful.
Aug 01 21:39:50 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9808c58b-62a7-4877-98c3-cb8a860f02bf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9808c58b-62a7-4877-98c3-cb8a860f02bf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f7e17e-d443-4964-a1c4-1cc4e3c0fc97]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f2b3fe-b0ed-4f09-8c03-a2780f6461ed]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9808c58b-62a7-4877-98c3-cb8a860f02bf (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:39:50 user nova-compute[72586]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d (non-flash)
Aug 01 21:39:50 user nova-compute[72586]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec (non-flash)
Aug 01 21:39:50 user nova-compute[72586]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9808c58b-62a7-4877-98c3-cb8a860f02bf (non-flash)
Aug 01 21:39:50 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:39:50 user nova-compute[72586]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d (non-flash)
Aug 01 21:39:50 user nova-compute[72586]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec (non-flash)
Aug 01 21:39:50 user nova-compute[72586]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9808c58b-62a7-4877-98c3-cb8a860f02bf (non-flash)
Aug 01 21:39:50 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9808c58b-62a7-4877-98c3-cb8a860f02bf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Connected to 172.16.0.220:3260 {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] HCTL ('36', '-', '-', 0) found on session 43 with lun 0 {{(pid=72586) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72586) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b81d445-2596-45bb-809b-abc92c0736e6]: (4, ('- - 0', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Searching for a device in session 43 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:39:50 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zWoTFcIe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 21:39:51 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-77fa88ae-74ed-455b-96a8-996056ce0aa0 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Acquiring lock "965244cc-71e5-43f9-8d22-62843bac3f52" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:39:51 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-77fa88ae-74ed-455b-96a8-996056ce0aa0 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "965244cc-71e5-43f9-8d22-62843bac3f52" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:39:51 user nova-compute[72586]: DEBUG nova.objects.instance [None req-77fa88ae-74ed-455b-96a8-996056ce0aa0 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lazy-loading 'flavor' on Instance uuid 965244cc-71e5-43f9-8d22-62843bac3f52 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:39:51 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-77fa88ae-74ed-455b-96a8-996056ce0aa0 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "965244cc-71e5-43f9-8d22-62843bac3f52" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:39:51 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-77fa88ae-74ed-455b-96a8-996056ce0aa0 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Acquiring lock "965244cc-71e5-43f9-8d22-62843bac3f52" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:39:51 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-77fa88ae-74ed-455b-96a8-996056ce0aa0 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "965244cc-71e5-43f9-8d22-62843bac3f52" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:39:51 user nova-compute[72586]: INFO nova.compute.manager [None req-77fa88ae-74ed-455b-96a8-996056ce0aa0 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Attaching volume 97608faa-e3cc-4920-bf16-f2ccd18f5fed to /dev/vdb
Aug 01 21:39:51 user nova-compute[72586]: DEBUG os_brick.utils [None req-77fa88ae-74ed-455b-96a8-996056ce0aa0 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:39:51 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:39:51 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:39:51 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f791ede9-c1e4-4558-8443-8aef93487f8b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4bc202fb9cb\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:39:51 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:39:51 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:39:51 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[78fa9054-0a74-4793-accb-8dc6c01e00ce]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:39:51 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:39:51 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:39:51 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[96eec44c-0a81-425f-8f0e-2056c346cf0c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:39:51 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1de4cc8-b344-4fc6-8580-222b8829cdaa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:39:51 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-77fa88ae-74ed-455b-96a8-996056ce0aa0 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Running cmd (subprocess): nvme version {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:39:51 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-77fa88ae-74ed-455b-96a8-996056ce0aa0 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] 'nvme version' failed. Not Retrying. {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:39:51 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.nvmeof [None req-77fa88ae-74ed-455b-96a8-996056ce0aa0 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] nvme not present on system {{(pid=72586) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 21:39:51 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:39:51 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:39:51 user nova-compute[72586]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 21:39:51 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6530fed-aa2c-4081-b5e4-8f247a3a697d]: (4, '') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:39:51 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-77fa88ae-74ed-455b-96a8-996056ce0aa0 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72586) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 21:39:51 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-77fa88ae-74ed-455b-96a8-996056ce0aa0 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 21:39:51 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-77fa88ae-74ed-455b-96a8-996056ce0aa0 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] LIGHTOS: no hostnqn found. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 21:39:51 user nova-compute[72586]: DEBUG os_brick.utils [None req-77fa88ae-74ed-455b-96a8-996056ce0aa0 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4bc202fb9cb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:39:51 user nova-compute[72586]: DEBUG nova.virt.block_device [None req-77fa88ae-74ed-455b-96a8-996056ce0aa0 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Updating existing volume attachment record: 0dd06218-0c3f-47b9-83d1-0db89dc5bd62 {{(pid=72586) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 21:39:51 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:39:51 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '23833666164313664', 'path': '/dev/sde'} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:39:51 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833666164313664', 'path': '/dev/sde'} {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 21:39:51 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:39:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1113570529',display_name='tempest-TestVolumeBootPattern-server-1113570529',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1113570529',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a631250d39c34afca47a1fa2817e627e',ramdisk_id='',reservation_id='r-n945irog',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1160754716',owner_user_name='tempest-TestVolumeBootPattern-1160754716-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:39:34Z,user_data=None,user_id='76cd0d9d973b410ca4ff08fc7630fbc6',uuid=aa164378-4fb3-46f3-9368-ddf76b39f18f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4136b652-b3ca-4e1a-aaec-3f782a13cf2e", "address": "fa:16:3e:01:52:76", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4136b652-b3", "ovs_interfaceid": "4136b652-b3ca-4e1a-aaec-3f782a13cf2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:39:51 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Converting VIF {"id": "4136b652-b3ca-4e1a-aaec-3f782a13cf2e", "address": "fa:16:3e:01:52:76", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4136b652-b3", "ovs_interfaceid": "4136b652-b3ca-4e1a-aaec-3f782a13cf2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:39:51 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:52:76,bridge_name='br-int',has_traffic_filtering=True,id=4136b652-b3ca-4e1a-aaec-3f782a13cf2e,network=Network(2fbf5ffb-0ec0-403b-bc92-259563ab1d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4136b652-b3') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:39:51 user nova-compute[72586]: DEBUG nova.objects.instance [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lazy-loading 'pci_devices' on Instance uuid aa164378-4fb3-46f3-9368-ddf76b39f18f {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:39:51 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:39:51 user nova-compute[72586]:   <uuid>aa164378-4fb3-46f3-9368-ddf76b39f18f</uuid>
Aug 01 21:39:51 user nova-compute[72586]:   <name>instance-00000025</name>
Aug 01 21:39:51 user nova-compute[72586]:   <memory>524288</memory>
Aug 01 21:39:51 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:39:51 user nova-compute[72586]:   <metadata>
Aug 01 21:39:51 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:39:51 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:39:51 user nova-compute[72586]:       <nova:name>tempest-TestVolumeBootPattern-server-1113570529</nova:name>
Aug 01 21:39:51 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:39:50</nova:creationTime>
Aug 01 21:39:51 user nova-compute[72586]:       <nova:flavor name="m1.tiny">
Aug 01 21:39:51 user nova-compute[72586]:         <nova:memory>512</nova:memory>
Aug 01 21:39:51 user nova-compute[72586]:         <nova:disk>1</nova:disk>
Aug 01 21:39:51 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:39:51 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:39:51 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:39:51 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:39:51 user nova-compute[72586]:       <nova:owner>
Aug 01 21:39:51 user nova-compute[72586]:         <nova:user uuid="76cd0d9d973b410ca4ff08fc7630fbc6">tempest-TestVolumeBootPattern-1160754716-project-member</nova:user>
Aug 01 21:39:51 user nova-compute[72586]:         <nova:project uuid="a631250d39c34afca47a1fa2817e627e">tempest-TestVolumeBootPattern-1160754716</nova:project>
Aug 01 21:39:51 user nova-compute[72586]:       </nova:owner>
Aug 01 21:39:51 user nova-compute[72586]:       <nova:ports>
Aug 01 21:39:51 user nova-compute[72586]:         <nova:port uuid="4136b652-b3ca-4e1a-aaec-3f782a13cf2e">
Aug 01 21:39:51 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 01 21:39:51 user nova-compute[72586]:         </nova:port>
Aug 01 21:39:51 user nova-compute[72586]:       </nova:ports>
Aug 01 21:39:51 user nova-compute[72586]:     </nova:instance>
Aug 01 21:39:51 user nova-compute[72586]:   </metadata>
Aug 01 21:39:51 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:39:51 user nova-compute[72586]:     <system>
Aug 01 21:39:51 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:39:51 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:39:51 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:39:51 user nova-compute[72586]:       <entry name="serial">aa164378-4fb3-46f3-9368-ddf76b39f18f</entry>
Aug 01 21:39:51 user nova-compute[72586]:       <entry name="uuid">aa164378-4fb3-46f3-9368-ddf76b39f18f</entry>
Aug 01 21:39:51 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:39:51 user nova-compute[72586]:     </system>
Aug 01 21:39:51 user nova-compute[72586]:   </sysinfo>
Aug 01 21:39:51 user nova-compute[72586]:   <os>
Aug 01 21:39:51 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:39:51 user nova-compute[72586]:     <boot dev="hd"/>
Aug 01 21:39:51 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:39:51 user nova-compute[72586]:   </os>
Aug 01 21:39:51 user nova-compute[72586]:   <features>
Aug 01 21:39:51 user nova-compute[72586]:     <acpi/>
Aug 01 21:39:51 user nova-compute[72586]:     <apic/>
Aug 01 21:39:51 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:39:51 user nova-compute[72586]:   </features>
Aug 01 21:39:51 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:39:51 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:39:51 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:39:51 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:39:51 user nova-compute[72586]:   </clock>
Aug 01 21:39:51 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:39:51 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:39:51 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:39:51 user nova-compute[72586]:   </cpu>
Aug 01 21:39:51 user nova-compute[72586]:   <devices>
Aug 01 21:39:51 user nova-compute[72586]:     <disk type="block" device="disk">
Aug 01 21:39:51 user nova-compute[72586]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:39:51 user nova-compute[72586]:       <source dev="/dev/sde"/>
Aug 01 21:39:51 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:39:51 user nova-compute[72586]:       <serial>9808c58b-62a7-4877-98c3-cb8a860f02bf</serial>
Aug 01 21:39:51 user nova-compute[72586]:     </disk>
Aug 01 21:39:51 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:39:51 user nova-compute[72586]:       <mac address="fa:16:3e:01:52:76"/>
Aug 01 21:39:51 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:39:51 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:39:51 user nova-compute[72586]:       <target dev="tap4136b652-b3"/>
Aug 01 21:39:51 user nova-compute[72586]:     </interface>
Aug 01 21:39:51 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:39:51 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/aa164378-4fb3-46f3-9368-ddf76b39f18f/console.log" append="off"/>
Aug 01 21:39:51 user nova-compute[72586]:     </serial>
Aug 01 21:39:51 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:39:51 user nova-compute[72586]:     <video>
Aug 01 21:39:51 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:39:51 user nova-compute[72586]:     </video>
Aug 01 21:39:51 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:39:51 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:39:51 user nova-compute[72586]:     </rng>
Aug 01 21:39:51 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:39:51 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:39:51 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:39:51 user nova-compute[72586]:     </memballoon>
Aug 01 21:39:51 user nova-compute[72586]:   </devices>
Aug 01 21:39:51 user nova-compute[72586]: </domain>
Aug 01 21:39:51 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:39:51 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:39:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1113570529',display_name='tempest-TestVolumeBootPattern-server-1113570529',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1113570529',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a631250d39c34afca47a1fa2817e627e',ramdisk_id='',reservation_id='r-n945irog',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1160754716',owner_user_name='tempest-TestVolumeBootPattern-1160754716-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:39:34Z,user_data=None,user_id='76cd0d9d973b410ca4ff08fc7630fbc6',uuid=aa164378-4fb3-46f3-9368-ddf76b39f18f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4136b652-b3ca-4e1a-aaec-3f782a13cf2e", "address": "fa:16:3e:01:52:76", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4136b652-b3", "ovs_interfaceid": "4136b652-b3ca-4e1a-aaec-3f782a13cf2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:39:51 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Converting VIF {"id": "4136b652-b3ca-4e1a-aaec-3f782a13cf2e", "address": "fa:16:3e:01:52:76", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4136b652-b3", "ovs_interfaceid": "4136b652-b3ca-4e1a-aaec-3f782a13cf2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:39:51 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:52:76,bridge_name='br-int',has_traffic_filtering=True,id=4136b652-b3ca-4e1a-aaec-3f782a13cf2e,network=Network(2fbf5ffb-0ec0-403b-bc92-259563ab1d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4136b652-b3') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:39:51 user nova-compute[72586]: DEBUG os_vif [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:52:76,bridge_name='br-int',has_traffic_filtering=True,id=4136b652-b3ca-4e1a-aaec-3f782a13cf2e,network=Network(2fbf5ffb-0ec0-403b-bc92-259563ab1d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4136b652-b3') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:39:51 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:39:51 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:39:51 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:39:51 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:39:51 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4136b652-b3, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:39:51 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4136b652-b3, col_values=(('external_ids', {'iface-id': '4136b652-b3ca-4e1a-aaec-3f782a13cf2e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:52:76', 'vm-uuid': 'aa164378-4fb3-46f3-9368-ddf76b39f18f'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:39:51 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:39:51 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:39:51 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:39:51 user nova-compute[72586]: INFO os_vif [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:52:76,bridge_name='br-int',has_traffic_filtering=True,id=4136b652-b3ca-4e1a-aaec-3f782a13cf2e,network=Network(2fbf5ffb-0ec0-403b-bc92-259563ab1d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4136b652-b3')
Aug 01 21:39:51 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:39:51 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] No VIF found with MAC fa:16:3e:01:52:76, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:39:53 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:39:53 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:39:53 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:39:53 user nova-compute[72586]: DEBUG nova.compute.manager [req-34a1d3d1-5659-4c77-a72c-594a615d0021 req-3c89c925-81f8-47a1-bcf1-6c728afa9044 service nova] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] Received event network-vif-plugged-4136b652-b3ca-4e1a-aaec-3f782a13cf2e {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:39:53 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-34a1d3d1-5659-4c77-a72c-594a615d0021 req-3c89c925-81f8-47a1-bcf1-6c728afa9044 service nova] Acquiring lock "aa164378-4fb3-46f3-9368-ddf76b39f18f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:39:53 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-34a1d3d1-5659-4c77-a72c-594a615d0021 req-3c89c925-81f8-47a1-bcf1-6c728afa9044 service nova] Lock "aa164378-4fb3-46f3-9368-ddf76b39f18f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:39:53 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-34a1d3d1-5659-4c77-a72c-594a615d0021 req-3c89c925-81f8-47a1-bcf1-6c728afa9044 service nova] Lock "aa164378-4fb3-46f3-9368-ddf76b39f18f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:39:53 user nova-compute[72586]: DEBUG nova.compute.manager [req-34a1d3d1-5659-4c77-a72c-594a615d0021 req-3c89c925-81f8-47a1-bcf1-6c728afa9044 service nova] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] No waiting events found dispatching network-vif-plugged-4136b652-b3ca-4e1a-aaec-3f782a13cf2e {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:39:53 user nova-compute[72586]: WARNING nova.compute.manager [req-34a1d3d1-5659-4c77-a72c-594a615d0021 req-3c89c925-81f8-47a1-bcf1-6c728afa9044 service nova] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] Received unexpected event network-vif-plugged-4136b652-b3ca-4e1a-aaec-3f782a13cf2e for instance with vm_state building and task_state spawning.
Aug 01 21:39:53 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:39:53 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:39:53 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:39:54 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:39:55 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925995.1841133, aa164378-4fb3-46f3-9368-ddf76b39f18f => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:39:55 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] VM Resumed (Lifecycle Event)
Aug 01 21:39:55 user nova-compute[72586]: DEBUG nova.compute.manager [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] Instance event wait completed in 0 seconds for  {{(pid=72586) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 21:39:55 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] Guest created on hypervisor {{(pid=72586) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 21:39:55 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] Instance spawned successfully.
Aug 01 21:39:55 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 21:39:55 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:39:55 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:39:55 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] Found default for hw_cdrom_bus of ide {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:39:55 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] Found default for hw_disk_bus of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:39:55 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] Found default for hw_input_bus of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:39:55 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] Found default for hw_pointer_model of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:39:55 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] Found default for hw_video_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:39:55 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] Found default for hw_vif_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:39:55 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:39:55 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690925995.1854284, aa164378-4fb3-46f3-9368-ddf76b39f18f => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:39:55 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] VM Started (Lifecycle Event)
Aug 01 21:39:55 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:39:55 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:39:55 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:39:55 user nova-compute[72586]: INFO nova.compute.manager [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] Took 5.05 seconds to spawn the instance on the hypervisor.
Aug 01 21:39:55 user nova-compute[72586]: DEBUG nova.compute.manager [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:39:55 user nova-compute[72586]: DEBUG nova.compute.manager [req-3425b0d5-5a18-4692-aa63-4302c58bc268 req-9c19235a-bdf7-4d7d-98cb-70c45f741a22 service nova] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] Received event network-vif-plugged-4136b652-b3ca-4e1a-aaec-3f782a13cf2e {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:39:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-3425b0d5-5a18-4692-aa63-4302c58bc268 req-9c19235a-bdf7-4d7d-98cb-70c45f741a22 service nova] Acquiring lock "aa164378-4fb3-46f3-9368-ddf76b39f18f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:39:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-3425b0d5-5a18-4692-aa63-4302c58bc268 req-9c19235a-bdf7-4d7d-98cb-70c45f741a22 service nova] Lock "aa164378-4fb3-46f3-9368-ddf76b39f18f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:39:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-3425b0d5-5a18-4692-aa63-4302c58bc268 req-9c19235a-bdf7-4d7d-98cb-70c45f741a22 service nova] Lock "aa164378-4fb3-46f3-9368-ddf76b39f18f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:39:55 user nova-compute[72586]: DEBUG nova.compute.manager [req-3425b0d5-5a18-4692-aa63-4302c58bc268 req-9c19235a-bdf7-4d7d-98cb-70c45f741a22 service nova] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] No waiting events found dispatching network-vif-plugged-4136b652-b3ca-4e1a-aaec-3f782a13cf2e {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:39:55 user nova-compute[72586]: WARNING nova.compute.manager [req-3425b0d5-5a18-4692-aa63-4302c58bc268 req-9c19235a-bdf7-4d7d-98cb-70c45f741a22 service nova] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] Received unexpected event network-vif-plugged-4136b652-b3ca-4e1a-aaec-3f782a13cf2e for instance with vm_state building and task_state spawning.
Aug 01 21:39:55 user nova-compute[72586]: INFO nova.compute.manager [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] Took 21.81 seconds to build instance.
Aug 01 21:39:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b2bfeb36-c875-4e92-97d1-9655f5ca3e21 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "aa164378-4fb3-46f3-9368-ddf76b39f18f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.901s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:39:56 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:39:59 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77fa88ae-74ed-455b-96a8-996056ce0aa0 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Calling os-brick to attach iSCSI Volume {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 21:39:59 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa88ae-74ed-455b-96a8-996056ce0aa0 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:97608faa-e3cc-4920-bf16-f2ccd18f5fed'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LCZpmuwI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:39:59 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-77fa88ae-74ed-455b-96a8-996056ce0aa0 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:39:59 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-77fa88ae-74ed-455b-96a8-996056ce0aa0 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:39:59 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-77fa88ae-74ed-455b-96a8-996056ce0aa0 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:39:59 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-77fa88ae-74ed-455b-96a8-996056ce0aa0 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:39:59 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-77fa88ae-74ed-455b-96a8-996056ce0aa0 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97608faa-e3cc-4920-bf16-f2ccd18f5fed" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:39:59 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-77fa88ae-74ed-455b-96a8-996056ce0aa0 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97608faa-e3cc-4920-bf16-f2ccd18f5fed" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:39:59 user nova-compute[72586]: INFO os_brick.initiator.connectors.iscsi [None req-77fa88ae-74ed-455b-96a8-996056ce0aa0 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 21:39:59 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97608faa-e3cc-4920-bf16-f2ccd18f5fed -p 172.16.0.220:3260 {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:39:59 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97608faa-e3cc-4920-bf16-f2ccd18f5fed -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:39:59 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb86c61d-bebc-43c9-a283-76095a9a2f85]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:39:59 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa88ae-74ed-455b-96a8-996056ce0aa0 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 21:39:59 user nova-compute[72586]:  {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:39:59 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97608faa-e3cc-4920-bf16-f2ccd18f5fed -p 172.16.0.220:3260 --interface default --op new {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:39:59 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97608faa-e3cc-4920-bf16-f2ccd18f5fed -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:39:59 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3d7f5d-7d28-418c-99b2-3bfacee8a473]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97608faa-e3cc-4920-bf16-f2ccd18f5fed] added\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:39:59 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa88ae-74ed-455b-96a8-996056ce0aa0 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97608faa-e3cc-4920-bf16-f2ccd18f5fed] added
Aug 01 21:39:59 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:39:59 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97608faa-e3cc-4920-bf16-f2ccd18f5fed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:39:59 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97608faa-e3cc-4920-bf16-f2ccd18f5fed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:39:59 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b684023d-3ce8-4237-acbc-6965b6dec1c9]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:39:59 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa88ae-74ed-455b-96a8-996056ce0aa0 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:39:59 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97608faa-e3cc-4920-bf16-f2ccd18f5fed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:39:59 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97608faa-e3cc-4920-bf16-f2ccd18f5fed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:39:59 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[c464d311-d94b-4951-b3c8-05e859f1915a]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:39:59 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa88ae-74ed-455b-96a8-996056ce0aa0 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:39:59 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97608faa-e3cc-4920-bf16-f2ccd18f5fed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LCZpmuwI {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:39:59 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97608faa-e3cc-4920-bf16-f2ccd18f5fed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LCZpmuwI" returned: 0 in 0.025s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:39:59 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a988ff9-5b26-47d7-a371-2173d641af63]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:39:59 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa88ae-74ed-455b-96a8-996056ce0aa0 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LCZpmuwI'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:39:59 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97608faa-e3cc-4920-bf16-f2ccd18f5fed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:39:59 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97608faa-e3cc-4920-bf16-f2ccd18f5fed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:39:59 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bffecaf-8f56-4164-81e7-588403fb9e0d]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:39:59 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa88ae-74ed-455b-96a8-996056ce0aa0 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:39:59 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:39:59 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:39:59 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3bba23a-ee61-4187-86f6-dc3fde1b7736]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9808c58b-62a7-4877-98c3-cb8a860f02bf (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:39:59 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa88ae-74ed-455b-96a8-996056ce0aa0 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:39:59 user nova-compute[72586]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d (non-flash)
Aug 01 21:39:59 user nova-compute[72586]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec (non-flash)
Aug 01 21:39:59 user nova-compute[72586]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9808c58b-62a7-4877-98c3-cb8a860f02bf (non-flash)
Aug 01 21:39:59 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:39:59 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa88ae-74ed-455b-96a8-996056ce0aa0 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:39:59 user nova-compute[72586]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d (non-flash)
Aug 01 21:39:59 user nova-compute[72586]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec (non-flash)
Aug 01 21:39:59 user nova-compute[72586]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9808c58b-62a7-4877-98c3-cb8a860f02bf (non-flash)
Aug 01 21:39:59 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:39:59 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97608faa-e3cc-4920-bf16-f2ccd18f5fed -p 172.16.0.220:3260 --login {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:39:59 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97608faa-e3cc-4920-bf16-f2ccd18f5fed -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:39:59 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa8c1394-f004-4a24-89a3-78416d19a05d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:97608faa-e3cc-4920-bf16-f2ccd18f5fed, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:97608faa-e3cc-4920-bf16-f2ccd18f5fed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:39:59 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa88ae-74ed-455b-96a8-996056ce0aa0 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:97608faa-e3cc-4920-bf16-f2ccd18f5fed, portal: 172.16.0.220,3260]
Aug 01 21:39:59 user nova-compute[72586]: Login to [iface: default, target: iqn.2010-10.org.openstack:97608faa-e3cc-4920-bf16-f2ccd18f5fed, portal: 172.16.0.220,3260] successful.
Aug 01 21:39:59 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:39:59 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97608faa-e3cc-4920-bf16-f2ccd18f5fed -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:39:59 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97608faa-e3cc-4920-bf16-f2ccd18f5fed -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:39:59 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2844b8-a88a-4225-8971-a9fb7319ce41]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:39:59 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa88ae-74ed-455b-96a8-996056ce0aa0 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:39:59 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:39:59 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:39:59 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c3c392-8bc8-404c-b3ba-1ed48039e080]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9808c58b-62a7-4877-98c3-cb8a860f02bf (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97608faa-e3cc-4920-bf16-f2ccd18f5fed (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:39:59 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa88ae-74ed-455b-96a8-996056ce0aa0 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:39:59 user nova-compute[72586]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d (non-flash)
Aug 01 21:39:59 user nova-compute[72586]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec (non-flash)
Aug 01 21:39:59 user nova-compute[72586]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9808c58b-62a7-4877-98c3-cb8a860f02bf (non-flash)
Aug 01 21:39:59 user nova-compute[72586]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97608faa-e3cc-4920-bf16-f2ccd18f5fed (non-flash)
Aug 01 21:39:59 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:39:59 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa88ae-74ed-455b-96a8-996056ce0aa0 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:39:59 user nova-compute[72586]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d (non-flash)
Aug 01 21:39:59 user nova-compute[72586]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec (non-flash)
Aug 01 21:39:59 user nova-compute[72586]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9808c58b-62a7-4877-98c3-cb8a860f02bf (non-flash)
Aug 01 21:39:59 user nova-compute[72586]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97608faa-e3cc-4920-bf16-f2ccd18f5fed (non-flash)
Aug 01 21:39:59 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:39:59 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-77fa88ae-74ed-455b-96a8-996056ce0aa0 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97608faa-e3cc-4920-bf16-f2ccd18f5fed" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:39:59 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa88ae-74ed-455b-96a8-996056ce0aa0 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Connected to 172.16.0.220:3260 {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 21:39:59 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-77fa88ae-74ed-455b-96a8-996056ce0aa0 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] HCTL ('37', '-', '-', 0) found on session 44 with lun 0 {{(pid=72586) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 21:39:59 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-77fa88ae-74ed-455b-96a8-996056ce0aa0 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72586) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 21:39:59 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:39:59 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:39:59 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ea5baa-4f19-4b19-8d70-c3b34237f2d9]: (4, ('- - 0', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:39:59 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-77fa88ae-74ed-455b-96a8-996056ce0aa0 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Searching for a device in session 44 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:39:59 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa88ae-74ed-455b-96a8-996056ce0aa0 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LCZpmuwI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 21:39:59 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:40:00 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-77fa88ae-74ed-455b-96a8-996056ce0aa0 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:40:00 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa88ae-74ed-455b-96a8-996056ce0aa0 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '23336646639633061', 'path': '/dev/sdf'} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:40:00 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77fa88ae-74ed-455b-96a8-996056ce0aa0 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336646639633061', 'path': '/dev/sdf'} {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 21:40:00 user nova-compute[72586]: DEBUG nova.objects.instance [None req-77fa88ae-74ed-455b-96a8-996056ce0aa0 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lazy-loading 'flavor' on Instance uuid 965244cc-71e5-43f9-8d22-62843bac3f52 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:40:00 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-77fa88ae-74ed-455b-96a8-996056ce0aa0 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 21:40:00 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:40:00 user nova-compute[72586]:   <source dev="/dev/sdf"/>
Aug 01 21:40:00 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:40:00 user nova-compute[72586]:   <serial>97608faa-e3cc-4920-bf16-f2ccd18f5fed</serial>
Aug 01 21:40:00 user nova-compute[72586]: </disk>
Aug 01 21:40:00 user nova-compute[72586]:  {{(pid=72586) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 21:40:01 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-77fa88ae-74ed-455b-96a8-996056ce0aa0 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:40:01 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-77fa88ae-74ed-455b-96a8-996056ce0aa0 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:40:01 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-77fa88ae-74ed-455b-96a8-996056ce0aa0 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] No VIF found with MAC fa:16:3e:02:f6:65, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:40:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-77fa88ae-74ed-455b-96a8-996056ce0aa0 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "965244cc-71e5-43f9-8d22-62843bac3f52" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.070s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:40:01 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:40:03 user nova-compute[72586]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690925988.020435, 49c24c77-f102-4aed-8314-b04aad5f6b3a => Stopped> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:40:03 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] VM Stopped (Lifecycle Event)
Aug 01 21:40:03 user nova-compute[72586]: DEBUG nova.compute.manager [None req-a55986f0-e434-4ccb-948d-77ee8b319c51 None None] [instance: 49c24c77-f102-4aed-8314-b04aad5f6b3a] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:40:04 user nova-compute[72586]: DEBUG nova.compute.manager [req-8a92dbab-35ee-4540-b68d-710582f14999 req-ad9661d4-f6f9-4fc7-9cc2-a24b3b14dfa6 service nova] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Received event network-changed-bf319273-ff82-45b9-8365-061755ed7b35 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:40:04 user nova-compute[72586]: DEBUG nova.compute.manager [req-8a92dbab-35ee-4540-b68d-710582f14999 req-ad9661d4-f6f9-4fc7-9cc2-a24b3b14dfa6 service nova] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Refreshing instance network info cache due to event network-changed-bf319273-ff82-45b9-8365-061755ed7b35. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:40:04 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-8a92dbab-35ee-4540-b68d-710582f14999 req-ad9661d4-f6f9-4fc7-9cc2-a24b3b14dfa6 service nova] Acquiring lock "refresh_cache-965244cc-71e5-43f9-8d22-62843bac3f52" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:40:04 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-8a92dbab-35ee-4540-b68d-710582f14999 req-ad9661d4-f6f9-4fc7-9cc2-a24b3b14dfa6 service nova] Acquired lock "refresh_cache-965244cc-71e5-43f9-8d22-62843bac3f52" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:40:04 user nova-compute[72586]: DEBUG nova.network.neutron [req-8a92dbab-35ee-4540-b68d-710582f14999 req-ad9661d4-f6f9-4fc7-9cc2-a24b3b14dfa6 service nova] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Refreshing network info cache for port bf319273-ff82-45b9-8365-061755ed7b35 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:40:05 user nova-compute[72586]: DEBUG nova.network.neutron [req-8a92dbab-35ee-4540-b68d-710582f14999 req-ad9661d4-f6f9-4fc7-9cc2-a24b3b14dfa6 service nova] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Updated VIF entry in instance network info cache for port bf319273-ff82-45b9-8365-061755ed7b35. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:40:05 user nova-compute[72586]: DEBUG nova.network.neutron [req-8a92dbab-35ee-4540-b68d-710582f14999 req-ad9661d4-f6f9-4fc7-9cc2-a24b3b14dfa6 service nova] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Updating instance_info_cache with network_info: [{"id": "bf319273-ff82-45b9-8365-061755ed7b35", "address": "fa:16:3e:02:f6:65", "network": {"id": "56c3419f-2c2c-4dda-88d7-ba96e2a689fd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-705071098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ae5f1c56b348de8a03f1a4bcdd9b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf319273-ff", "ovs_interfaceid": "bf319273-ff82-45b9-8365-061755ed7b35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:40:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-8a92dbab-35ee-4540-b68d-710582f14999 req-ad9661d4-f6f9-4fc7-9cc2-a24b3b14dfa6 service nova] Releasing lock "refresh_cache-965244cc-71e5-43f9-8d22-62843bac3f52" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:40:06 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:40:06 user nova-compute[72586]: DEBUG nova.compute.manager [req-3f403c2d-2807-49dc-8db9-54e87ea1be4f req-6612fe6f-1184-48de-9953-f6502431f8be service nova] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Received event network-changed-bf319273-ff82-45b9-8365-061755ed7b35 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:40:06 user nova-compute[72586]: DEBUG nova.compute.manager [req-3f403c2d-2807-49dc-8db9-54e87ea1be4f req-6612fe6f-1184-48de-9953-f6502431f8be service nova] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Refreshing instance network info cache due to event network-changed-bf319273-ff82-45b9-8365-061755ed7b35. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:40:06 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-3f403c2d-2807-49dc-8db9-54e87ea1be4f req-6612fe6f-1184-48de-9953-f6502431f8be service nova] Acquiring lock "refresh_cache-965244cc-71e5-43f9-8d22-62843bac3f52" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:40:06 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-3f403c2d-2807-49dc-8db9-54e87ea1be4f req-6612fe6f-1184-48de-9953-f6502431f8be service nova] Acquired lock "refresh_cache-965244cc-71e5-43f9-8d22-62843bac3f52" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:40:06 user nova-compute[72586]: DEBUG nova.network.neutron [req-3f403c2d-2807-49dc-8db9-54e87ea1be4f req-6612fe6f-1184-48de-9953-f6502431f8be service nova] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Refreshing network info cache for port bf319273-ff82-45b9-8365-061755ed7b35 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:40:07 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-6f40c8a7-e8b3-4c31-b54b-868c9e2dbc8e tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Acquiring lock "965244cc-71e5-43f9-8d22-62843bac3f52" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:40:07 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-6f40c8a7-e8b3-4c31-b54b-868c9e2dbc8e tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "965244cc-71e5-43f9-8d22-62843bac3f52" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:40:07 user nova-compute[72586]: INFO nova.compute.manager [None req-6f40c8a7-e8b3-4c31-b54b-868c9e2dbc8e tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Rebooting instance
Aug 01 21:40:07 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-6f40c8a7-e8b3-4c31-b54b-868c9e2dbc8e tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Acquiring lock "refresh_cache-965244cc-71e5-43f9-8d22-62843bac3f52" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:40:07 user nova-compute[72586]: DEBUG nova.network.neutron [req-3f403c2d-2807-49dc-8db9-54e87ea1be4f req-6612fe6f-1184-48de-9953-f6502431f8be service nova] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Updated VIF entry in instance network info cache for port bf319273-ff82-45b9-8365-061755ed7b35. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:40:07 user nova-compute[72586]: DEBUG nova.network.neutron [req-3f403c2d-2807-49dc-8db9-54e87ea1be4f req-6612fe6f-1184-48de-9953-f6502431f8be service nova] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Updating instance_info_cache with network_info: [{"id": "bf319273-ff82-45b9-8365-061755ed7b35", "address": "fa:16:3e:02:f6:65", "network": {"id": "56c3419f-2c2c-4dda-88d7-ba96e2a689fd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-705071098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ae5f1c56b348de8a03f1a4bcdd9b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf319273-ff", "ovs_interfaceid": "bf319273-ff82-45b9-8365-061755ed7b35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:40:07 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-3f403c2d-2807-49dc-8db9-54e87ea1be4f req-6612fe6f-1184-48de-9953-f6502431f8be service nova] Releasing lock "refresh_cache-965244cc-71e5-43f9-8d22-62843bac3f52" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:40:07 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-6f40c8a7-e8b3-4c31-b54b-868c9e2dbc8e tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Acquired lock "refresh_cache-965244cc-71e5-43f9-8d22-62843bac3f52" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:40:07 user nova-compute[72586]: DEBUG nova.network.neutron [None req-6f40c8a7-e8b3-4c31-b54b-868c9e2dbc8e tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:40:08 user nova-compute[72586]: DEBUG nova.network.neutron [None req-6f40c8a7-e8b3-4c31-b54b-868c9e2dbc8e tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Updating instance_info_cache with network_info: [{"id": "bf319273-ff82-45b9-8365-061755ed7b35", "address": "fa:16:3e:02:f6:65", "network": {"id": "56c3419f-2c2c-4dda-88d7-ba96e2a689fd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-705071098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ae5f1c56b348de8a03f1a4bcdd9b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf319273-ff", "ovs_interfaceid": "bf319273-ff82-45b9-8365-061755ed7b35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:40:08 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-6f40c8a7-e8b3-4c31-b54b-868c9e2dbc8e tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Releasing lock "refresh_cache-965244cc-71e5-43f9-8d22-62843bac3f52" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:40:08 user nova-compute[72586]: DEBUG nova.compute.manager [None req-6f40c8a7-e8b3-4c31-b54b-868c9e2dbc8e tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:40:09 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:40:10 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:40:10 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:40:10 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:40:10 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:40:10 user nova-compute[72586]: DEBUG nova.compute.manager [req-63e38384-52cf-4c79-8bae-6bf135dfe37d req-5472ec0c-0ac7-4186-814f-2d753da719a1 service nova] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Received event network-vif-unplugged-bf319273-ff82-45b9-8365-061755ed7b35 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:40:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-63e38384-52cf-4c79-8bae-6bf135dfe37d req-5472ec0c-0ac7-4186-814f-2d753da719a1 service nova] Acquiring lock "965244cc-71e5-43f9-8d22-62843bac3f52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:40:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-63e38384-52cf-4c79-8bae-6bf135dfe37d req-5472ec0c-0ac7-4186-814f-2d753da719a1 service nova] Lock "965244cc-71e5-43f9-8d22-62843bac3f52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:40:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-63e38384-52cf-4c79-8bae-6bf135dfe37d req-5472ec0c-0ac7-4186-814f-2d753da719a1 service nova] Lock "965244cc-71e5-43f9-8d22-62843bac3f52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:40:10 user nova-compute[72586]: DEBUG nova.compute.manager [req-63e38384-52cf-4c79-8bae-6bf135dfe37d req-5472ec0c-0ac7-4186-814f-2d753da719a1 service nova] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] No waiting events found dispatching network-vif-unplugged-bf319273-ff82-45b9-8365-061755ed7b35 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:40:10 user nova-compute[72586]: WARNING nova.compute.manager [req-63e38384-52cf-4c79-8bae-6bf135dfe37d req-5472ec0c-0ac7-4186-814f-2d753da719a1 service nova] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Received unexpected event network-vif-unplugged-bf319273-ff82-45b9-8365-061755ed7b35 for instance with vm_state active and task_state reboot_started.
Aug 01 21:40:11 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-6f40c8a7-e8b3-4c31-b54b-868c9e2dbc8e tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Instance shutdown successfully.
Aug 01 21:40:11 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:40:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:40:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:40:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:40:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:40:12 user nova-compute[72586]: DEBUG nova.compute.manager [req-685d8461-6a46-499e-a144-195bb60de96a req-1d8c0d3b-e851-4516-88d7-217070df24a6 service nova] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Received event network-vif-plugged-bf319273-ff82-45b9-8365-061755ed7b35 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:40:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-685d8461-6a46-499e-a144-195bb60de96a req-1d8c0d3b-e851-4516-88d7-217070df24a6 service nova] Acquiring lock "965244cc-71e5-43f9-8d22-62843bac3f52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:40:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-685d8461-6a46-499e-a144-195bb60de96a req-1d8c0d3b-e851-4516-88d7-217070df24a6 service nova] Lock "965244cc-71e5-43f9-8d22-62843bac3f52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:40:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-685d8461-6a46-499e-a144-195bb60de96a req-1d8c0d3b-e851-4516-88d7-217070df24a6 service nova] Lock "965244cc-71e5-43f9-8d22-62843bac3f52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:40:12 user nova-compute[72586]: DEBUG nova.compute.manager [req-685d8461-6a46-499e-a144-195bb60de96a req-1d8c0d3b-e851-4516-88d7-217070df24a6 service nova] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] No waiting events found dispatching network-vif-plugged-bf319273-ff82-45b9-8365-061755ed7b35 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:40:12 user nova-compute[72586]: WARNING nova.compute.manager [req-685d8461-6a46-499e-a144-195bb60de96a req-1d8c0d3b-e851-4516-88d7-217070df24a6 service nova] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Received unexpected event network-vif-plugged-bf319273-ff82-45b9-8365-061755ed7b35 for instance with vm_state active and task_state reboot_started.
Aug 01 21:40:13 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:40:13 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:40:13 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:40:14 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:40:14 user nova-compute[72586]: DEBUG nova.compute.manager [req-bff3f1a2-3f78-4c1b-95a8-3fc30167ca3e req-ad2e85c0-ef9e-416b-9660-bd294642c6ff service nova] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Received event network-vif-plugged-bf319273-ff82-45b9-8365-061755ed7b35 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:40:14 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-bff3f1a2-3f78-4c1b-95a8-3fc30167ca3e req-ad2e85c0-ef9e-416b-9660-bd294642c6ff service nova] Acquiring lock "965244cc-71e5-43f9-8d22-62843bac3f52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:40:14 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-bff3f1a2-3f78-4c1b-95a8-3fc30167ca3e req-ad2e85c0-ef9e-416b-9660-bd294642c6ff service nova] Lock "965244cc-71e5-43f9-8d22-62843bac3f52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:40:14 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-bff3f1a2-3f78-4c1b-95a8-3fc30167ca3e req-ad2e85c0-ef9e-416b-9660-bd294642c6ff service nova] Lock "965244cc-71e5-43f9-8d22-62843bac3f52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:40:14 user nova-compute[72586]: DEBUG nova.compute.manager [req-bff3f1a2-3f78-4c1b-95a8-3fc30167ca3e req-ad2e85c0-ef9e-416b-9660-bd294642c6ff service nova] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] No waiting events found dispatching network-vif-plugged-bf319273-ff82-45b9-8365-061755ed7b35 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:40:14 user nova-compute[72586]: WARNING nova.compute.manager [req-bff3f1a2-3f78-4c1b-95a8-3fc30167ca3e req-ad2e85c0-ef9e-416b-9660-bd294642c6ff service nova] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Received unexpected event network-vif-plugged-bf319273-ff82-45b9-8365-061755ed7b35 for instance with vm_state active and task_state reboot_started.
Aug 01 21:40:14 user nova-compute[72586]: DEBUG nova.compute.manager [req-bff3f1a2-3f78-4c1b-95a8-3fc30167ca3e req-ad2e85c0-ef9e-416b-9660-bd294642c6ff service nova] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Received event network-vif-plugged-bf319273-ff82-45b9-8365-061755ed7b35 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:40:14 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-bff3f1a2-3f78-4c1b-95a8-3fc30167ca3e req-ad2e85c0-ef9e-416b-9660-bd294642c6ff service nova] Acquiring lock "965244cc-71e5-43f9-8d22-62843bac3f52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:40:14 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-bff3f1a2-3f78-4c1b-95a8-3fc30167ca3e req-ad2e85c0-ef9e-416b-9660-bd294642c6ff service nova] Lock "965244cc-71e5-43f9-8d22-62843bac3f52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:40:14 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-bff3f1a2-3f78-4c1b-95a8-3fc30167ca3e req-ad2e85c0-ef9e-416b-9660-bd294642c6ff service nova] Lock "965244cc-71e5-43f9-8d22-62843bac3f52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:40:14 user nova-compute[72586]: DEBUG nova.compute.manager [req-bff3f1a2-3f78-4c1b-95a8-3fc30167ca3e req-ad2e85c0-ef9e-416b-9660-bd294642c6ff service nova] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] No waiting events found dispatching network-vif-plugged-bf319273-ff82-45b9-8365-061755ed7b35 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:40:14 user nova-compute[72586]: WARNING nova.compute.manager [req-bff3f1a2-3f78-4c1b-95a8-3fc30167ca3e req-ad2e85c0-ef9e-416b-9660-bd294642c6ff service nova] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Received unexpected event network-vif-plugged-bf319273-ff82-45b9-8365-061755ed7b35 for instance with vm_state active and task_state reboot_started.
Aug 01 21:40:15 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Removed pending event for 965244cc-71e5-43f9-8d22-62843bac3f52 due to event {{(pid=72586) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 21:40:15 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690926015.0768058, 965244cc-71e5-43f9-8d22-62843bac3f52 => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:40:15 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] VM Resumed (Lifecycle Event)
Aug 01 21:40:15 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Instance running successfully.
Aug 01 21:40:15 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-6f40c8a7-e8b3-4c31-b54b-868c9e2dbc8e tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Instance soft rebooted successfully.
Aug 01 21:40:15 user nova-compute[72586]: DEBUG nova.compute.manager [None req-6f40c8a7-e8b3-4c31-b54b-868c9e2dbc8e tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:40:15 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:40:15 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:40:15 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 01 21:40:15 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690926015.078513, 965244cc-71e5-43f9-8d22-62843bac3f52 => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:40:15 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] VM Started (Lifecycle Event)
Aug 01 21:40:15 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:40:15 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-6f40c8a7-e8b3-4c31-b54b-868c9e2dbc8e tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "965244cc-71e5-43f9-8d22-62843bac3f52" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.736s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:40:15 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:40:16 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:40:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:40:21 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:40:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-09ed0315-85fa-412e-b291-82285c335686 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Acquiring lock "11ab466b-8caa-4a38-8350-213aa17ee75e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:40:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-09ed0315-85fa-412e-b291-82285c335686 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "11ab466b-8caa-4a38-8350-213aa17ee75e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:40:24 user nova-compute[72586]: INFO nova.compute.manager [None req-09ed0315-85fa-412e-b291-82285c335686 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Detaching volume 8cfe922d-8f30-47f4-9bba-6396ad979f5d
Aug 01 21:40:24 user nova-compute[72586]: INFO nova.virt.block_device [None req-09ed0315-85fa-412e-b291-82285c335686 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Attempting to driver detach volume 8cfe922d-8f30-47f4-9bba-6396ad979f5d from mountpoint /dev/vdb
Aug 01 21:40:24 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-09ed0315-85fa-412e-b291-82285c335686 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Attempting to detach device vdb from instance 11ab466b-8caa-4a38-8350-213aa17ee75e from the persistent domain config. {{(pid=72586) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 21:40:24 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-09ed0315-85fa-412e-b291-82285c335686 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 21:40:24 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:40:24 user nova-compute[72586]:   <source dev="/dev/sdc"/>
Aug 01 21:40:24 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:40:24 user nova-compute[72586]:   <serial>8cfe922d-8f30-47f4-9bba-6396ad979f5d</serial>
Aug 01 21:40:24 user nova-compute[72586]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 01 21:40:24 user nova-compute[72586]: </disk>
Aug 01 21:40:24 user nova-compute[72586]:  {{(pid=72586) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 21:40:24 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-09ed0315-85fa-412e-b291-82285c335686 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Successfully detached device vdb from instance 11ab466b-8caa-4a38-8350-213aa17ee75e from the persistent domain config.
Aug 01 21:40:24 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-09ed0315-85fa-412e-b291-82285c335686 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 11ab466b-8caa-4a38-8350-213aa17ee75e from the live domain config. {{(pid=72586) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 21:40:24 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-09ed0315-85fa-412e-b291-82285c335686 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 21:40:24 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:40:24 user nova-compute[72586]:   <source dev="/dev/sdc"/>
Aug 01 21:40:24 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:40:24 user nova-compute[72586]:   <serial>8cfe922d-8f30-47f4-9bba-6396ad979f5d</serial>
Aug 01 21:40:24 user nova-compute[72586]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 01 21:40:24 user nova-compute[72586]: </disk>
Aug 01 21:40:24 user nova-compute[72586]:  {{(pid=72586) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 21:40:24 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:40:25 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Received event <DeviceRemovedEvent: 1690926025.0554605, 11ab466b-8caa-4a38-8350-213aa17ee75e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72586) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 21:40:25 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-09ed0315-85fa-412e-b291-82285c335686 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 11ab466b-8caa-4a38-8350-213aa17ee75e {{(pid=72586) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 21:40:25 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-09ed0315-85fa-412e-b291-82285c335686 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Successfully detached device vdb from instance 11ab466b-8caa-4a38-8350-213aa17ee75e from the live domain config.
Aug 01 21:40:25 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09ed0315-85fa-412e-b291-82285c335686 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] calling os-brick to detach iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 21:40:25 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ed0315-85fa-412e-b291-82285c335686 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, {'target_iqns': ['iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XhuyFReN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:40:25 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-09ed0315-85fa-412e-b291-82285c335686 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:40:25 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-09ed0315-85fa-412e-b291-82285c335686 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:40:25 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-09ed0315-85fa-412e-b291-82285c335686 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:40:25 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ed0315-85fa-412e-b291-82285c335686 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d', 0)] {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 21:40:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:40:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:40:25 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[76dcec8e-fd8c-4416-ab41-bc124b28c623]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97608faa-e3cc-4920-bf16-f2ccd18f5fed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9808c58b-62a7-4877-98c3-cb8a860f02bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:40:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:40:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:40:25 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae22496-4f9d-4f95-bf15-6ff7ede1d438]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9808c58b-62a7-4877-98c3-cb8a860f02bf (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97608faa-e3cc-4920-bf16-f2ccd18f5fed (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:40:25 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ed0315-85fa-412e-b291-82285c335686 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:40:25 user nova-compute[72586]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d (non-flash)
Aug 01 21:40:25 user nova-compute[72586]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec (non-flash)
Aug 01 21:40:25 user nova-compute[72586]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9808c58b-62a7-4877-98c3-cb8a860f02bf (non-flash)
Aug 01 21:40:25 user nova-compute[72586]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97608faa-e3cc-4920-bf16-f2ccd18f5fed (non-flash)
Aug 01 21:40:25 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:40:25 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ed0315-85fa-412e-b291-82285c335686 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:40:25 user nova-compute[72586]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d (non-flash)
Aug 01 21:40:25 user nova-compute[72586]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec (non-flash)
Aug 01 21:40:25 user nova-compute[72586]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9808c58b-62a7-4877-98c3-cb8a860f02bf (non-flash)
Aug 01 21:40:25 user nova-compute[72586]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97608faa-e3cc-4920-bf16-f2ccd18f5fed (non-flash)
Aug 01 21:40:25 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:40:25 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ed0315-85fa-412e-b291-82285c335686 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ef177b6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d'): ({'sdc'}, set())}) {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 21:40:25 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-09ed0315-85fa-412e-b291-82285c335686 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Removing single pathed devices sdc {{(pid=72586) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 21:40:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:40:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:40:25 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a84b67-bcd7-42bc-8a82-12adfcbb45f0]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:40:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:40:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:40:25 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f664cc-a2da-4fb5-83bc-ca84c8564e82]: (4, ('ok\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:40:25 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-09ed0315-85fa-412e-b291-82285c335686 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Flushing IO for device /dev/sdc {{(pid=72586) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 21:40:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:40:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:40:25 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b37044-886d-4ef9-92de-ab5bb74ff959]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:40:25 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-09ed0315-85fa-412e-b291-82285c335686 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72586) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 21:40:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:40:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:40:25 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[5200c16e-2ec7-4c18-89c6-3bc21bb4e2f0]: (4, ('1', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:40:25 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-09ed0315-85fa-412e-b291-82285c335686 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 21:40:25 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-09ed0315-85fa-412e-b291-82285c335686 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] SCSI volumes sdc have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 21:40:25 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ed0315-85fa-412e-b291-82285c335686 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d')] {{(pid=72586) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 21:40:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:40:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:40:25 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[49371597-5ec2-4498-bd21-6fa77789b8ad]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:40:25 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ed0315-85fa-412e-b291-82285c335686 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:40:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d -p 172.16.0.220:3260 --logout {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:40:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:40:25 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde62d48-a2dd-4060-85a8-b947f85a9065]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:40:25 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ed0315-85fa-412e-b291-82285c335686 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d, portal: 172.16.0.220,3260]
Aug 01 21:40:25 user nova-compute[72586]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d, portal: 172.16.0.220,3260] successful.
Aug 01 21:40:25 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:40:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d -p 172.16.0.220:3260 --op delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:40:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cfe922d-8f30-47f4-9bba-6396ad979f5d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:40:25 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[be57d710-f3b2-46da-8290-601a66c6aa50]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:40:25 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ed0315-85fa-412e-b291-82285c335686 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:40:25 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-09ed0315-85fa-412e-b291-82285c335686 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:40:25 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ed0315-85fa-412e-b291-82285c335686 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] <== disconnect_volume: return (286ms) None {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:40:25 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09ed0315-85fa-412e-b291-82285c335686 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Disconnected iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 21:40:26 user nova-compute[72586]: DEBUG nova.objects.instance [None req-09ed0315-85fa-412e-b291-82285c335686 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lazy-loading 'flavor' on Instance uuid 11ab466b-8caa-4a38-8350-213aa17ee75e {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:40:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-09ed0315-85fa-412e-b291-82285c335686 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "11ab466b-8caa-4a38-8350-213aa17ee75e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.782s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:40:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-907f103e-d84a-4d5b-b075-94af66bcdc7d tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Acquiring lock "11ab466b-8caa-4a38-8350-213aa17ee75e" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:40:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-907f103e-d84a-4d5b-b075-94af66bcdc7d tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "11ab466b-8caa-4a38-8350-213aa17ee75e" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:40:26 user nova-compute[72586]: DEBUG nova.compute.manager [None req-907f103e-d84a-4d5b-b075-94af66bcdc7d tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:40:26 user nova-compute[72586]: DEBUG nova.compute.manager [None req-907f103e-d84a-4d5b-b075-94af66bcdc7d tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72586) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 01 21:40:26 user nova-compute[72586]: DEBUG nova.objects.instance [None req-907f103e-d84a-4d5b-b075-94af66bcdc7d tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lazy-loading 'flavor' on Instance uuid 11ab466b-8caa-4a38-8350-213aa17ee75e {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:40:26 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:40:26 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:40:26 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:40:26 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:40:26 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:40:26 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:40:27 user nova-compute[72586]: DEBUG nova.compute.manager [req-77526894-7e31-4474-836f-d281f96a8dc9 req-a9e800b3-a90d-4954-8fa3-806e0590a96c service nova] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Received event network-vif-unplugged-d70607b2-8e0c-4166-8218-ecbc976d0369 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:40:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-77526894-7e31-4474-836f-d281f96a8dc9 req-a9e800b3-a90d-4954-8fa3-806e0590a96c service nova] Acquiring lock "11ab466b-8caa-4a38-8350-213aa17ee75e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:40:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-77526894-7e31-4474-836f-d281f96a8dc9 req-a9e800b3-a90d-4954-8fa3-806e0590a96c service nova] Lock "11ab466b-8caa-4a38-8350-213aa17ee75e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:40:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-77526894-7e31-4474-836f-d281f96a8dc9 req-a9e800b3-a90d-4954-8fa3-806e0590a96c service nova] Lock "11ab466b-8caa-4a38-8350-213aa17ee75e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:40:27 user nova-compute[72586]: DEBUG nova.compute.manager [req-77526894-7e31-4474-836f-d281f96a8dc9 req-a9e800b3-a90d-4954-8fa3-806e0590a96c service nova] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] No waiting events found dispatching network-vif-unplugged-d70607b2-8e0c-4166-8218-ecbc976d0369 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:40:27 user nova-compute[72586]: WARNING nova.compute.manager [req-77526894-7e31-4474-836f-d281f96a8dc9 req-a9e800b3-a90d-4954-8fa3-806e0590a96c service nova] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Received unexpected event network-vif-unplugged-d70607b2-8e0c-4166-8218-ecbc976d0369 for instance with vm_state active and task_state powering-off.
Aug 01 21:40:27 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Instance destroyed successfully.
Aug 01 21:40:27 user nova-compute[72586]: DEBUG nova.compute.manager [None req-907f103e-d84a-4d5b-b075-94af66bcdc7d tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:40:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-907f103e-d84a-4d5b-b075-94af66bcdc7d tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "11ab466b-8caa-4a38-8350-213aa17ee75e" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.879s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:40:29 user nova-compute[72586]: DEBUG nova.compute.manager [req-6e6445c1-21df-4355-ae72-d5bfa94fa12e req-9c33ad4d-8556-47e8-bc1d-fbc90fe41958 service nova] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Received event network-vif-plugged-d70607b2-8e0c-4166-8218-ecbc976d0369 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:40:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-6e6445c1-21df-4355-ae72-d5bfa94fa12e req-9c33ad4d-8556-47e8-bc1d-fbc90fe41958 service nova] Acquiring lock "11ab466b-8caa-4a38-8350-213aa17ee75e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:40:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-6e6445c1-21df-4355-ae72-d5bfa94fa12e req-9c33ad4d-8556-47e8-bc1d-fbc90fe41958 service nova] Lock "11ab466b-8caa-4a38-8350-213aa17ee75e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:40:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-6e6445c1-21df-4355-ae72-d5bfa94fa12e req-9c33ad4d-8556-47e8-bc1d-fbc90fe41958 service nova] Lock "11ab466b-8caa-4a38-8350-213aa17ee75e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:40:29 user nova-compute[72586]: DEBUG nova.compute.manager [req-6e6445c1-21df-4355-ae72-d5bfa94fa12e req-9c33ad4d-8556-47e8-bc1d-fbc90fe41958 service nova] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] No waiting events found dispatching network-vif-plugged-d70607b2-8e0c-4166-8218-ecbc976d0369 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:40:29 user nova-compute[72586]: WARNING nova.compute.manager [req-6e6445c1-21df-4355-ae72-d5bfa94fa12e req-9c33ad4d-8556-47e8-bc1d-fbc90fe41958 service nova] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Received unexpected event network-vif-plugged-d70607b2-8e0c-4166-8218-ecbc976d0369 for instance with vm_state stopped and task_state None.
Aug 01 21:40:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:40:30 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:40:30 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Cleaning up deleted instances with incomplete migration  {{(pid=72586) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 21:40:31 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:40:31 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:40:32 user nova-compute[72586]: INFO nova.compute.manager [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Rescuing
Aug 01 21:40:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Acquiring lock "refresh_cache-178d26d5-3570-442f-9268-21cd73cccfc7" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:40:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Acquired lock "refresh_cache-178d26d5-3570-442f-9268-21cd73cccfc7" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:40:32 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:40:32 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Updating instance_info_cache with network_info: [{"id": "9bddd744-887b-44bf-aacf-d7606c470f70", "address": "fa:16:3e:50:53:8c", "network": {"id": "86940e5d-852b-48fc-9b0e-858305321349", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1967467603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d847d04360420c80ea5608d5a2b15a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bddd744-88", "ovs_interfaceid": "9bddd744-887b-44bf-aacf-d7606c470f70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:40:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Releasing lock "refresh_cache-178d26d5-3570-442f-9268-21cd73cccfc7" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:40:32 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:40:32 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:40:33 user nova-compute[72586]: DEBUG nova.compute.manager [req-df2e0550-5971-4c62-9671-5d4f01f7c155 req-55ccf78d-afeb-4872-94ee-487b30d7ab1c service nova] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Received event network-vif-unplugged-9bddd744-887b-44bf-aacf-d7606c470f70 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:40:33 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-df2e0550-5971-4c62-9671-5d4f01f7c155 req-55ccf78d-afeb-4872-94ee-487b30d7ab1c service nova] Acquiring lock "178d26d5-3570-442f-9268-21cd73cccfc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:40:33 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-df2e0550-5971-4c62-9671-5d4f01f7c155 req-55ccf78d-afeb-4872-94ee-487b30d7ab1c service nova] Lock "178d26d5-3570-442f-9268-21cd73cccfc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:40:33 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-df2e0550-5971-4c62-9671-5d4f01f7c155 req-55ccf78d-afeb-4872-94ee-487b30d7ab1c service nova] Lock "178d26d5-3570-442f-9268-21cd73cccfc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:40:33 user nova-compute[72586]: DEBUG nova.compute.manager [req-df2e0550-5971-4c62-9671-5d4f01f7c155 req-55ccf78d-afeb-4872-94ee-487b30d7ab1c service nova] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] No waiting events found dispatching network-vif-unplugged-9bddd744-887b-44bf-aacf-d7606c470f70 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:40:33 user nova-compute[72586]: WARNING nova.compute.manager [req-df2e0550-5971-4c62-9671-5d4f01f7c155 req-55ccf78d-afeb-4872-94ee-487b30d7ab1c service nova] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Received unexpected event network-vif-unplugged-9bddd744-887b-44bf-aacf-d7606c470f70 for instance with vm_state active and task_state rescuing.
Aug 01 21:40:33 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:40:33 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:40:33 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Instance destroyed successfully.
Aug 01 21:40:33 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Attempting a stable device rescue
Aug 01 21:40:33 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72586) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 01 21:40:33 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Instance directory exists: not creating {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 01 21:40:33 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Creating image(s)
Aug 01 21:40:33 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Acquiring lock "/opt/stack/data/nova/instances/178d26d5-3570-442f-9268-21cd73cccfc7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:40:33 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "/opt/stack/data/nova/instances/178d26d5-3570-442f-9268-21cd73cccfc7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:40:33 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "/opt/stack/data/nova/instances/178d26d5-3570-442f-9268-21cd73cccfc7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:40:33 user nova-compute[72586]: DEBUG nova.objects.instance [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lazy-loading 'trusted_certs' on Instance uuid 178d26d5-3570-442f-9268-21cd73cccfc7 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:40:33 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Acquiring lock "26780bcd8d16ee62b640857842ecaa2af4b1ae58" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:40:33 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "26780bcd8d16ee62b640857842ecaa2af4b1ae58" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:40:34 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/26780bcd8d16ee62b640857842ecaa2af4b1ae58.part --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:40:34 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:40:34 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:40:34 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/26780bcd8d16ee62b640857842ecaa2af4b1ae58.part --force-share --output=json" returned: 0 in 0.142s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:40:34 user nova-compute[72586]: DEBUG nova.virt.images [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] bf9b1623-cdea-4385-9ad7-f1eff5351b3e was qcow2, converting to raw {{(pid=72586) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 21:40:34 user nova-compute[72586]: DEBUG nova.privsep.utils [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72586) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 21:40:34 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/26780bcd8d16ee62b640857842ecaa2af4b1ae58.part /opt/stack/data/nova/instances/_base/26780bcd8d16ee62b640857842ecaa2af4b1ae58.converted {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:40:34 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG nova.compute.manager [req-63ccb413-0a27-4d32-9902-b074e1dbdf5b req-de45678f-d959-4a9a-b36d-ebf0c73545a3 service nova] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Received event network-vif-plugged-9bddd744-887b-44bf-aacf-d7606c470f70 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-63ccb413-0a27-4d32-9902-b074e1dbdf5b req-de45678f-d959-4a9a-b36d-ebf0c73545a3 service nova] Acquiring lock "178d26d5-3570-442f-9268-21cd73cccfc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-63ccb413-0a27-4d32-9902-b074e1dbdf5b req-de45678f-d959-4a9a-b36d-ebf0c73545a3 service nova] Lock "178d26d5-3570-442f-9268-21cd73cccfc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-63ccb413-0a27-4d32-9902-b074e1dbdf5b req-de45678f-d959-4a9a-b36d-ebf0c73545a3 service nova] Lock "178d26d5-3570-442f-9268-21cd73cccfc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG nova.compute.manager [req-63ccb413-0a27-4d32-9902-b074e1dbdf5b req-de45678f-d959-4a9a-b36d-ebf0c73545a3 service nova] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] No waiting events found dispatching network-vif-plugged-9bddd744-887b-44bf-aacf-d7606c470f70 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:40:35 user nova-compute[72586]: WARNING nova.compute.manager [req-63ccb413-0a27-4d32-9902-b074e1dbdf5b req-de45678f-d959-4a9a-b36d-ebf0c73545a3 service nova] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Received unexpected event network-vif-plugged-9bddd744-887b-44bf-aacf-d7606c470f70 for instance with vm_state active and task_state rescuing.
Aug 01 21:40:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/26780bcd8d16ee62b640857842ecaa2af4b1ae58.part /opt/stack/data/nova/instances/_base/26780bcd8d16ee62b640857842ecaa2af4b1ae58.converted" returned: 0 in 0.437s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/26780bcd8d16ee62b640857842ecaa2af4b1ae58.converted --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/26780bcd8d16ee62b640857842ecaa2af4b1ae58.converted --force-share --output=json" returned: 0 in 0.135s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "26780bcd8d16ee62b640857842ecaa2af4b1ae58" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.680s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Acquiring lock "26780bcd8d16ee62b640857842ecaa2af4b1ae58" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "26780bcd8d16ee62b640857842ecaa2af4b1ae58" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/26780bcd8d16ee62b640857842ecaa2af4b1ae58 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/26780bcd8d16ee62b640857842ecaa2af4b1ae58 --force-share --output=json" returned: 0 in 0.132s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/26780bcd8d16ee62b640857842ecaa2af4b1ae58,backing_fmt=raw /opt/stack/data/nova/instances/178d26d5-3570-442f-9268-21cd73cccfc7/disk.rescue {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/26780bcd8d16ee62b640857842ecaa2af4b1ae58,backing_fmt=raw /opt/stack/data/nova/instances/178d26d5-3570-442f-9268-21cd73cccfc7/disk.rescue" returned: 0 in 0.048s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "26780bcd8d16ee62b640857842ecaa2af4b1ae58" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.186s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG nova.objects.instance [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lazy-loading 'migration_context' on Instance uuid 178d26d5-3570-442f-9268-21cd73cccfc7 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Created local disks {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Start _get_guest_xml network_info=[{"id": "9bddd744-887b-44bf-aacf-d7606c470f70", "address": "fa:16:3e:50:53:8c", "network": {"id": "86940e5d-852b-48fc-9b0e-858305321349", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1967467603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1967467603-network", "vif_mac": "fa:16:3e:50:53:8c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d847d04360420c80ea5608d5a2b15a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bddd744-88", "ovs_interfaceid": "9bddd744-887b-44bf-aacf-d7606c470f70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'bf9b1623-cdea-4385-9ad7-f1eff5351b3e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Dfqvdwst', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '178d26d5-3570-442f-9268-21cd73cccfc7', 'attached_at': '', 'detached_at': '', 'volume_id': 'b89d79f8-7470-41bf-80e3-b41c398493ec', 'serial': 'b89d79f8-7470-41bf-80e3-b41c398493ec'}, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'f1cd0544-600e-4a25-a046-705d3583237f', 'delete_on_termination': False, 'volume_type': None} {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG nova.objects.instance [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lazy-loading 'resources' on Instance uuid 178d26d5-3570-442f-9268-21cd73cccfc7 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG nova.objects.instance [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lazy-loading 'numa_topology' on Instance uuid 178d26d5-3570-442f-9268-21cd73cccfc7 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:40:35 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:40:35 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:40:35 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG nova.objects.instance [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lazy-loading 'vcpu_model' on Instance uuid 178d26d5-3570-442f-9268-21cd73cccfc7 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Calling os-brick to attach iSCSI Volume {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Dfqvdwst', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:40:35 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:40:35 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:40:35 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:40:35 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:40:35 user nova-compute[72586]: INFO os_brick.initiator.connectors.iscsi [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 21:40:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec -p 172.16.0.220:3260 {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec -p 172.16.0.220:3260" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d97cd24-2f58-4db2-af28-fb43c11c6c2e]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = Dfqvdwst\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 01 21:40:35 user nova-compute[72586]: node.name = iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec
Aug 01 21:40:35 user nova-compute[72586]: node.tpgt = -1
Aug 01 21:40:35 user nova-compute[72586]: node.startup = automatic
Aug 01 21:40:35 user nova-compute[72586]: node.leading_login = No
Aug 01 21:40:35 user nova-compute[72586]: iface.iscsi_ifacename = default
Aug 01 21:40:35 user nova-compute[72586]: iface.net_ifacename = <empty>
Aug 01 21:40:35 user nova-compute[72586]: iface.ipaddress = <empty>
Aug 01 21:40:35 user nova-compute[72586]: iface.prefix_len = 0
Aug 01 21:40:35 user nova-compute[72586]: iface.hwaddress = <empty>
Aug 01 21:40:35 user nova-compute[72586]: iface.transport_name = tcp
Aug 01 21:40:35 user nova-compute[72586]: iface.initiatorname = <empty>
Aug 01 21:40:35 user nova-compute[72586]: iface.state = <empty>
Aug 01 21:40:35 user nova-compute[72586]: iface.vlan_id = 0
Aug 01 21:40:35 user nova-compute[72586]: iface.vlan_priority = 0
Aug 01 21:40:35 user nova-compute[72586]: iface.vlan_state = <empty>
Aug 01 21:40:35 user nova-compute[72586]: iface.iface_num = 0
Aug 01 21:40:35 user nova-compute[72586]: iface.mtu = 0
Aug 01 21:40:35 user nova-compute[72586]: iface.port = 0
Aug 01 21:40:35 user nova-compute[72586]: iface.bootproto = <empty>
Aug 01 21:40:35 user nova-compute[72586]: iface.subnet_mask = <empty>
Aug 01 21:40:35 user nova-compute[72586]: iface.gateway = <empty>
Aug 01 21:40:35 user nova-compute[72586]: iface.dhcp_alt_client_id_state = <empty>
Aug 01 21:40:35 user nova-compute[72586]: iface.dhcp_alt_client_id = <empty>
Aug 01 21:40:35 user nova-compute[72586]: iface.dhcp_dns = <empty>
Aug 01 21:40:35 user nova-compute[72586]: iface.dhcp_learn_iqn = <empty>
Aug 01 21:40:35 user nova-compute[72586]: iface.dhcp_req_vendor_id_state = <empty>
Aug 01 21:40:35 user nova-compute[72586]: iface.dhcp_vendor_id_state = <empty>
Aug 01 21:40:35 user nova-compute[72586]: iface.dhcp_vendor_id = <empty>
Aug 01 21:40:35 user nova-compute[72586]: iface.dhcp_slp_da = <empty>
Aug 01 21:40:35 user nova-compute[72586]: iface.fragmentation = <empty>
Aug 01 21:40:35 user nova-compute[72586]: iface.gratuitous_arp = <empty>
Aug 01 21:40:35 user nova-compute[72586]: iface.incoming_forwarding = <empty>
Aug 01 21:40:35 user nova-compute[72586]: iface.tos_state = <empty>
Aug 01 21:40:35 user nova-compute[72586]: iface.tos = 0
Aug 01 21:40:35 user nova-compute[72586]: iface.ttl = 0
Aug 01 21:40:35 user nova-compute[72586]: iface.delayed_ack = <empty>
Aug 01 21:40:35 user nova-compute[72586]: iface.tcp_nagle = <empty>
Aug 01 21:40:35 user nova-compute[72586]: iface.tcp_wsf_state = <empty>
Aug 01 21:40:35 user nova-compute[72586]: iface.tcp_wsf = 0
Aug 01 21:40:35 user nova-compute[72586]: iface.tcp_timer_scale = 0
Aug 01 21:40:35 user nova-compute[72586]: iface.tcp_timestamp = <empty>
Aug 01 21:40:35 user nova-compute[72586]: iface.redirect = <empty>
Aug 01 21:40:35 user nova-compute[72586]: iface.def_task_mgmt_timeout = 0
Aug 01 21:40:35 user nova-compute[72586]: iface.header_digest = <empty>
Aug 01 21:40:35 user nova-compute[72586]: iface.data_digest = <empty>
Aug 01 21:40:35 user nova-compute[72586]: iface.immediate_data = <empty>
Aug 01 21:40:35 user nova-compute[72586]: iface.initial_r2t = <empty>
Aug 01 21:40:35 user nova-compute[72586]: iface.data_seq_inorder = <empty>
Aug 01 21:40:35 user nova-compute[72586]: iface.data_pdu_inorder = <empty>
Aug 01 21:40:35 user nova-compute[72586]: iface.erl = 0
Aug 01 21:40:35 user nova-compute[72586]: iface.max_receive_data_len = 0
Aug 01 21:40:35 user nova-compute[72586]: iface.first_burst_len = 0
Aug 01 21:40:35 user nova-compute[72586]: iface.max_outstanding_r2t = 0
Aug 01 21:40:35 user nova-compute[72586]: iface.max_burst_len = 0
Aug 01 21:40:35 user nova-compute[72586]: iface.chap_auth = <empty>
Aug 01 21:40:35 user nova-compute[72586]: iface.bidi_chap = <empty>
Aug 01 21:40:35 user nova-compute[72586]: iface.strict_login_compliance = <empty>
Aug 01 21:40:35 user nova-compute[72586]: iface.discovery_auth = <empty>
Aug 01 21:40:35 user nova-compute[72586]: iface.discovery_logout = <empty>
Aug 01 21:40:35 user nova-compute[72586]: node.discovery_address = <empty>
Aug 01 21:40:35 user nova-compute[72586]: node.discovery_port = 0
Aug 01 21:40:35 user nova-compute[72586]: node.discovery_type = static
Aug 01 21:40:35 user nova-compute[72586]: node.session.initial_cmdsn = 0
Aug 01 21:40:35 user nova-compute[72586]: node.session.initial_login_retry_max = 8
Aug 01 21:40:35 user nova-compute[72586]: node.session.xmit_thread_priority = -20
Aug 01 21:40:35 user nova-compute[72586]: node.session.cmds_max = 128
Aug 01 21:40:35 user nova-compute[72586]: node.session.queue_depth = 32
Aug 01 21:40:35 user nova-compute[72586]: node.session.nr_sessions = 1
Aug 01 21:40:35 user nova-compute[72586]: node.session.auth.authmethod = CHAP
Aug 01 21:40:35 user nova-compute[72586]: node.session.auth.username = Dfqvdwst
Aug 01 21:40:35 user nova-compute[72586]: node.session.auth.password = ***
Aug 01 21:40:35 user nova-compute[72586]: node.session.auth.username_in = <empty>
Aug 01 21:40:35 user nova-compute[72586]: node.session.auth.password_in = <empty>
Aug 01 21:40:35 user nova-compute[72586]: node.session.auth.chap_algs = MD5
Aug 01 21:40:35 user nova-compute[72586]: node.session.timeo.replacement_timeout = 120
Aug 01 21:40:35 user nova-compute[72586]: node.session.err_timeo.abort_timeout = 15
Aug 01 21:40:35 user nova-compute[72586]: node.session.err_timeo.lu_reset_timeout = 30
Aug 01 21:40:35 user nova-compute[72586]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 01 21:40:35 user nova-compute[72586]: node.session.err_timeo.host_reset_timeout = 60
Aug 01 21:40:35 user nova-compute[72586]: node.session.iscsi.FastAbort = Yes
Aug 01 21:40:35 user nova-compute[72586]: node.session.iscsi.InitialR2T = No
Aug 01 21:40:35 user nova-compute[72586]: node.session.iscsi.ImmediateData = Yes
Aug 01 21:40:35 user nova-compute[72586]: node.session.iscsi.FirstBurstLength = 262144
Aug 01 21:40:35 user nova-compute[72586]: node.session.iscsi.MaxBurstLength = 16776192
Aug 01 21:40:35 user nova-compute[72586]: node.session.iscsi.DefaultTime2Retain = 0
Aug 01 21:40:35 user nova-compute[72586]: node.session.iscsi.DefaultTime2Wait = 2
Aug 01 21:40:35 user nova-compute[72586]: node.session.iscsi.MaxConnections = 1
Aug 01 21:40:35 user nova-compute[72586]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 01 21:40:35 user nova-compute[72586]: node.session.iscsi.ERL = 0
Aug 01 21:40:35 user nova-compute[72586]: node.session.scan = manual
Aug 01 21:40:35 user nova-compute[72586]: node.session.reopen_max = 0
Aug 01 21:40:35 user nova-compute[72586]: node.conn[0].address = 172.16.0.220
Aug 01 21:40:35 user nova-compute[72586]: node.conn[0].port = 3260
Aug 01 21:40:35 user nova-compute[72586]: node.conn[0].startup = manual
Aug 01 21:40:35 user nova-compute[72586]: node.conn[0].tcp.window_size = 524288
Aug 01 21:40:35 user nova-compute[72586]: node.conn[0].tcp.type_of_service = 0
Aug 01 21:40:35 user nova-compute[72586]: node.conn[0].timeo.logout_timeout = 15
Aug 01 21:40:35 user nova-compute[72586]: node.conn[0].timeo.login_timeout = 15
Aug 01 21:40:35 user nova-compute[72586]: node.conn[0].timeo.auth_timeout = 45
Aug 01 21:40:35 user nova-compute[72586]: node.conn[0].timeo.noop_out_interval = 5
Aug 01 21:40:35 user nova-compute[72586]: node.conn[0].timeo.noop_out_timeout = 5
Aug 01 21:40:35 user nova-compute[72586]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 01 21:40:35 user nova-compute[72586]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 01 21:40:35 user nova-compute[72586]: node.conn[0].iscsi.HeaderDigest = None
Aug 01 21:40:35 user nova-compute[72586]: node.conn[0].iscsi.DataDigest = None
Aug 01 21:40:35 user nova-compute[72586]: node.conn[0].iscsi.IFMarker = No
Aug 01 21:40:35 user nova-compute[72586]: node.conn[0].iscsi.OFMarker = No
Aug 01 21:40:35 user nova-compute[72586]: # END RECORD
Aug 01 21:40:35 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4c19d9-dba0-46f2-8fb4-ed56ae8a7617]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c56abb3-6ad4-42c9-9936-61eb096c0f43]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Dfqvdwst {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Dfqvdwst" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7046ae-5072-4691-9e87-2eec75c165d3]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'Dfqvdwst'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0d7d5d-a588-4a03-84f2-d45997f19762]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[da03c73d-4b6f-4eca-882a-e981de1bb626]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9808c58b-62a7-4877-98c3-cb8a860f02bf (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97608faa-e3cc-4920-bf16-f2ccd18f5fed (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:40:35 user nova-compute[72586]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec (non-flash)
Aug 01 21:40:35 user nova-compute[72586]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9808c58b-62a7-4877-98c3-cb8a860f02bf (non-flash)
Aug 01 21:40:35 user nova-compute[72586]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97608faa-e3cc-4920-bf16-f2ccd18f5fed (non-flash)
Aug 01 21:40:35 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:40:35 user nova-compute[72586]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec (non-flash)
Aug 01 21:40:35 user nova-compute[72586]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9808c58b-62a7-4877-98c3-cb8a860f02bf (non-flash)
Aug 01 21:40:35 user nova-compute[72586]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97608faa-e3cc-4920-bf16-f2ccd18f5fed (non-flash)
Aug 01 21:40:35 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.141s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Connected to 172.16.0.220:3260 {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] HCTL ('35', '0', '0', 0) found on session 42 with lun 0 {{(pid=72586) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=72586) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.013s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1802472-0d32-4293-aadb-8a3fd0927e10]: (4, ('0 0 0', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Searching for a device in session 42 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Dfqvdwst', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.163s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] <== connect_volume: return (165ms) {'type': 'block', 'scsi_wwn': '26634633333623461', 'path': '/dev/sdd'} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634633333623461', 'path': '/dev/sdd'} {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:38:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1421463273',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1421463273',id=35,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:39:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88d847d04360420c80ea5608d5a2b15a',ramdisk_id='',reservation_id='r-emch0wow',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1268085586',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:39:07Z,user_data=None,user_id='a984642731b9413c97038f65052ab92d',uuid=178d26d5-3570-442f-9268-21cd73cccfc7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9bddd744-887b-44bf-aacf-d7606c470f70", "address": "fa:16:3e:50:53:8c", "network": {"id": "86940e5d-852b-48fc-9b0e-858305321349", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1967467603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1967467603-network", "vif_mac": "fa:16:3e:50:53:8c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d847d04360420c80ea5608d5a2b15a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bddd744-88", "ovs_interfaceid": "9bddd744-887b-44bf-aacf-d7606c470f70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Converting VIF {"id": "9bddd744-887b-44bf-aacf-d7606c470f70", "address": "fa:16:3e:50:53:8c", "network": {"id": "86940e5d-852b-48fc-9b0e-858305321349", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1967467603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1967467603-network", "vif_mac": "fa:16:3e:50:53:8c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d847d04360420c80ea5608d5a2b15a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bddd744-88", "ovs_interfaceid": "9bddd744-887b-44bf-aacf-d7606c470f70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:50:53:8c,bridge_name='br-int',has_traffic_filtering=True,id=9bddd744-887b-44bf-aacf-d7606c470f70,network=Network(86940e5d-852b-48fc-9b0e-858305321349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bddd744-88') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG nova.objects.instance [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lazy-loading 'pci_devices' on Instance uuid 178d26d5-3570-442f-9268-21cd73cccfc7 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:40:35 user nova-compute[72586]:   <uuid>178d26d5-3570-442f-9268-21cd73cccfc7</uuid>
Aug 01 21:40:35 user nova-compute[72586]:   <name>instance-00000023</name>
Aug 01 21:40:35 user nova-compute[72586]:   <memory>524288</memory>
Aug 01 21:40:35 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:40:35 user nova-compute[72586]:   <metadata>
Aug 01 21:40:35 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:40:35 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:40:35 user nova-compute[72586]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1421463273</nova:name>
Aug 01 21:40:35 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:40:35</nova:creationTime>
Aug 01 21:40:35 user nova-compute[72586]:       <nova:flavor name="m1.tiny">
Aug 01 21:40:35 user nova-compute[72586]:         <nova:memory>512</nova:memory>
Aug 01 21:40:35 user nova-compute[72586]:         <nova:disk>1</nova:disk>
Aug 01 21:40:35 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:40:35 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:40:35 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:40:35 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:40:35 user nova-compute[72586]:       <nova:owner>
Aug 01 21:40:35 user nova-compute[72586]:         <nova:user uuid="a984642731b9413c97038f65052ab92d">tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member</nova:user>
Aug 01 21:40:35 user nova-compute[72586]:         <nova:project uuid="88d847d04360420c80ea5608d5a2b15a">tempest-ServerBootFromVolumeStableRescueTest-1268085586</nova:project>
Aug 01 21:40:35 user nova-compute[72586]:       </nova:owner>
Aug 01 21:40:35 user nova-compute[72586]:       <nova:root type="image" uuid="0243d46b-6819-42a5-926f-42b71f0c97ad"/>
Aug 01 21:40:35 user nova-compute[72586]:       <nova:ports>
Aug 01 21:40:35 user nova-compute[72586]:         <nova:port uuid="9bddd744-887b-44bf-aacf-d7606c470f70">
Aug 01 21:40:35 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 01 21:40:35 user nova-compute[72586]:         </nova:port>
Aug 01 21:40:35 user nova-compute[72586]:       </nova:ports>
Aug 01 21:40:35 user nova-compute[72586]:     </nova:instance>
Aug 01 21:40:35 user nova-compute[72586]:   </metadata>
Aug 01 21:40:35 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:40:35 user nova-compute[72586]:     <system>
Aug 01 21:40:35 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:40:35 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:40:35 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:40:35 user nova-compute[72586]:       <entry name="serial">178d26d5-3570-442f-9268-21cd73cccfc7</entry>
Aug 01 21:40:35 user nova-compute[72586]:       <entry name="uuid">178d26d5-3570-442f-9268-21cd73cccfc7</entry>
Aug 01 21:40:35 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:40:35 user nova-compute[72586]:     </system>
Aug 01 21:40:35 user nova-compute[72586]:   </sysinfo>
Aug 01 21:40:35 user nova-compute[72586]:   <os>
Aug 01 21:40:35 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:40:35 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:40:35 user nova-compute[72586]:   </os>
Aug 01 21:40:35 user nova-compute[72586]:   <features>
Aug 01 21:40:35 user nova-compute[72586]:     <acpi/>
Aug 01 21:40:35 user nova-compute[72586]:     <apic/>
Aug 01 21:40:35 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:40:35 user nova-compute[72586]:   </features>
Aug 01 21:40:35 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:40:35 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:40:35 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:40:35 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:40:35 user nova-compute[72586]:   </clock>
Aug 01 21:40:35 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:40:35 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:40:35 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:40:35 user nova-compute[72586]:   </cpu>
Aug 01 21:40:35 user nova-compute[72586]:   <devices>
Aug 01 21:40:35 user nova-compute[72586]:     <disk type="block" device="disk">
Aug 01 21:40:35 user nova-compute[72586]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:40:35 user nova-compute[72586]:       <source dev="/dev/sdd"/>
Aug 01 21:40:35 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:40:35 user nova-compute[72586]:       <serial>b89d79f8-7470-41bf-80e3-b41c398493ec</serial>
Aug 01 21:40:35 user nova-compute[72586]:     </disk>
Aug 01 21:40:35 user nova-compute[72586]:     <disk type="file" device="disk">
Aug 01 21:40:35 user nova-compute[72586]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 21:40:35 user nova-compute[72586]:       <source file="/opt/stack/data/nova/instances/178d26d5-3570-442f-9268-21cd73cccfc7/disk.rescue"/>
Aug 01 21:40:35 user nova-compute[72586]:       <target dev="vdb" bus="virtio"/>
Aug 01 21:40:35 user nova-compute[72586]:       <boot order="1"/>
Aug 01 21:40:35 user nova-compute[72586]:     </disk>
Aug 01 21:40:35 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:40:35 user nova-compute[72586]:       <mac address="fa:16:3e:50:53:8c"/>
Aug 01 21:40:35 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:40:35 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:40:35 user nova-compute[72586]:       <target dev="tap9bddd744-88"/>
Aug 01 21:40:35 user nova-compute[72586]:     </interface>
Aug 01 21:40:35 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:40:35 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/178d26d5-3570-442f-9268-21cd73cccfc7/console.log" append="off"/>
Aug 01 21:40:35 user nova-compute[72586]:     </serial>
Aug 01 21:40:35 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:40:35 user nova-compute[72586]:     <video>
Aug 01 21:40:35 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:40:35 user nova-compute[72586]:     </video>
Aug 01 21:40:35 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:40:35 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:40:35 user nova-compute[72586]:     </rng>
Aug 01 21:40:35 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:40:35 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:40:35 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:40:35 user nova-compute[72586]:     </memballoon>
Aug 01 21:40:35 user nova-compute[72586]:   </devices>
Aug 01 21:40:35 user nova-compute[72586]: </domain>
Aug 01 21:40:35 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72586) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 21:40:35 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Instance destroyed successfully.
Aug 01 21:40:35 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:40:35 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] No VIF found with MAC fa:16:3e:50:53:8c, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:40:36 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:40:36 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:40:36 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:40:36 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:40:36 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:40:36 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:40:36 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Auditing locally available compute resources for user (node: user) {{(pid=72586) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 21:40:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:40:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:40:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:40:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:40:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:40:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:40:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:40:37 user nova-compute[72586]: DEBUG nova.compute.manager [req-a666523d-949a-43d9-85be-4333116f14a7 req-d5593d78-2dad-4cc1-b60e-d9a8f7071c76 service nova] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Received event network-vif-plugged-9bddd744-887b-44bf-aacf-d7606c470f70 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:40:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-a666523d-949a-43d9-85be-4333116f14a7 req-d5593d78-2dad-4cc1-b60e-d9a8f7071c76 service nova] Acquiring lock "178d26d5-3570-442f-9268-21cd73cccfc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:40:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-a666523d-949a-43d9-85be-4333116f14a7 req-d5593d78-2dad-4cc1-b60e-d9a8f7071c76 service nova] Lock "178d26d5-3570-442f-9268-21cd73cccfc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:40:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-a666523d-949a-43d9-85be-4333116f14a7 req-d5593d78-2dad-4cc1-b60e-d9a8f7071c76 service nova] Lock "178d26d5-3570-442f-9268-21cd73cccfc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:40:37 user nova-compute[72586]: DEBUG nova.compute.manager [req-a666523d-949a-43d9-85be-4333116f14a7 req-d5593d78-2dad-4cc1-b60e-d9a8f7071c76 service nova] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] No waiting events found dispatching network-vif-plugged-9bddd744-887b-44bf-aacf-d7606c470f70 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:40:37 user nova-compute[72586]: WARNING nova.compute.manager [req-a666523d-949a-43d9-85be-4333116f14a7 req-d5593d78-2dad-4cc1-b60e-d9a8f7071c76 service nova] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Received unexpected event network-vif-plugged-9bddd744-887b-44bf-aacf-d7606c470f70 for instance with vm_state active and task_state rescuing.
Aug 01 21:40:37 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:40:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/178d26d5-3570-442f-9268-21cd73cccfc7/disk.rescue --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:40:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/178d26d5-3570-442f-9268-21cd73cccfc7/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:40:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/178d26d5-3570-442f-9268-21cd73cccfc7/disk.rescue --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:40:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/178d26d5-3570-442f-9268-21cd73cccfc7/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:40:38 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:40:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ab466b-8caa-4a38-8350-213aa17ee75e/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:40:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ab466b-8caa-4a38-8350-213aa17ee75e/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:40:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ab466b-8caa-4a38-8350-213aa17ee75e/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:40:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ab466b-8caa-4a38-8350-213aa17ee75e/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:40:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:40:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:40:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:40:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:40:38 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:40:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b436dd23-122a-4da5-9fa7-1d658909b16e/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:40:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b436dd23-122a-4da5-9fa7-1d658909b16e/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:40:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b436dd23-122a-4da5-9fa7-1d658909b16e/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:40:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b436dd23-122a-4da5-9fa7-1d658909b16e/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:40:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee464b0-f75e-4f30-9838-74bca9619a07/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:40:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee464b0-f75e-4f30-9838-74bca9619a07/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:40:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee464b0-f75e-4f30-9838-74bca9619a07/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:40:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee464b0-f75e-4f30-9838-74bca9619a07/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:40:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63625685-227f-48cc-9cc0-594633e0b8bb/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:40:39 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Removed pending event for 178d26d5-3570-442f-9268-21cd73cccfc7 due to event {{(pid=72586) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 21:40:39 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690926039.4010806, 178d26d5-3570-442f-9268-21cd73cccfc7 => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:40:39 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] VM Resumed (Lifecycle Event)
Aug 01 21:40:39 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5ef8a0ee-4477-48fa-b17b-d4fa5db5d267 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:40:39 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:40:39 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:40:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63625685-227f-48cc-9cc0-594633e0b8bb/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:40:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63625685-227f-48cc-9cc0-594633e0b8bb/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:40:39 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 01 21:40:39 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690926039.4147382, 178d26d5-3570-442f-9268-21cd73cccfc7 => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:40:39 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] VM Started (Lifecycle Event)
Aug 01 21:40:39 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:40:39 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:40:39 user nova-compute[72586]: DEBUG nova.compute.manager [req-777a3d6e-3a35-47e2-93b9-8d121d84842d req-e39314aa-9168-4a20-be8d-9b13b0abde5c service nova] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Received event network-vif-plugged-9bddd744-887b-44bf-aacf-d7606c470f70 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:40:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-777a3d6e-3a35-47e2-93b9-8d121d84842d req-e39314aa-9168-4a20-be8d-9b13b0abde5c service nova] Acquiring lock "178d26d5-3570-442f-9268-21cd73cccfc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:40:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-777a3d6e-3a35-47e2-93b9-8d121d84842d req-e39314aa-9168-4a20-be8d-9b13b0abde5c service nova] Lock "178d26d5-3570-442f-9268-21cd73cccfc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:40:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-777a3d6e-3a35-47e2-93b9-8d121d84842d req-e39314aa-9168-4a20-be8d-9b13b0abde5c service nova] Lock "178d26d5-3570-442f-9268-21cd73cccfc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:40:39 user nova-compute[72586]: DEBUG nova.compute.manager [req-777a3d6e-3a35-47e2-93b9-8d121d84842d req-e39314aa-9168-4a20-be8d-9b13b0abde5c service nova] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] No waiting events found dispatching network-vif-plugged-9bddd744-887b-44bf-aacf-d7606c470f70 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:40:39 user nova-compute[72586]: WARNING nova.compute.manager [req-777a3d6e-3a35-47e2-93b9-8d121d84842d req-e39314aa-9168-4a20-be8d-9b13b0abde5c service nova] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Received unexpected event network-vif-plugged-9bddd744-887b-44bf-aacf-d7606c470f70 for instance with vm_state rescued and task_state None.
Aug 01 21:40:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63625685-227f-48cc-9cc0-594633e0b8bb/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:40:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/965244cc-71e5-43f9-8d22-62843bac3f52/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:40:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/965244cc-71e5-43f9-8d22-62843bac3f52/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:40:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/965244cc-71e5-43f9-8d22-62843bac3f52/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:40:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/965244cc-71e5-43f9-8d22-62843bac3f52/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:40:39 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:40:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:40:40 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:40:40 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:40:40 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Hypervisor/Node resource view: name=user free_ram=7874MB free_disk=24.993614196777344GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72586) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 21:40:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:40:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:40:40 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance af2de810-b22f-4fa9-835c-c673abd145db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:40:40 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 161fab9d-a7d1-4ea0-b4b9-2afc54040eef actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:40:40 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 11ab466b-8caa-4a38-8350-213aa17ee75e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:40:40 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 63625685-227f-48cc-9cc0-594633e0b8bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:40:40 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 8ee464b0-f75e-4f30-9838-74bca9619a07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:40:40 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 965244cc-71e5-43f9-8d22-62843bac3f52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:40:40 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 178d26d5-3570-442f-9268-21cd73cccfc7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:40:40 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance b436dd23-122a-4da5-9fa7-1d658909b16e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:40:40 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance aa164378-4fb3-46f3-9368-ddf76b39f18f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:40:40 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 21:40:40 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 21:40:40 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Refreshing inventories for resource provider ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 21:40:40 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Updating ProviderTree inventory for provider ca6775c1-2a64-43f9-9467-372aa0457b1d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 21:40:40 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Updating inventory in ProviderTree for provider ca6775c1-2a64-43f9-9467-372aa0457b1d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 21:40:40 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Refreshing aggregate associations for resource provider ca6775c1-2a64-43f9-9467-372aa0457b1d, aggregates: None {{(pid=72586) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 21:40:40 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Refreshing trait associations for resource provider ca6775c1-2a64-43f9-9467-372aa0457b1d, traits: COMPUTE_NODE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_TRUSTED_CERTS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AMI {{(pid=72586) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 21:40:41 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:40:41 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:40:41 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Compute_service record updated for user:user {{(pid=72586) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 21:40:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.623s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:40:41 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:40:41 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:40:42 user nova-compute[72586]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690926027.4831986, 11ab466b-8caa-4a38-8350-213aa17ee75e => Stopped> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:40:42 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] VM Stopped (Lifecycle Event)
Aug 01 21:40:42 user nova-compute[72586]: DEBUG nova.compute.manager [None req-11e24257-2c5e-45bb-a587-5d6f8ebbea43 None None] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:40:42 user nova-compute[72586]: DEBUG nova.compute.manager [None req-11e24257-2c5e-45bb-a587-5d6f8ebbea43 None None] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:40:43 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:40:43 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Starting heal instance info cache {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 21:40:43 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Rebuilding the list of instances to heal {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 21:40:43 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "refresh_cache-af2de810-b22f-4fa9-835c-c673abd145db" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:40:43 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquired lock "refresh_cache-af2de810-b22f-4fa9-835c-c673abd145db" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:40:43 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Forcefully refreshing network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 21:40:43 user nova-compute[72586]: DEBUG nova.objects.instance [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lazy-loading 'info_cache' on Instance uuid af2de810-b22f-4fa9-835c-c673abd145db {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:40:43 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Updating instance_info_cache with network_info: [{"id": "b3d7d993-0a45-40ab-8cdd-e3eb06183294", "address": "fa:16:3e:29:af:12", "network": {"id": "86940e5d-852b-48fc-9b0e-858305321349", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1967467603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d847d04360420c80ea5608d5a2b15a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3d7d993-0a", "ovs_interfaceid": "b3d7d993-0a45-40ab-8cdd-e3eb06183294", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:40:43 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Releasing lock "refresh_cache-af2de810-b22f-4fa9-835c-c673abd145db" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:40:43 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Updated the network info_cache for instance {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 21:40:43 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:40:43 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:40:44 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:40:46 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:40:51 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:40:51 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:40:51 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72586) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 21:40:51 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72586) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 21:40:51 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72586) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 21:40:51 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:40:54 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:40:56 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:40:57 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:40:58 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:40:58 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Cleaning up deleted instances {{(pid=72586) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 21:40:58 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] There are 0 instances to clean {{(pid=72586) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 21:40:59 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:41:01 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:41:04 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:41:06 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:41:09 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:41:09 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:41:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-008635ae-7b6e-472c-a03b-e7a5959cd93f tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Acquiring lock "b436dd23-122a-4da5-9fa7-1d658909b16e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:41:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-008635ae-7b6e-472c-a03b-e7a5959cd93f tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Lock "b436dd23-122a-4da5-9fa7-1d658909b16e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:41:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-008635ae-7b6e-472c-a03b-e7a5959cd93f tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Acquiring lock "b436dd23-122a-4da5-9fa7-1d658909b16e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:41:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-008635ae-7b6e-472c-a03b-e7a5959cd93f tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Lock "b436dd23-122a-4da5-9fa7-1d658909b16e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:41:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-008635ae-7b6e-472c-a03b-e7a5959cd93f tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Lock "b436dd23-122a-4da5-9fa7-1d658909b16e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:41:10 user nova-compute[72586]: INFO nova.compute.manager [None req-008635ae-7b6e-472c-a03b-e7a5959cd93f tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] Terminating instance
Aug 01 21:41:10 user nova-compute[72586]: DEBUG nova.compute.manager [None req-008635ae-7b6e-472c-a03b-e7a5959cd93f tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] Start destroying the instance on the hypervisor. {{(pid=72586) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 21:41:11 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:41:11 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:41:11 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:41:11 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:41:11 user nova-compute[72586]: DEBUG nova.compute.manager [req-88e19d54-d833-44b7-8164-5dfe391c22b3 req-bef5b34c-16fd-41d5-9b22-481bffb427d6 service nova] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] Received event network-vif-unplugged-a6a850af-8cd3-4b83-b79e-3259b6e8655c {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:41:11 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-88e19d54-d833-44b7-8164-5dfe391c22b3 req-bef5b34c-16fd-41d5-9b22-481bffb427d6 service nova] Acquiring lock "b436dd23-122a-4da5-9fa7-1d658909b16e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:41:11 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-88e19d54-d833-44b7-8164-5dfe391c22b3 req-bef5b34c-16fd-41d5-9b22-481bffb427d6 service nova] Lock "b436dd23-122a-4da5-9fa7-1d658909b16e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:41:11 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-88e19d54-d833-44b7-8164-5dfe391c22b3 req-bef5b34c-16fd-41d5-9b22-481bffb427d6 service nova] Lock "b436dd23-122a-4da5-9fa7-1d658909b16e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:41:11 user nova-compute[72586]: DEBUG nova.compute.manager [req-88e19d54-d833-44b7-8164-5dfe391c22b3 req-bef5b34c-16fd-41d5-9b22-481bffb427d6 service nova] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] No waiting events found dispatching network-vif-unplugged-a6a850af-8cd3-4b83-b79e-3259b6e8655c {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:41:11 user nova-compute[72586]: DEBUG nova.compute.manager [req-88e19d54-d833-44b7-8164-5dfe391c22b3 req-bef5b34c-16fd-41d5-9b22-481bffb427d6 service nova] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] Received event network-vif-unplugged-a6a850af-8cd3-4b83-b79e-3259b6e8655c for instance with task_state deleting. {{(pid=72586) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 21:41:11 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] Instance destroyed successfully.
Aug 01 21:41:11 user nova-compute[72586]: DEBUG nova.objects.instance [None req-008635ae-7b6e-472c-a03b-e7a5959cd93f tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Lazy-loading 'resources' on Instance uuid b436dd23-122a-4da5-9fa7-1d658909b16e {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:41:11 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-008635ae-7b6e-472c-a03b-e7a5959cd93f tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:39:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-245976474',display_name='tempest-ServersNegativeTestJSON-server-245976474',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-245976474',id=36,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:39:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2896d39f80af4e07869d3b1acfba1d8b',ramdisk_id='',reservation_id='r-nes3j6g7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-2014666022',owner_user_name='tempest-ServersNegativeTestJSON-2014666022-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:39:27Z,user_data=None,user_id='49d631f793a54e4cbf086cbf89696834',uuid=b436dd23-122a-4da5-9fa7-1d658909b16e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a6a850af-8cd3-4b83-b79e-3259b6e8655c", "address": "fa:16:3e:49:18:f2", "network": {"id": "e687eacc-3080-46db-b577-5efb36856dce", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1089459024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2896d39f80af4e07869d3b1acfba1d8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6a850af-8c", "ovs_interfaceid": "a6a850af-8cd3-4b83-b79e-3259b6e8655c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:41:11 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-008635ae-7b6e-472c-a03b-e7a5959cd93f tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Converting VIF {"id": "a6a850af-8cd3-4b83-b79e-3259b6e8655c", "address": "fa:16:3e:49:18:f2", "network": {"id": "e687eacc-3080-46db-b577-5efb36856dce", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1089459024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2896d39f80af4e07869d3b1acfba1d8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6a850af-8c", "ovs_interfaceid": "a6a850af-8cd3-4b83-b79e-3259b6e8655c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:41:11 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-008635ae-7b6e-472c-a03b-e7a5959cd93f tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:18:f2,bridge_name='br-int',has_traffic_filtering=True,id=a6a850af-8cd3-4b83-b79e-3259b6e8655c,network=Network(e687eacc-3080-46db-b577-5efb36856dce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6a850af-8c') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:41:11 user nova-compute[72586]: DEBUG os_vif [None req-008635ae-7b6e-472c-a03b-e7a5959cd93f tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:18:f2,bridge_name='br-int',has_traffic_filtering=True,id=a6a850af-8cd3-4b83-b79e-3259b6e8655c,network=Network(e687eacc-3080-46db-b577-5efb36856dce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6a850af-8c') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:41:11 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:41:11 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa6a850af-8c, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:41:11 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:41:11 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:41:11 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:41:11 user nova-compute[72586]: INFO os_vif [None req-008635ae-7b6e-472c-a03b-e7a5959cd93f tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:18:f2,bridge_name='br-int',has_traffic_filtering=True,id=a6a850af-8cd3-4b83-b79e-3259b6e8655c,network=Network(e687eacc-3080-46db-b577-5efb36856dce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6a850af-8c')
Aug 01 21:41:11 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-008635ae-7b6e-472c-a03b-e7a5959cd93f tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] Deleting instance files /opt/stack/data/nova/instances/b436dd23-122a-4da5-9fa7-1d658909b16e_del
Aug 01 21:41:11 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-008635ae-7b6e-472c-a03b-e7a5959cd93f tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] Deletion of /opt/stack/data/nova/instances/b436dd23-122a-4da5-9fa7-1d658909b16e_del complete
Aug 01 21:41:11 user nova-compute[72586]: INFO nova.compute.manager [None req-008635ae-7b6e-472c-a03b-e7a5959cd93f tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 01 21:41:11 user nova-compute[72586]: DEBUG oslo.service.loopingcall [None req-008635ae-7b6e-472c-a03b-e7a5959cd93f tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72586) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 21:41:11 user nova-compute[72586]: DEBUG nova.compute.manager [-] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] Deallocating network for instance {{(pid=72586) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 21:41:11 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] deallocate_for_instance() {{(pid=72586) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 21:41:12 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:41:12 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] Took 0.55 seconds to deallocate network for instance.
Aug 01 21:41:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-008635ae-7b6e-472c-a03b-e7a5959cd93f tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:41:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-008635ae-7b6e-472c-a03b-e7a5959cd93f tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:41:12 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-008635ae-7b6e-472c-a03b-e7a5959cd93f tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:41:12 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-008635ae-7b6e-472c-a03b-e7a5959cd93f tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:41:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-008635ae-7b6e-472c-a03b-e7a5959cd93f tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.348s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:41:12 user nova-compute[72586]: INFO nova.scheduler.client.report [None req-008635ae-7b6e-472c-a03b-e7a5959cd93f tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Deleted allocations for instance b436dd23-122a-4da5-9fa7-1d658909b16e
Aug 01 21:41:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-008635ae-7b6e-472c-a03b-e7a5959cd93f tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Lock "b436dd23-122a-4da5-9fa7-1d658909b16e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.032s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:41:13 user nova-compute[72586]: DEBUG nova.compute.manager [req-c12a10c3-6a5d-4c3f-bbdb-b209052c6b93 req-bae8fc94-2b3e-49ae-abf9-91b667cf4bdb service nova] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] Received event network-vif-plugged-a6a850af-8cd3-4b83-b79e-3259b6e8655c {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:41:13 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-c12a10c3-6a5d-4c3f-bbdb-b209052c6b93 req-bae8fc94-2b3e-49ae-abf9-91b667cf4bdb service nova] Acquiring lock "b436dd23-122a-4da5-9fa7-1d658909b16e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:41:13 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-c12a10c3-6a5d-4c3f-bbdb-b209052c6b93 req-bae8fc94-2b3e-49ae-abf9-91b667cf4bdb service nova] Lock "b436dd23-122a-4da5-9fa7-1d658909b16e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:41:13 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-c12a10c3-6a5d-4c3f-bbdb-b209052c6b93 req-bae8fc94-2b3e-49ae-abf9-91b667cf4bdb service nova] Lock "b436dd23-122a-4da5-9fa7-1d658909b16e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:41:13 user nova-compute[72586]: DEBUG nova.compute.manager [req-c12a10c3-6a5d-4c3f-bbdb-b209052c6b93 req-bae8fc94-2b3e-49ae-abf9-91b667cf4bdb service nova] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] No waiting events found dispatching network-vif-plugged-a6a850af-8cd3-4b83-b79e-3259b6e8655c {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:41:13 user nova-compute[72586]: WARNING nova.compute.manager [req-c12a10c3-6a5d-4c3f-bbdb-b209052c6b93 req-bae8fc94-2b3e-49ae-abf9-91b667cf4bdb service nova] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] Received unexpected event network-vif-plugged-a6a850af-8cd3-4b83-b79e-3259b6e8655c for instance with vm_state deleted and task_state None.
Aug 01 21:41:13 user nova-compute[72586]: DEBUG nova.compute.manager [req-c12a10c3-6a5d-4c3f-bbdb-b209052c6b93 req-bae8fc94-2b3e-49ae-abf9-91b667cf4bdb service nova] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] Received event network-vif-deleted-a6a850af-8cd3-4b83-b79e-3259b6e8655c {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:41:14 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:41:16 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:41:21 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:41:21 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:41:21 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72586) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 21:41:21 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72586) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 21:41:21 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72586) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 21:41:21 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:41:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-6fded96d-3544-401e-a454-2e75554616da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Acquiring lock "aa164378-4fb3-46f3-9368-ddf76b39f18f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:41:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-6fded96d-3544-401e-a454-2e75554616da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "aa164378-4fb3-46f3-9368-ddf76b39f18f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:41:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-6fded96d-3544-401e-a454-2e75554616da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Acquiring lock "aa164378-4fb3-46f3-9368-ddf76b39f18f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:41:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-6fded96d-3544-401e-a454-2e75554616da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "aa164378-4fb3-46f3-9368-ddf76b39f18f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:41:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-6fded96d-3544-401e-a454-2e75554616da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "aa164378-4fb3-46f3-9368-ddf76b39f18f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:41:24 user nova-compute[72586]: INFO nova.compute.manager [None req-6fded96d-3544-401e-a454-2e75554616da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] Terminating instance
Aug 01 21:41:24 user nova-compute[72586]: DEBUG nova.compute.manager [None req-6fded96d-3544-401e-a454-2e75554616da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] Start destroying the instance on the hypervisor. {{(pid=72586) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 21:41:24 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:41:24 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:41:24 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:41:24 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:41:24 user nova-compute[72586]: DEBUG nova.compute.manager [req-2957a847-199d-42a6-8f07-11c135e00ea3 req-bdf65bfb-427b-4d0a-8098-83cb3a0d1a9c service nova] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] Received event network-vif-unplugged-4136b652-b3ca-4e1a-aaec-3f782a13cf2e {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:41:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-2957a847-199d-42a6-8f07-11c135e00ea3 req-bdf65bfb-427b-4d0a-8098-83cb3a0d1a9c service nova] Acquiring lock "aa164378-4fb3-46f3-9368-ddf76b39f18f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:41:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-2957a847-199d-42a6-8f07-11c135e00ea3 req-bdf65bfb-427b-4d0a-8098-83cb3a0d1a9c service nova] Lock "aa164378-4fb3-46f3-9368-ddf76b39f18f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:41:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-2957a847-199d-42a6-8f07-11c135e00ea3 req-bdf65bfb-427b-4d0a-8098-83cb3a0d1a9c service nova] Lock "aa164378-4fb3-46f3-9368-ddf76b39f18f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:41:24 user nova-compute[72586]: DEBUG nova.compute.manager [req-2957a847-199d-42a6-8f07-11c135e00ea3 req-bdf65bfb-427b-4d0a-8098-83cb3a0d1a9c service nova] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] No waiting events found dispatching network-vif-unplugged-4136b652-b3ca-4e1a-aaec-3f782a13cf2e {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:41:24 user nova-compute[72586]: DEBUG nova.compute.manager [req-2957a847-199d-42a6-8f07-11c135e00ea3 req-bdf65bfb-427b-4d0a-8098-83cb3a0d1a9c service nova] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] Received event network-vif-unplugged-4136b652-b3ca-4e1a-aaec-3f782a13cf2e for instance with task_state deleting. {{(pid=72586) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 21:41:25 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] Instance destroyed successfully.
Aug 01 21:41:25 user nova-compute[72586]: DEBUG nova.objects.instance [None req-6fded96d-3544-401e-a454-2e75554616da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lazy-loading 'resources' on Instance uuid aa164378-4fb3-46f3-9368-ddf76b39f18f {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:41:25 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-6fded96d-3544-401e-a454-2e75554616da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:39:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1113570529',display_name='tempest-TestVolumeBootPattern-server-1113570529',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1113570529',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:39:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a631250d39c34afca47a1fa2817e627e',ramdisk_id='',reservation_id='r-n945irog',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1160754716',owner_user_name='tempest-TestVolumeBootPattern-1160754716-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:39:55Z,user_data=None,user_id='76cd0d9d973b410ca4ff08fc7630fbc6',uuid=aa164378-4fb3-46f3-9368-ddf76b39f18f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4136b652-b3ca-4e1a-aaec-3f782a13cf2e", "address": "fa:16:3e:01:52:76", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4136b652-b3", "ovs_interfaceid": "4136b652-b3ca-4e1a-aaec-3f782a13cf2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:41:25 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-6fded96d-3544-401e-a454-2e75554616da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Converting VIF {"id": "4136b652-b3ca-4e1a-aaec-3f782a13cf2e", "address": "fa:16:3e:01:52:76", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4136b652-b3", "ovs_interfaceid": "4136b652-b3ca-4e1a-aaec-3f782a13cf2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:41:25 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-6fded96d-3544-401e-a454-2e75554616da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:52:76,bridge_name='br-int',has_traffic_filtering=True,id=4136b652-b3ca-4e1a-aaec-3f782a13cf2e,network=Network(2fbf5ffb-0ec0-403b-bc92-259563ab1d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4136b652-b3') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:41:25 user nova-compute[72586]: DEBUG os_vif [None req-6fded96d-3544-401e-a454-2e75554616da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:52:76,bridge_name='br-int',has_traffic_filtering=True,id=4136b652-b3ca-4e1a-aaec-3f782a13cf2e,network=Network(2fbf5ffb-0ec0-403b-bc92-259563ab1d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4136b652-b3') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:41:25 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:41:25 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4136b652-b3, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:41:25 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:41:25 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:41:25 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:41:25 user nova-compute[72586]: INFO os_vif [None req-6fded96d-3544-401e-a454-2e75554616da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:52:76,bridge_name='br-int',has_traffic_filtering=True,id=4136b652-b3ca-4e1a-aaec-3f782a13cf2e,network=Network(2fbf5ffb-0ec0-403b-bc92-259563ab1d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4136b652-b3')
Aug 01 21:41:25 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fded96d-3544-401e-a454-2e75554616da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] calling os-brick to detach iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 21:41:25 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fded96d-3544-401e-a454-2e75554616da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, {'target_iqns': ['iqn.2010-10.org.openstack:9808c58b-62a7-4877-98c3-cb8a860f02bf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zWoTFcIe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:41:25 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-6fded96d-3544-401e-a454-2e75554616da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:41:25 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-6fded96d-3544-401e-a454-2e75554616da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:41:25 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-6fded96d-3544-401e-a454-2e75554616da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:41:25 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fded96d-3544-401e-a454-2e75554616da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9808c58b-62a7-4877-98c3-cb8a860f02bf', 0)] {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 21:41:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:41:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:41:25 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9170a4-59f6-4e40-9755-30f1c245c95a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97608faa-e3cc-4920-bf16-f2ccd18f5fed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9808c58b-62a7-4877-98c3-cb8a860f02bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:41:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:41:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:41:25 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a45263-7636-490b-8add-1a3f0e639d0d]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9808c58b-62a7-4877-98c3-cb8a860f02bf (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97608faa-e3cc-4920-bf16-f2ccd18f5fed (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:41:25 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fded96d-3544-401e-a454-2e75554616da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:41:25 user nova-compute[72586]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec (non-flash)
Aug 01 21:41:25 user nova-compute[72586]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9808c58b-62a7-4877-98c3-cb8a860f02bf (non-flash)
Aug 01 21:41:25 user nova-compute[72586]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97608faa-e3cc-4920-bf16-f2ccd18f5fed (non-flash)
Aug 01 21:41:25 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:41:25 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fded96d-3544-401e-a454-2e75554616da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:41:25 user nova-compute[72586]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec (non-flash)
Aug 01 21:41:25 user nova-compute[72586]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9808c58b-62a7-4877-98c3-cb8a860f02bf (non-flash)
Aug 01 21:41:25 user nova-compute[72586]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97608faa-e3cc-4920-bf16-f2ccd18f5fed (non-flash)
Aug 01 21:41:25 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:41:25 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fded96d-3544-401e-a454-2e75554616da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ed03d5bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9808c58b-62a7-4877-98c3-cb8a860f02bf'): ({'sde'}, set())}) {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 21:41:25 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-6fded96d-3544-401e-a454-2e75554616da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Removing single pathed devices sde {{(pid=72586) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 21:41:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:41:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:41:25 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc8716d-c547-4dd4-b571-d51f7b9f92b9]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:41:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:41:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:41:25 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ddee830-0acf-4d0e-bc1b-789e949c04bf]: (4, ('ok\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:41:25 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-6fded96d-3544-401e-a454-2e75554616da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Flushing IO for device /dev/sde {{(pid=72586) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 21:41:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:41:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:41:25 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[df086409-8e83-4a8b-8ce9-6040dcd7959d]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:41:25 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-6fded96d-3544-401e-a454-2e75554616da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72586) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 21:41:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:41:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.057s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:41:25 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b34c71-db63-42c8-bedd-c3c882448ee3]: (4, ('1', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:41:25 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-6fded96d-3544-401e-a454-2e75554616da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 21:41:25 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-6fded96d-3544-401e-a454-2e75554616da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] SCSI volumes sde have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 21:41:25 user nova-compute[72586]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO15e474c8-83fad16d72dbf9ae', '/dev/disk/by-id/scsi-23833666164313664', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_15e474c8') {{(pid=83581) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 01 21:41:25 user nova-compute[72586]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO15e474c8-83fad16d72dbf9ae
Aug 01 21:41:25 user nova-compute[72586]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23833666164313664
Aug 01 21:41:25 user nova-compute[72586]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_15e474c8
Aug 01 21:41:25 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c2a746f-7c81-4256-b443-8e8b04eef9ca]: (4, None) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:41:25 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fded96d-3544-401e-a454-2e75554616da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9808c58b-62a7-4877-98c3-cb8a860f02bf')] {{(pid=72586) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 21:41:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9808c58b-62a7-4877-98c3-cb8a860f02bf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:41:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9808c58b-62a7-4877-98c3-cb8a860f02bf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:41:25 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bdde3e6-c479-47b5-b00e-b0118686858a]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:41:25 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fded96d-3544-401e-a454-2e75554616da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:41:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9808c58b-62a7-4877-98c3-cb8a860f02bf -p 172.16.0.220:3260 --logout {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:41:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9808c58b-62a7-4877-98c3-cb8a860f02bf -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:41:25 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c11660-84fd-40f4-a2e3-7e52442eb121]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:9808c58b-62a7-4877-98c3-cb8a860f02bf, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:9808c58b-62a7-4877-98c3-cb8a860f02bf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:41:25 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fded96d-3544-401e-a454-2e75554616da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:9808c58b-62a7-4877-98c3-cb8a860f02bf, portal: 172.16.0.220,3260]
Aug 01 21:41:25 user nova-compute[72586]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:9808c58b-62a7-4877-98c3-cb8a860f02bf, portal: 172.16.0.220,3260] successful.
Aug 01 21:41:25 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:41:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9808c58b-62a7-4877-98c3-cb8a860f02bf -p 172.16.0.220:3260 --op delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:41:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9808c58b-62a7-4877-98c3-cb8a860f02bf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:41:25 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[029b15ae-1808-4ced-826e-23d47243170b]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:41:25 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fded96d-3544-401e-a454-2e75554616da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:41:25 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-6fded96d-3544-401e-a454-2e75554616da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:41:25 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fded96d-3544-401e-a454-2e75554616da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] <== disconnect_volume: return (331ms) None {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:41:25 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fded96d-3544-401e-a454-2e75554616da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] Disconnected iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 21:41:25 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-6fded96d-3544-401e-a454-2e75554616da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] Deleting instance files /opt/stack/data/nova/instances/aa164378-4fb3-46f3-9368-ddf76b39f18f_del
Aug 01 21:41:25 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-6fded96d-3544-401e-a454-2e75554616da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] Deletion of /opt/stack/data/nova/instances/aa164378-4fb3-46f3-9368-ddf76b39f18f_del complete
Aug 01 21:41:25 user nova-compute[72586]: INFO nova.compute.manager [None req-6fded96d-3544-401e-a454-2e75554616da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] Took 1.20 seconds to destroy the instance on the hypervisor.
Aug 01 21:41:25 user nova-compute[72586]: DEBUG oslo.service.loopingcall [None req-6fded96d-3544-401e-a454-2e75554616da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72586) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 21:41:25 user nova-compute[72586]: DEBUG nova.compute.manager [-] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] Deallocating network for instance {{(pid=72586) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 21:41:25 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] deallocate_for_instance() {{(pid=72586) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 21:41:26 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:41:26 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] Took 0.81 seconds to deallocate network for instance.
Aug 01 21:41:26 user nova-compute[72586]: DEBUG nova.compute.manager [req-4b83ad5f-b9de-41f3-b952-f30ead2dcf46 req-b1526fa4-920b-49ea-927c-615ab7b4c293 service nova] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] Received event network-vif-deleted-4136b652-b3ca-4e1a-aaec-3f782a13cf2e {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:41:26 user nova-compute[72586]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690926071.675197, b436dd23-122a-4da5-9fa7-1d658909b16e => Stopped> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:41:26 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] VM Stopped (Lifecycle Event)
Aug 01 21:41:26 user nova-compute[72586]: DEBUG nova.compute.manager [req-6242aedb-a798-44d1-9e50-bc8541390403 req-3a203d66-49b8-4f3d-8d19-d2851ccf86d7 service nova] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] Received event network-vif-plugged-4136b652-b3ca-4e1a-aaec-3f782a13cf2e {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:41:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-6242aedb-a798-44d1-9e50-bc8541390403 req-3a203d66-49b8-4f3d-8d19-d2851ccf86d7 service nova] Acquiring lock "aa164378-4fb3-46f3-9368-ddf76b39f18f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:41:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-6242aedb-a798-44d1-9e50-bc8541390403 req-3a203d66-49b8-4f3d-8d19-d2851ccf86d7 service nova] Lock "aa164378-4fb3-46f3-9368-ddf76b39f18f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:41:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-6242aedb-a798-44d1-9e50-bc8541390403 req-3a203d66-49b8-4f3d-8d19-d2851ccf86d7 service nova] Lock "aa164378-4fb3-46f3-9368-ddf76b39f18f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:41:26 user nova-compute[72586]: DEBUG nova.compute.manager [req-6242aedb-a798-44d1-9e50-bc8541390403 req-3a203d66-49b8-4f3d-8d19-d2851ccf86d7 service nova] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] No waiting events found dispatching network-vif-plugged-4136b652-b3ca-4e1a-aaec-3f782a13cf2e {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:41:26 user nova-compute[72586]: WARNING nova.compute.manager [req-6242aedb-a798-44d1-9e50-bc8541390403 req-3a203d66-49b8-4f3d-8d19-d2851ccf86d7 service nova] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] Received unexpected event network-vif-plugged-4136b652-b3ca-4e1a-aaec-3f782a13cf2e for instance with vm_state active and task_state deleting.
Aug 01 21:41:26 user nova-compute[72586]: DEBUG nova.compute.manager [None req-2b13d00b-7bc1-4764-9aaa-9803a830a607 None None] [instance: b436dd23-122a-4da5-9fa7-1d658909b16e] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:41:27 user nova-compute[72586]: INFO nova.compute.manager [None req-6fded96d-3544-401e-a454-2e75554616da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] Took 0.80 seconds to detach 1 volumes for instance.
Aug 01 21:41:27 user nova-compute[72586]: DEBUG nova.compute.manager [None req-6fded96d-3544-401e-a454-2e75554616da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] Deleting volume: 9808c58b-62a7-4877-98c3-cb8a860f02bf {{(pid=72586) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 01 21:41:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-6fded96d-3544-401e-a454-2e75554616da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:41:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-6fded96d-3544-401e-a454-2e75554616da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:41:27 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-6fded96d-3544-401e-a454-2e75554616da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:41:27 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-6fded96d-3544-401e-a454-2e75554616da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:41:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-6fded96d-3544-401e-a454-2e75554616da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.298s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:41:27 user nova-compute[72586]: INFO nova.scheduler.client.report [None req-6fded96d-3544-401e-a454-2e75554616da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Deleted allocations for instance aa164378-4fb3-46f3-9368-ddf76b39f18f
Aug 01 21:41:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-6fded96d-3544-401e-a454-2e75554616da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "aa164378-4fb3-46f3-9368-ddf76b39f18f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.354s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:41:30 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:41:33 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:41:33 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:41:33 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:41:35 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:41:35 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:41:35 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72586) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 21:41:36 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:41:37 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:41:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:41:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:41:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:41:37 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Auditing locally available compute resources for user (node: user) {{(pid=72586) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 21:41:38 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:41:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/178d26d5-3570-442f-9268-21cd73cccfc7/disk.rescue --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:41:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/178d26d5-3570-442f-9268-21cd73cccfc7/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:41:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/178d26d5-3570-442f-9268-21cd73cccfc7/disk.rescue --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:41:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/178d26d5-3570-442f-9268-21cd73cccfc7/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:41:38 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:41:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ab466b-8caa-4a38-8350-213aa17ee75e/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:41:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ab466b-8caa-4a38-8350-213aa17ee75e/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:41:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ab466b-8caa-4a38-8350-213aa17ee75e/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:41:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ab466b-8caa-4a38-8350-213aa17ee75e/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:41:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:41:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:41:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:41:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:41:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee464b0-f75e-4f30-9838-74bca9619a07/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:41:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee464b0-f75e-4f30-9838-74bca9619a07/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:41:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee464b0-f75e-4f30-9838-74bca9619a07/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:41:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee464b0-f75e-4f30-9838-74bca9619a07/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:41:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63625685-227f-48cc-9cc0-594633e0b8bb/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:41:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63625685-227f-48cc-9cc0-594633e0b8bb/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:41:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63625685-227f-48cc-9cc0-594633e0b8bb/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:41:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63625685-227f-48cc-9cc0-594633e0b8bb/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:41:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/965244cc-71e5-43f9-8d22-62843bac3f52/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:41:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/965244cc-71e5-43f9-8d22-62843bac3f52/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:41:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/965244cc-71e5-43f9-8d22-62843bac3f52/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:41:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/965244cc-71e5-43f9-8d22-62843bac3f52/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:41:39 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:41:40 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:41:40 user nova-compute[72586]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690926085.1308954, aa164378-4fb3-46f3-9368-ddf76b39f18f => Stopped> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:41:40 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] VM Stopped (Lifecycle Event)
Aug 01 21:41:40 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:41:40 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:41:40 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Hypervisor/Node resource view: name=user free_ram=8119MB free_disk=25.016464233398438GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72586) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 21:41:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:41:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:41:40 user nova-compute[72586]: DEBUG nova.compute.manager [None req-21a7a242-2e8f-44b1-b87f-eb20371a992d None None] [instance: aa164378-4fb3-46f3-9368-ddf76b39f18f] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:41:40 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance af2de810-b22f-4fa9-835c-c673abd145db actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:41:40 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 161fab9d-a7d1-4ea0-b4b9-2afc54040eef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:41:40 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 11ab466b-8caa-4a38-8350-213aa17ee75e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:41:40 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 63625685-227f-48cc-9cc0-594633e0b8bb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:41:40 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 8ee464b0-f75e-4f30-9838-74bca9619a07 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:41:40 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 965244cc-71e5-43f9-8d22-62843bac3f52 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:41:40 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 178d26d5-3570-442f-9268-21cd73cccfc7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:41:40 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 21:41:40 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 21:41:40 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:41:40 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:41:40 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Compute_service record updated for user:user {{(pid=72586) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 21:41:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.363s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:41:43 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:41:43 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Starting heal instance info cache {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 21:41:43 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "refresh_cache-161fab9d-a7d1-4ea0-b4b9-2afc54040eef" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:41:43 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquired lock "refresh_cache-161fab9d-a7d1-4ea0-b4b9-2afc54040eef" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:41:43 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Forcefully refreshing network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 21:41:44 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Updating instance_info_cache with network_info: [{"id": "c082b11d-fb01-4def-98b8-6b2966ce364c", "address": "fa:16:3e:b6:24:7c", "network": {"id": "86940e5d-852b-48fc-9b0e-858305321349", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1967467603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d847d04360420c80ea5608d5a2b15a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc082b11d-fb", "ovs_interfaceid": "c082b11d-fb01-4def-98b8-6b2966ce364c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:41:44 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Releasing lock "refresh_cache-161fab9d-a7d1-4ea0-b4b9-2afc54040eef" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:41:44 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Updated the network info_cache for instance {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 21:41:44 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:41:44 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:41:45 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:41:45 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:41:50 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:41:55 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:41:59 user nova-compute[72586]: DEBUG nova.compute.manager [req-bfdeaa00-fdf0-44da-864f-2d9e2dfe6efa req-03e67782-e9e3-4425-a768-74700a625352 service nova] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Received event network-changed-bf319273-ff82-45b9-8365-061755ed7b35 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:41:59 user nova-compute[72586]: DEBUG nova.compute.manager [req-bfdeaa00-fdf0-44da-864f-2d9e2dfe6efa req-03e67782-e9e3-4425-a768-74700a625352 service nova] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Refreshing instance network info cache due to event network-changed-bf319273-ff82-45b9-8365-061755ed7b35. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:41:59 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-bfdeaa00-fdf0-44da-864f-2d9e2dfe6efa req-03e67782-e9e3-4425-a768-74700a625352 service nova] Acquiring lock "refresh_cache-965244cc-71e5-43f9-8d22-62843bac3f52" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:41:59 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-bfdeaa00-fdf0-44da-864f-2d9e2dfe6efa req-03e67782-e9e3-4425-a768-74700a625352 service nova] Acquired lock "refresh_cache-965244cc-71e5-43f9-8d22-62843bac3f52" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:41:59 user nova-compute[72586]: DEBUG nova.network.neutron [req-bfdeaa00-fdf0-44da-864f-2d9e2dfe6efa req-03e67782-e9e3-4425-a768-74700a625352 service nova] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Refreshing network info cache for port bf319273-ff82-45b9-8365-061755ed7b35 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:41:59 user nova-compute[72586]: DEBUG nova.network.neutron [req-bfdeaa00-fdf0-44da-864f-2d9e2dfe6efa req-03e67782-e9e3-4425-a768-74700a625352 service nova] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Updated VIF entry in instance network info cache for port bf319273-ff82-45b9-8365-061755ed7b35. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:41:59 user nova-compute[72586]: DEBUG nova.network.neutron [req-bfdeaa00-fdf0-44da-864f-2d9e2dfe6efa req-03e67782-e9e3-4425-a768-74700a625352 service nova] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Updating instance_info_cache with network_info: [{"id": "bf319273-ff82-45b9-8365-061755ed7b35", "address": "fa:16:3e:02:f6:65", "network": {"id": "56c3419f-2c2c-4dda-88d7-ba96e2a689fd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-705071098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ae5f1c56b348de8a03f1a4bcdd9b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf319273-ff", "ovs_interfaceid": "bf319273-ff82-45b9-8365-061755ed7b35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:41:59 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-bfdeaa00-fdf0-44da-864f-2d9e2dfe6efa req-03e67782-e9e3-4425-a768-74700a625352 service nova] Releasing lock "refresh_cache-965244cc-71e5-43f9-8d22-62843bac3f52" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:41:59 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:00 user nova-compute[72586]: DEBUG nova.compute.manager [req-d1f52cfe-141e-4376-a5b7-050aa4daa12c req-d75d62b8-1e01-4376-9192-36b25e3790dd service nova] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Received event network-changed-bf319273-ff82-45b9-8365-061755ed7b35 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:42:00 user nova-compute[72586]: DEBUG nova.compute.manager [req-d1f52cfe-141e-4376-a5b7-050aa4daa12c req-d75d62b8-1e01-4376-9192-36b25e3790dd service nova] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Refreshing instance network info cache due to event network-changed-bf319273-ff82-45b9-8365-061755ed7b35. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:42:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d1f52cfe-141e-4376-a5b7-050aa4daa12c req-d75d62b8-1e01-4376-9192-36b25e3790dd service nova] Acquiring lock "refresh_cache-965244cc-71e5-43f9-8d22-62843bac3f52" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:42:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d1f52cfe-141e-4376-a5b7-050aa4daa12c req-d75d62b8-1e01-4376-9192-36b25e3790dd service nova] Acquired lock "refresh_cache-965244cc-71e5-43f9-8d22-62843bac3f52" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:42:00 user nova-compute[72586]: DEBUG nova.network.neutron [req-d1f52cfe-141e-4376-a5b7-050aa4daa12c req-d75d62b8-1e01-4376-9192-36b25e3790dd service nova] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Refreshing network info cache for port bf319273-ff82-45b9-8365-061755ed7b35 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:42:00 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-dc21e169-add2-49d4-961a-868cd8841af6 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Acquiring lock "965244cc-71e5-43f9-8d22-62843bac3f52" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:42:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-dc21e169-add2-49d4-961a-868cd8841af6 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "965244cc-71e5-43f9-8d22-62843bac3f52" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:42:00 user nova-compute[72586]: INFO nova.compute.manager [None req-dc21e169-add2-49d4-961a-868cd8841af6 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Detaching volume 97608faa-e3cc-4920-bf16-f2ccd18f5fed
Aug 01 21:42:00 user nova-compute[72586]: INFO nova.virt.block_device [None req-dc21e169-add2-49d4-961a-868cd8841af6 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Attempting to driver detach volume 97608faa-e3cc-4920-bf16-f2ccd18f5fed from mountpoint /dev/vdb
Aug 01 21:42:00 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-dc21e169-add2-49d4-961a-868cd8841af6 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Attempting to detach device vdb from instance 965244cc-71e5-43f9-8d22-62843bac3f52 from the persistent domain config. {{(pid=72586) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 21:42:00 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-dc21e169-add2-49d4-961a-868cd8841af6 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 21:42:00 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:42:00 user nova-compute[72586]:   <source dev="/dev/sdf"/>
Aug 01 21:42:00 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:42:00 user nova-compute[72586]:   <serial>97608faa-e3cc-4920-bf16-f2ccd18f5fed</serial>
Aug 01 21:42:00 user nova-compute[72586]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 21:42:00 user nova-compute[72586]: </disk>
Aug 01 21:42:00 user nova-compute[72586]:  {{(pid=72586) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 21:42:00 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-dc21e169-add2-49d4-961a-868cd8841af6 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Successfully detached device vdb from instance 965244cc-71e5-43f9-8d22-62843bac3f52 from the persistent domain config.
Aug 01 21:42:00 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-dc21e169-add2-49d4-961a-868cd8841af6 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 965244cc-71e5-43f9-8d22-62843bac3f52 from the live domain config. {{(pid=72586) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 21:42:00 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-dc21e169-add2-49d4-961a-868cd8841af6 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 21:42:00 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:42:00 user nova-compute[72586]:   <source dev="/dev/sdf"/>
Aug 01 21:42:00 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:42:00 user nova-compute[72586]:   <serial>97608faa-e3cc-4920-bf16-f2ccd18f5fed</serial>
Aug 01 21:42:00 user nova-compute[72586]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 21:42:00 user nova-compute[72586]: </disk>
Aug 01 21:42:00 user nova-compute[72586]:  {{(pid=72586) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 21:42:00 user nova-compute[72586]: DEBUG nova.network.neutron [req-d1f52cfe-141e-4376-a5b7-050aa4daa12c req-d75d62b8-1e01-4376-9192-36b25e3790dd service nova] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Updated VIF entry in instance network info cache for port bf319273-ff82-45b9-8365-061755ed7b35. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:42:00 user nova-compute[72586]: DEBUG nova.network.neutron [req-d1f52cfe-141e-4376-a5b7-050aa4daa12c req-d75d62b8-1e01-4376-9192-36b25e3790dd service nova] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Updating instance_info_cache with network_info: [{"id": "bf319273-ff82-45b9-8365-061755ed7b35", "address": "fa:16:3e:02:f6:65", "network": {"id": "56c3419f-2c2c-4dda-88d7-ba96e2a689fd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-705071098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ae5f1c56b348de8a03f1a4bcdd9b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf319273-ff", "ovs_interfaceid": "bf319273-ff82-45b9-8365-061755ed7b35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:42:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d1f52cfe-141e-4376-a5b7-050aa4daa12c req-d75d62b8-1e01-4376-9192-36b25e3790dd service nova] Releasing lock "refresh_cache-965244cc-71e5-43f9-8d22-62843bac3f52" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:42:00 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Received event <DeviceRemovedEvent: 1690926120.8987682, 965244cc-71e5-43f9-8d22-62843bac3f52 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72586) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 21:42:00 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-dc21e169-add2-49d4-961a-868cd8841af6 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 965244cc-71e5-43f9-8d22-62843bac3f52 {{(pid=72586) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 21:42:00 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-dc21e169-add2-49d4-961a-868cd8841af6 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Successfully detached device vdb from instance 965244cc-71e5-43f9-8d22-62843bac3f52 from the live domain config.
Aug 01 21:42:00 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc21e169-add2-49d4-961a-868cd8841af6 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] calling os-brick to detach iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 21:42:00 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc21e169-add2-49d4-961a-868cd8841af6 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, {'target_iqns': ['iqn.2010-10.org.openstack:97608faa-e3cc-4920-bf16-f2ccd18f5fed'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LCZpmuwI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:42:00 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-dc21e169-add2-49d4-961a-868cd8841af6 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:42:00 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-dc21e169-add2-49d4-961a-868cd8841af6 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:42:00 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-dc21e169-add2-49d4-961a-868cd8841af6 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:42:00 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc21e169-add2-49d4-961a-868cd8841af6 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97608faa-e3cc-4920-bf16-f2ccd18f5fed', 0)] {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 21:42:00 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:42:00 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:42:00 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fdc3c85-e8b0-4cb8-8a4f-f16ecafd1f19]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97608faa-e3cc-4920-bf16-f2ccd18f5fed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:42:00 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:42:00 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:42:00 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[36481838-d4da-41cf-9eba-715e8f879529]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97608faa-e3cc-4920-bf16-f2ccd18f5fed (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:42:00 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc21e169-add2-49d4-961a-868cd8841af6 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:42:00 user nova-compute[72586]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec (non-flash)
Aug 01 21:42:00 user nova-compute[72586]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97608faa-e3cc-4920-bf16-f2ccd18f5fed (non-flash)
Aug 01 21:42:00 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:42:00 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc21e169-add2-49d4-961a-868cd8841af6 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:42:00 user nova-compute[72586]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec (non-flash)
Aug 01 21:42:00 user nova-compute[72586]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97608faa-e3cc-4920-bf16-f2ccd18f5fed (non-flash)
Aug 01 21:42:00 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:42:00 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc21e169-add2-49d4-961a-868cd8841af6 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ed0785510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97608faa-e3cc-4920-bf16-f2ccd18f5fed'): ({'sdf'}, set())}) {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 21:42:00 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-dc21e169-add2-49d4-961a-868cd8841af6 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Removing single pathed devices sdf {{(pid=72586) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 21:42:00 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:42:00 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:42:00 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[07440f02-1908-4aa5-8984-ac12ed638b0c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:42:00 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:42:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:42:01 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab17e4a9-1a57-4db7-9f31-b6ab39118c7b]: (4, ('ok\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:42:01 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-dc21e169-add2-49d4-961a-868cd8841af6 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Flushing IO for device /dev/sdf {{(pid=72586) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 21:42:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:42:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:42:01 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aadc6fa-ac59-4002-8cd3-3eba9d06489b]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:42:01 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-dc21e169-add2-49d4-961a-868cd8841af6 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72586) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 21:42:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:42:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:42:01 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d78ab0-b247-49c5-b5ce-bbee970078f4]: (4, ('1', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:42:01 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-dc21e169-add2-49d4-961a-868cd8841af6 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 21:42:01 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-dc21e169-add2-49d4-961a-868cd8841af6 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] SCSI volumes sdf have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 21:42:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc21e169-add2-49d4-961a-868cd8841af6 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97608faa-e3cc-4920-bf16-f2ccd18f5fed')] {{(pid=72586) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 21:42:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97608faa-e3cc-4920-bf16-f2ccd18f5fed -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:42:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97608faa-e3cc-4920-bf16-f2ccd18f5fed -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:42:01 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0b1f9f-11aa-4285-9a62-a92680a89463]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:42:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc21e169-add2-49d4-961a-868cd8841af6 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:42:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97608faa-e3cc-4920-bf16-f2ccd18f5fed -p 172.16.0.220:3260 --logout {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:42:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97608faa-e3cc-4920-bf16-f2ccd18f5fed -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:42:01 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f49a82-875b-4bc2-87e6-e0232b983a42]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:97608faa-e3cc-4920-bf16-f2ccd18f5fed, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:97608faa-e3cc-4920-bf16-f2ccd18f5fed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:42:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc21e169-add2-49d4-961a-868cd8841af6 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:97608faa-e3cc-4920-bf16-f2ccd18f5fed, portal: 172.16.0.220,3260]
Aug 01 21:42:01 user nova-compute[72586]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:97608faa-e3cc-4920-bf16-f2ccd18f5fed, portal: 172.16.0.220,3260] successful.
Aug 01 21:42:01 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:42:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97608faa-e3cc-4920-bf16-f2ccd18f5fed -p 172.16.0.220:3260 --op delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:42:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97608faa-e3cc-4920-bf16-f2ccd18f5fed -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:42:01 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[501974d8-4994-4d8a-81b6-7e6c6121d813]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:42:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc21e169-add2-49d4-961a-868cd8841af6 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:42:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-dc21e169-add2-49d4-961a-868cd8841af6 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:42:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc21e169-add2-49d4-961a-868cd8841af6 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] <== disconnect_volume: return (293ms) None {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:42:01 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc21e169-add2-49d4-961a-868cd8841af6 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Disconnected iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 21:42:02 user nova-compute[72586]: DEBUG nova.objects.instance [None req-dc21e169-add2-49d4-961a-868cd8841af6 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lazy-loading 'flavor' on Instance uuid 965244cc-71e5-43f9-8d22-62843bac3f52 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:42:02 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-dc21e169-add2-49d4-961a-868cd8841af6 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "965244cc-71e5-43f9-8d22-62843bac3f52" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.790s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:42:05 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:10 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:10 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:10 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:14 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:15 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:16 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:17 user nova-compute[72586]: DEBUG nova.objects.instance [None req-a2816084-3b0a-44c1-aee7-12f42c644f40 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lazy-loading 'flavor' on Instance uuid 11ab466b-8caa-4a38-8350-213aa17ee75e {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:42:17 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a2816084-3b0a-44c1-aee7-12f42c644f40 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Acquiring lock "refresh_cache-11ab466b-8caa-4a38-8350-213aa17ee75e" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:42:17 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a2816084-3b0a-44c1-aee7-12f42c644f40 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Acquired lock "refresh_cache-11ab466b-8caa-4a38-8350-213aa17ee75e" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:42:17 user nova-compute[72586]: DEBUG nova.network.neutron [None req-a2816084-3b0a-44c1-aee7-12f42c644f40 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:42:17 user nova-compute[72586]: DEBUG nova.objects.instance [None req-a2816084-3b0a-44c1-aee7-12f42c644f40 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lazy-loading 'info_cache' on Instance uuid 11ab466b-8caa-4a38-8350-213aa17ee75e {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:42:18 user nova-compute[72586]: DEBUG nova.network.neutron [None req-a2816084-3b0a-44c1-aee7-12f42c644f40 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Updating instance_info_cache with network_info: [{"id": "d70607b2-8e0c-4166-8218-ecbc976d0369", "address": "fa:16:3e:76:af:74", "network": {"id": "63b6e8c7-fad0-44bf-a479-9baab6f0d1e3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2101151631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cbab7dfc55429c9b991bf1091a84c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd70607b2-8e", "ovs_interfaceid": "d70607b2-8e0c-4166-8218-ecbc976d0369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:42:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a2816084-3b0a-44c1-aee7-12f42c644f40 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Releasing lock "refresh_cache-11ab466b-8caa-4a38-8350-213aa17ee75e" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:42:18 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Instance destroyed successfully.
Aug 01 21:42:18 user nova-compute[72586]: DEBUG nova.objects.instance [None req-a2816084-3b0a-44c1-aee7-12f42c644f40 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lazy-loading 'resources' on Instance uuid 11ab466b-8caa-4a38-8350-213aa17ee75e {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:42:18 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-a2816084-3b0a-44c1-aee7-12f42c644f40 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:34:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2094185911',display_name='tempest-AttachVolumeTestJSON-server-2094185911',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2094185911',id=31,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8bY2a+j0kMVaPrfl1MtLxUCVEzM0sy04URPhEHt1a9A1Fyz7ckW9BOF4xfEN78B/F9+N05Diy+kKgMUVPp6Ls9nXPam6BDkRvokPK0ly7jy5lxY/agzzRa/NAHpQoc4w==',key_name='tempest-keypair-809503431',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:34:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='99cbab7dfc55429c9b991bf1091a84c7',ramdisk_id='',reservation_id='r-mw52zjwf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1420576365',owner_user_name='tempest-AttachVolumeTestJSON-1420576365-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:40:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='50893dc844b44f498e1545aeee794742',uuid=11ab466b-8caa-4a38-8350-213aa17ee75e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d70607b2-8e0c-4166-8218-ecbc976d0369", "address": "fa:16:3e:76:af:74", "network": {"id": "63b6e8c7-fad0-44bf-a479-9baab6f0d1e3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2101151631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cbab7dfc55429c9b991bf1091a84c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd70607b2-8e", "ovs_interfaceid": "d70607b2-8e0c-4166-8218-ecbc976d0369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:42:18 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-a2816084-3b0a-44c1-aee7-12f42c644f40 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Converting VIF {"id": "d70607b2-8e0c-4166-8218-ecbc976d0369", "address": "fa:16:3e:76:af:74", "network": {"id": "63b6e8c7-fad0-44bf-a479-9baab6f0d1e3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2101151631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cbab7dfc55429c9b991bf1091a84c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd70607b2-8e", "ovs_interfaceid": "d70607b2-8e0c-4166-8218-ecbc976d0369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:42:18 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-a2816084-3b0a-44c1-aee7-12f42c644f40 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:af:74,bridge_name='br-int',has_traffic_filtering=True,id=d70607b2-8e0c-4166-8218-ecbc976d0369,network=Network(63b6e8c7-fad0-44bf-a479-9baab6f0d1e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd70607b2-8e') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:42:18 user nova-compute[72586]: DEBUG os_vif [None req-a2816084-3b0a-44c1-aee7-12f42c644f40 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:af:74,bridge_name='br-int',has_traffic_filtering=True,id=d70607b2-8e0c-4166-8218-ecbc976d0369,network=Network(63b6e8c7-fad0-44bf-a479-9baab6f0d1e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd70607b2-8e') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:42:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd70607b2-8e, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:42:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:42:18 user nova-compute[72586]: INFO os_vif [None req-a2816084-3b0a-44c1-aee7-12f42c644f40 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:af:74,bridge_name='br-int',has_traffic_filtering=True,id=d70607b2-8e0c-4166-8218-ecbc976d0369,network=Network(63b6e8c7-fad0-44bf-a479-9baab6f0d1e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd70607b2-8e')
Aug 01 21:42:18 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-a2816084-3b0a-44c1-aee7-12f42c644f40 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Start _get_guest_xml network_info=[{"id": "d70607b2-8e0c-4166-8218-ecbc976d0369", "address": "fa:16:3e:76:af:74", "network": {"id": "63b6e8c7-fad0-44bf-a479-9baab6f0d1e3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2101151631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cbab7dfc55429c9b991bf1091a84c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd70607b2-8e", "ovs_interfaceid": "d70607b2-8e0c-4166-8218-ecbc976d0369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '0243d46b-6819-42a5-926f-42b71f0c97ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:42:18 user nova-compute[72586]: DEBUG nova.objects.instance [None req-a2816084-3b0a-44c1-aee7-12f42c644f40 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lazy-loading 'numa_topology' on Instance uuid 11ab466b-8caa-4a38-8350-213aa17ee75e {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:42:18 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-a2816084-3b0a-44c1-aee7-12f42c644f40 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:42:18 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-a2816084-3b0a-44c1-aee7-12f42c644f40 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:42:18 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-a2816084-3b0a-44c1-aee7-12f42c644f40 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:42:18 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-a2816084-3b0a-44c1-aee7-12f42c644f40 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:42:18 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-a2816084-3b0a-44c1-aee7-12f42c644f40 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:42:18 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-a2816084-3b0a-44c1-aee7-12f42c644f40 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:42:18 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-a2816084-3b0a-44c1-aee7-12f42c644f40 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:42:18 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-a2816084-3b0a-44c1-aee7-12f42c644f40 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:42:18 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-a2816084-3b0a-44c1-aee7-12f42c644f40 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:42:18 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-a2816084-3b0a-44c1-aee7-12f42c644f40 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:42:18 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-a2816084-3b0a-44c1-aee7-12f42c644f40 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:42:18 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-a2816084-3b0a-44c1-aee7-12f42c644f40 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:42:18 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-a2816084-3b0a-44c1-aee7-12f42c644f40 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:42:18 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-a2816084-3b0a-44c1-aee7-12f42c644f40 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:42:18 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-a2816084-3b0a-44c1-aee7-12f42c644f40 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:42:18 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-a2816084-3b0a-44c1-aee7-12f42c644f40 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:42:18 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-a2816084-3b0a-44c1-aee7-12f42c644f40 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:42:18 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-a2816084-3b0a-44c1-aee7-12f42c644f40 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:42:18 user nova-compute[72586]: DEBUG nova.objects.instance [None req-a2816084-3b0a-44c1-aee7-12f42c644f40 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lazy-loading 'vcpu_model' on Instance uuid 11ab466b-8caa-4a38-8350-213aa17ee75e {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:42:18 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-a2816084-3b0a-44c1-aee7-12f42c644f40 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:34:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2094185911',display_name='tempest-AttachVolumeTestJSON-server-2094185911',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2094185911',id=31,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8bY2a+j0kMVaPrfl1MtLxUCVEzM0sy04URPhEHt1a9A1Fyz7ckW9BOF4xfEN78B/F9+N05Diy+kKgMUVPp6Ls9nXPam6BDkRvokPK0ly7jy5lxY/agzzRa/NAHpQoc4w==',key_name='tempest-keypair-809503431',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:34:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='99cbab7dfc55429c9b991bf1091a84c7',ramdisk_id='',reservation_id='r-mw52zjwf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1420576365',owner_user_name='tempest-AttachVolumeTestJSON-1420576365-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:40:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='50893dc844b44f498e1545aeee794742',uuid=11ab466b-8caa-4a38-8350-213aa17ee75e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d70607b2-8e0c-4166-8218-ecbc976d0369", "address": "fa:16:3e:76:af:74", "network": {"id": "63b6e8c7-fad0-44bf-a479-9baab6f0d1e3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2101151631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cbab7dfc55429c9b991bf1091a84c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd70607b2-8e", "ovs_interfaceid": "d70607b2-8e0c-4166-8218-ecbc976d0369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:42:18 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-a2816084-3b0a-44c1-aee7-12f42c644f40 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Converting VIF {"id": "d70607b2-8e0c-4166-8218-ecbc976d0369", "address": "fa:16:3e:76:af:74", "network": {"id": "63b6e8c7-fad0-44bf-a479-9baab6f0d1e3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2101151631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cbab7dfc55429c9b991bf1091a84c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd70607b2-8e", "ovs_interfaceid": "d70607b2-8e0c-4166-8218-ecbc976d0369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:42:18 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-a2816084-3b0a-44c1-aee7-12f42c644f40 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:af:74,bridge_name='br-int',has_traffic_filtering=True,id=d70607b2-8e0c-4166-8218-ecbc976d0369,network=Network(63b6e8c7-fad0-44bf-a479-9baab6f0d1e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd70607b2-8e') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:42:18 user nova-compute[72586]: DEBUG nova.objects.instance [None req-a2816084-3b0a-44c1-aee7-12f42c644f40 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lazy-loading 'pci_devices' on Instance uuid 11ab466b-8caa-4a38-8350-213aa17ee75e {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:42:18 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-a2816084-3b0a-44c1-aee7-12f42c644f40 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:42:18 user nova-compute[72586]:   <uuid>11ab466b-8caa-4a38-8350-213aa17ee75e</uuid>
Aug 01 21:42:18 user nova-compute[72586]:   <name>instance-0000001f</name>
Aug 01 21:42:18 user nova-compute[72586]:   <memory>524288</memory>
Aug 01 21:42:18 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:42:18 user nova-compute[72586]:   <metadata>
Aug 01 21:42:18 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:42:18 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:42:18 user nova-compute[72586]:       <nova:name>tempest-AttachVolumeTestJSON-server-2094185911</nova:name>
Aug 01 21:42:18 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:42:18</nova:creationTime>
Aug 01 21:42:18 user nova-compute[72586]:       <nova:flavor name="m1.tiny">
Aug 01 21:42:18 user nova-compute[72586]:         <nova:memory>512</nova:memory>
Aug 01 21:42:18 user nova-compute[72586]:         <nova:disk>1</nova:disk>
Aug 01 21:42:18 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:42:18 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:42:18 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:42:18 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:42:18 user nova-compute[72586]:       <nova:owner>
Aug 01 21:42:18 user nova-compute[72586]:         <nova:user uuid="50893dc844b44f498e1545aeee794742">tempest-AttachVolumeTestJSON-1420576365-project-member</nova:user>
Aug 01 21:42:18 user nova-compute[72586]:         <nova:project uuid="99cbab7dfc55429c9b991bf1091a84c7">tempest-AttachVolumeTestJSON-1420576365</nova:project>
Aug 01 21:42:18 user nova-compute[72586]:       </nova:owner>
Aug 01 21:42:18 user nova-compute[72586]:       <nova:root type="image" uuid="0243d46b-6819-42a5-926f-42b71f0c97ad"/>
Aug 01 21:42:18 user nova-compute[72586]:       <nova:ports>
Aug 01 21:42:18 user nova-compute[72586]:         <nova:port uuid="d70607b2-8e0c-4166-8218-ecbc976d0369">
Aug 01 21:42:18 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 01 21:42:18 user nova-compute[72586]:         </nova:port>
Aug 01 21:42:18 user nova-compute[72586]:       </nova:ports>
Aug 01 21:42:18 user nova-compute[72586]:     </nova:instance>
Aug 01 21:42:18 user nova-compute[72586]:   </metadata>
Aug 01 21:42:18 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:42:18 user nova-compute[72586]:     <system>
Aug 01 21:42:18 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:42:18 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:42:18 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:42:18 user nova-compute[72586]:       <entry name="serial">11ab466b-8caa-4a38-8350-213aa17ee75e</entry>
Aug 01 21:42:18 user nova-compute[72586]:       <entry name="uuid">11ab466b-8caa-4a38-8350-213aa17ee75e</entry>
Aug 01 21:42:18 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:42:18 user nova-compute[72586]:     </system>
Aug 01 21:42:18 user nova-compute[72586]:   </sysinfo>
Aug 01 21:42:18 user nova-compute[72586]:   <os>
Aug 01 21:42:18 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:42:18 user nova-compute[72586]:     <boot dev="hd"/>
Aug 01 21:42:18 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:42:18 user nova-compute[72586]:   </os>
Aug 01 21:42:18 user nova-compute[72586]:   <features>
Aug 01 21:42:18 user nova-compute[72586]:     <acpi/>
Aug 01 21:42:18 user nova-compute[72586]:     <apic/>
Aug 01 21:42:18 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:42:18 user nova-compute[72586]:   </features>
Aug 01 21:42:18 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:42:18 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:42:18 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:42:18 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:42:18 user nova-compute[72586]:   </clock>
Aug 01 21:42:18 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:42:18 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:42:18 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:42:18 user nova-compute[72586]:   </cpu>
Aug 01 21:42:18 user nova-compute[72586]:   <devices>
Aug 01 21:42:18 user nova-compute[72586]:     <disk type="file" device="disk">
Aug 01 21:42:18 user nova-compute[72586]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 21:42:18 user nova-compute[72586]:       <source file="/opt/stack/data/nova/instances/11ab466b-8caa-4a38-8350-213aa17ee75e/disk"/>
Aug 01 21:42:18 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:42:18 user nova-compute[72586]:     </disk>
Aug 01 21:42:18 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:42:18 user nova-compute[72586]:       <mac address="fa:16:3e:76:af:74"/>
Aug 01 21:42:18 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:42:18 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:42:18 user nova-compute[72586]:       <target dev="tapd70607b2-8e"/>
Aug 01 21:42:18 user nova-compute[72586]:     </interface>
Aug 01 21:42:18 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:42:18 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/11ab466b-8caa-4a38-8350-213aa17ee75e/console.log" append="off"/>
Aug 01 21:42:18 user nova-compute[72586]:     </serial>
Aug 01 21:42:18 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:42:18 user nova-compute[72586]:     <video>
Aug 01 21:42:18 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:42:18 user nova-compute[72586]:     </video>
Aug 01 21:42:18 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:42:18 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:42:18 user nova-compute[72586]:     </rng>
Aug 01 21:42:18 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:42:18 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:42:18 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:42:18 user nova-compute[72586]:     </memballoon>
Aug 01 21:42:18 user nova-compute[72586]:   </devices>
Aug 01 21:42:18 user nova-compute[72586]: </domain>
Aug 01 21:42:18 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:42:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-a2816084-3b0a-44c1-aee7-12f42c644f40 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ab466b-8caa-4a38-8350-213aa17ee75e/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:42:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-a2816084-3b0a-44c1-aee7-12f42c644f40 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ab466b-8caa-4a38-8350-213aa17ee75e/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:42:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-a2816084-3b0a-44c1-aee7-12f42c644f40 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ab466b-8caa-4a38-8350-213aa17ee75e/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:42:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-a2816084-3b0a-44c1-aee7-12f42c644f40 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ab466b-8caa-4a38-8350-213aa17ee75e/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:42:18 user nova-compute[72586]: DEBUG nova.objects.instance [None req-a2816084-3b0a-44c1-aee7-12f42c644f40 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lazy-loading 'trusted_certs' on Instance uuid 11ab466b-8caa-4a38-8350-213aa17ee75e {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:42:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-a2816084-3b0a-44c1-aee7-12f42c644f40 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:42:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-a2816084-3b0a-44c1-aee7-12f42c644f40 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.147s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:42:18 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-a2816084-3b0a-44c1-aee7-12f42c644f40 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Checking if we can resize image /opt/stack/data/nova/instances/11ab466b-8caa-4a38-8350-213aa17ee75e/disk. size=1073741824 {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 21:42:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-a2816084-3b0a-44c1-aee7-12f42c644f40 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ab466b-8caa-4a38-8350-213aa17ee75e/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:42:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-a2816084-3b0a-44c1-aee7-12f42c644f40 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ab466b-8caa-4a38-8350-213aa17ee75e/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:42:19 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-a2816084-3b0a-44c1-aee7-12f42c644f40 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Cannot resize image /opt/stack/data/nova/instances/11ab466b-8caa-4a38-8350-213aa17ee75e/disk to a smaller size. {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 21:42:19 user nova-compute[72586]: DEBUG nova.objects.instance [None req-a2816084-3b0a-44c1-aee7-12f42c644f40 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lazy-loading 'migration_context' on Instance uuid 11ab466b-8caa-4a38-8350-213aa17ee75e {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:42:19 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-a2816084-3b0a-44c1-aee7-12f42c644f40 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:34:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2094185911',display_name='tempest-AttachVolumeTestJSON-server-2094185911',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2094185911',id=31,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8bY2a+j0kMVaPrfl1MtLxUCVEzM0sy04URPhEHt1a9A1Fyz7ckW9BOF4xfEN78B/F9+N05Diy+kKgMUVPp6Ls9nXPam6BDkRvokPK0ly7jy5lxY/agzzRa/NAHpQoc4w==',key_name='tempest-keypair-809503431',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:34:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='99cbab7dfc55429c9b991bf1091a84c7',ramdisk_id='',reservation_id='r-mw52zjwf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1420576365',owner_user_name='tempest-AttachVolumeTestJSON-1420576365-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:40:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='50893dc844b44f498e1545aeee794742',uuid=11ab466b-8caa-4a38-8350-213aa17ee75e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d70607b2-8e0c-4166-8218-ecbc976d0369", "address": "fa:16:3e:76:af:74", "network": {"id": "63b6e8c7-fad0-44bf-a479-9baab6f0d1e3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2101151631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cbab7dfc55429c9b991bf1091a84c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd70607b2-8e", "ovs_interfaceid": "d70607b2-8e0c-4166-8218-ecbc976d0369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:42:19 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-a2816084-3b0a-44c1-aee7-12f42c644f40 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Converting VIF {"id": "d70607b2-8e0c-4166-8218-ecbc976d0369", "address": "fa:16:3e:76:af:74", "network": {"id": "63b6e8c7-fad0-44bf-a479-9baab6f0d1e3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2101151631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cbab7dfc55429c9b991bf1091a84c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd70607b2-8e", "ovs_interfaceid": "d70607b2-8e0c-4166-8218-ecbc976d0369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:42:19 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-a2816084-3b0a-44c1-aee7-12f42c644f40 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:af:74,bridge_name='br-int',has_traffic_filtering=True,id=d70607b2-8e0c-4166-8218-ecbc976d0369,network=Network(63b6e8c7-fad0-44bf-a479-9baab6f0d1e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd70607b2-8e') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:42:19 user nova-compute[72586]: DEBUG os_vif [None req-a2816084-3b0a-44c1-aee7-12f42c644f40 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:af:74,bridge_name='br-int',has_traffic_filtering=True,id=d70607b2-8e0c-4166-8218-ecbc976d0369,network=Network(63b6e8c7-fad0-44bf-a479-9baab6f0d1e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd70607b2-8e') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:42:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:42:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:42:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd70607b2-8e, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:42:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd70607b2-8e, col_values=(('external_ids', {'iface-id': 'd70607b2-8e0c-4166-8218-ecbc976d0369', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:af:74', 'vm-uuid': '11ab466b-8caa-4a38-8350-213aa17ee75e'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:42:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:42:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:19 user nova-compute[72586]: INFO os_vif [None req-a2816084-3b0a-44c1-aee7-12f42c644f40 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:af:74,bridge_name='br-int',has_traffic_filtering=True,id=d70607b2-8e0c-4166-8218-ecbc976d0369,network=Network(63b6e8c7-fad0-44bf-a479-9baab6f0d1e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd70607b2-8e')
Aug 01 21:42:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:20 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:20 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:20 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:21 user nova-compute[72586]: DEBUG nova.compute.manager [req-5f5ef142-6ea5-45d0-9f93-318ee67a81a2 req-c0c62e8a-194a-4fb2-97c5-5fc1aea6a7f6 service nova] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Received event network-vif-plugged-d70607b2-8e0c-4166-8218-ecbc976d0369 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:42:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-5f5ef142-6ea5-45d0-9f93-318ee67a81a2 req-c0c62e8a-194a-4fb2-97c5-5fc1aea6a7f6 service nova] Acquiring lock "11ab466b-8caa-4a38-8350-213aa17ee75e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:42:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-5f5ef142-6ea5-45d0-9f93-318ee67a81a2 req-c0c62e8a-194a-4fb2-97c5-5fc1aea6a7f6 service nova] Lock "11ab466b-8caa-4a38-8350-213aa17ee75e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:42:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-5f5ef142-6ea5-45d0-9f93-318ee67a81a2 req-c0c62e8a-194a-4fb2-97c5-5fc1aea6a7f6 service nova] Lock "11ab466b-8caa-4a38-8350-213aa17ee75e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:42:21 user nova-compute[72586]: DEBUG nova.compute.manager [req-5f5ef142-6ea5-45d0-9f93-318ee67a81a2 req-c0c62e8a-194a-4fb2-97c5-5fc1aea6a7f6 service nova] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] No waiting events found dispatching network-vif-plugged-d70607b2-8e0c-4166-8218-ecbc976d0369 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:42:21 user nova-compute[72586]: WARNING nova.compute.manager [req-5f5ef142-6ea5-45d0-9f93-318ee67a81a2 req-c0c62e8a-194a-4fb2-97c5-5fc1aea6a7f6 service nova] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Received unexpected event network-vif-plugged-d70607b2-8e0c-4166-8218-ecbc976d0369 for instance with vm_state stopped and task_state powering-on.
Aug 01 21:42:21 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:21 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:21 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Acquiring lock "8b5b09f4-6973-4b0f-bb46-d6b720a87339" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:42:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Lock "8b5b09f4-6973-4b0f-bb46-d6b720a87339" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:42:22 user nova-compute[72586]: DEBUG nova.compute.manager [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Starting instance... {{(pid=72586) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 21:42:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:42:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:42:22 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72586) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 21:42:22 user nova-compute[72586]: INFO nova.compute.claims [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Claim successful on node user
Aug 01 21:42:22 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690926142.6990602, 11ab466b-8caa-4a38-8350-213aa17ee75e => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:42:22 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] VM Resumed (Lifecycle Event)
Aug 01 21:42:22 user nova-compute[72586]: DEBUG nova.compute.manager [None req-a2816084-3b0a-44c1-aee7-12f42c644f40 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Instance event wait completed in 0 seconds for  {{(pid=72586) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 21:42:22 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Instance rebooted successfully.
Aug 01 21:42:22 user nova-compute[72586]: DEBUG nova.compute.manager [None req-a2816084-3b0a-44c1-aee7-12f42c644f40 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:42:22 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:42:22 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:42:22 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 01 21:42:22 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690926142.7003603, 11ab466b-8caa-4a38-8350-213aa17ee75e => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:42:22 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] VM Started (Lifecycle Event)
Aug 01 21:42:22 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:42:22 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:42:22 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:42:22 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:42:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.413s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:42:22 user nova-compute[72586]: DEBUG nova.compute.manager [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Start building networks asynchronously for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 21:42:23 user nova-compute[72586]: DEBUG nova.compute.manager [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Allocating IP information in the background. {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 21:42:23 user nova-compute[72586]: DEBUG nova.network.neutron [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] allocate_for_instance() {{(pid=72586) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 21:42:23 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 21:42:23 user nova-compute[72586]: DEBUG nova.compute.manager [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Start building block device mappings for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 21:42:23 user nova-compute[72586]: DEBUG nova.compute.manager [req-a17cc5f8-7203-4936-875e-8bb67eadcc0e req-dec8506e-a117-4636-af26-62761247f23b service nova] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Received event network-vif-plugged-d70607b2-8e0c-4166-8218-ecbc976d0369 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:42:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-a17cc5f8-7203-4936-875e-8bb67eadcc0e req-dec8506e-a117-4636-af26-62761247f23b service nova] Acquiring lock "11ab466b-8caa-4a38-8350-213aa17ee75e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:42:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-a17cc5f8-7203-4936-875e-8bb67eadcc0e req-dec8506e-a117-4636-af26-62761247f23b service nova] Lock "11ab466b-8caa-4a38-8350-213aa17ee75e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:42:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-a17cc5f8-7203-4936-875e-8bb67eadcc0e req-dec8506e-a117-4636-af26-62761247f23b service nova] Lock "11ab466b-8caa-4a38-8350-213aa17ee75e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:42:23 user nova-compute[72586]: DEBUG nova.compute.manager [req-a17cc5f8-7203-4936-875e-8bb67eadcc0e req-dec8506e-a117-4636-af26-62761247f23b service nova] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] No waiting events found dispatching network-vif-plugged-d70607b2-8e0c-4166-8218-ecbc976d0369 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:42:23 user nova-compute[72586]: WARNING nova.compute.manager [req-a17cc5f8-7203-4936-875e-8bb67eadcc0e req-dec8506e-a117-4636-af26-62761247f23b service nova] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Received unexpected event network-vif-plugged-d70607b2-8e0c-4166-8218-ecbc976d0369 for instance with vm_state active and task_state None.
Aug 01 21:42:23 user nova-compute[72586]: DEBUG nova.policy [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd9704aa4160c487198d550d9084ae976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561de31d533d492782ef0545e2c69adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72586) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 21:42:23 user nova-compute[72586]: DEBUG nova.compute.manager [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Start spawning the instance on the hypervisor. {{(pid=72586) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 21:42:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Creating instance directory {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 21:42:23 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Creating image(s)
Aug 01 21:42:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Acquiring lock "/opt/stack/data/nova/instances/8b5b09f4-6973-4b0f-bb46-d6b720a87339/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:42:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Lock "/opt/stack/data/nova/instances/8b5b09f4-6973-4b0f-bb46-d6b720a87339/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:42:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Lock "/opt/stack/data/nova/instances/8b5b09f4-6973-4b0f-bb46-d6b720a87339/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:42:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:42:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.153s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:42:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Acquiring lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:42:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:42:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:42:23 user nova-compute[72586]: INFO nova.compute.manager [None req-839bd82d-4abb-487c-9de5-9ee6c1af317d tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Unrescuing
Aug 01 21:42:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-839bd82d-4abb-487c-9de5-9ee6c1af317d tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Acquiring lock "refresh_cache-178d26d5-3570-442f-9268-21cd73cccfc7" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:42:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-839bd82d-4abb-487c-9de5-9ee6c1af317d tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Acquired lock "refresh_cache-178d26d5-3570-442f-9268-21cd73cccfc7" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:42:23 user nova-compute[72586]: DEBUG nova.network.neutron [None req-839bd82d-4abb-487c-9de5-9ee6c1af317d tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:42:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.153s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:42:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/8b5b09f4-6973-4b0f-bb46-d6b720a87339/disk 1073741824 {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:42:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/8b5b09f4-6973-4b0f-bb46-d6b720a87339/disk 1073741824" returned: 0 in 0.076s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:42:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:42:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:42:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.142s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:42:23 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8b5b09f4-6973-4b0f-bb46-d6b720a87339/disk. size=1073741824 {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 21:42:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b5b09f4-6973-4b0f-bb46-d6b720a87339/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:42:23 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b5b09f4-6973-4b0f-bb46-d6b720a87339/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:42:23 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Cannot resize image /opt/stack/data/nova/instances/8b5b09f4-6973-4b0f-bb46-d6b720a87339/disk to a smaller size. {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 21:42:23 user nova-compute[72586]: DEBUG nova.objects.instance [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Lazy-loading 'migration_context' on Instance uuid 8b5b09f4-6973-4b0f-bb46-d6b720a87339 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:42:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Created local disks {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 21:42:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Ensure instance console log exists: /opt/stack/data/nova/instances/8b5b09f4-6973-4b0f-bb46-d6b720a87339/console.log {{(pid=72586) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 21:42:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:42:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:42:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:42:24 user nova-compute[72586]: DEBUG nova.network.neutron [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Successfully created port: 9b2bbf44-3450-4de2-bb25-adefa62c1755 {{(pid=72586) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 21:42:24 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:24 user nova-compute[72586]: DEBUG nova.network.neutron [None req-839bd82d-4abb-487c-9de5-9ee6c1af317d tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Updating instance_info_cache with network_info: [{"id": "9bddd744-887b-44bf-aacf-d7606c470f70", "address": "fa:16:3e:50:53:8c", "network": {"id": "86940e5d-852b-48fc-9b0e-858305321349", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1967467603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d847d04360420c80ea5608d5a2b15a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bddd744-88", "ovs_interfaceid": "9bddd744-887b-44bf-aacf-d7606c470f70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:42:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-839bd82d-4abb-487c-9de5-9ee6c1af317d tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Releasing lock "refresh_cache-178d26d5-3570-442f-9268-21cd73cccfc7" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:42:24 user nova-compute[72586]: DEBUG nova.objects.instance [None req-839bd82d-4abb-487c-9de5-9ee6c1af317d tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lazy-loading 'flavor' on Instance uuid 178d26d5-3570-442f-9268-21cd73cccfc7 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:42:24 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:24 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:24 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:24 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:24 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:25 user nova-compute[72586]: DEBUG nova.compute.manager [req-b5b5ac6c-8368-41eb-8d1b-869e18c8c101 req-c4d8bdfc-6982-4320-93a3-6077594a6e88 service nova] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Received event network-vif-unplugged-9bddd744-887b-44bf-aacf-d7606c470f70 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:42:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-b5b5ac6c-8368-41eb-8d1b-869e18c8c101 req-c4d8bdfc-6982-4320-93a3-6077594a6e88 service nova] Acquiring lock "178d26d5-3570-442f-9268-21cd73cccfc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:42:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-b5b5ac6c-8368-41eb-8d1b-869e18c8c101 req-c4d8bdfc-6982-4320-93a3-6077594a6e88 service nova] Lock "178d26d5-3570-442f-9268-21cd73cccfc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:42:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-b5b5ac6c-8368-41eb-8d1b-869e18c8c101 req-c4d8bdfc-6982-4320-93a3-6077594a6e88 service nova] Lock "178d26d5-3570-442f-9268-21cd73cccfc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:42:25 user nova-compute[72586]: DEBUG nova.compute.manager [req-b5b5ac6c-8368-41eb-8d1b-869e18c8c101 req-c4d8bdfc-6982-4320-93a3-6077594a6e88 service nova] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] No waiting events found dispatching network-vif-unplugged-9bddd744-887b-44bf-aacf-d7606c470f70 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:42:25 user nova-compute[72586]: WARNING nova.compute.manager [req-b5b5ac6c-8368-41eb-8d1b-869e18c8c101 req-c4d8bdfc-6982-4320-93a3-6077594a6e88 service nova] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Received unexpected event network-vif-unplugged-9bddd744-887b-44bf-aacf-d7606c470f70 for instance with vm_state rescued and task_state unrescuing.
Aug 01 21:42:25 user nova-compute[72586]: DEBUG nova.compute.manager [req-b5b5ac6c-8368-41eb-8d1b-869e18c8c101 req-c4d8bdfc-6982-4320-93a3-6077594a6e88 service nova] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Received event network-vif-plugged-9bddd744-887b-44bf-aacf-d7606c470f70 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:42:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-b5b5ac6c-8368-41eb-8d1b-869e18c8c101 req-c4d8bdfc-6982-4320-93a3-6077594a6e88 service nova] Acquiring lock "178d26d5-3570-442f-9268-21cd73cccfc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:42:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-b5b5ac6c-8368-41eb-8d1b-869e18c8c101 req-c4d8bdfc-6982-4320-93a3-6077594a6e88 service nova] Lock "178d26d5-3570-442f-9268-21cd73cccfc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:42:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-b5b5ac6c-8368-41eb-8d1b-869e18c8c101 req-c4d8bdfc-6982-4320-93a3-6077594a6e88 service nova] Lock "178d26d5-3570-442f-9268-21cd73cccfc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:42:25 user nova-compute[72586]: DEBUG nova.compute.manager [req-b5b5ac6c-8368-41eb-8d1b-869e18c8c101 req-c4d8bdfc-6982-4320-93a3-6077594a6e88 service nova] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] No waiting events found dispatching network-vif-plugged-9bddd744-887b-44bf-aacf-d7606c470f70 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:42:25 user nova-compute[72586]: WARNING nova.compute.manager [req-b5b5ac6c-8368-41eb-8d1b-869e18c8c101 req-c4d8bdfc-6982-4320-93a3-6077594a6e88 service nova] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Received unexpected event network-vif-plugged-9bddd744-887b-44bf-aacf-d7606c470f70 for instance with vm_state rescued and task_state unrescuing.
Aug 01 21:42:25 user nova-compute[72586]: DEBUG nova.network.neutron [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Successfully updated port: 9b2bbf44-3450-4de2-bb25-adefa62c1755 {{(pid=72586) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 21:42:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Acquiring lock "refresh_cache-8b5b09f4-6973-4b0f-bb46-d6b720a87339" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:42:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Acquired lock "refresh_cache-8b5b09f4-6973-4b0f-bb46-d6b720a87339" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:42:25 user nova-compute[72586]: DEBUG nova.network.neutron [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:42:25 user nova-compute[72586]: DEBUG nova.compute.manager [req-4b6c37f9-e105-4c76-99f5-9b0a1996f17f req-50fadf39-bf7d-4181-a96e-cb2c6fd5784f service nova] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Received event network-changed-9b2bbf44-3450-4de2-bb25-adefa62c1755 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:42:25 user nova-compute[72586]: DEBUG nova.compute.manager [req-4b6c37f9-e105-4c76-99f5-9b0a1996f17f req-50fadf39-bf7d-4181-a96e-cb2c6fd5784f service nova] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Refreshing instance network info cache due to event network-changed-9b2bbf44-3450-4de2-bb25-adefa62c1755. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:42:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-4b6c37f9-e105-4c76-99f5-9b0a1996f17f req-50fadf39-bf7d-4181-a96e-cb2c6fd5784f service nova] Acquiring lock "refresh_cache-8b5b09f4-6973-4b0f-bb46-d6b720a87339" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:42:25 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Instance destroyed successfully.
Aug 01 21:42:25 user nova-compute[72586]: DEBUG nova.network.neutron [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Instance cache missing network info. {{(pid=72586) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 21:42:25 user nova-compute[72586]: DEBUG nova.network.neutron [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Updating instance_info_cache with network_info: [{"id": "9b2bbf44-3450-4de2-bb25-adefa62c1755", "address": "fa:16:3e:92:8b:1a", "network": {"id": "ca864e90-8fc3-454d-af99-93600911d16c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1236727659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "561de31d533d492782ef0545e2c69adb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b2bbf44-34", "ovs_interfaceid": "9b2bbf44-3450-4de2-bb25-adefa62c1755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:42:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Releasing lock "refresh_cache-8b5b09f4-6973-4b0f-bb46-d6b720a87339" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:42:25 user nova-compute[72586]: DEBUG nova.compute.manager [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Instance network_info: |[{"id": "9b2bbf44-3450-4de2-bb25-adefa62c1755", "address": "fa:16:3e:92:8b:1a", "network": {"id": "ca864e90-8fc3-454d-af99-93600911d16c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1236727659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "561de31d533d492782ef0545e2c69adb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b2bbf44-34", "ovs_interfaceid": "9b2bbf44-3450-4de2-bb25-adefa62c1755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 21:42:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-4b6c37f9-e105-4c76-99f5-9b0a1996f17f req-50fadf39-bf7d-4181-a96e-cb2c6fd5784f service nova] Acquired lock "refresh_cache-8b5b09f4-6973-4b0f-bb46-d6b720a87339" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:42:25 user nova-compute[72586]: DEBUG nova.network.neutron [req-4b6c37f9-e105-4c76-99f5-9b0a1996f17f req-50fadf39-bf7d-4181-a96e-cb2c6fd5784f service nova] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Refreshing network info cache for port 9b2bbf44-3450-4de2-bb25-adefa62c1755 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:42:25 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Start _get_guest_xml network_info=[{"id": "9b2bbf44-3450-4de2-bb25-adefa62c1755", "address": "fa:16:3e:92:8b:1a", "network": {"id": "ca864e90-8fc3-454d-af99-93600911d16c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1236727659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "561de31d533d492782ef0545e2c69adb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b2bbf44-34", "ovs_interfaceid": "9b2bbf44-3450-4de2-bb25-adefa62c1755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '0243d46b-6819-42a5-926f-42b71f0c97ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:42:25 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:42:25 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:42:25 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:42:25 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:42:25 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:42:25 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:42:25 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:42:25 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:42:25 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:42:25 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:42:25 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:42:25 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:42:25 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:42:25 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:42:25 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:42:25 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:42:25 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:42:25 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:42:25 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:42:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1436732971',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1436732971',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1436732',id=38,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA0FfE2awTcr1VhdiC5n3q/4Yl36+odjHbET3ycxpAOGW4F5uAGKc1CJ3wC8axRXBKeUqNIgjM3rmHw9DtJLM3ctjhrgKGEuvCToTh3L/gCmAwbRL6Vvune3vV7F+q4j/w==',key_name='tempest-keypair-519122917',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='561de31d533d492782ef0545e2c69adb',ramdisk_id='',reservation_id='r-hxgzf8yi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-273472066',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:42:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9704aa4160c487198d550d9084ae976',uuid=8b5b09f4-6973-4b0f-bb46-d6b720a87339,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b2bbf44-3450-4de2-bb25-adefa62c1755", "address": "fa:16:3e:92:8b:1a", "network": {"id": "ca864e90-8fc3-454d-af99-93600911d16c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1236727659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "561de31d533d492782ef0545e2c69adb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b2bbf44-34", "ovs_interfaceid": "9b2bbf44-3450-4de2-bb25-adefa62c1755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:42:25 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Converting VIF {"id": "9b2bbf44-3450-4de2-bb25-adefa62c1755", "address": "fa:16:3e:92:8b:1a", "network": {"id": "ca864e90-8fc3-454d-af99-93600911d16c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1236727659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "561de31d533d492782ef0545e2c69adb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b2bbf44-34", "ovs_interfaceid": "9b2bbf44-3450-4de2-bb25-adefa62c1755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:42:25 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:8b:1a,bridge_name='br-int',has_traffic_filtering=True,id=9b2bbf44-3450-4de2-bb25-adefa62c1755,network=Network(ca864e90-8fc3-454d-af99-93600911d16c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b2bbf44-34') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:42:25 user nova-compute[72586]: DEBUG nova.objects.instance [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Lazy-loading 'pci_devices' on Instance uuid 8b5b09f4-6973-4b0f-bb46-d6b720a87339 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:42:25 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:42:25 user nova-compute[72586]:   <uuid>8b5b09f4-6973-4b0f-bb46-d6b720a87339</uuid>
Aug 01 21:42:25 user nova-compute[72586]:   <name>instance-00000026</name>
Aug 01 21:42:25 user nova-compute[72586]:   <memory>524288</memory>
Aug 01 21:42:25 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:42:25 user nova-compute[72586]:   <metadata>
Aug 01 21:42:25 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:42:25 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:42:25 user nova-compute[72586]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1436732971</nova:name>
Aug 01 21:42:25 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:42:25</nova:creationTime>
Aug 01 21:42:25 user nova-compute[72586]:       <nova:flavor name="m1.tiny">
Aug 01 21:42:25 user nova-compute[72586]:         <nova:memory>512</nova:memory>
Aug 01 21:42:25 user nova-compute[72586]:         <nova:disk>1</nova:disk>
Aug 01 21:42:25 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:42:25 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:42:25 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:42:25 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:42:25 user nova-compute[72586]:       <nova:owner>
Aug 01 21:42:25 user nova-compute[72586]:         <nova:user uuid="d9704aa4160c487198d550d9084ae976">tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member</nova:user>
Aug 01 21:42:25 user nova-compute[72586]:         <nova:project uuid="561de31d533d492782ef0545e2c69adb">tempest-TestServerVolumeAttachScenarioOldVersion-273472066</nova:project>
Aug 01 21:42:25 user nova-compute[72586]:       </nova:owner>
Aug 01 21:42:25 user nova-compute[72586]:       <nova:root type="image" uuid="0243d46b-6819-42a5-926f-42b71f0c97ad"/>
Aug 01 21:42:25 user nova-compute[72586]:       <nova:ports>
Aug 01 21:42:25 user nova-compute[72586]:         <nova:port uuid="9b2bbf44-3450-4de2-bb25-adefa62c1755">
Aug 01 21:42:25 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 01 21:42:25 user nova-compute[72586]:         </nova:port>
Aug 01 21:42:25 user nova-compute[72586]:       </nova:ports>
Aug 01 21:42:25 user nova-compute[72586]:     </nova:instance>
Aug 01 21:42:25 user nova-compute[72586]:   </metadata>
Aug 01 21:42:25 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:42:25 user nova-compute[72586]:     <system>
Aug 01 21:42:25 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:42:25 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:42:25 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:42:25 user nova-compute[72586]:       <entry name="serial">8b5b09f4-6973-4b0f-bb46-d6b720a87339</entry>
Aug 01 21:42:25 user nova-compute[72586]:       <entry name="uuid">8b5b09f4-6973-4b0f-bb46-d6b720a87339</entry>
Aug 01 21:42:25 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:42:25 user nova-compute[72586]:     </system>
Aug 01 21:42:25 user nova-compute[72586]:   </sysinfo>
Aug 01 21:42:25 user nova-compute[72586]:   <os>
Aug 01 21:42:25 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:42:25 user nova-compute[72586]:     <boot dev="hd"/>
Aug 01 21:42:25 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:42:25 user nova-compute[72586]:   </os>
Aug 01 21:42:25 user nova-compute[72586]:   <features>
Aug 01 21:42:25 user nova-compute[72586]:     <acpi/>
Aug 01 21:42:25 user nova-compute[72586]:     <apic/>
Aug 01 21:42:25 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:42:25 user nova-compute[72586]:   </features>
Aug 01 21:42:25 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:42:25 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:42:25 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:42:25 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:42:25 user nova-compute[72586]:   </clock>
Aug 01 21:42:25 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:42:25 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:42:25 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:42:25 user nova-compute[72586]:   </cpu>
Aug 01 21:42:25 user nova-compute[72586]:   <devices>
Aug 01 21:42:25 user nova-compute[72586]:     <disk type="file" device="disk">
Aug 01 21:42:25 user nova-compute[72586]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 21:42:25 user nova-compute[72586]:       <source file="/opt/stack/data/nova/instances/8b5b09f4-6973-4b0f-bb46-d6b720a87339/disk"/>
Aug 01 21:42:25 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:42:25 user nova-compute[72586]:     </disk>
Aug 01 21:42:25 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:42:25 user nova-compute[72586]:       <mac address="fa:16:3e:92:8b:1a"/>
Aug 01 21:42:25 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:42:25 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:42:25 user nova-compute[72586]:       <target dev="tap9b2bbf44-34"/>
Aug 01 21:42:25 user nova-compute[72586]:     </interface>
Aug 01 21:42:25 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:42:25 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/8b5b09f4-6973-4b0f-bb46-d6b720a87339/console.log" append="off"/>
Aug 01 21:42:25 user nova-compute[72586]:     </serial>
Aug 01 21:42:25 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:42:25 user nova-compute[72586]:     <video>
Aug 01 21:42:25 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:42:25 user nova-compute[72586]:     </video>
Aug 01 21:42:25 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:42:25 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:42:25 user nova-compute[72586]:     </rng>
Aug 01 21:42:25 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:42:25 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:42:25 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:42:25 user nova-compute[72586]:     </memballoon>
Aug 01 21:42:25 user nova-compute[72586]:   </devices>
Aug 01 21:42:25 user nova-compute[72586]: </domain>
Aug 01 21:42:25 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:42:25 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:42:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1436732971',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1436732971',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1436732',id=38,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA0FfE2awTcr1VhdiC5n3q/4Yl36+odjHbET3ycxpAOGW4F5uAGKc1CJ3wC8axRXBKeUqNIgjM3rmHw9DtJLM3ctjhrgKGEuvCToTh3L/gCmAwbRL6Vvune3vV7F+q4j/w==',key_name='tempest-keypair-519122917',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='561de31d533d492782ef0545e2c69adb',ramdisk_id='',reservation_id='r-hxgzf8yi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-273472066',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:42:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9704aa4160c487198d550d9084ae976',uuid=8b5b09f4-6973-4b0f-bb46-d6b720a87339,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b2bbf44-3450-4de2-bb25-adefa62c1755", "address": "fa:16:3e:92:8b:1a", "network": {"id": "ca864e90-8fc3-454d-af99-93600911d16c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1236727659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "561de31d533d492782ef0545e2c69adb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b2bbf44-34", "ovs_interfaceid": "9b2bbf44-3450-4de2-bb25-adefa62c1755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:42:25 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Converting VIF {"id": "9b2bbf44-3450-4de2-bb25-adefa62c1755", "address": "fa:16:3e:92:8b:1a", "network": {"id": "ca864e90-8fc3-454d-af99-93600911d16c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1236727659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "561de31d533d492782ef0545e2c69adb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b2bbf44-34", "ovs_interfaceid": "9b2bbf44-3450-4de2-bb25-adefa62c1755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:42:25 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:8b:1a,bridge_name='br-int',has_traffic_filtering=True,id=9b2bbf44-3450-4de2-bb25-adefa62c1755,network=Network(ca864e90-8fc3-454d-af99-93600911d16c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b2bbf44-34') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:42:25 user nova-compute[72586]: DEBUG os_vif [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:8b:1a,bridge_name='br-int',has_traffic_filtering=True,id=9b2bbf44-3450-4de2-bb25-adefa62c1755,network=Network(ca864e90-8fc3-454d-af99-93600911d16c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b2bbf44-34') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:42:25 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:25 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:42:25 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:42:25 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:25 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9b2bbf44-34, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:42:25 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9b2bbf44-34, col_values=(('external_ids', {'iface-id': '9b2bbf44-3450-4de2-bb25-adefa62c1755', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:8b:1a', 'vm-uuid': '8b5b09f4-6973-4b0f-bb46-d6b720a87339'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:42:25 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:25 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:42:25 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:25 user nova-compute[72586]: INFO os_vif [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:8b:1a,bridge_name='br-int',has_traffic_filtering=True,id=9b2bbf44-3450-4de2-bb25-adefa62c1755,network=Network(ca864e90-8fc3-454d-af99-93600911d16c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b2bbf44-34')
Aug 01 21:42:25 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:42:25 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] No VIF found with MAC fa:16:3e:92:8b:1a, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:42:26 user nova-compute[72586]: DEBUG nova.network.neutron [req-4b6c37f9-e105-4c76-99f5-9b0a1996f17f req-50fadf39-bf7d-4181-a96e-cb2c6fd5784f service nova] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Updated VIF entry in instance network info cache for port 9b2bbf44-3450-4de2-bb25-adefa62c1755. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:42:26 user nova-compute[72586]: DEBUG nova.network.neutron [req-4b6c37f9-e105-4c76-99f5-9b0a1996f17f req-50fadf39-bf7d-4181-a96e-cb2c6fd5784f service nova] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Updating instance_info_cache with network_info: [{"id": "9b2bbf44-3450-4de2-bb25-adefa62c1755", "address": "fa:16:3e:92:8b:1a", "network": {"id": "ca864e90-8fc3-454d-af99-93600911d16c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1236727659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "561de31d533d492782ef0545e2c69adb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b2bbf44-34", "ovs_interfaceid": "9b2bbf44-3450-4de2-bb25-adefa62c1755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:42:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-4b6c37f9-e105-4c76-99f5-9b0a1996f17f req-50fadf39-bf7d-4181-a96e-cb2c6fd5784f service nova] Releasing lock "refresh_cache-8b5b09f4-6973-4b0f-bb46-d6b720a87339" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:42:27 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:27 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:27 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:27 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:27 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:28 user nova-compute[72586]: DEBUG nova.compute.manager [req-b6b2f1b9-0308-4d78-86bf-343bafcc7005 req-b6e71b3c-d652-40c5-9296-3d1fb89904f7 service nova] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Received event network-vif-plugged-9bddd744-887b-44bf-aacf-d7606c470f70 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:42:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-b6b2f1b9-0308-4d78-86bf-343bafcc7005 req-b6e71b3c-d652-40c5-9296-3d1fb89904f7 service nova] Acquiring lock "178d26d5-3570-442f-9268-21cd73cccfc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:42:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-b6b2f1b9-0308-4d78-86bf-343bafcc7005 req-b6e71b3c-d652-40c5-9296-3d1fb89904f7 service nova] Lock "178d26d5-3570-442f-9268-21cd73cccfc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:42:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-b6b2f1b9-0308-4d78-86bf-343bafcc7005 req-b6e71b3c-d652-40c5-9296-3d1fb89904f7 service nova] Lock "178d26d5-3570-442f-9268-21cd73cccfc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:42:28 user nova-compute[72586]: DEBUG nova.compute.manager [req-b6b2f1b9-0308-4d78-86bf-343bafcc7005 req-b6e71b3c-d652-40c5-9296-3d1fb89904f7 service nova] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] No waiting events found dispatching network-vif-plugged-9bddd744-887b-44bf-aacf-d7606c470f70 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:42:28 user nova-compute[72586]: WARNING nova.compute.manager [req-b6b2f1b9-0308-4d78-86bf-343bafcc7005 req-b6e71b3c-d652-40c5-9296-3d1fb89904f7 service nova] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Received unexpected event network-vif-plugged-9bddd744-887b-44bf-aacf-d7606c470f70 for instance with vm_state rescued and task_state unrescuing.
Aug 01 21:42:28 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:28 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:28 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:28 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:28 user nova-compute[72586]: DEBUG nova.compute.manager [req-df11804b-ded7-4464-87ce-4bd6d81faf19 req-8935bf56-9da8-4138-b619-b61fe756532a service nova] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Received event network-vif-plugged-9b2bbf44-3450-4de2-bb25-adefa62c1755 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:42:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-df11804b-ded7-4464-87ce-4bd6d81faf19 req-8935bf56-9da8-4138-b619-b61fe756532a service nova] Acquiring lock "8b5b09f4-6973-4b0f-bb46-d6b720a87339-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:42:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-df11804b-ded7-4464-87ce-4bd6d81faf19 req-8935bf56-9da8-4138-b619-b61fe756532a service nova] Lock "8b5b09f4-6973-4b0f-bb46-d6b720a87339-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:42:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-df11804b-ded7-4464-87ce-4bd6d81faf19 req-8935bf56-9da8-4138-b619-b61fe756532a service nova] Lock "8b5b09f4-6973-4b0f-bb46-d6b720a87339-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:42:28 user nova-compute[72586]: DEBUG nova.compute.manager [req-df11804b-ded7-4464-87ce-4bd6d81faf19 req-8935bf56-9da8-4138-b619-b61fe756532a service nova] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] No waiting events found dispatching network-vif-plugged-9b2bbf44-3450-4de2-bb25-adefa62c1755 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:42:28 user nova-compute[72586]: WARNING nova.compute.manager [req-df11804b-ded7-4464-87ce-4bd6d81faf19 req-8935bf56-9da8-4138-b619-b61fe756532a service nova] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Received unexpected event network-vif-plugged-9b2bbf44-3450-4de2-bb25-adefa62c1755 for instance with vm_state building and task_state spawning.
Aug 01 21:42:28 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:28 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:30 user nova-compute[72586]: DEBUG nova.compute.manager [req-ed8c10aa-7885-44a2-ad22-7de79fe1985b req-1d519165-d874-4663-a450-862f3bd33c5b service nova] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Received event network-vif-plugged-9bddd744-887b-44bf-aacf-d7606c470f70 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:42:30 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ed8c10aa-7885-44a2-ad22-7de79fe1985b req-1d519165-d874-4663-a450-862f3bd33c5b service nova] Acquiring lock "178d26d5-3570-442f-9268-21cd73cccfc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:42:30 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ed8c10aa-7885-44a2-ad22-7de79fe1985b req-1d519165-d874-4663-a450-862f3bd33c5b service nova] Lock "178d26d5-3570-442f-9268-21cd73cccfc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:42:30 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ed8c10aa-7885-44a2-ad22-7de79fe1985b req-1d519165-d874-4663-a450-862f3bd33c5b service nova] Lock "178d26d5-3570-442f-9268-21cd73cccfc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:42:30 user nova-compute[72586]: DEBUG nova.compute.manager [req-ed8c10aa-7885-44a2-ad22-7de79fe1985b req-1d519165-d874-4663-a450-862f3bd33c5b service nova] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] No waiting events found dispatching network-vif-plugged-9bddd744-887b-44bf-aacf-d7606c470f70 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:42:30 user nova-compute[72586]: WARNING nova.compute.manager [req-ed8c10aa-7885-44a2-ad22-7de79fe1985b req-1d519165-d874-4663-a450-862f3bd33c5b service nova] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Received unexpected event network-vif-plugged-9bddd744-887b-44bf-aacf-d7606c470f70 for instance with vm_state rescued and task_state unrescuing.
Aug 01 21:42:30 user nova-compute[72586]: DEBUG nova.compute.manager [req-cd58edad-bf94-4311-afd5-c2e541916888 req-fe56dcdc-02d2-47c0-8724-93e42f18bbb0 service nova] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Received event network-vif-plugged-9b2bbf44-3450-4de2-bb25-adefa62c1755 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:42:30 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-cd58edad-bf94-4311-afd5-c2e541916888 req-fe56dcdc-02d2-47c0-8724-93e42f18bbb0 service nova] Acquiring lock "8b5b09f4-6973-4b0f-bb46-d6b720a87339-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:42:30 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-cd58edad-bf94-4311-afd5-c2e541916888 req-fe56dcdc-02d2-47c0-8724-93e42f18bbb0 service nova] Lock "8b5b09f4-6973-4b0f-bb46-d6b720a87339-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:42:30 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-cd58edad-bf94-4311-afd5-c2e541916888 req-fe56dcdc-02d2-47c0-8724-93e42f18bbb0 service nova] Lock "8b5b09f4-6973-4b0f-bb46-d6b720a87339-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:42:30 user nova-compute[72586]: DEBUG nova.compute.manager [req-cd58edad-bf94-4311-afd5-c2e541916888 req-fe56dcdc-02d2-47c0-8724-93e42f18bbb0 service nova] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] No waiting events found dispatching network-vif-plugged-9b2bbf44-3450-4de2-bb25-adefa62c1755 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:42:30 user nova-compute[72586]: WARNING nova.compute.manager [req-cd58edad-bf94-4311-afd5-c2e541916888 req-fe56dcdc-02d2-47c0-8724-93e42f18bbb0 service nova] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Received unexpected event network-vif-plugged-9b2bbf44-3450-4de2-bb25-adefa62c1755 for instance with vm_state building and task_state spawning.
Aug 01 21:42:30 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Removed pending event for 178d26d5-3570-442f-9268-21cd73cccfc7 due to event {{(pid=72586) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 21:42:30 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690926150.6810038, 178d26d5-3570-442f-9268-21cd73cccfc7 => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:42:30 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] VM Resumed (Lifecycle Event)
Aug 01 21:42:30 user nova-compute[72586]: DEBUG nova.compute.manager [None req-839bd82d-4abb-487c-9de5-9ee6c1af317d tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:42:30 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:42:30 user nova-compute[72586]: DEBUG nova.compute.manager [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Instance event wait completed in 0 seconds for  {{(pid=72586) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 21:42:30 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Guest created on hypervisor {{(pid=72586) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 21:42:30 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:42:30 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Instance spawned successfully.
Aug 01 21:42:30 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 21:42:30 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 01 21:42:30 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690926150.686142, 178d26d5-3570-442f-9268-21cd73cccfc7 => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:42:30 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] VM Started (Lifecycle Event)
Aug 01 21:42:30 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Found default for hw_cdrom_bus of ide {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:42:30 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Found default for hw_disk_bus of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:42:30 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Found default for hw_input_bus of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:42:30 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Found default for hw_pointer_model of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:42:30 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Found default for hw_video_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:42:30 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Found default for hw_vif_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:42:30 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:42:30 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:42:30 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690926150.7218091, 8b5b09f4-6973-4b0f-bb46-d6b720a87339 => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:42:30 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] VM Resumed (Lifecycle Event)
Aug 01 21:42:30 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:30 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:42:30 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:42:30 user nova-compute[72586]: INFO nova.compute.manager [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Took 7.67 seconds to spawn the instance on the hypervisor.
Aug 01 21:42:30 user nova-compute[72586]: DEBUG nova.compute.manager [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:42:30 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:42:30 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690926150.724214, 8b5b09f4-6973-4b0f-bb46-d6b720a87339 => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:42:30 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] VM Started (Lifecycle Event)
Aug 01 21:42:30 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:42:30 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:42:30 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:42:30 user nova-compute[72586]: INFO nova.compute.manager [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Took 8.48 seconds to build instance.
Aug 01 21:42:31 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b28951c4-2730-42e5-8001-aa82fa69d0e2 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Lock "8b5b09f4-6973-4b0f-bb46-d6b720a87339" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.583s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:42:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Acquiring lock "f2f4343d-0cab-4ed6-972d-e2bd8a801e8f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:42:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "f2f4343d-0cab-4ed6-972d-e2bd8a801e8f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:42:32 user nova-compute[72586]: DEBUG nova.compute.manager [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Starting instance... {{(pid=72586) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 21:42:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:42:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:42:32 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72586) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 21:42:32 user nova-compute[72586]: INFO nova.compute.claims [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Claim successful on node user
Aug 01 21:42:32 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:42:32 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:42:33 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.435s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:42:33 user nova-compute[72586]: DEBUG nova.compute.manager [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Start building networks asynchronously for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 21:42:33 user nova-compute[72586]: DEBUG nova.compute.manager [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Allocating IP information in the background. {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 21:42:33 user nova-compute[72586]: DEBUG nova.network.neutron [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] allocate_for_instance() {{(pid=72586) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 21:42:33 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 21:42:33 user nova-compute[72586]: DEBUG nova.compute.manager [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Start building block device mappings for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 21:42:33 user nova-compute[72586]: INFO nova.virt.block_device [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Booting with volume 50a204c0-4010-4245-8c44-3f0fbedcf4a1 at /dev/vda
Aug 01 21:42:33 user nova-compute[72586]: DEBUG nova.policy [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '76cd0d9d973b410ca4ff08fc7630fbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a631250d39c34afca47a1fa2817e627e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72586) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 21:42:33 user nova-compute[72586]: DEBUG os_brick.utils [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:42:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:42:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:42:33 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2a4bf2-1dba-427c-a7e0-6d09cc29fd33]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4bc202fb9cb\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:42:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:42:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:42:33 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bdfe1db-b30e-46c1-943d-1c6b8b32ca92]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:42:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:42:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:42:33 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1809320-af8a-4419-8aea-1256a4dd41e0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:42:33 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[be01ec22-2e9e-4dcf-91db-22236023a816]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:42:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Running cmd (subprocess): nvme version {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:42:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] 'nvme version' failed. Not Retrying. {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:42:33 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.nvmeof [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] nvme not present on system {{(pid=72586) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 21:42:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:42:33 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:42:33 user nova-compute[72586]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 21:42:33 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[74fad26e-96bc-4ee5-a088-0e6323f68d1d]: (4, '') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:42:33 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72586) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 21:42:33 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 21:42:33 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] LIGHTOS: no hostnqn found. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 21:42:33 user nova-compute[72586]: DEBUG os_brick.utils [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4bc202fb9cb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:42:33 user nova-compute[72586]: DEBUG nova.virt.block_device [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Updating existing volume attachment record: 9e59a376-4432-4749-a7d2-a8da0e14c641 {{(pid=72586) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 21:42:33 user nova-compute[72586]: DEBUG nova.network.neutron [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Successfully created port: 69059e55-c62d-461b-860f-f638d25c9351 {{(pid=72586) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 21:42:33 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:42:34 user nova-compute[72586]: DEBUG nova.network.neutron [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Successfully updated port: 69059e55-c62d-461b-860f-f638d25c9351 {{(pid=72586) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 21:42:34 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Acquiring lock "refresh_cache-f2f4343d-0cab-4ed6-972d-e2bd8a801e8f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:42:34 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Acquired lock "refresh_cache-f2f4343d-0cab-4ed6-972d-e2bd8a801e8f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:42:34 user nova-compute[72586]: DEBUG nova.network.neutron [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:42:34 user nova-compute[72586]: DEBUG nova.compute.manager [req-50922163-3de9-4efb-8115-3c4c110e392f req-b1493811-a580-4018-800b-5dd734fc504d service nova] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Received event network-changed-69059e55-c62d-461b-860f-f638d25c9351 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:42:34 user nova-compute[72586]: DEBUG nova.compute.manager [req-50922163-3de9-4efb-8115-3c4c110e392f req-b1493811-a580-4018-800b-5dd734fc504d service nova] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Refreshing instance network info cache due to event network-changed-69059e55-c62d-461b-860f-f638d25c9351. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:42:34 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-50922163-3de9-4efb-8115-3c4c110e392f req-b1493811-a580-4018-800b-5dd734fc504d service nova] Acquiring lock "refresh_cache-f2f4343d-0cab-4ed6-972d-e2bd8a801e8f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:42:34 user nova-compute[72586]: DEBUG nova.network.neutron [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Instance cache missing network info. {{(pid=72586) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 21:42:34 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:42:34 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:35 user nova-compute[72586]: DEBUG nova.network.neutron [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Updating instance_info_cache with network_info: [{"id": "69059e55-c62d-461b-860f-f638d25c9351", "address": "fa:16:3e:5e:53:9a", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69059e55-c6", "ovs_interfaceid": "69059e55-c62d-461b-860f-f638d25c9351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:42:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Releasing lock "refresh_cache-f2f4343d-0cab-4ed6-972d-e2bd8a801e8f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:42:35 user nova-compute[72586]: DEBUG nova.compute.manager [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Instance network_info: |[{"id": "69059e55-c62d-461b-860f-f638d25c9351", "address": "fa:16:3e:5e:53:9a", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69059e55-c6", "ovs_interfaceid": "69059e55-c62d-461b-860f-f638d25c9351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 21:42:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-50922163-3de9-4efb-8115-3c4c110e392f req-b1493811-a580-4018-800b-5dd734fc504d service nova] Acquired lock "refresh_cache-f2f4343d-0cab-4ed6-972d-e2bd8a801e8f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:42:35 user nova-compute[72586]: DEBUG nova.network.neutron [req-50922163-3de9-4efb-8115-3c4c110e392f req-b1493811-a580-4018-800b-5dd734fc504d service nova] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Refreshing network info cache for port 69059e55-c62d-461b-860f-f638d25c9351 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:42:35 user nova-compute[72586]: DEBUG nova.network.neutron [req-50922163-3de9-4efb-8115-3c4c110e392f req-b1493811-a580-4018-800b-5dd734fc504d service nova] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Updated VIF entry in instance network info cache for port 69059e55-c62d-461b-860f-f638d25c9351. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:42:35 user nova-compute[72586]: DEBUG nova.network.neutron [req-50922163-3de9-4efb-8115-3c4c110e392f req-b1493811-a580-4018-800b-5dd734fc504d service nova] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Updating instance_info_cache with network_info: [{"id": "69059e55-c62d-461b-860f-f638d25c9351", "address": "fa:16:3e:5e:53:9a", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69059e55-c6", "ovs_interfaceid": "69059e55-c62d-461b-860f-f638d25c9351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:42:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-50922163-3de9-4efb-8115-3c4c110e392f req-b1493811-a580-4018-800b-5dd734fc504d service nova] Releasing lock "refresh_cache-f2f4343d-0cab-4ed6-972d-e2bd8a801e8f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:42:35 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:35 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:42:37 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:42:37 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:42:37 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72586) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 21:42:39 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:42:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:42:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:42:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:42:39 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Auditing locally available compute resources for user (node: user) {{(pid=72586) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 21:42:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:40 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:42:40 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:42:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ab466b-8caa-4a38-8350-213aa17ee75e/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:42:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ab466b-8caa-4a38-8350-213aa17ee75e/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:42:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ab466b-8caa-4a38-8350-213aa17ee75e/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:42:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ab466b-8caa-4a38-8350-213aa17ee75e/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:42:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:42:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:42:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:42:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:42:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b5b09f4-6973-4b0f-bb46-d6b720a87339/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:42:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b5b09f4-6973-4b0f-bb46-d6b720a87339/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:42:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b5b09f4-6973-4b0f-bb46-d6b720a87339/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:42:40 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b5b09f4-6973-4b0f-bb46-d6b720a87339/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:42:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee464b0-f75e-4f30-9838-74bca9619a07/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee464b0-f75e-4f30-9838-74bca9619a07/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee464b0-f75e-4f30-9838-74bca9619a07/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG nova.compute.manager [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Start spawning the instance on the hypervisor. {{(pid=72586) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Creating instance directory {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 21:42:41 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Creating image(s)
Aug 01 21:42:41 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Did not create local disks {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Ensure instance console log exists: /opt/stack/data/nova/instances/f2f4343d-0cab-4ed6-972d-e2bd8a801e8f/console.log {{(pid=72586) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Start _get_guest_xml network_info=[{"id": "69059e55-c62d-461b-860f-f638d25c9351", "address": "fa:16:3e:5e:53:9a", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69059e55-c6", "ovs_interfaceid": "69059e55-c62d-461b-860f-f638d25c9351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zjHcWePn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f2f4343d-0cab-4ed6-972d-e2bd8a801e8f', 'attached_at': '', 'detached_at': '', 'volume_id': '50a204c0-4010-4245-8c44-3f0fbedcf4a1', 'serial': '50a204c0-4010-4245-8c44-3f0fbedcf4a1'}, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '9e59a376-4432-4749-a7d2-a8da0e14c641', 'delete_on_termination': True, 'volume_type': None} {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:42:41 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:42:41 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:42:41 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Calling os-brick to attach iSCSI Volume {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zjHcWePn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:42:41 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:42:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:42:41 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:42:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:42:41 user nova-compute[72586]: INFO os_brick.initiator.connectors.iscsi [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 21:42:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee464b0-f75e-4f30-9838-74bca9619a07/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1 -p 172.16.0.220:3260 {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63625685-227f-48cc-9cc0-594633e0b8bb/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c74a0de-01f0-4685-b254-b986d290ba20]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 21:42:41 user nova-compute[72586]:  {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1 -p 172.16.0.220:3260 --interface default --op new {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aacc26e-8225-4796-9b49-60912a973fe3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1] added\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1] added
Aug 01 21:42:41 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b6bf03-13ef-477d-af06-7662a7e10e5a]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd089501-6656-4e3a-862e-a25446fa06ca]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zjHcWePn {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zjHcWePn" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[361b988a-a408-4e21-ab8c-f0ba27977c6f]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zjHcWePn'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63625685-227f-48cc-9cc0-594633e0b8bb/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63625685-227f-48cc-9cc0-594633e0b8bb/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d99051-c2ce-49bf-9f4c-5eb5d1fb5830]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[567148b6-f3e8-4102-ac0c-48803761887a]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:42:41 user nova-compute[72586]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec (non-flash)
Aug 01 21:42:41 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:42:41 user nova-compute[72586]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec (non-flash)
Aug 01 21:42:41 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1 -p 172.16.0.220:3260 --login {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[62fb3bc8-4951-4bc3-bde7-3bbabc00e4b9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1, portal: 172.16.0.220,3260]
Aug 01 21:42:41 user nova-compute[72586]: Login to [iface: default, target: iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1, portal: 172.16.0.220,3260] successful.
Aug 01 21:42:41 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[45974d1d-342e-4843-8ebb-d01f38ba812e]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[703bc57b-61dd-4a42-a236-e3251d94416c]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:42:41 user nova-compute[72586]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec (non-flash)
Aug 01 21:42:41 user nova-compute[72586]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1 (non-flash)
Aug 01 21:42:41 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:42:41 user nova-compute[72586]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec (non-flash)
Aug 01 21:42:41 user nova-compute[72586]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1 (non-flash)
Aug 01 21:42:41 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Connected to 172.16.0.220:3260 {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=72586) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72586) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63625685-227f-48cc-9cc0-594633e0b8bb/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/965244cc-71e5-43f9-8d22-62843bac3f52/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[6947ebf3-882b-4e11-87a5-8a2438691e22]: (4, ('- - 0', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zjHcWePn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/965244cc-71e5-43f9-8d22-62843bac3f52/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/965244cc-71e5-43f9-8d22-62843bac3f52/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:42:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/965244cc-71e5-43f9-8d22-62843bac3f52/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:42:42 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:42:42 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:42:42 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Hypervisor/Node resource view: name=user free_ram=7806MB free_disk=25.004531860351562GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72586) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 21:42:42 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:42:42 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:42:42 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance af2de810-b22f-4fa9-835c-c673abd145db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:42:42 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 161fab9d-a7d1-4ea0-b4b9-2afc54040eef actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:42:42 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 11ab466b-8caa-4a38-8350-213aa17ee75e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:42:42 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 63625685-227f-48cc-9cc0-594633e0b8bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:42:42 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 8ee464b0-f75e-4f30-9838-74bca9619a07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:42:42 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 965244cc-71e5-43f9-8d22-62843bac3f52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:42:42 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 178d26d5-3570-442f-9268-21cd73cccfc7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:42:42 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 8b5b09f4-6973-4b0f-bb46-d6b720a87339 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:42:42 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance f2f4343d-0cab-4ed6-972d-e2bd8a801e8f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:42:42 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 21:42:42 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 21:42:42 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.383s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:42:42 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] <== connect_volume: return (1385ms) {'type': 'block', 'scsi_wwn': '23539343131353631', 'path': '/dev/sdc'} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:42:42 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539343131353631', 'path': '/dev/sdc'} {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 21:42:42 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:42:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-207875059',display_name='tempest-TestVolumeBootPattern-volume-backed-server-207875059',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-207875059',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjJN2/edARG7yQjIN0zv12sSNLb5T+PntMhWviPB9DN83wlKev1TsK5+Bb/k6EQiFO3XyBfFW37jtAbk4OiCH7l6zRFtSX4JoeJU7Lyo/i6SlaWlqzVBKOKEd/iVO52Rg==',key_name='tempest-keypair-13475106',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a631250d39c34afca47a1fa2817e627e',ramdisk_id='',reservation_id='r-qvukxx03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1160754716',owner_user_name='tempest-TestVolumeBootPattern-1160754716-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:42:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76cd0d9d973b410ca4ff08fc7630fbc6',uuid=f2f4343d-0cab-4ed6-972d-e2bd8a801e8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69059e55-c62d-461b-860f-f638d25c9351", "address": "fa:16:3e:5e:53:9a", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69059e55-c6", "ovs_interfaceid": "69059e55-c62d-461b-860f-f638d25c9351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:42:42 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Converting VIF {"id": "69059e55-c62d-461b-860f-f638d25c9351", "address": "fa:16:3e:5e:53:9a", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69059e55-c6", "ovs_interfaceid": "69059e55-c62d-461b-860f-f638d25c9351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:42:42 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:53:9a,bridge_name='br-int',has_traffic_filtering=True,id=69059e55-c62d-461b-860f-f638d25c9351,network=Network(2fbf5ffb-0ec0-403b-bc92-259563ab1d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69059e55-c6') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:42:42 user nova-compute[72586]: DEBUG nova.objects.instance [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lazy-loading 'pci_devices' on Instance uuid f2f4343d-0cab-4ed6-972d-e2bd8a801e8f {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:42:42 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:42:42 user nova-compute[72586]:   <uuid>f2f4343d-0cab-4ed6-972d-e2bd8a801e8f</uuid>
Aug 01 21:42:42 user nova-compute[72586]:   <name>instance-00000027</name>
Aug 01 21:42:42 user nova-compute[72586]:   <memory>524288</memory>
Aug 01 21:42:42 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:42:42 user nova-compute[72586]:   <metadata>
Aug 01 21:42:42 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:42:42 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:42:42 user nova-compute[72586]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-207875059</nova:name>
Aug 01 21:42:42 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:42:41</nova:creationTime>
Aug 01 21:42:42 user nova-compute[72586]:       <nova:flavor name="m1.tiny">
Aug 01 21:42:42 user nova-compute[72586]:         <nova:memory>512</nova:memory>
Aug 01 21:42:42 user nova-compute[72586]:         <nova:disk>1</nova:disk>
Aug 01 21:42:42 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:42:42 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:42:42 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:42:42 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:42:42 user nova-compute[72586]:       <nova:owner>
Aug 01 21:42:42 user nova-compute[72586]:         <nova:user uuid="76cd0d9d973b410ca4ff08fc7630fbc6">tempest-TestVolumeBootPattern-1160754716-project-member</nova:user>
Aug 01 21:42:42 user nova-compute[72586]:         <nova:project uuid="a631250d39c34afca47a1fa2817e627e">tempest-TestVolumeBootPattern-1160754716</nova:project>
Aug 01 21:42:42 user nova-compute[72586]:       </nova:owner>
Aug 01 21:42:42 user nova-compute[72586]:       <nova:ports>
Aug 01 21:42:42 user nova-compute[72586]:         <nova:port uuid="69059e55-c62d-461b-860f-f638d25c9351">
Aug 01 21:42:42 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 01 21:42:42 user nova-compute[72586]:         </nova:port>
Aug 01 21:42:42 user nova-compute[72586]:       </nova:ports>
Aug 01 21:42:42 user nova-compute[72586]:     </nova:instance>
Aug 01 21:42:42 user nova-compute[72586]:   </metadata>
Aug 01 21:42:42 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:42:42 user nova-compute[72586]:     <system>
Aug 01 21:42:42 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:42:42 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:42:42 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:42:42 user nova-compute[72586]:       <entry name="serial">f2f4343d-0cab-4ed6-972d-e2bd8a801e8f</entry>
Aug 01 21:42:42 user nova-compute[72586]:       <entry name="uuid">f2f4343d-0cab-4ed6-972d-e2bd8a801e8f</entry>
Aug 01 21:42:42 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:42:42 user nova-compute[72586]:     </system>
Aug 01 21:42:42 user nova-compute[72586]:   </sysinfo>
Aug 01 21:42:42 user nova-compute[72586]:   <os>
Aug 01 21:42:42 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:42:42 user nova-compute[72586]:     <boot dev="hd"/>
Aug 01 21:42:42 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:42:42 user nova-compute[72586]:   </os>
Aug 01 21:42:42 user nova-compute[72586]:   <features>
Aug 01 21:42:42 user nova-compute[72586]:     <acpi/>
Aug 01 21:42:42 user nova-compute[72586]:     <apic/>
Aug 01 21:42:42 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:42:42 user nova-compute[72586]:   </features>
Aug 01 21:42:42 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:42:42 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:42:42 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:42:42 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:42:42 user nova-compute[72586]:   </clock>
Aug 01 21:42:42 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:42:42 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:42:42 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:42:42 user nova-compute[72586]:   </cpu>
Aug 01 21:42:42 user nova-compute[72586]:   <devices>
Aug 01 21:42:42 user nova-compute[72586]:     <disk type="block" device="disk">
Aug 01 21:42:42 user nova-compute[72586]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:42:42 user nova-compute[72586]:       <source dev="/dev/sdc"/>
Aug 01 21:42:42 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:42:42 user nova-compute[72586]:       <serial>50a204c0-4010-4245-8c44-3f0fbedcf4a1</serial>
Aug 01 21:42:42 user nova-compute[72586]:     </disk>
Aug 01 21:42:42 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:42:42 user nova-compute[72586]:       <mac address="fa:16:3e:5e:53:9a"/>
Aug 01 21:42:42 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:42:42 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:42:42 user nova-compute[72586]:       <target dev="tap69059e55-c6"/>
Aug 01 21:42:42 user nova-compute[72586]:     </interface>
Aug 01 21:42:42 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:42:42 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/f2f4343d-0cab-4ed6-972d-e2bd8a801e8f/console.log" append="off"/>
Aug 01 21:42:42 user nova-compute[72586]:     </serial>
Aug 01 21:42:42 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:42:42 user nova-compute[72586]:     <video>
Aug 01 21:42:42 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:42:42 user nova-compute[72586]:     </video>
Aug 01 21:42:42 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:42:42 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:42:42 user nova-compute[72586]:     </rng>
Aug 01 21:42:42 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:42:42 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:42:42 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:42:42 user nova-compute[72586]:     </memballoon>
Aug 01 21:42:42 user nova-compute[72586]:   </devices>
Aug 01 21:42:42 user nova-compute[72586]: </domain>
Aug 01 21:42:42 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:42:42 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:42:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-207875059',display_name='tempest-TestVolumeBootPattern-volume-backed-server-207875059',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-207875059',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjJN2/edARG7yQjIN0zv12sSNLb5T+PntMhWviPB9DN83wlKev1TsK5+Bb/k6EQiFO3XyBfFW37jtAbk4OiCH7l6zRFtSX4JoeJU7Lyo/i6SlaWlqzVBKOKEd/iVO52Rg==',key_name='tempest-keypair-13475106',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a631250d39c34afca47a1fa2817e627e',ramdisk_id='',reservation_id='r-qvukxx03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1160754716',owner_user_name='tempest-TestVolumeBootPattern-1160754716-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:42:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76cd0d9d973b410ca4ff08fc7630fbc6',uuid=f2f4343d-0cab-4ed6-972d-e2bd8a801e8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69059e55-c62d-461b-860f-f638d25c9351", "address": "fa:16:3e:5e:53:9a", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69059e55-c6", "ovs_interfaceid": "69059e55-c62d-461b-860f-f638d25c9351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:42:42 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Converting VIF {"id": "69059e55-c62d-461b-860f-f638d25c9351", "address": "fa:16:3e:5e:53:9a", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69059e55-c6", "ovs_interfaceid": "69059e55-c62d-461b-860f-f638d25c9351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:42:42 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:53:9a,bridge_name='br-int',has_traffic_filtering=True,id=69059e55-c62d-461b-860f-f638d25c9351,network=Network(2fbf5ffb-0ec0-403b-bc92-259563ab1d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69059e55-c6') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:42:42 user nova-compute[72586]: DEBUG os_vif [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:53:9a,bridge_name='br-int',has_traffic_filtering=True,id=69059e55-c62d-461b-860f-f638d25c9351,network=Network(2fbf5ffb-0ec0-403b-bc92-259563ab1d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69059e55-c6') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:42:42 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:42 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:42:42 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:42:42 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:42 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap69059e55-c6, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:42:42 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap69059e55-c6, col_values=(('external_ids', {'iface-id': '69059e55-c62d-461b-860f-f638d25c9351', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:53:9a', 'vm-uuid': 'f2f4343d-0cab-4ed6-972d-e2bd8a801e8f'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:42:42 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:42 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:42:42 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:42 user nova-compute[72586]: INFO os_vif [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:53:9a,bridge_name='br-int',has_traffic_filtering=True,id=69059e55-c62d-461b-860f-f638d25c9351,network=Network(2fbf5ffb-0ec0-403b-bc92-259563ab1d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69059e55-c6')
Aug 01 21:42:42 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:42:42 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:42:42 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:42:42 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] No VIF found with MAC fa:16:3e:5e:53:9a, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:42:42 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Compute_service record updated for user:user {{(pid=72586) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 21:42:42 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.460s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:42:44 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:44 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:44 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:44 user nova-compute[72586]: DEBUG nova.compute.manager [req-1722479b-c890-4e72-bb20-12e07d48d7c7 req-4ecbeecd-06ab-45a3-8b08-89451fba1798 service nova] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Received event network-vif-plugged-69059e55-c62d-461b-860f-f638d25c9351 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:42:44 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-1722479b-c890-4e72-bb20-12e07d48d7c7 req-4ecbeecd-06ab-45a3-8b08-89451fba1798 service nova] Acquiring lock "f2f4343d-0cab-4ed6-972d-e2bd8a801e8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:42:44 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-1722479b-c890-4e72-bb20-12e07d48d7c7 req-4ecbeecd-06ab-45a3-8b08-89451fba1798 service nova] Lock "f2f4343d-0cab-4ed6-972d-e2bd8a801e8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:42:44 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-1722479b-c890-4e72-bb20-12e07d48d7c7 req-4ecbeecd-06ab-45a3-8b08-89451fba1798 service nova] Lock "f2f4343d-0cab-4ed6-972d-e2bd8a801e8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:42:44 user nova-compute[72586]: DEBUG nova.compute.manager [req-1722479b-c890-4e72-bb20-12e07d48d7c7 req-4ecbeecd-06ab-45a3-8b08-89451fba1798 service nova] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] No waiting events found dispatching network-vif-plugged-69059e55-c62d-461b-860f-f638d25c9351 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:42:44 user nova-compute[72586]: WARNING nova.compute.manager [req-1722479b-c890-4e72-bb20-12e07d48d7c7 req-4ecbeecd-06ab-45a3-8b08-89451fba1798 service nova] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Received unexpected event network-vif-plugged-69059e55-c62d-461b-860f-f638d25c9351 for instance with vm_state building and task_state spawning.
Aug 01 21:42:44 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:44 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:44 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:44 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:42:44 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Starting heal instance info cache {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 21:42:44 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "refresh_cache-11ab466b-8caa-4a38-8350-213aa17ee75e" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:42:44 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquired lock "refresh_cache-11ab466b-8caa-4a38-8350-213aa17ee75e" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:42:44 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Forcefully refreshing network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 21:42:44 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:45 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Updating instance_info_cache with network_info: [{"id": "d70607b2-8e0c-4166-8218-ecbc976d0369", "address": "fa:16:3e:76:af:74", "network": {"id": "63b6e8c7-fad0-44bf-a479-9baab6f0d1e3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2101151631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cbab7dfc55429c9b991bf1091a84c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd70607b2-8e", "ovs_interfaceid": "d70607b2-8e0c-4166-8218-ecbc976d0369", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:42:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Releasing lock "refresh_cache-11ab466b-8caa-4a38-8350-213aa17ee75e" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:42:45 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Updated the network info_cache for instance {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 21:42:45 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:42:46 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690926166.3186727, f2f4343d-0cab-4ed6-972d-e2bd8a801e8f => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:42:46 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] VM Resumed (Lifecycle Event)
Aug 01 21:42:46 user nova-compute[72586]: DEBUG nova.compute.manager [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Instance event wait completed in 0 seconds for  {{(pid=72586) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 21:42:46 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Guest created on hypervisor {{(pid=72586) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 21:42:46 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Instance spawned successfully.
Aug 01 21:42:46 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 21:42:46 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:42:46 user nova-compute[72586]: DEBUG nova.compute.manager [req-e214fa85-f861-418a-a2b0-1d5fa053b944 req-48a8a030-010f-49b3-bc1e-659c189d0b03 service nova] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Received event network-vif-plugged-69059e55-c62d-461b-860f-f638d25c9351 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:42:46 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-e214fa85-f861-418a-a2b0-1d5fa053b944 req-48a8a030-010f-49b3-bc1e-659c189d0b03 service nova] Acquiring lock "f2f4343d-0cab-4ed6-972d-e2bd8a801e8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:42:46 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-e214fa85-f861-418a-a2b0-1d5fa053b944 req-48a8a030-010f-49b3-bc1e-659c189d0b03 service nova] Lock "f2f4343d-0cab-4ed6-972d-e2bd8a801e8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:42:46 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-e214fa85-f861-418a-a2b0-1d5fa053b944 req-48a8a030-010f-49b3-bc1e-659c189d0b03 service nova] Lock "f2f4343d-0cab-4ed6-972d-e2bd8a801e8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:42:46 user nova-compute[72586]: DEBUG nova.compute.manager [req-e214fa85-f861-418a-a2b0-1d5fa053b944 req-48a8a030-010f-49b3-bc1e-659c189d0b03 service nova] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] No waiting events found dispatching network-vif-plugged-69059e55-c62d-461b-860f-f638d25c9351 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:42:46 user nova-compute[72586]: WARNING nova.compute.manager [req-e214fa85-f861-418a-a2b0-1d5fa053b944 req-48a8a030-010f-49b3-bc1e-659c189d0b03 service nova] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Received unexpected event network-vif-plugged-69059e55-c62d-461b-860f-f638d25c9351 for instance with vm_state building and task_state spawning.
Aug 01 21:42:46 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:42:46 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Found default for hw_cdrom_bus of ide {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:42:46 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Found default for hw_disk_bus of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:42:46 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Found default for hw_input_bus of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:42:46 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Found default for hw_pointer_model of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:42:46 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Found default for hw_video_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:42:46 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Found default for hw_vif_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:42:46 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:42:46 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690926166.3206897, f2f4343d-0cab-4ed6-972d-e2bd8a801e8f => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:42:46 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] VM Started (Lifecycle Event)
Aug 01 21:42:46 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:42:46 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:42:46 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:42:46 user nova-compute[72586]: INFO nova.compute.manager [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Took 5.20 seconds to spawn the instance on the hypervisor.
Aug 01 21:42:46 user nova-compute[72586]: DEBUG nova.compute.manager [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:42:46 user nova-compute[72586]: INFO nova.compute.manager [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Took 13.98 seconds to build instance.
Aug 01 21:42:46 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-40f1ced2-231d-4b19-8153-84e39be8aa2e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "f2f4343d-0cab-4ed6-972d-e2bd8a801e8f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.082s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:42:46 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:42:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:49 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:52 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:55 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:56 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-4381f49a-3959-4fb8-ba46-317f84dc96a5 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Acquiring lock "965244cc-71e5-43f9-8d22-62843bac3f52" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:42:56 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-4381f49a-3959-4fb8-ba46-317f84dc96a5 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "965244cc-71e5-43f9-8d22-62843bac3f52" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:42:56 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-4381f49a-3959-4fb8-ba46-317f84dc96a5 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Acquiring lock "965244cc-71e5-43f9-8d22-62843bac3f52-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:42:56 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-4381f49a-3959-4fb8-ba46-317f84dc96a5 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "965244cc-71e5-43f9-8d22-62843bac3f52-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:42:56 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-4381f49a-3959-4fb8-ba46-317f84dc96a5 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "965244cc-71e5-43f9-8d22-62843bac3f52-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:42:56 user nova-compute[72586]: INFO nova.compute.manager [None req-4381f49a-3959-4fb8-ba46-317f84dc96a5 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Terminating instance
Aug 01 21:42:56 user nova-compute[72586]: DEBUG nova.compute.manager [None req-4381f49a-3959-4fb8-ba46-317f84dc96a5 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Start destroying the instance on the hypervisor. {{(pid=72586) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 21:42:56 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:56 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:56 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:56 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:56 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:56 user nova-compute[72586]: DEBUG nova.compute.manager [req-7ce4d0a8-6a23-4d27-bfb5-24d99db9218f req-621e130d-e330-4369-a9cd-e7d9be4ca566 service nova] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Received event network-vif-unplugged-bf319273-ff82-45b9-8365-061755ed7b35 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:42:56 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-7ce4d0a8-6a23-4d27-bfb5-24d99db9218f req-621e130d-e330-4369-a9cd-e7d9be4ca566 service nova] Acquiring lock "965244cc-71e5-43f9-8d22-62843bac3f52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:42:56 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-7ce4d0a8-6a23-4d27-bfb5-24d99db9218f req-621e130d-e330-4369-a9cd-e7d9be4ca566 service nova] Lock "965244cc-71e5-43f9-8d22-62843bac3f52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:42:56 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-7ce4d0a8-6a23-4d27-bfb5-24d99db9218f req-621e130d-e330-4369-a9cd-e7d9be4ca566 service nova] Lock "965244cc-71e5-43f9-8d22-62843bac3f52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:42:56 user nova-compute[72586]: DEBUG nova.compute.manager [req-7ce4d0a8-6a23-4d27-bfb5-24d99db9218f req-621e130d-e330-4369-a9cd-e7d9be4ca566 service nova] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] No waiting events found dispatching network-vif-unplugged-bf319273-ff82-45b9-8365-061755ed7b35 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:42:56 user nova-compute[72586]: DEBUG nova.compute.manager [req-7ce4d0a8-6a23-4d27-bfb5-24d99db9218f req-621e130d-e330-4369-a9cd-e7d9be4ca566 service nova] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Received event network-vif-unplugged-bf319273-ff82-45b9-8365-061755ed7b35 for instance with task_state deleting. {{(pid=72586) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 21:42:57 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Instance destroyed successfully.
Aug 01 21:42:57 user nova-compute[72586]: DEBUG nova.objects.instance [None req-4381f49a-3959-4fb8-ba46-317f84dc96a5 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lazy-loading 'resources' on Instance uuid 965244cc-71e5-43f9-8d22-62843bac3f52 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:42:57 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-4381f49a-3959-4fb8-ba46-317f84dc96a5 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:37:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-103888368',display_name='tempest-TestMinimumBasicScenario-server-103888368',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-103888368',id=34,image_ref='0ab99c22-dd5c-42f9-b2d5-7be61771c605',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBdI9vS4xIEypRmtEbKNWWvQt8cCTtKirHSxaCIW1WH3QFF0GUP/pt1xfCy8JKvpqhKZIQ07Fe4YmMFFuV/eB7M40q94xaDzbsl2IN/zZfR9MH0p1FSPWcf1+VB6TwiUoQ==',key_name='tempest-TestMinimumBasicScenario-877343528',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:38:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f7ae5f1c56b348de8a03f1a4bcdd9b5c',ramdisk_id='',reservation_id='r-9nlc064p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0ab99c22-dd5c-42f9-b2d5-7be61771c605',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1119751084',owner_user_name='tempest-TestMinimumBasicScenario-1119751084-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:40:15Z,user_data=None,user_id='fed345b7cf8f44bfa83d45d408a18c4a',uuid=965244cc-71e5-43f9-8d22-62843bac3f52,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf319273-ff82-45b9-8365-061755ed7b35", "address": "fa:16:3e:02:f6:65", "network": {"id": "56c3419f-2c2c-4dda-88d7-ba96e2a689fd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-705071098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ae5f1c56b348de8a03f1a4bcdd9b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf319273-ff", "ovs_interfaceid": "bf319273-ff82-45b9-8365-061755ed7b35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:42:57 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-4381f49a-3959-4fb8-ba46-317f84dc96a5 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Converting VIF {"id": "bf319273-ff82-45b9-8365-061755ed7b35", "address": "fa:16:3e:02:f6:65", "network": {"id": "56c3419f-2c2c-4dda-88d7-ba96e2a689fd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-705071098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ae5f1c56b348de8a03f1a4bcdd9b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf319273-ff", "ovs_interfaceid": "bf319273-ff82-45b9-8365-061755ed7b35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:42:57 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-4381f49a-3959-4fb8-ba46-317f84dc96a5 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:02:f6:65,bridge_name='br-int',has_traffic_filtering=True,id=bf319273-ff82-45b9-8365-061755ed7b35,network=Network(56c3419f-2c2c-4dda-88d7-ba96e2a689fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf319273-ff') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:42:57 user nova-compute[72586]: DEBUG os_vif [None req-4381f49a-3959-4fb8-ba46-317f84dc96a5 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:f6:65,bridge_name='br-int',has_traffic_filtering=True,id=bf319273-ff82-45b9-8365-061755ed7b35,network=Network(56c3419f-2c2c-4dda-88d7-ba96e2a689fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf319273-ff') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:42:57 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:42:57 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbf319273-ff, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:42:57 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:42:57 user nova-compute[72586]: INFO os_vif [None req-4381f49a-3959-4fb8-ba46-317f84dc96a5 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:f6:65,bridge_name='br-int',has_traffic_filtering=True,id=bf319273-ff82-45b9-8365-061755ed7b35,network=Network(56c3419f-2c2c-4dda-88d7-ba96e2a689fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf319273-ff')
Aug 01 21:42:57 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-4381f49a-3959-4fb8-ba46-317f84dc96a5 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Deleting instance files /opt/stack/data/nova/instances/965244cc-71e5-43f9-8d22-62843bac3f52_del
Aug 01 21:42:57 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-4381f49a-3959-4fb8-ba46-317f84dc96a5 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Deletion of /opt/stack/data/nova/instances/965244cc-71e5-43f9-8d22-62843bac3f52_del complete
Aug 01 21:42:57 user nova-compute[72586]: INFO nova.compute.manager [None req-4381f49a-3959-4fb8-ba46-317f84dc96a5 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 01 21:42:57 user nova-compute[72586]: DEBUG oslo.service.loopingcall [None req-4381f49a-3959-4fb8-ba46-317f84dc96a5 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72586) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 21:42:57 user nova-compute[72586]: DEBUG nova.compute.manager [-] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Deallocating network for instance {{(pid=72586) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 21:42:57 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] deallocate_for_instance() {{(pid=72586) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 21:42:57 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:42:57 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Took 0.61 seconds to deallocate network for instance.
Aug 01 21:42:57 user nova-compute[72586]: DEBUG nova.compute.manager [req-b1b02d1d-68ef-4fc6-9353-a8516c0ccecc req-8f13c2b5-91b6-4eb2-a600-6d386389d21a service nova] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Received event network-vif-deleted-bf319273-ff82-45b9-8365-061755ed7b35 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:42:57 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-4381f49a-3959-4fb8-ba46-317f84dc96a5 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:42:57 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-4381f49a-3959-4fb8-ba46-317f84dc96a5 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:42:58 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-4381f49a-3959-4fb8-ba46-317f84dc96a5 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:42:58 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-4381f49a-3959-4fb8-ba46-317f84dc96a5 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:42:58 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-4381f49a-3959-4fb8-ba46-317f84dc96a5 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.295s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:42:58 user nova-compute[72586]: INFO nova.scheduler.client.report [None req-4381f49a-3959-4fb8-ba46-317f84dc96a5 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Deleted allocations for instance 965244cc-71e5-43f9-8d22-62843bac3f52
Aug 01 21:42:58 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-4381f49a-3959-4fb8-ba46-317f84dc96a5 tempest-TestMinimumBasicScenario-1119751084 tempest-TestMinimumBasicScenario-1119751084-project-member] Lock "965244cc-71e5-43f9-8d22-62843bac3f52" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.061s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:42:58 user nova-compute[72586]: DEBUG nova.compute.manager [req-d15ecd86-c5a5-4091-b5d6-b1b21a6ed060 req-519c87f2-dbb3-4b5c-8038-417f80295c92 service nova] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Received event network-vif-plugged-bf319273-ff82-45b9-8365-061755ed7b35 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:42:58 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d15ecd86-c5a5-4091-b5d6-b1b21a6ed060 req-519c87f2-dbb3-4b5c-8038-417f80295c92 service nova] Acquiring lock "965244cc-71e5-43f9-8d22-62843bac3f52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:42:58 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d15ecd86-c5a5-4091-b5d6-b1b21a6ed060 req-519c87f2-dbb3-4b5c-8038-417f80295c92 service nova] Lock "965244cc-71e5-43f9-8d22-62843bac3f52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:42:58 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d15ecd86-c5a5-4091-b5d6-b1b21a6ed060 req-519c87f2-dbb3-4b5c-8038-417f80295c92 service nova] Lock "965244cc-71e5-43f9-8d22-62843bac3f52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:42:58 user nova-compute[72586]: DEBUG nova.compute.manager [req-d15ecd86-c5a5-4091-b5d6-b1b21a6ed060 req-519c87f2-dbb3-4b5c-8038-417f80295c92 service nova] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] No waiting events found dispatching network-vif-plugged-bf319273-ff82-45b9-8365-061755ed7b35 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:42:58 user nova-compute[72586]: WARNING nova.compute.manager [req-d15ecd86-c5a5-4091-b5d6-b1b21a6ed060 req-519c87f2-dbb3-4b5c-8038-417f80295c92 service nova] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Received unexpected event network-vif-plugged-bf319273-ff82-45b9-8365-061755ed7b35 for instance with vm_state deleted and task_state None.
Aug 01 21:42:59 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:43:02 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:43:05 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:43:07 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:43:10 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:43:12 user nova-compute[72586]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690926177.1356716, 965244cc-71e5-43f9-8d22-62843bac3f52 => Stopped> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:43:12 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] VM Stopped (Lifecycle Event)
Aug 01 21:43:12 user nova-compute[72586]: DEBUG nova.compute.manager [None req-28270280-517d-4cc5-80f8-b5eb0d6ed312 None None] [instance: 965244cc-71e5-43f9-8d22-62843bac3f52] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:43:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:43:15 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:43:17 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:43:22 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:43:27 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:43:32 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:43:34 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:43:34 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:43:36 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:43:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:43:37 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:43:37 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:43:37 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72586) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 21:43:41 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:43:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:43:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:43:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:43:41 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Auditing locally available compute resources for user (node: user) {{(pid=72586) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 21:43:42 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:43:42 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:43:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ab466b-8caa-4a38-8350-213aa17ee75e/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:43:42 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:43:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ab466b-8caa-4a38-8350-213aa17ee75e/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:43:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ab466b-8caa-4a38-8350-213aa17ee75e/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:43:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ab466b-8caa-4a38-8350-213aa17ee75e/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:43:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:43:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:43:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:43:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:43:42 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:43:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b5b09f4-6973-4b0f-bb46-d6b720a87339/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:43:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b5b09f4-6973-4b0f-bb46-d6b720a87339/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:43:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b5b09f4-6973-4b0f-bb46-d6b720a87339/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:43:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b5b09f4-6973-4b0f-bb46-d6b720a87339/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:43:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee464b0-f75e-4f30-9838-74bca9619a07/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:43:43 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee464b0-f75e-4f30-9838-74bca9619a07/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:43:43 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee464b0-f75e-4f30-9838-74bca9619a07/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:43:43 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee464b0-f75e-4f30-9838-74bca9619a07/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:43:43 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63625685-227f-48cc-9cc0-594633e0b8bb/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:43:43 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63625685-227f-48cc-9cc0-594633e0b8bb/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:43:43 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63625685-227f-48cc-9cc0-594633e0b8bb/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:43:43 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63625685-227f-48cc-9cc0-594633e0b8bb/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:43:43 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:43:43 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:43:43 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Hypervisor/Node resource view: name=user free_ram=7783MB free_disk=25.00265121459961GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72586) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 21:43:43 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:43:43 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:43:44 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance af2de810-b22f-4fa9-835c-c673abd145db actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:43:44 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 161fab9d-a7d1-4ea0-b4b9-2afc54040eef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:43:44 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 11ab466b-8caa-4a38-8350-213aa17ee75e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:43:44 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 63625685-227f-48cc-9cc0-594633e0b8bb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:43:44 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 8ee464b0-f75e-4f30-9838-74bca9619a07 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:43:44 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 178d26d5-3570-442f-9268-21cd73cccfc7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:43:44 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 8b5b09f4-6973-4b0f-bb46-d6b720a87339 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:43:44 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance f2f4343d-0cab-4ed6-972d-e2bd8a801e8f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:43:44 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 21:43:44 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 21:43:44 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:43:44 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:43:44 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Compute_service record updated for user:user {{(pid=72586) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 21:43:44 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.416s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:43:46 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:43:46 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Starting heal instance info cache {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 21:43:46 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "refresh_cache-63625685-227f-48cc-9cc0-594633e0b8bb" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:43:46 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquired lock "refresh_cache-63625685-227f-48cc-9cc0-594633e0b8bb" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:43:46 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Forcefully refreshing network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 21:43:46 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Updating instance_info_cache with network_info: [{"id": "0508879f-0d7d-40ab-adcb-d51a6743fdf2", "address": "fa:16:3e:ac:c9:31", "network": {"id": "86940e5d-852b-48fc-9b0e-858305321349", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1967467603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d847d04360420c80ea5608d5a2b15a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0508879f-0d", "ovs_interfaceid": "0508879f-0d7d-40ab-adcb-d51a6743fdf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:43:46 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Releasing lock "refresh_cache-63625685-227f-48cc-9cc0-594633e0b8bb" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:43:46 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Updated the network info_cache for instance {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 21:43:46 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:43:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:43:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:43:47 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:43:47 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:43:49 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:43:52 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:43:53 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:43:57 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:44:02 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:44:07 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:44:08 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f4981cdf-28e4-42e3-a534-95dd44e9ad31 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Acquiring lock "11ab466b-8caa-4a38-8350-213aa17ee75e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:44:08 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f4981cdf-28e4-42e3-a534-95dd44e9ad31 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "11ab466b-8caa-4a38-8350-213aa17ee75e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:44:08 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f4981cdf-28e4-42e3-a534-95dd44e9ad31 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Acquiring lock "11ab466b-8caa-4a38-8350-213aa17ee75e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:44:08 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f4981cdf-28e4-42e3-a534-95dd44e9ad31 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "11ab466b-8caa-4a38-8350-213aa17ee75e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:44:08 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f4981cdf-28e4-42e3-a534-95dd44e9ad31 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "11ab466b-8caa-4a38-8350-213aa17ee75e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:44:08 user nova-compute[72586]: INFO nova.compute.manager [None req-f4981cdf-28e4-42e3-a534-95dd44e9ad31 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Terminating instance
Aug 01 21:44:08 user nova-compute[72586]: DEBUG nova.compute.manager [None req-f4981cdf-28e4-42e3-a534-95dd44e9ad31 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Start destroying the instance on the hypervisor. {{(pid=72586) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 21:44:08 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:44:08 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:44:08 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:44:08 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:44:08 user nova-compute[72586]: DEBUG nova.compute.manager [req-d7e85382-65a6-4bed-9afe-fbb3dc78a669 req-facf13ec-5412-4eff-9fca-c29edbfcf6e1 service nova] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Received event network-vif-unplugged-d70607b2-8e0c-4166-8218-ecbc976d0369 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:44:08 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d7e85382-65a6-4bed-9afe-fbb3dc78a669 req-facf13ec-5412-4eff-9fca-c29edbfcf6e1 service nova] Acquiring lock "11ab466b-8caa-4a38-8350-213aa17ee75e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:44:08 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d7e85382-65a6-4bed-9afe-fbb3dc78a669 req-facf13ec-5412-4eff-9fca-c29edbfcf6e1 service nova] Lock "11ab466b-8caa-4a38-8350-213aa17ee75e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:44:08 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-d7e85382-65a6-4bed-9afe-fbb3dc78a669 req-facf13ec-5412-4eff-9fca-c29edbfcf6e1 service nova] Lock "11ab466b-8caa-4a38-8350-213aa17ee75e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:44:08 user nova-compute[72586]: DEBUG nova.compute.manager [req-d7e85382-65a6-4bed-9afe-fbb3dc78a669 req-facf13ec-5412-4eff-9fca-c29edbfcf6e1 service nova] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] No waiting events found dispatching network-vif-unplugged-d70607b2-8e0c-4166-8218-ecbc976d0369 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:44:08 user nova-compute[72586]: DEBUG nova.compute.manager [req-d7e85382-65a6-4bed-9afe-fbb3dc78a669 req-facf13ec-5412-4eff-9fca-c29edbfcf6e1 service nova] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Received event network-vif-unplugged-d70607b2-8e0c-4166-8218-ecbc976d0369 for instance with task_state deleting. {{(pid=72586) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 21:44:09 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:44:09 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Instance destroyed successfully.
Aug 01 21:44:09 user nova-compute[72586]: DEBUG nova.objects.instance [None req-f4981cdf-28e4-42e3-a534-95dd44e9ad31 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lazy-loading 'resources' on Instance uuid 11ab466b-8caa-4a38-8350-213aa17ee75e {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:44:09 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:44:09 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:44:09 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-f4981cdf-28e4-42e3-a534-95dd44e9ad31 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:34:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2094185911',display_name='tempest-AttachVolumeTestJSON-server-2094185911',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2094185911',id=31,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8bY2a+j0kMVaPrfl1MtLxUCVEzM0sy04URPhEHt1a9A1Fyz7ckW9BOF4xfEN78B/F9+N05Diy+kKgMUVPp6Ls9nXPam6BDkRvokPK0ly7jy5lxY/agzzRa/NAHpQoc4w==',key_name='tempest-keypair-809503431',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:34:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='99cbab7dfc55429c9b991bf1091a84c7',ramdisk_id='',reservation_id='r-mw52zjwf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1420576365',owner_user_name='tempest-AttachVolumeTestJSON-1420576365-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:42:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='50893dc844b44f498e1545aeee794742',uuid=11ab466b-8caa-4a38-8350-213aa17ee75e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d70607b2-8e0c-4166-8218-ecbc976d0369", "address": "fa:16:3e:76:af:74", "network": {"id": "63b6e8c7-fad0-44bf-a479-9baab6f0d1e3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2101151631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cbab7dfc55429c9b991bf1091a84c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd70607b2-8e", "ovs_interfaceid": "d70607b2-8e0c-4166-8218-ecbc976d0369", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:44:09 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-f4981cdf-28e4-42e3-a534-95dd44e9ad31 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Converting VIF {"id": "d70607b2-8e0c-4166-8218-ecbc976d0369", "address": "fa:16:3e:76:af:74", "network": {"id": "63b6e8c7-fad0-44bf-a479-9baab6f0d1e3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2101151631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cbab7dfc55429c9b991bf1091a84c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd70607b2-8e", "ovs_interfaceid": "d70607b2-8e0c-4166-8218-ecbc976d0369", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:44:09 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-f4981cdf-28e4-42e3-a534-95dd44e9ad31 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:af:74,bridge_name='br-int',has_traffic_filtering=True,id=d70607b2-8e0c-4166-8218-ecbc976d0369,network=Network(63b6e8c7-fad0-44bf-a479-9baab6f0d1e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd70607b2-8e') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:44:09 user nova-compute[72586]: DEBUG os_vif [None req-f4981cdf-28e4-42e3-a534-95dd44e9ad31 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:af:74,bridge_name='br-int',has_traffic_filtering=True,id=d70607b2-8e0c-4166-8218-ecbc976d0369,network=Network(63b6e8c7-fad0-44bf-a479-9baab6f0d1e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd70607b2-8e') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:44:09 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:44:09 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd70607b2-8e, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:44:09 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:44:09 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:44:09 user nova-compute[72586]: INFO os_vif [None req-f4981cdf-28e4-42e3-a534-95dd44e9ad31 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:af:74,bridge_name='br-int',has_traffic_filtering=True,id=d70607b2-8e0c-4166-8218-ecbc976d0369,network=Network(63b6e8c7-fad0-44bf-a479-9baab6f0d1e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd70607b2-8e')
Aug 01 21:44:09 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-f4981cdf-28e4-42e3-a534-95dd44e9ad31 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Deleting instance files /opt/stack/data/nova/instances/11ab466b-8caa-4a38-8350-213aa17ee75e_del
Aug 01 21:44:09 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-f4981cdf-28e4-42e3-a534-95dd44e9ad31 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Deletion of /opt/stack/data/nova/instances/11ab466b-8caa-4a38-8350-213aa17ee75e_del complete
Aug 01 21:44:09 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:44:09 user nova-compute[72586]: INFO nova.compute.manager [None req-f4981cdf-28e4-42e3-a534-95dd44e9ad31 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 01 21:44:09 user nova-compute[72586]: DEBUG oslo.service.loopingcall [None req-f4981cdf-28e4-42e3-a534-95dd44e9ad31 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72586) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 21:44:09 user nova-compute[72586]: DEBUG nova.compute.manager [-] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Deallocating network for instance {{(pid=72586) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 21:44:09 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] deallocate_for_instance() {{(pid=72586) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 21:44:09 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:44:09 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:44:09 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:44:09 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:44:10 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:44:10 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:44:10 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:44:10 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Took 1.01 seconds to deallocate network for instance.
Aug 01 21:44:10 user nova-compute[72586]: DEBUG nova.compute.manager [req-f57020a6-24f1-4ec0-ab17-c17f7a9d11e6 req-1ee8edd8-199e-4c94-8f95-ea7ee77c7acb service nova] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Received event network-vif-deleted-d70607b2-8e0c-4166-8218-ecbc976d0369 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:44:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f4981cdf-28e4-42e3-a534-95dd44e9ad31 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:44:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f4981cdf-28e4-42e3-a534-95dd44e9ad31 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:44:10 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-f4981cdf-28e4-42e3-a534-95dd44e9ad31 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:44:10 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-f4981cdf-28e4-42e3-a534-95dd44e9ad31 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:44:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f4981cdf-28e4-42e3-a534-95dd44e9ad31 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.283s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:44:10 user nova-compute[72586]: INFO nova.scheduler.client.report [None req-f4981cdf-28e4-42e3-a534-95dd44e9ad31 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Deleted allocations for instance 11ab466b-8caa-4a38-8350-213aa17ee75e
Aug 01 21:44:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f4981cdf-28e4-42e3-a534-95dd44e9ad31 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "11ab466b-8caa-4a38-8350-213aa17ee75e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.364s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:44:10 user nova-compute[72586]: DEBUG nova.compute.manager [req-2806f071-f814-46d9-80a3-f95e32174cfc req-55e5009d-9213-4cdc-89f4-a91962e200fb service nova] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Received event network-vif-plugged-d70607b2-8e0c-4166-8218-ecbc976d0369 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:44:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-2806f071-f814-46d9-80a3-f95e32174cfc req-55e5009d-9213-4cdc-89f4-a91962e200fb service nova] Acquiring lock "11ab466b-8caa-4a38-8350-213aa17ee75e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:44:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-2806f071-f814-46d9-80a3-f95e32174cfc req-55e5009d-9213-4cdc-89f4-a91962e200fb service nova] Lock "11ab466b-8caa-4a38-8350-213aa17ee75e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:44:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-2806f071-f814-46d9-80a3-f95e32174cfc req-55e5009d-9213-4cdc-89f4-a91962e200fb service nova] Lock "11ab466b-8caa-4a38-8350-213aa17ee75e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:44:10 user nova-compute[72586]: DEBUG nova.compute.manager [req-2806f071-f814-46d9-80a3-f95e32174cfc req-55e5009d-9213-4cdc-89f4-a91962e200fb service nova] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] No waiting events found dispatching network-vif-plugged-d70607b2-8e0c-4166-8218-ecbc976d0369 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:44:10 user nova-compute[72586]: WARNING nova.compute.manager [req-2806f071-f814-46d9-80a3-f95e32174cfc req-55e5009d-9213-4cdc-89f4-a91962e200fb service nova] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Received unexpected event network-vif-plugged-d70607b2-8e0c-4166-8218-ecbc976d0369 for instance with vm_state deleted and task_state None.
Aug 01 21:44:10 user nova-compute[72586]: DEBUG nova.compute.manager [req-2806f071-f814-46d9-80a3-f95e32174cfc req-55e5009d-9213-4cdc-89f4-a91962e200fb service nova] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Received event network-vif-plugged-d70607b2-8e0c-4166-8218-ecbc976d0369 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:44:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-2806f071-f814-46d9-80a3-f95e32174cfc req-55e5009d-9213-4cdc-89f4-a91962e200fb service nova] Acquiring lock "11ab466b-8caa-4a38-8350-213aa17ee75e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:44:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-2806f071-f814-46d9-80a3-f95e32174cfc req-55e5009d-9213-4cdc-89f4-a91962e200fb service nova] Lock "11ab466b-8caa-4a38-8350-213aa17ee75e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:44:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-2806f071-f814-46d9-80a3-f95e32174cfc req-55e5009d-9213-4cdc-89f4-a91962e200fb service nova] Lock "11ab466b-8caa-4a38-8350-213aa17ee75e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:44:10 user nova-compute[72586]: DEBUG nova.compute.manager [req-2806f071-f814-46d9-80a3-f95e32174cfc req-55e5009d-9213-4cdc-89f4-a91962e200fb service nova] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] No waiting events found dispatching network-vif-plugged-d70607b2-8e0c-4166-8218-ecbc976d0369 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:44:10 user nova-compute[72586]: WARNING nova.compute.manager [req-2806f071-f814-46d9-80a3-f95e32174cfc req-55e5009d-9213-4cdc-89f4-a91962e200fb service nova] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Received unexpected event network-vif-plugged-d70607b2-8e0c-4166-8218-ecbc976d0369 for instance with vm_state deleted and task_state None.
Aug 01 21:44:10 user nova-compute[72586]: DEBUG nova.compute.manager [req-2806f071-f814-46d9-80a3-f95e32174cfc req-55e5009d-9213-4cdc-89f4-a91962e200fb service nova] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Received event network-vif-plugged-d70607b2-8e0c-4166-8218-ecbc976d0369 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:44:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-2806f071-f814-46d9-80a3-f95e32174cfc req-55e5009d-9213-4cdc-89f4-a91962e200fb service nova] Acquiring lock "11ab466b-8caa-4a38-8350-213aa17ee75e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:44:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-2806f071-f814-46d9-80a3-f95e32174cfc req-55e5009d-9213-4cdc-89f4-a91962e200fb service nova] Lock "11ab466b-8caa-4a38-8350-213aa17ee75e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:44:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-2806f071-f814-46d9-80a3-f95e32174cfc req-55e5009d-9213-4cdc-89f4-a91962e200fb service nova] Lock "11ab466b-8caa-4a38-8350-213aa17ee75e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:44:10 user nova-compute[72586]: DEBUG nova.compute.manager [req-2806f071-f814-46d9-80a3-f95e32174cfc req-55e5009d-9213-4cdc-89f4-a91962e200fb service nova] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] No waiting events found dispatching network-vif-plugged-d70607b2-8e0c-4166-8218-ecbc976d0369 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:44:10 user nova-compute[72586]: WARNING nova.compute.manager [req-2806f071-f814-46d9-80a3-f95e32174cfc req-55e5009d-9213-4cdc-89f4-a91962e200fb service nova] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Received unexpected event network-vif-plugged-d70607b2-8e0c-4166-8218-ecbc976d0369 for instance with vm_state deleted and task_state None.
Aug 01 21:44:10 user nova-compute[72586]: DEBUG nova.compute.manager [req-2806f071-f814-46d9-80a3-f95e32174cfc req-55e5009d-9213-4cdc-89f4-a91962e200fb service nova] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Received event network-vif-unplugged-d70607b2-8e0c-4166-8218-ecbc976d0369 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:44:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-2806f071-f814-46d9-80a3-f95e32174cfc req-55e5009d-9213-4cdc-89f4-a91962e200fb service nova] Acquiring lock "11ab466b-8caa-4a38-8350-213aa17ee75e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:44:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-2806f071-f814-46d9-80a3-f95e32174cfc req-55e5009d-9213-4cdc-89f4-a91962e200fb service nova] Lock "11ab466b-8caa-4a38-8350-213aa17ee75e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:44:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-2806f071-f814-46d9-80a3-f95e32174cfc req-55e5009d-9213-4cdc-89f4-a91962e200fb service nova] Lock "11ab466b-8caa-4a38-8350-213aa17ee75e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:44:10 user nova-compute[72586]: DEBUG nova.compute.manager [req-2806f071-f814-46d9-80a3-f95e32174cfc req-55e5009d-9213-4cdc-89f4-a91962e200fb service nova] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] No waiting events found dispatching network-vif-unplugged-d70607b2-8e0c-4166-8218-ecbc976d0369 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:44:10 user nova-compute[72586]: WARNING nova.compute.manager [req-2806f071-f814-46d9-80a3-f95e32174cfc req-55e5009d-9213-4cdc-89f4-a91962e200fb service nova] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Received unexpected event network-vif-unplugged-d70607b2-8e0c-4166-8218-ecbc976d0369 for instance with vm_state deleted and task_state None.
Aug 01 21:44:10 user nova-compute[72586]: DEBUG nova.compute.manager [req-2806f071-f814-46d9-80a3-f95e32174cfc req-55e5009d-9213-4cdc-89f4-a91962e200fb service nova] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Received event network-vif-plugged-d70607b2-8e0c-4166-8218-ecbc976d0369 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:44:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-2806f071-f814-46d9-80a3-f95e32174cfc req-55e5009d-9213-4cdc-89f4-a91962e200fb service nova] Acquiring lock "11ab466b-8caa-4a38-8350-213aa17ee75e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:44:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-2806f071-f814-46d9-80a3-f95e32174cfc req-55e5009d-9213-4cdc-89f4-a91962e200fb service nova] Lock "11ab466b-8caa-4a38-8350-213aa17ee75e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:44:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-2806f071-f814-46d9-80a3-f95e32174cfc req-55e5009d-9213-4cdc-89f4-a91962e200fb service nova] Lock "11ab466b-8caa-4a38-8350-213aa17ee75e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:44:10 user nova-compute[72586]: DEBUG nova.compute.manager [req-2806f071-f814-46d9-80a3-f95e32174cfc req-55e5009d-9213-4cdc-89f4-a91962e200fb service nova] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] No waiting events found dispatching network-vif-plugged-d70607b2-8e0c-4166-8218-ecbc976d0369 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:44:10 user nova-compute[72586]: WARNING nova.compute.manager [req-2806f071-f814-46d9-80a3-f95e32174cfc req-55e5009d-9213-4cdc-89f4-a91962e200fb service nova] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Received unexpected event network-vif-plugged-d70607b2-8e0c-4166-8218-ecbc976d0369 for instance with vm_state deleted and task_state None.
Aug 01 21:44:13 user nova-compute[72586]: DEBUG nova.compute.manager [req-6e16ce1f-f771-4717-9bae-970bc35ebbbf req-1b02bcd5-e551-4183-92e2-82c28a603f3b service nova] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Received event network-changed-9b2bbf44-3450-4de2-bb25-adefa62c1755 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:44:13 user nova-compute[72586]: DEBUG nova.compute.manager [req-6e16ce1f-f771-4717-9bae-970bc35ebbbf req-1b02bcd5-e551-4183-92e2-82c28a603f3b service nova] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Refreshing instance network info cache due to event network-changed-9b2bbf44-3450-4de2-bb25-adefa62c1755. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:44:13 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-6e16ce1f-f771-4717-9bae-970bc35ebbbf req-1b02bcd5-e551-4183-92e2-82c28a603f3b service nova] Acquiring lock "refresh_cache-8b5b09f4-6973-4b0f-bb46-d6b720a87339" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:44:13 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-6e16ce1f-f771-4717-9bae-970bc35ebbbf req-1b02bcd5-e551-4183-92e2-82c28a603f3b service nova] Acquired lock "refresh_cache-8b5b09f4-6973-4b0f-bb46-d6b720a87339" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:44:13 user nova-compute[72586]: DEBUG nova.network.neutron [req-6e16ce1f-f771-4717-9bae-970bc35ebbbf req-1b02bcd5-e551-4183-92e2-82c28a603f3b service nova] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Refreshing network info cache for port 9b2bbf44-3450-4de2-bb25-adefa62c1755 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:44:13 user nova-compute[72586]: DEBUG nova.network.neutron [req-6e16ce1f-f771-4717-9bae-970bc35ebbbf req-1b02bcd5-e551-4183-92e2-82c28a603f3b service nova] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Updated VIF entry in instance network info cache for port 9b2bbf44-3450-4de2-bb25-adefa62c1755. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:44:13 user nova-compute[72586]: DEBUG nova.network.neutron [req-6e16ce1f-f771-4717-9bae-970bc35ebbbf req-1b02bcd5-e551-4183-92e2-82c28a603f3b service nova] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Updating instance_info_cache with network_info: [{"id": "9b2bbf44-3450-4de2-bb25-adefa62c1755", "address": "fa:16:3e:92:8b:1a", "network": {"id": "ca864e90-8fc3-454d-af99-93600911d16c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1236727659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "561de31d533d492782ef0545e2c69adb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b2bbf44-34", "ovs_interfaceid": "9b2bbf44-3450-4de2-bb25-adefa62c1755", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:44:13 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-6e16ce1f-f771-4717-9bae-970bc35ebbbf req-1b02bcd5-e551-4183-92e2-82c28a603f3b service nova] Releasing lock "refresh_cache-8b5b09f4-6973-4b0f-bb46-d6b720a87339" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:44:14 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:44:14 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b3c4e88b-df0e-42b0-a145-bbe340498c54 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Acquiring lock "178d26d5-3570-442f-9268-21cd73cccfc7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:44:14 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b3c4e88b-df0e-42b0-a145-bbe340498c54 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "178d26d5-3570-442f-9268-21cd73cccfc7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:44:14 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b3c4e88b-df0e-42b0-a145-bbe340498c54 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Acquiring lock "178d26d5-3570-442f-9268-21cd73cccfc7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:44:14 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b3c4e88b-df0e-42b0-a145-bbe340498c54 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "178d26d5-3570-442f-9268-21cd73cccfc7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:44:14 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b3c4e88b-df0e-42b0-a145-bbe340498c54 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "178d26d5-3570-442f-9268-21cd73cccfc7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:44:14 user nova-compute[72586]: INFO nova.compute.manager [None req-b3c4e88b-df0e-42b0-a145-bbe340498c54 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Terminating instance
Aug 01 21:44:14 user nova-compute[72586]: DEBUG nova.compute.manager [None req-b3c4e88b-df0e-42b0-a145-bbe340498c54 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Start destroying the instance on the hypervisor. {{(pid=72586) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 21:44:14 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:44:14 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:44:14 user nova-compute[72586]: DEBUG nova.compute.manager [req-25dd3543-eff9-4380-90f2-22d5c8b32b6a req-76a63284-43ba-4023-a791-43e78e688f31 service nova] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Received event network-vif-unplugged-9bddd744-887b-44bf-aacf-d7606c470f70 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:44:14 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-25dd3543-eff9-4380-90f2-22d5c8b32b6a req-76a63284-43ba-4023-a791-43e78e688f31 service nova] Acquiring lock "178d26d5-3570-442f-9268-21cd73cccfc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:44:14 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-25dd3543-eff9-4380-90f2-22d5c8b32b6a req-76a63284-43ba-4023-a791-43e78e688f31 service nova] Lock "178d26d5-3570-442f-9268-21cd73cccfc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:44:14 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-25dd3543-eff9-4380-90f2-22d5c8b32b6a req-76a63284-43ba-4023-a791-43e78e688f31 service nova] Lock "178d26d5-3570-442f-9268-21cd73cccfc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:44:14 user nova-compute[72586]: DEBUG nova.compute.manager [req-25dd3543-eff9-4380-90f2-22d5c8b32b6a req-76a63284-43ba-4023-a791-43e78e688f31 service nova] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] No waiting events found dispatching network-vif-unplugged-9bddd744-887b-44bf-aacf-d7606c470f70 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:44:14 user nova-compute[72586]: DEBUG nova.compute.manager [req-25dd3543-eff9-4380-90f2-22d5c8b32b6a req-76a63284-43ba-4023-a791-43e78e688f31 service nova] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Received event network-vif-unplugged-9bddd744-887b-44bf-aacf-d7606c470f70 for instance with task_state deleting. {{(pid=72586) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 21:44:14 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:44:14 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:44:15 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:44:15 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Instance destroyed successfully.
Aug 01 21:44:15 user nova-compute[72586]: DEBUG nova.objects.instance [None req-b3c4e88b-df0e-42b0-a145-bbe340498c54 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lazy-loading 'resources' on Instance uuid 178d26d5-3570-442f-9268-21cd73cccfc7 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:44:15 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-b3c4e88b-df0e-42b0-a145-bbe340498c54 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:38:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1421463273',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1421463273',id=35,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:40:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88d847d04360420c80ea5608d5a2b15a',ramdisk_id='',reservation_id='r-emch0wow',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1268085586',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:42:31Z,user_data=None,user_id='a984642731b9413c97038f65052ab92d',uuid=178d26d5-3570-442f-9268-21cd73cccfc7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9bddd744-887b-44bf-aacf-d7606c470f70", "address": "fa:16:3e:50:53:8c", "network": {"id": "86940e5d-852b-48fc-9b0e-858305321349", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1967467603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d847d04360420c80ea5608d5a2b15a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bddd744-88", "ovs_interfaceid": "9bddd744-887b-44bf-aacf-d7606c470f70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:44:15 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-b3c4e88b-df0e-42b0-a145-bbe340498c54 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Converting VIF {"id": "9bddd744-887b-44bf-aacf-d7606c470f70", "address": "fa:16:3e:50:53:8c", "network": {"id": "86940e5d-852b-48fc-9b0e-858305321349", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1967467603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d847d04360420c80ea5608d5a2b15a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bddd744-88", "ovs_interfaceid": "9bddd744-887b-44bf-aacf-d7606c470f70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:44:15 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-b3c4e88b-df0e-42b0-a145-bbe340498c54 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:50:53:8c,bridge_name='br-int',has_traffic_filtering=True,id=9bddd744-887b-44bf-aacf-d7606c470f70,network=Network(86940e5d-852b-48fc-9b0e-858305321349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bddd744-88') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:44:15 user nova-compute[72586]: DEBUG os_vif [None req-b3c4e88b-df0e-42b0-a145-bbe340498c54 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:53:8c,bridge_name='br-int',has_traffic_filtering=True,id=9bddd744-887b-44bf-aacf-d7606c470f70,network=Network(86940e5d-852b-48fc-9b0e-858305321349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bddd744-88') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:44:15 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:44:15 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9bddd744-88, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:44:15 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:44:15 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:44:15 user nova-compute[72586]: INFO os_vif [None req-b3c4e88b-df0e-42b0-a145-bbe340498c54 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:53:8c,bridge_name='br-int',has_traffic_filtering=True,id=9bddd744-887b-44bf-aacf-d7606c470f70,network=Network(86940e5d-852b-48fc-9b0e-858305321349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bddd744-88')
Aug 01 21:44:15 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3c4e88b-df0e-42b0-a145-bbe340498c54 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] calling os-brick to detach iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 21:44:15 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3c4e88b-df0e-42b0-a145-bbe340498c54 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, {'target_iqns': ['iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Dfqvdwst', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:44:15 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-b3c4e88b-df0e-42b0-a145-bbe340498c54 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:44:15 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-b3c4e88b-df0e-42b0-a145-bbe340498c54 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:44:15 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-b3c4e88b-df0e-42b0-a145-bbe340498c54 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:44:15 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3c4e88b-df0e-42b0-a145-bbe340498c54 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec', 0)] {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 21:44:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:44:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:44:15 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d90de5-f0f4-49be-9264-9cc7d5fc6ae7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:44:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:44:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:44:15 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e7c781-72fc-454e-870b-e782ef912f79]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:44:15 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3c4e88b-df0e-42b0-a145-bbe340498c54 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:44:15 user nova-compute[72586]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec (non-flash)
Aug 01 21:44:15 user nova-compute[72586]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1 (non-flash)
Aug 01 21:44:15 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:44:15 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3c4e88b-df0e-42b0-a145-bbe340498c54 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:44:15 user nova-compute[72586]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec (non-flash)
Aug 01 21:44:15 user nova-compute[72586]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1 (non-flash)
Aug 01 21:44:15 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:44:15 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3c4e88b-df0e-42b0-a145-bbe340498c54 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ed03d27a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec'): ({'sdd'}, set())}) {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 21:44:15 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-b3c4e88b-df0e-42b0-a145-bbe340498c54 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Removing single pathed devices sdd {{(pid=72586) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 21:44:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:44:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.038s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:44:15 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[224370ef-e78e-42ec-abd0-be0cdc08423c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:44:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:44:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:44:15 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be5d974-40ae-4f12-b352-7b62270d39ab]: (4, ('ok\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:44:15 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-b3c4e88b-df0e-42b0-a145-bbe340498c54 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Flushing IO for device /dev/sdd {{(pid=72586) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 21:44:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:44:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.025s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:44:15 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5279c33-8a7a-4252-8b9c-c27adb815399]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:44:15 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-b3c4e88b-df0e-42b0-a145-bbe340498c54 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72586) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 21:44:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:44:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:44:15 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f12ea3-d434-4182-a7b4-f8c439649665]: (4, ('1', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:44:15 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-b3c4e88b-df0e-42b0-a145-bbe340498c54 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 21:44:15 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-b3c4e88b-df0e-42b0-a145-bbe340498c54 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] SCSI volumes sdd have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 21:44:15 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3c4e88b-df0e-42b0-a145-bbe340498c54 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec')] {{(pid=72586) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 21:44:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:44:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:44:15 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f317d5-4fb7-45d1-918e-d0dccb43ea68]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:44:15 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3c4e88b-df0e-42b0-a145-bbe340498c54 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:44:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec -p 172.16.0.220:3260 --logout {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:44:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:44:15 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f158d49-5204-47ad-8a21-e90e6d56d8f6]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:44:15 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3c4e88b-df0e-42b0-a145-bbe340498c54 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec, portal: 172.16.0.220,3260]
Aug 01 21:44:15 user nova-compute[72586]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec, portal: 172.16.0.220,3260] successful.
Aug 01 21:44:15 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:44:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec -p 172.16.0.220:3260 --op delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:44:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b89d79f8-7470-41bf-80e3-b41c398493ec -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:44:15 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d3ad39-0aba-4f56-82ae-34931b449554]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:44:15 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3c4e88b-df0e-42b0-a145-bbe340498c54 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:44:15 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-b3c4e88b-df0e-42b0-a145-bbe340498c54 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:44:15 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3c4e88b-df0e-42b0-a145-bbe340498c54 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] <== disconnect_volume: return (309ms) None {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:44:15 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3c4e88b-df0e-42b0-a145-bbe340498c54 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Disconnected iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 21:44:15 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-b3c4e88b-df0e-42b0-a145-bbe340498c54 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Deleting instance files /opt/stack/data/nova/instances/178d26d5-3570-442f-9268-21cd73cccfc7_del
Aug 01 21:44:15 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-b3c4e88b-df0e-42b0-a145-bbe340498c54 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Deletion of /opt/stack/data/nova/instances/178d26d5-3570-442f-9268-21cd73cccfc7_del complete
Aug 01 21:44:15 user nova-compute[72586]: INFO nova.compute.manager [None req-b3c4e88b-df0e-42b0-a145-bbe340498c54 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Took 1.23 seconds to destroy the instance on the hypervisor.
Aug 01 21:44:15 user nova-compute[72586]: DEBUG oslo.service.loopingcall [None req-b3c4e88b-df0e-42b0-a145-bbe340498c54 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72586) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 21:44:15 user nova-compute[72586]: DEBUG nova.compute.manager [-] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Deallocating network for instance {{(pid=72586) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 21:44:15 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] deallocate_for_instance() {{(pid=72586) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 21:44:16 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:44:16 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Took 0.68 seconds to deallocate network for instance.
Aug 01 21:44:16 user nova-compute[72586]: DEBUG nova.compute.manager [req-8238a8cc-247e-4aa5-848e-bc595e567fae req-85627896-62a2-4d57-a9e9-8e330db1d817 service nova] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Received event network-vif-deleted-9bddd744-887b-44bf-aacf-d7606c470f70 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:44:16 user nova-compute[72586]: INFO nova.compute.manager [req-8238a8cc-247e-4aa5-848e-bc595e567fae req-85627896-62a2-4d57-a9e9-8e330db1d817 service nova] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Neutron deleted interface 9bddd744-887b-44bf-aacf-d7606c470f70; detaching it from the instance and deleting it from the info cache
Aug 01 21:44:16 user nova-compute[72586]: DEBUG nova.network.neutron [req-8238a8cc-247e-4aa5-848e-bc595e567fae req-85627896-62a2-4d57-a9e9-8e330db1d817 service nova] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:44:16 user nova-compute[72586]: DEBUG nova.compute.manager [req-8238a8cc-247e-4aa5-848e-bc595e567fae req-85627896-62a2-4d57-a9e9-8e330db1d817 service nova] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Detach interface failed, port_id=9bddd744-887b-44bf-aacf-d7606c470f70, reason: Instance 178d26d5-3570-442f-9268-21cd73cccfc7 could not be found. {{(pid=72586) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 21:44:16 user nova-compute[72586]: DEBUG nova.compute.manager [req-401ae696-f50f-4956-b92f-35f894eb6f24 req-2e6709c3-b3fa-4be4-a102-e48869d49f71 service nova] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Received event network-vif-plugged-9bddd744-887b-44bf-aacf-d7606c470f70 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:44:16 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-401ae696-f50f-4956-b92f-35f894eb6f24 req-2e6709c3-b3fa-4be4-a102-e48869d49f71 service nova] Acquiring lock "178d26d5-3570-442f-9268-21cd73cccfc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:44:16 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-401ae696-f50f-4956-b92f-35f894eb6f24 req-2e6709c3-b3fa-4be4-a102-e48869d49f71 service nova] Lock "178d26d5-3570-442f-9268-21cd73cccfc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:44:16 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-401ae696-f50f-4956-b92f-35f894eb6f24 req-2e6709c3-b3fa-4be4-a102-e48869d49f71 service nova] Lock "178d26d5-3570-442f-9268-21cd73cccfc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:44:16 user nova-compute[72586]: DEBUG nova.compute.manager [req-401ae696-f50f-4956-b92f-35f894eb6f24 req-2e6709c3-b3fa-4be4-a102-e48869d49f71 service nova] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] No waiting events found dispatching network-vif-plugged-9bddd744-887b-44bf-aacf-d7606c470f70 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:44:16 user nova-compute[72586]: WARNING nova.compute.manager [req-401ae696-f50f-4956-b92f-35f894eb6f24 req-2e6709c3-b3fa-4be4-a102-e48869d49f71 service nova] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Received unexpected event network-vif-plugged-9bddd744-887b-44bf-aacf-d7606c470f70 for instance with vm_state active and task_state deleting.
Aug 01 21:44:17 user nova-compute[72586]: INFO nova.compute.manager [None req-b3c4e88b-df0e-42b0-a145-bbe340498c54 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Took 0.83 seconds to detach 1 volumes for instance.
Aug 01 21:44:17 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b3c4e88b-df0e-42b0-a145-bbe340498c54 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:44:17 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b3c4e88b-df0e-42b0-a145-bbe340498c54 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:44:17 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c0798d2d-e20b-41b8-971d-649f15469657 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Acquiring lock "8b5b09f4-6973-4b0f-bb46-d6b720a87339" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:44:17 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c0798d2d-e20b-41b8-971d-649f15469657 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Lock "8b5b09f4-6973-4b0f-bb46-d6b720a87339" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:44:17 user nova-compute[72586]: DEBUG nova.objects.instance [None req-c0798d2d-e20b-41b8-971d-649f15469657 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Lazy-loading 'flavor' on Instance uuid 8b5b09f4-6973-4b0f-bb46-d6b720a87339 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:44:17 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c0798d2d-e20b-41b8-971d-649f15469657 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Lock "8b5b09f4-6973-4b0f-bb46-d6b720a87339" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:44:17 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-b3c4e88b-df0e-42b0-a145-bbe340498c54 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:44:17 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-b3c4e88b-df0e-42b0-a145-bbe340498c54 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:44:17 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b3c4e88b-df0e-42b0-a145-bbe340498c54 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.269s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:44:17 user nova-compute[72586]: INFO nova.scheduler.client.report [None req-b3c4e88b-df0e-42b0-a145-bbe340498c54 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Deleted allocations for instance 178d26d5-3570-442f-9268-21cd73cccfc7
Aug 01 21:44:17 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c0798d2d-e20b-41b8-971d-649f15469657 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Acquiring lock "8b5b09f4-6973-4b0f-bb46-d6b720a87339" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:44:17 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c0798d2d-e20b-41b8-971d-649f15469657 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Lock "8b5b09f4-6973-4b0f-bb46-d6b720a87339" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:44:17 user nova-compute[72586]: INFO nova.compute.manager [None req-c0798d2d-e20b-41b8-971d-649f15469657 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Attaching volume 0609c464-00cd-43c5-bd05-c6e0c9449f29 to /dev/vdb
Aug 01 21:44:17 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b3c4e88b-df0e-42b0-a145-bbe340498c54 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "178d26d5-3570-442f-9268-21cd73cccfc7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.191s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:44:17 user nova-compute[72586]: DEBUG os_brick.utils [None req-c0798d2d-e20b-41b8-971d-649f15469657 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:44:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:44:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:44:17 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb10f23e-568c-4e18-82b6-e6cf534198ef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4bc202fb9cb\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:44:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:44:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:44:17 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[575e53c4-4003-4bb4-8f07-bbc0faea022b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:44:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:44:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:44:17 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c565082-ddff-4420-bec0-9339f4b8fba2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:44:17 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfdd6292-751f-47f8-b0ff-06dd5e0bfc71]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:44:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-c0798d2d-e20b-41b8-971d-649f15469657 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Running cmd (subprocess): nvme version {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:44:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-c0798d2d-e20b-41b8-971d-649f15469657 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] 'nvme version' failed. Not Retrying. {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:44:17 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c0798d2d-e20b-41b8-971d-649f15469657 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] nvme not present on system {{(pid=72586) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 21:44:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:44:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:44:17 user nova-compute[72586]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 21:44:17 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a824dc9-3b5a-4002-bd2e-ffed7fd36b1a]: (4, '') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:44:17 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-c0798d2d-e20b-41b8-971d-649f15469657 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72586) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 21:44:17 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-c0798d2d-e20b-41b8-971d-649f15469657 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 21:44:17 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-c0798d2d-e20b-41b8-971d-649f15469657 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] LIGHTOS: no hostnqn found. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 21:44:17 user nova-compute[72586]: DEBUG os_brick.utils [None req-c0798d2d-e20b-41b8-971d-649f15469657 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4bc202fb9cb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:44:17 user nova-compute[72586]: DEBUG nova.virt.block_device [None req-c0798d2d-e20b-41b8-971d-649f15469657 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Updating existing volume attachment record: 5a96936c-0d2e-4366-9fa2-ff546356d9b3 {{(pid=72586) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 21:44:20 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:44:20 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:44:23 user nova-compute[72586]: DEBUG nova.compute.manager [req-0f06349a-881b-48ad-9357-0eb25667d154 req-270c008a-e54a-4b6d-b41e-8b59e0cfe56a service nova] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Received event network-changed-69059e55-c62d-461b-860f-f638d25c9351 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:44:23 user nova-compute[72586]: DEBUG nova.compute.manager [req-0f06349a-881b-48ad-9357-0eb25667d154 req-270c008a-e54a-4b6d-b41e-8b59e0cfe56a service nova] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Refreshing instance network info cache due to event network-changed-69059e55-c62d-461b-860f-f638d25c9351. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:44:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-0f06349a-881b-48ad-9357-0eb25667d154 req-270c008a-e54a-4b6d-b41e-8b59e0cfe56a service nova] Acquiring lock "refresh_cache-f2f4343d-0cab-4ed6-972d-e2bd8a801e8f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:44:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-0f06349a-881b-48ad-9357-0eb25667d154 req-270c008a-e54a-4b6d-b41e-8b59e0cfe56a service nova] Acquired lock "refresh_cache-f2f4343d-0cab-4ed6-972d-e2bd8a801e8f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:44:23 user nova-compute[72586]: DEBUG nova.network.neutron [req-0f06349a-881b-48ad-9357-0eb25667d154 req-270c008a-e54a-4b6d-b41e-8b59e0cfe56a service nova] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Refreshing network info cache for port 69059e55-c62d-461b-860f-f638d25c9351 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:44:23 user nova-compute[72586]: DEBUG nova.network.neutron [req-0f06349a-881b-48ad-9357-0eb25667d154 req-270c008a-e54a-4b6d-b41e-8b59e0cfe56a service nova] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Updated VIF entry in instance network info cache for port 69059e55-c62d-461b-860f-f638d25c9351. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:44:23 user nova-compute[72586]: DEBUG nova.network.neutron [req-0f06349a-881b-48ad-9357-0eb25667d154 req-270c008a-e54a-4b6d-b41e-8b59e0cfe56a service nova] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Updating instance_info_cache with network_info: [{"id": "69059e55-c62d-461b-860f-f638d25c9351", "address": "fa:16:3e:5e:53:9a", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69059e55-c6", "ovs_interfaceid": "69059e55-c62d-461b-860f-f638d25c9351", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:44:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-0f06349a-881b-48ad-9357-0eb25667d154 req-270c008a-e54a-4b6d-b41e-8b59e0cfe56a service nova] Releasing lock "refresh_cache-f2f4343d-0cab-4ed6-972d-e2bd8a801e8f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:44:24 user nova-compute[72586]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690926249.2478428, 11ab466b-8caa-4a38-8350-213aa17ee75e => Stopped> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:44:24 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] VM Stopped (Lifecycle Event)
Aug 01 21:44:24 user nova-compute[72586]: DEBUG nova.compute.manager [None req-ff46629b-8fcf-49b0-9c63-b5d5cbcabacd None None] [instance: 11ab466b-8caa-4a38-8350-213aa17ee75e] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:44:25 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:44:25 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:44:25 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0798d2d-e20b-41b8-971d-649f15469657 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Calling os-brick to attach iSCSI Volume {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 21:44:25 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0798d2d-e20b-41b8-971d-649f15469657 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0609c464-00cd-43c5-bd05-c6e0c9449f29'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rdlQDcAF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:44:25 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-c0798d2d-e20b-41b8-971d-649f15469657 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:44:25 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-c0798d2d-e20b-41b8-971d-649f15469657 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:44:25 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-c0798d2d-e20b-41b8-971d-649f15469657 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:44:25 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-c0798d2d-e20b-41b8-971d-649f15469657 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:44:25 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-c0798d2d-e20b-41b8-971d-649f15469657 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0609c464-00cd-43c5-bd05-c6e0c9449f29" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:44:25 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-c0798d2d-e20b-41b8-971d-649f15469657 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0609c464-00cd-43c5-bd05-c6e0c9449f29" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:44:25 user nova-compute[72586]: INFO os_brick.initiator.connectors.iscsi [None req-c0798d2d-e20b-41b8-971d-649f15469657 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 21:44:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0609c464-00cd-43c5-bd05-c6e0c9449f29 -p 172.16.0.220:3260 {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:44:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0609c464-00cd-43c5-bd05-c6e0c9449f29 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:44:25 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa680e94-aa7e-4dc2-bed2-bf719bd05aad]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:44:25 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0798d2d-e20b-41b8-971d-649f15469657 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 21:44:25 user nova-compute[72586]:  {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:44:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0609c464-00cd-43c5-bd05-c6e0c9449f29 -p 172.16.0.220:3260 --interface default --op new {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:44:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0609c464-00cd-43c5-bd05-c6e0c9449f29 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:44:25 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4d59d8-835c-4cbc-bdcf-dd52835a4f1e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0609c464-00cd-43c5-bd05-c6e0c9449f29] added\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:44:25 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0798d2d-e20b-41b8-971d-649f15469657 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0609c464-00cd-43c5-bd05-c6e0c9449f29] added
Aug 01 21:44:25 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:44:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0609c464-00cd-43c5-bd05-c6e0c9449f29 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:44:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0609c464-00cd-43c5-bd05-c6e0c9449f29 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:44:25 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73f7c8e-9971-452b-af74-d75a4a53bebc]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:44:25 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0798d2d-e20b-41b8-971d-649f15469657 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:44:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0609c464-00cd-43c5-bd05-c6e0c9449f29 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:44:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0609c464-00cd-43c5-bd05-c6e0c9449f29 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:44:25 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f271ed22-79d1-41a4-b46a-715fd22e54f3]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:44:25 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0798d2d-e20b-41b8-971d-649f15469657 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:44:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0609c464-00cd-43c5-bd05-c6e0c9449f29 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rdlQDcAF {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:44:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0609c464-00cd-43c5-bd05-c6e0c9449f29 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rdlQDcAF" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:44:25 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e958dc-79c3-499a-b1f4-1a718747c211]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:44:25 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0798d2d-e20b-41b8-971d-649f15469657 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rdlQDcAF'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:44:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0609c464-00cd-43c5-bd05-c6e0c9449f29 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:44:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0609c464-00cd-43c5-bd05-c6e0c9449f29 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:44:25 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[06853413-19c8-49b5-a772-072af0bb8753]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:44:25 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0798d2d-e20b-41b8-971d-649f15469657 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:44:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:44:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:44:25 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e95fdef-8ada-47b8-ae74-b4859e05dcb9]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:44:25 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0798d2d-e20b-41b8-971d-649f15469657 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:44:25 user nova-compute[72586]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1 (non-flash)
Aug 01 21:44:25 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:44:25 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0798d2d-e20b-41b8-971d-649f15469657 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:44:25 user nova-compute[72586]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1 (non-flash)
Aug 01 21:44:25 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:44:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0609c464-00cd-43c5-bd05-c6e0c9449f29 -p 172.16.0.220:3260 --login {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:44:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0609c464-00cd-43c5-bd05-c6e0c9449f29 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:44:25 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[263f634a-0d3f-481e-ae44-e4c36e730558]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0609c464-00cd-43c5-bd05-c6e0c9449f29, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0609c464-00cd-43c5-bd05-c6e0c9449f29, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:44:25 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0798d2d-e20b-41b8-971d-649f15469657 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0609c464-00cd-43c5-bd05-c6e0c9449f29, portal: 172.16.0.220,3260]
Aug 01 21:44:25 user nova-compute[72586]: Login to [iface: default, target: iqn.2010-10.org.openstack:0609c464-00cd-43c5-bd05-c6e0c9449f29, portal: 172.16.0.220,3260] successful.
Aug 01 21:44:25 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:44:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0609c464-00cd-43c5-bd05-c6e0c9449f29 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:44:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0609c464-00cd-43c5-bd05-c6e0c9449f29 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:44:25 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b955e2a8-98db-4fe5-81c6-ef5953a83f31]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:44:25 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0798d2d-e20b-41b8-971d-649f15469657 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:44:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:44:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:44:25 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[8761abe9-9d25-4574-9656-251e8f93e678]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0609c464-00cd-43c5-bd05-c6e0c9449f29 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:44:25 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0798d2d-e20b-41b8-971d-649f15469657 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:44:25 user nova-compute[72586]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1 (non-flash)
Aug 01 21:44:25 user nova-compute[72586]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0609c464-00cd-43c5-bd05-c6e0c9449f29 (non-flash)
Aug 01 21:44:25 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:44:25 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0798d2d-e20b-41b8-971d-649f15469657 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:44:25 user nova-compute[72586]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1 (non-flash)
Aug 01 21:44:25 user nova-compute[72586]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0609c464-00cd-43c5-bd05-c6e0c9449f29 (non-flash)
Aug 01 21:44:25 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:44:25 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-c0798d2d-e20b-41b8-971d-649f15469657 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0609c464-00cd-43c5-bd05-c6e0c9449f29" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:44:25 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0798d2d-e20b-41b8-971d-649f15469657 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Connected to 172.16.0.220:3260 {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 21:44:25 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-c0798d2d-e20b-41b8-971d-649f15469657 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] HCTL ('35', '-', '-', 0) found on session 46 with lun 0 {{(pid=72586) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 21:44:25 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-c0798d2d-e20b-41b8-971d-649f15469657 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72586) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 21:44:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:44:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:44:25 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd2fb89-4fdc-4f14-aafb-5c7ccd4c10fc]: (4, ('- - 0', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:44:25 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-c0798d2d-e20b-41b8-971d-649f15469657 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:44:25 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0798d2d-e20b-41b8-971d-649f15469657 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rdlQDcAF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 21:44:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-c0798d2d-e20b-41b8-971d-649f15469657 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:44:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0798d2d-e20b-41b8-971d-649f15469657 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '23861616262306535', 'path': '/dev/sdd'} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:44:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0798d2d-e20b-41b8-971d-649f15469657 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23861616262306535', 'path': '/dev/sdd'} {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 21:44:26 user nova-compute[72586]: DEBUG nova.objects.instance [None req-c0798d2d-e20b-41b8-971d-649f15469657 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Lazy-loading 'flavor' on Instance uuid 8b5b09f4-6973-4b0f-bb46-d6b720a87339 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:44:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-c0798d2d-e20b-41b8-971d-649f15469657 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 21:44:26 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:44:26 user nova-compute[72586]:   <source dev="/dev/sdd"/>
Aug 01 21:44:26 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:44:26 user nova-compute[72586]:   <serial>0609c464-00cd-43c5-bd05-c6e0c9449f29</serial>
Aug 01 21:44:26 user nova-compute[72586]: </disk>
Aug 01 21:44:26 user nova-compute[72586]:  {{(pid=72586) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 21:44:27 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c0798d2d-e20b-41b8-971d-649f15469657 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:44:27 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c0798d2d-e20b-41b8-971d-649f15469657 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:44:27 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c0798d2d-e20b-41b8-971d-649f15469657 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] No VIF found with MAC fa:16:3e:92:8b:1a, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:44:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c0798d2d-e20b-41b8-971d-649f15469657 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Lock "8b5b09f4-6973-4b0f-bb46-d6b720a87339" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.638s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:44:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-4aa5c1ed-1cf0-4556-baf2-8b36199cabdf tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Acquiring lock "8b5b09f4-6973-4b0f-bb46-d6b720a87339" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:44:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-4aa5c1ed-1cf0-4556-baf2-8b36199cabdf tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Lock "8b5b09f4-6973-4b0f-bb46-d6b720a87339" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:44:29 user nova-compute[72586]: INFO nova.compute.manager [None req-4aa5c1ed-1cf0-4556-baf2-8b36199cabdf tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Detaching volume 0609c464-00cd-43c5-bd05-c6e0c9449f29
Aug 01 21:44:29 user nova-compute[72586]: INFO nova.virt.block_device [None req-4aa5c1ed-1cf0-4556-baf2-8b36199cabdf tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Attempting to driver detach volume 0609c464-00cd-43c5-bd05-c6e0c9449f29 from mountpoint /dev/vdb
Aug 01 21:44:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-4aa5c1ed-1cf0-4556-baf2-8b36199cabdf tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Attempting to detach device vdb from instance 8b5b09f4-6973-4b0f-bb46-d6b720a87339 from the persistent domain config. {{(pid=72586) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 21:44:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-4aa5c1ed-1cf0-4556-baf2-8b36199cabdf tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 21:44:29 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:44:29 user nova-compute[72586]:   <source dev="/dev/sdd"/>
Aug 01 21:44:29 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:44:29 user nova-compute[72586]:   <serial>0609c464-00cd-43c5-bd05-c6e0c9449f29</serial>
Aug 01 21:44:29 user nova-compute[72586]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 21:44:29 user nova-compute[72586]: </disk>
Aug 01 21:44:29 user nova-compute[72586]:  {{(pid=72586) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 21:44:29 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-4aa5c1ed-1cf0-4556-baf2-8b36199cabdf tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Successfully detached device vdb from instance 8b5b09f4-6973-4b0f-bb46-d6b720a87339 from the persistent domain config.
Aug 01 21:44:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-4aa5c1ed-1cf0-4556-baf2-8b36199cabdf tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8b5b09f4-6973-4b0f-bb46-d6b720a87339 from the live domain config. {{(pid=72586) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 21:44:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-4aa5c1ed-1cf0-4556-baf2-8b36199cabdf tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 21:44:29 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:44:29 user nova-compute[72586]:   <source dev="/dev/sdd"/>
Aug 01 21:44:29 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:44:29 user nova-compute[72586]:   <serial>0609c464-00cd-43c5-bd05-c6e0c9449f29</serial>
Aug 01 21:44:29 user nova-compute[72586]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 21:44:29 user nova-compute[72586]: </disk>
Aug 01 21:44:29 user nova-compute[72586]:  {{(pid=72586) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 21:44:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Received event <DeviceRemovedEvent: 1690926269.8320563, 8b5b09f4-6973-4b0f-bb46-d6b720a87339 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72586) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 21:44:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-4aa5c1ed-1cf0-4556-baf2-8b36199cabdf tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8b5b09f4-6973-4b0f-bb46-d6b720a87339 {{(pid=72586) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 21:44:29 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-4aa5c1ed-1cf0-4556-baf2-8b36199cabdf tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Successfully detached device vdb from instance 8b5b09f4-6973-4b0f-bb46-d6b720a87339 from the live domain config.
Aug 01 21:44:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4aa5c1ed-1cf0-4556-baf2-8b36199cabdf tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] calling os-brick to detach iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 21:44:29 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa5c1ed-1cf0-4556-baf2-8b36199cabdf tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, {'target_iqns': ['iqn.2010-10.org.openstack:0609c464-00cd-43c5-bd05-c6e0c9449f29'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rdlQDcAF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:44:29 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-4aa5c1ed-1cf0-4556-baf2-8b36199cabdf tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:44:29 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-4aa5c1ed-1cf0-4556-baf2-8b36199cabdf tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:44:29 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-4aa5c1ed-1cf0-4556-baf2-8b36199cabdf tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:44:29 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa5c1ed-1cf0-4556-baf2-8b36199cabdf tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0609c464-00cd-43c5-bd05-c6e0c9449f29', 0)] {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 21:44:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:44:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:44:29 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4cecf21-645a-40e7-9138-813c7dd80b89]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0609c464-00cd-43c5-bd05-c6e0c9449f29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:44:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:44:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:44:29 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[90695e39-b258-4d15-965b-d0cba2d446ad]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0609c464-00cd-43c5-bd05-c6e0c9449f29 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:44:29 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa5c1ed-1cf0-4556-baf2-8b36199cabdf tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:44:29 user nova-compute[72586]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1 (non-flash)
Aug 01 21:44:29 user nova-compute[72586]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0609c464-00cd-43c5-bd05-c6e0c9449f29 (non-flash)
Aug 01 21:44:29 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:44:29 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa5c1ed-1cf0-4556-baf2-8b36199cabdf tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:44:29 user nova-compute[72586]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1 (non-flash)
Aug 01 21:44:29 user nova-compute[72586]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0609c464-00cd-43c5-bd05-c6e0c9449f29 (non-flash)
Aug 01 21:44:29 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:44:29 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa5c1ed-1cf0-4556-baf2-8b36199cabdf tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ee82755a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0609c464-00cd-43c5-bd05-c6e0c9449f29'): ({'sdd'}, set())}) {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 21:44:29 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-4aa5c1ed-1cf0-4556-baf2-8b36199cabdf tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Removing single pathed devices sdd {{(pid=72586) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 21:44:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:44:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:44:29 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0a6163-7903-4f79-a656-da9e39be3d8d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:44:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:44:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:44:29 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1d3ae2-bcdd-4dd1-a193-06cbabe58cc8]: (4, ('ok\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:44:29 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-4aa5c1ed-1cf0-4556-baf2-8b36199cabdf tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Flushing IO for device /dev/sdd {{(pid=72586) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 21:44:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:44:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:44:29 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb2394b-8a9a-4994-881f-961be4c45426]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:44:29 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-4aa5c1ed-1cf0-4556-baf2-8b36199cabdf tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72586) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 21:44:29 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:44:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:44:30 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[060cf217-9708-4320-b213-64fc6ff4e51a]: (4, ('1', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:44:30 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-4aa5c1ed-1cf0-4556-baf2-8b36199cabdf tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 21:44:30 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-4aa5c1ed-1cf0-4556-baf2-8b36199cabdf tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] SCSI volumes sdd have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 21:44:30 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa5c1ed-1cf0-4556-baf2-8b36199cabdf tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0609c464-00cd-43c5-bd05-c6e0c9449f29')] {{(pid=72586) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 21:44:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0609c464-00cd-43c5-bd05-c6e0c9449f29 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:44:30 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:44:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0609c464-00cd-43c5-bd05-c6e0c9449f29 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:44:30 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[47224fe8-6bd0-4a4d-b368-764507bdedae]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:44:30 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa5c1ed-1cf0-4556-baf2-8b36199cabdf tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:44:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0609c464-00cd-43c5-bd05-c6e0c9449f29 -p 172.16.0.220:3260 --logout {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:44:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0609c464-00cd-43c5-bd05-c6e0c9449f29 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:44:30 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[662adf4b-f25b-4142-8661-75355832a99d]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:0609c464-00cd-43c5-bd05-c6e0c9449f29, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:0609c464-00cd-43c5-bd05-c6e0c9449f29, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:44:30 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa5c1ed-1cf0-4556-baf2-8b36199cabdf tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:0609c464-00cd-43c5-bd05-c6e0c9449f29, portal: 172.16.0.220,3260]
Aug 01 21:44:30 user nova-compute[72586]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:0609c464-00cd-43c5-bd05-c6e0c9449f29, portal: 172.16.0.220,3260] successful.
Aug 01 21:44:30 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:44:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0609c464-00cd-43c5-bd05-c6e0c9449f29 -p 172.16.0.220:3260 --op delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:44:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0609c464-00cd-43c5-bd05-c6e0c9449f29 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:44:30 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[3446343d-9119-4daf-a27e-aeab494955b7]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:44:30 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa5c1ed-1cf0-4556-baf2-8b36199cabdf tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:44:30 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-4aa5c1ed-1cf0-4556-baf2-8b36199cabdf tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:44:30 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa5c1ed-1cf0-4556-baf2-8b36199cabdf tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] <== disconnect_volume: return (309ms) None {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:44:30 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4aa5c1ed-1cf0-4556-baf2-8b36199cabdf tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Disconnected iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 21:44:30 user nova-compute[72586]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690926255.375109, 178d26d5-3570-442f-9268-21cd73cccfc7 => Stopped> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:44:30 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] VM Stopped (Lifecycle Event)
Aug 01 21:44:30 user nova-compute[72586]: DEBUG nova.compute.manager [None req-a7e4eb98-ace4-4995-af2c-93dde663e7b4 None None] [instance: 178d26d5-3570-442f-9268-21cd73cccfc7] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:44:30 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:44:31 user nova-compute[72586]: DEBUG nova.objects.instance [None req-4aa5c1ed-1cf0-4556-baf2-8b36199cabdf tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Lazy-loading 'flavor' on Instance uuid 8b5b09f4-6973-4b0f-bb46-d6b720a87339 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:44:31 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-4aa5c1ed-1cf0-4556-baf2-8b36199cabdf tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Lock "8b5b09f4-6973-4b0f-bb46-d6b720a87339" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.771s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:44:31 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Acquiring lock "2dd707a7-354a-4563-9c3f-56d9a92dc1b0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:44:31 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "2dd707a7-354a-4563-9c3f-56d9a92dc1b0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:44:31 user nova-compute[72586]: DEBUG nova.compute.manager [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Starting instance... {{(pid=72586) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 21:44:31 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:44:31 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:44:31 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72586) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 21:44:31 user nova-compute[72586]: INFO nova.compute.claims [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Claim successful on node user
Aug 01 21:44:32 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:44:32 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:44:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.297s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:44:32 user nova-compute[72586]: DEBUG nova.compute.manager [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Start building networks asynchronously for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 21:44:32 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 21:44:32 user nova-compute[72586]: DEBUG nova.compute.manager [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Allocating IP information in the background. {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 21:44:32 user nova-compute[72586]: DEBUG nova.network.neutron [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] allocate_for_instance() {{(pid=72586) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 21:44:32 user nova-compute[72586]: DEBUG nova.compute.manager [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Start building block device mappings for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 21:44:32 user nova-compute[72586]: INFO nova.virt.block_device [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Booting with volume snapshot 410827bb-e94c-4e8b-a6dc-745f027b71ab at /dev/vda
Aug 01 21:44:32 user nova-compute[72586]: DEBUG nova.policy [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '76cd0d9d973b410ca4ff08fc7630fbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a631250d39c34afca47a1fa2817e627e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72586) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 21:44:33 user nova-compute[72586]: DEBUG nova.network.neutron [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Successfully created port: c77ce213-734b-4877-80a6-7827c6756b51 {{(pid=72586) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 21:44:34 user nova-compute[72586]: DEBUG nova.network.neutron [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Successfully updated port: c77ce213-734b-4877-80a6-7827c6756b51 {{(pid=72586) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 21:44:34 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Acquiring lock "refresh_cache-2dd707a7-354a-4563-9c3f-56d9a92dc1b0" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:44:34 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Acquired lock "refresh_cache-2dd707a7-354a-4563-9c3f-56d9a92dc1b0" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:44:34 user nova-compute[72586]: DEBUG nova.network.neutron [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:44:34 user nova-compute[72586]: DEBUG nova.compute.manager [req-445fcea1-132f-4ba7-bb1d-10e4cebb07ac req-e300dce4-cdc8-46e9-8ad1-f365d0a9edf9 service nova] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Received event network-changed-c77ce213-734b-4877-80a6-7827c6756b51 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:44:34 user nova-compute[72586]: DEBUG nova.compute.manager [req-445fcea1-132f-4ba7-bb1d-10e4cebb07ac req-e300dce4-cdc8-46e9-8ad1-f365d0a9edf9 service nova] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Refreshing instance network info cache due to event network-changed-c77ce213-734b-4877-80a6-7827c6756b51. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:44:34 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-445fcea1-132f-4ba7-bb1d-10e4cebb07ac req-e300dce4-cdc8-46e9-8ad1-f365d0a9edf9 service nova] Acquiring lock "refresh_cache-2dd707a7-354a-4563-9c3f-56d9a92dc1b0" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:44:34 user nova-compute[72586]: DEBUG nova.network.neutron [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Instance cache missing network info. {{(pid=72586) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 21:44:34 user nova-compute[72586]: DEBUG nova.network.neutron [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Updating instance_info_cache with network_info: [{"id": "c77ce213-734b-4877-80a6-7827c6756b51", "address": "fa:16:3e:e8:22:d9", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc77ce213-73", "ovs_interfaceid": "c77ce213-734b-4877-80a6-7827c6756b51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:44:34 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Releasing lock "refresh_cache-2dd707a7-354a-4563-9c3f-56d9a92dc1b0" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:44:34 user nova-compute[72586]: DEBUG nova.compute.manager [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Instance network_info: |[{"id": "c77ce213-734b-4877-80a6-7827c6756b51", "address": "fa:16:3e:e8:22:d9", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc77ce213-73", "ovs_interfaceid": "c77ce213-734b-4877-80a6-7827c6756b51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 21:44:34 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-445fcea1-132f-4ba7-bb1d-10e4cebb07ac req-e300dce4-cdc8-46e9-8ad1-f365d0a9edf9 service nova] Acquired lock "refresh_cache-2dd707a7-354a-4563-9c3f-56d9a92dc1b0" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:44:34 user nova-compute[72586]: DEBUG nova.network.neutron [req-445fcea1-132f-4ba7-bb1d-10e4cebb07ac req-e300dce4-cdc8-46e9-8ad1-f365d0a9edf9 service nova] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Refreshing network info cache for port c77ce213-734b-4877-80a6-7827c6756b51 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:44:35 user nova-compute[72586]: DEBUG nova.network.neutron [req-445fcea1-132f-4ba7-bb1d-10e4cebb07ac req-e300dce4-cdc8-46e9-8ad1-f365d0a9edf9 service nova] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Updated VIF entry in instance network info cache for port c77ce213-734b-4877-80a6-7827c6756b51. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:44:35 user nova-compute[72586]: DEBUG nova.network.neutron [req-445fcea1-132f-4ba7-bb1d-10e4cebb07ac req-e300dce4-cdc8-46e9-8ad1-f365d0a9edf9 service nova] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Updating instance_info_cache with network_info: [{"id": "c77ce213-734b-4877-80a6-7827c6756b51", "address": "fa:16:3e:e8:22:d9", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc77ce213-73", "ovs_interfaceid": "c77ce213-734b-4877-80a6-7827c6756b51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:44:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-445fcea1-132f-4ba7-bb1d-10e4cebb07ac req-e300dce4-cdc8-46e9-8ad1-f365d0a9edf9 service nova] Releasing lock "refresh_cache-2dd707a7-354a-4563-9c3f-56d9a92dc1b0" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:44:35 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:44:35 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:44:36 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:44:36 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:44:38 user nova-compute[72586]: DEBUG os_brick.utils [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:44:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:44:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:44:38 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[8222fe17-fa3c-4a8d-8ca7-d06770276022]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4bc202fb9cb\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:44:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:44:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:44:38 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[275f284b-bb31-482a-8fe0-bd92403ecdcd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:44:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:44:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:44:38 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[61196dc8-f50c-4e22-a8d4-37eb10cf6ab3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:44:38 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9275bfb4-c68b-4d7e-9e7b-6064e0526fca]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:44:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Running cmd (subprocess): nvme version {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:44:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] 'nvme version' failed. Not Retrying. {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:44:38 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] nvme not present on system {{(pid=72586) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 21:44:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:44:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:44:38 user nova-compute[72586]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 21:44:38 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[299ea18e-976b-4846-be4d-1ad16d427a4c]: (4, '') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:44:38 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72586) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 21:44:38 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 21:44:38 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] LIGHTOS: no hostnqn found. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 21:44:38 user nova-compute[72586]: DEBUG os_brick.utils [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4bc202fb9cb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:44:38 user nova-compute[72586]: DEBUG nova.virt.block_device [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Updating existing volume attachment record: a03e64df-2bf9-4f17-b9e0-243bcae74ab9 {{(pid=72586) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 21:44:38 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:44:38 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:44:38 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72586) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 21:44:40 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:44:40 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:44:41 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:44:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:44:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:44:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:44:41 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Auditing locally available compute resources for user (node: user) {{(pid=72586) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 21:44:42 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:44:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:44:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:44:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:44:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:44:42 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:44:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b5b09f4-6973-4b0f-bb46-d6b720a87339/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:44:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b5b09f4-6973-4b0f-bb46-d6b720a87339/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:44:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b5b09f4-6973-4b0f-bb46-d6b720a87339/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:44:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b5b09f4-6973-4b0f-bb46-d6b720a87339/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:44:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee464b0-f75e-4f30-9838-74bca9619a07/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:44:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee464b0-f75e-4f30-9838-74bca9619a07/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:44:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee464b0-f75e-4f30-9838-74bca9619a07/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:44:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee464b0-f75e-4f30-9838-74bca9619a07/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:44:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63625685-227f-48cc-9cc0-594633e0b8bb/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:44:43 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63625685-227f-48cc-9cc0-594633e0b8bb/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:44:43 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63625685-227f-48cc-9cc0-594633e0b8bb/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:44:43 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63625685-227f-48cc-9cc0-594633e0b8bb/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:44:43 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:44:43 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:44:43 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Hypervisor/Node resource view: name=user free_ram=8162MB free_disk=25.05908203125GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72586) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 21:44:43 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:44:43 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:44:43 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance af2de810-b22f-4fa9-835c-c673abd145db actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:44:43 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 161fab9d-a7d1-4ea0-b4b9-2afc54040eef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:44:43 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 63625685-227f-48cc-9cc0-594633e0b8bb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:44:43 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 8ee464b0-f75e-4f30-9838-74bca9619a07 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:44:43 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 8b5b09f4-6973-4b0f-bb46-d6b720a87339 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:44:43 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance f2f4343d-0cab-4ed6-972d-e2bd8a801e8f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:44:43 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 2dd707a7-354a-4563-9c3f-56d9a92dc1b0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:44:43 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 21:44:43 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 21:44:44 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:44:44 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:44:44 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Compute_service record updated for user:user {{(pid=72586) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 21:44:44 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.379s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:44:45 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:44:45 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:44:45 user nova-compute[72586]: DEBUG nova.compute.manager [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Start spawning the instance on the hypervisor. {{(pid=72586) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 21:44:45 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Creating instance directory {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 21:44:45 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Creating image(s)
Aug 01 21:44:45 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Did not create local disks {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 21:44:45 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Ensure instance console log exists: /opt/stack/data/nova/instances/2dd707a7-354a-4563-9c3f-56d9a92dc1b0/console.log {{(pid=72586) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 21:44:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:44:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:44:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:44:45 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Start _get_guest_xml network_info=[{"id": "c77ce213-734b-4877-80a6-7827c6756b51", "address": "fa:16:3e:e8:22:d9", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc77ce213-73", "ovs_interfaceid": "c77ce213-734b-4877-80a6-7827c6756b51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-01T21:44:25Z,direct_url=<?>,disk_format='qcow2',id=16514bf0-f9b7-4e6c-ab95-3c846f9cc0d4,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-348437998',owner='a631250d39c34afca47a1fa2817e627e',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-01T21:44:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:108439f6-3bb3-4d17-a606-8a23163d802c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cpYaPyFk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2dd707a7-354a-4563-9c3f-56d9a92dc1b0', 'attached_at': '', 'detached_at': '', 'volume_id': '108439f6-3bb3-4d17-a606-8a23163d802c', 'serial': '108439f6-3bb3-4d17-a606-8a23163d802c'}, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'a03e64df-2bf9-4f17-b9e0-243bcae74ab9', 'delete_on_termination': True, 'volume_type': None} {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:44:45 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:44:45 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:44:45 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:44:45 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:44:45 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:44:45 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:44:45 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:44:45 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-01T21:44:25Z,direct_url=<?>,disk_format='qcow2',id=16514bf0-f9b7-4e6c-ab95-3c846f9cc0d4,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-348437998',owner='a631250d39c34afca47a1fa2817e627e',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-01T21:44:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:44:45 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:44:45 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:44:45 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:44:45 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:44:45 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:44:45 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:44:45 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:44:45 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:44:45 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:44:45 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:44:45 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Calling os-brick to attach iSCSI Volume {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 21:44:45 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:108439f6-3bb3-4d17-a606-8a23163d802c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cpYaPyFk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:44:45 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:44:45 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:44:45 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:44:45 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:44:45 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:108439f6-3bb3-4d17-a606-8a23163d802c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:44:45 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:108439f6-3bb3-4d17-a606-8a23163d802c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:44:45 user nova-compute[72586]: INFO os_brick.initiator.connectors.iscsi [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 21:44:45 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:108439f6-3bb3-4d17-a606-8a23163d802c -p 172.16.0.220:3260 {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:44:45 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:108439f6-3bb3-4d17-a606-8a23163d802c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:44:45 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74de3f4-40b5-46b6-a4da-fb50ec10fe3f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:44:45 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 21:44:45 user nova-compute[72586]:  {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:44:45 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:108439f6-3bb3-4d17-a606-8a23163d802c -p 172.16.0.220:3260 --interface default --op new {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:44:45 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:108439f6-3bb3-4d17-a606-8a23163d802c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:44:45 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1619355-5e61-4e70-b4d3-a867c398bfee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:108439f6-3bb3-4d17-a606-8a23163d802c] added\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:44:45 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:108439f6-3bb3-4d17-a606-8a23163d802c] added
Aug 01 21:44:45 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:44:45 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:108439f6-3bb3-4d17-a606-8a23163d802c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:44:45 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:108439f6-3bb3-4d17-a606-8a23163d802c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:44:45 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9189d789-7c34-4953-b32a-9cb581370c41]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:44:45 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:44:45 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:108439f6-3bb3-4d17-a606-8a23163d802c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:44:45 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:108439f6-3bb3-4d17-a606-8a23163d802c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:44:45 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f46fd3d-d2e0-404b-a366-2b8856e1b92d]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:44:45 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:44:45 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:108439f6-3bb3-4d17-a606-8a23163d802c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cpYaPyFk {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:44:45 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:108439f6-3bb3-4d17-a606-8a23163d802c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cpYaPyFk" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:44:45 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0918cc40-81b1-4d36-b308-a3b072fd8af3]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:44:45 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cpYaPyFk'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:44:45 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:108439f6-3bb3-4d17-a606-8a23163d802c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:44:45 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:108439f6-3bb3-4d17-a606-8a23163d802c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:44:45 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42de67f-72eb-4066-8dc1-e69d53f0e0e0]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:44:45 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:44:45 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:44:45 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:44:45 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cffe302-3fb0-4809-95df-811ddca06611]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:44:45 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:44:45 user nova-compute[72586]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1 (non-flash)
Aug 01 21:44:45 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:44:45 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:44:45 user nova-compute[72586]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1 (non-flash)
Aug 01 21:44:45 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:44:45 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:108439f6-3bb3-4d17-a606-8a23163d802c -p 172.16.0.220:3260 --login {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:44:46 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:108439f6-3bb3-4d17-a606-8a23163d802c -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:44:46 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ef735f-a3ef-401e-b15d-e43da0ec146e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:108439f6-3bb3-4d17-a606-8a23163d802c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:108439f6-3bb3-4d17-a606-8a23163d802c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:44:46 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:108439f6-3bb3-4d17-a606-8a23163d802c, portal: 172.16.0.220,3260]
Aug 01 21:44:46 user nova-compute[72586]: Login to [iface: default, target: iqn.2010-10.org.openstack:108439f6-3bb3-4d17-a606-8a23163d802c, portal: 172.16.0.220,3260] successful.
Aug 01 21:44:46 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:44:46 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:108439f6-3bb3-4d17-a606-8a23163d802c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:44:46 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:108439f6-3bb3-4d17-a606-8a23163d802c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:44:46 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dcef044-3147-4893-bde9-10da3ccd4383]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:44:46 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:44:46 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:44:46 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:44:46 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Starting heal instance info cache {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 21:44:46 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:44:46 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[74756d2c-f7fa-4b9f-94d9-64d452f3f776]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:108439f6-3bb3-4d17-a606-8a23163d802c (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:44:46 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:44:46 user nova-compute[72586]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1 (non-flash)
Aug 01 21:44:46 user nova-compute[72586]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:108439f6-3bb3-4d17-a606-8a23163d802c (non-flash)
Aug 01 21:44:46 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:44:46 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:44:46 user nova-compute[72586]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1 (non-flash)
Aug 01 21:44:46 user nova-compute[72586]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:108439f6-3bb3-4d17-a606-8a23163d802c (non-flash)
Aug 01 21:44:46 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:44:46 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:108439f6-3bb3-4d17-a606-8a23163d802c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:44:46 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Connected to 172.16.0.220:3260 {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 21:44:46 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] HCTL ('35', '-', '-', 0) found on session 47 with lun 0 {{(pid=72586) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 21:44:46 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72586) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 21:44:46 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:44:46 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:44:46 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f64b41-53ea-48a6-a5b8-d1f12c4b1c87]: (4, ('- - 0', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:44:46 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Searching for a device in session 47 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:44:46 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cpYaPyFk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 21:44:46 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "refresh_cache-8ee464b0-f75e-4f30-9838-74bca9619a07" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:44:46 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquired lock "refresh_cache-8ee464b0-f75e-4f30-9838-74bca9619a07" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:44:46 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] Forcefully refreshing network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 21:44:46 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] Updating instance_info_cache with network_info: [{"id": "37f8d809-78f6-45fa-a4e8-db8e816f6f6e", "address": "fa:16:3e:96:29:2e", "network": {"id": "e687eacc-3080-46db-b577-5efb36856dce", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1089459024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2896d39f80af4e07869d3b1acfba1d8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f8d809-78", "ovs_interfaceid": "37f8d809-78f6-45fa-a4e8-db8e816f6f6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:44:46 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Releasing lock "refresh_cache-8ee464b0-f75e-4f30-9838-74bca9619a07" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:44:46 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] Updated the network info_cache for instance {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 21:44:47 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:44:47 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:44:47 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '23234383630313663', 'path': '/dev/sdd'} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:44:47 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234383630313663', 'path': '/dev/sdd'} {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 21:44:47 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:44:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-296158979',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-296158979',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-296158979',id=40,image_ref='16514bf0-f9b7-4e6c-ab95-3c846f9cc0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATYd21D981zh36wIBufSPkJZG8vmxKla34eSqQ707Lv6uBiL8y6mGuBQEM+8zzWIgrYCX0v4Pd4D2SvDAkXTIVa8rFUQKrC0wDymVzvEAMa1uagPiObTU3oWLuTNBP86A==',key_name='tempest-keypair-2139281117',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a631250d39c34afca47a1fa2817e627e',ramdisk_id='',reservation_id='r-267qp8is',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1160754716',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1160754716-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1160754716',owner_user_name='tempest-TestVolumeBootPattern-1160754716-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:44:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76cd0d9d973b410ca4ff08fc7630fbc6',uuid=2dd707a7-354a-4563-9c3f-56d9a92dc1b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c77ce213-734b-4877-80a6-7827c6756b51", "address": "fa:16:3e:e8:22:d9", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc77ce213-73", "ovs_interfaceid": "c77ce213-734b-4877-80a6-7827c6756b51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:44:47 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Converting VIF {"id": "c77ce213-734b-4877-80a6-7827c6756b51", "address": "fa:16:3e:e8:22:d9", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc77ce213-73", "ovs_interfaceid": "c77ce213-734b-4877-80a6-7827c6756b51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:44:47 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:22:d9,bridge_name='br-int',has_traffic_filtering=True,id=c77ce213-734b-4877-80a6-7827c6756b51,network=Network(2fbf5ffb-0ec0-403b-bc92-259563ab1d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc77ce213-73') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:44:47 user nova-compute[72586]: DEBUG nova.objects.instance [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lazy-loading 'pci_devices' on Instance uuid 2dd707a7-354a-4563-9c3f-56d9a92dc1b0 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:44:47 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:44:47 user nova-compute[72586]:   <uuid>2dd707a7-354a-4563-9c3f-56d9a92dc1b0</uuid>
Aug 01 21:44:47 user nova-compute[72586]:   <name>instance-00000028</name>
Aug 01 21:44:47 user nova-compute[72586]:   <memory>524288</memory>
Aug 01 21:44:47 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:44:47 user nova-compute[72586]:   <metadata>
Aug 01 21:44:47 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:44:47 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:44:47 user nova-compute[72586]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-296158979</nova:name>
Aug 01 21:44:47 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:44:45</nova:creationTime>
Aug 01 21:44:47 user nova-compute[72586]:       <nova:flavor name="m1.tiny">
Aug 01 21:44:47 user nova-compute[72586]:         <nova:memory>512</nova:memory>
Aug 01 21:44:47 user nova-compute[72586]:         <nova:disk>1</nova:disk>
Aug 01 21:44:47 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:44:47 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:44:47 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:44:47 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:44:47 user nova-compute[72586]:       <nova:owner>
Aug 01 21:44:47 user nova-compute[72586]:         <nova:user uuid="76cd0d9d973b410ca4ff08fc7630fbc6">tempest-TestVolumeBootPattern-1160754716-project-member</nova:user>
Aug 01 21:44:47 user nova-compute[72586]:         <nova:project uuid="a631250d39c34afca47a1fa2817e627e">tempest-TestVolumeBootPattern-1160754716</nova:project>
Aug 01 21:44:47 user nova-compute[72586]:       </nova:owner>
Aug 01 21:44:47 user nova-compute[72586]:       <nova:root type="image" uuid="16514bf0-f9b7-4e6c-ab95-3c846f9cc0d4"/>
Aug 01 21:44:47 user nova-compute[72586]:       <nova:ports>
Aug 01 21:44:47 user nova-compute[72586]:         <nova:port uuid="c77ce213-734b-4877-80a6-7827c6756b51">
Aug 01 21:44:47 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 01 21:44:47 user nova-compute[72586]:         </nova:port>
Aug 01 21:44:47 user nova-compute[72586]:       </nova:ports>
Aug 01 21:44:47 user nova-compute[72586]:     </nova:instance>
Aug 01 21:44:47 user nova-compute[72586]:   </metadata>
Aug 01 21:44:47 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:44:47 user nova-compute[72586]:     <system>
Aug 01 21:44:47 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:44:47 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:44:47 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:44:47 user nova-compute[72586]:       <entry name="serial">2dd707a7-354a-4563-9c3f-56d9a92dc1b0</entry>
Aug 01 21:44:47 user nova-compute[72586]:       <entry name="uuid">2dd707a7-354a-4563-9c3f-56d9a92dc1b0</entry>
Aug 01 21:44:47 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:44:47 user nova-compute[72586]:     </system>
Aug 01 21:44:47 user nova-compute[72586]:   </sysinfo>
Aug 01 21:44:47 user nova-compute[72586]:   <os>
Aug 01 21:44:47 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:44:47 user nova-compute[72586]:     <boot dev="hd"/>
Aug 01 21:44:47 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:44:47 user nova-compute[72586]:   </os>
Aug 01 21:44:47 user nova-compute[72586]:   <features>
Aug 01 21:44:47 user nova-compute[72586]:     <acpi/>
Aug 01 21:44:47 user nova-compute[72586]:     <apic/>
Aug 01 21:44:47 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:44:47 user nova-compute[72586]:   </features>
Aug 01 21:44:47 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:44:47 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:44:47 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:44:47 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:44:47 user nova-compute[72586]:   </clock>
Aug 01 21:44:47 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:44:47 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:44:47 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:44:47 user nova-compute[72586]:   </cpu>
Aug 01 21:44:47 user nova-compute[72586]:   <devices>
Aug 01 21:44:47 user nova-compute[72586]:     <disk type="block" device="disk">
Aug 01 21:44:47 user nova-compute[72586]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:44:47 user nova-compute[72586]:       <source dev="/dev/sdd"/>
Aug 01 21:44:47 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:44:47 user nova-compute[72586]:       <serial>108439f6-3bb3-4d17-a606-8a23163d802c</serial>
Aug 01 21:44:47 user nova-compute[72586]:     </disk>
Aug 01 21:44:47 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:44:47 user nova-compute[72586]:       <mac address="fa:16:3e:e8:22:d9"/>
Aug 01 21:44:47 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:44:47 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:44:47 user nova-compute[72586]:       <target dev="tapc77ce213-73"/>
Aug 01 21:44:47 user nova-compute[72586]:     </interface>
Aug 01 21:44:47 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:44:47 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/2dd707a7-354a-4563-9c3f-56d9a92dc1b0/console.log" append="off"/>
Aug 01 21:44:47 user nova-compute[72586]:     </serial>
Aug 01 21:44:47 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:44:47 user nova-compute[72586]:     <video>
Aug 01 21:44:47 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:44:47 user nova-compute[72586]:     </video>
Aug 01 21:44:47 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:44:47 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:44:47 user nova-compute[72586]:     </rng>
Aug 01 21:44:47 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:44:47 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:44:47 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:44:47 user nova-compute[72586]:     </memballoon>
Aug 01 21:44:47 user nova-compute[72586]:   </devices>
Aug 01 21:44:47 user nova-compute[72586]: </domain>
Aug 01 21:44:47 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:44:47 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:44:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-296158979',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-296158979',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-296158979',id=40,image_ref='16514bf0-f9b7-4e6c-ab95-3c846f9cc0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATYd21D981zh36wIBufSPkJZG8vmxKla34eSqQ707Lv6uBiL8y6mGuBQEM+8zzWIgrYCX0v4Pd4D2SvDAkXTIVa8rFUQKrC0wDymVzvEAMa1uagPiObTU3oWLuTNBP86A==',key_name='tempest-keypair-2139281117',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a631250d39c34afca47a1fa2817e627e',ramdisk_id='',reservation_id='r-267qp8is',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1160754716',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1160754716-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1160754716',owner_user_name='tempest-TestVolumeBootPattern-1160754716-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:44:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76cd0d9d973b410ca4ff08fc7630fbc6',uuid=2dd707a7-354a-4563-9c3f-56d9a92dc1b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c77ce213-734b-4877-80a6-7827c6756b51", "address": "fa:16:3e:e8:22:d9", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc77ce213-73", "ovs_interfaceid": "c77ce213-734b-4877-80a6-7827c6756b51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:44:47 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Converting VIF {"id": "c77ce213-734b-4877-80a6-7827c6756b51", "address": "fa:16:3e:e8:22:d9", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc77ce213-73", "ovs_interfaceid": "c77ce213-734b-4877-80a6-7827c6756b51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:44:47 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:22:d9,bridge_name='br-int',has_traffic_filtering=True,id=c77ce213-734b-4877-80a6-7827c6756b51,network=Network(2fbf5ffb-0ec0-403b-bc92-259563ab1d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc77ce213-73') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:44:47 user nova-compute[72586]: DEBUG os_vif [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:22:d9,bridge_name='br-int',has_traffic_filtering=True,id=c77ce213-734b-4877-80a6-7827c6756b51,network=Network(2fbf5ffb-0ec0-403b-bc92-259563ab1d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc77ce213-73') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:44:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:44:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:44:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:44:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:44:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc77ce213-73, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:44:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc77ce213-73, col_values=(('external_ids', {'iface-id': 'c77ce213-734b-4877-80a6-7827c6756b51', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:22:d9', 'vm-uuid': '2dd707a7-354a-4563-9c3f-56d9a92dc1b0'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:44:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:44:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:44:47 user nova-compute[72586]: INFO os_vif [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:22:d9,bridge_name='br-int',has_traffic_filtering=True,id=c77ce213-734b-4877-80a6-7827c6756b51,network=Network(2fbf5ffb-0ec0-403b-bc92-259563ab1d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc77ce213-73')
Aug 01 21:44:47 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:44:47 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] No VIF found with MAC fa:16:3e:e8:22:d9, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:44:48 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:44:48 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:44:48 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:44:48 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:44:48 user nova-compute[72586]: DEBUG nova.compute.manager [req-f1784026-8a22-48db-a4e4-23c278ebfcb3 req-9c930461-4009-4ddc-b029-e3ff7ead960b service nova] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Received event network-vif-plugged-c77ce213-734b-4877-80a6-7827c6756b51 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:44:48 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-f1784026-8a22-48db-a4e4-23c278ebfcb3 req-9c930461-4009-4ddc-b029-e3ff7ead960b service nova] Acquiring lock "2dd707a7-354a-4563-9c3f-56d9a92dc1b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:44:48 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-f1784026-8a22-48db-a4e4-23c278ebfcb3 req-9c930461-4009-4ddc-b029-e3ff7ead960b service nova] Lock "2dd707a7-354a-4563-9c3f-56d9a92dc1b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:44:48 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-f1784026-8a22-48db-a4e4-23c278ebfcb3 req-9c930461-4009-4ddc-b029-e3ff7ead960b service nova] Lock "2dd707a7-354a-4563-9c3f-56d9a92dc1b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:44:48 user nova-compute[72586]: DEBUG nova.compute.manager [req-f1784026-8a22-48db-a4e4-23c278ebfcb3 req-9c930461-4009-4ddc-b029-e3ff7ead960b service nova] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] No waiting events found dispatching network-vif-plugged-c77ce213-734b-4877-80a6-7827c6756b51 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:44:48 user nova-compute[72586]: WARNING nova.compute.manager [req-f1784026-8a22-48db-a4e4-23c278ebfcb3 req-9c930461-4009-4ddc-b029-e3ff7ead960b service nova] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Received unexpected event network-vif-plugged-c77ce213-734b-4877-80a6-7827c6756b51 for instance with vm_state building and task_state spawning.
Aug 01 21:44:48 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:44:48 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:44:48 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:44:50 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:44:50 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690926290.659591, 2dd707a7-354a-4563-9c3f-56d9a92dc1b0 => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:44:50 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] VM Resumed (Lifecycle Event)
Aug 01 21:44:50 user nova-compute[72586]: DEBUG nova.compute.manager [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Instance event wait completed in 0 seconds for  {{(pid=72586) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 21:44:50 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Guest created on hypervisor {{(pid=72586) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 21:44:50 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Instance spawned successfully.
Aug 01 21:44:50 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 21:44:50 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Found default for hw_input_bus of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:44:50 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Found default for hw_pointer_model of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:44:50 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:44:50 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:44:50 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:44:50 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690926290.660907, 2dd707a7-354a-4563-9c3f-56d9a92dc1b0 => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:44:50 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] VM Started (Lifecycle Event)
Aug 01 21:44:50 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:44:50 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:44:50 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:44:50 user nova-compute[72586]: INFO nova.compute.manager [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Took 5.04 seconds to spawn the instance on the hypervisor.
Aug 01 21:44:50 user nova-compute[72586]: DEBUG nova.compute.manager [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:44:50 user nova-compute[72586]: INFO nova.compute.manager [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Took 18.93 seconds to build instance.
Aug 01 21:44:50 user nova-compute[72586]: DEBUG nova.compute.manager [req-e964076b-68cc-43c9-a0be-304fb585b712 req-3fe82fbd-8902-47d0-949e-e0cde4fa0594 service nova] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Received event network-vif-plugged-c77ce213-734b-4877-80a6-7827c6756b51 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:44:50 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-e964076b-68cc-43c9-a0be-304fb585b712 req-3fe82fbd-8902-47d0-949e-e0cde4fa0594 service nova] Acquiring lock "2dd707a7-354a-4563-9c3f-56d9a92dc1b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:44:50 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-e964076b-68cc-43c9-a0be-304fb585b712 req-3fe82fbd-8902-47d0-949e-e0cde4fa0594 service nova] Lock "2dd707a7-354a-4563-9c3f-56d9a92dc1b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:44:50 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-e964076b-68cc-43c9-a0be-304fb585b712 req-3fe82fbd-8902-47d0-949e-e0cde4fa0594 service nova] Lock "2dd707a7-354a-4563-9c3f-56d9a92dc1b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:44:50 user nova-compute[72586]: DEBUG nova.compute.manager [req-e964076b-68cc-43c9-a0be-304fb585b712 req-3fe82fbd-8902-47d0-949e-e0cde4fa0594 service nova] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] No waiting events found dispatching network-vif-plugged-c77ce213-734b-4877-80a6-7827c6756b51 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:44:50 user nova-compute[72586]: WARNING nova.compute.manager [req-e964076b-68cc-43c9-a0be-304fb585b712 req-3fe82fbd-8902-47d0-949e-e0cde4fa0594 service nova] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Received unexpected event network-vif-plugged-c77ce213-734b-4877-80a6-7827c6756b51 for instance with vm_state active and task_state None.
Aug 01 21:44:50 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-9ed508e9-53c4-4e4d-ae02-2f3866194a3e tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "2dd707a7-354a-4563-9c3f-56d9a92dc1b0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.033s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:44:52 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:44:55 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:44:57 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:44:59 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:45:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Acquiring lock "2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:45:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:45:01 user nova-compute[72586]: DEBUG nova.compute.manager [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Starting instance... {{(pid=72586) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 21:45:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:45:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:45:01 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72586) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 21:45:01 user nova-compute[72586]: INFO nova.compute.claims [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Claim successful on node user
Aug 01 21:45:02 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:45:02 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:45:02 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.345s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:45:02 user nova-compute[72586]: DEBUG nova.compute.manager [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Start building networks asynchronously for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 21:45:02 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:45:02 user nova-compute[72586]: DEBUG nova.compute.manager [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Allocating IP information in the background. {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 21:45:02 user nova-compute[72586]: DEBUG nova.network.neutron [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] allocate_for_instance() {{(pid=72586) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 21:45:02 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 21:45:02 user nova-compute[72586]: DEBUG nova.compute.manager [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Start building block device mappings for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 21:45:02 user nova-compute[72586]: DEBUG nova.policy [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '50893dc844b44f498e1545aeee794742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99cbab7dfc55429c9b991bf1091a84c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72586) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 21:45:02 user nova-compute[72586]: DEBUG nova.compute.manager [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Start spawning the instance on the hypervisor. {{(pid=72586) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 21:45:02 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Creating instance directory {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 21:45:02 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Creating image(s)
Aug 01 21:45:02 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Acquiring lock "/opt/stack/data/nova/instances/2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:45:02 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "/opt/stack/data/nova/instances/2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:45:02 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "/opt/stack/data/nova/instances/2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:45:02 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:45:03 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.229s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:45:03 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Acquiring lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:45:03 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:45:03 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:45:03 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.215s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:45:03 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6/disk 1073741824 {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:45:03 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6/disk 1073741824" returned: 0 in 0.068s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:45:03 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.294s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:45:03 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:45:03 user nova-compute[72586]: DEBUG nova.network.neutron [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Successfully created port: 1dd6baee-ef06-420a-b60b-af402143b22d {{(pid=72586) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 21:45:03 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.191s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:45:03 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6/disk. size=1073741824 {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 21:45:03 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:45:03 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:45:03 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Cannot resize image /opt/stack/data/nova/instances/2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6/disk to a smaller size. {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 21:45:03 user nova-compute[72586]: DEBUG nova.objects.instance [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lazy-loading 'migration_context' on Instance uuid 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:45:03 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Created local disks {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 21:45:03 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Ensure instance console log exists: /opt/stack/data/nova/instances/2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6/console.log {{(pid=72586) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 21:45:03 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:45:03 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:45:03 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:45:04 user nova-compute[72586]: DEBUG nova.network.neutron [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Successfully updated port: 1dd6baee-ef06-420a-b60b-af402143b22d {{(pid=72586) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 21:45:04 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Acquiring lock "refresh_cache-2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:45:04 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Acquired lock "refresh_cache-2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:45:04 user nova-compute[72586]: DEBUG nova.network.neutron [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:45:04 user nova-compute[72586]: DEBUG nova.compute.manager [req-448cad6a-b1ca-4b87-b715-112ddbc9eb00 req-2100360e-cbcc-4b9f-bfdc-a5a9cae0e498 service nova] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Received event network-changed-1dd6baee-ef06-420a-b60b-af402143b22d {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:45:04 user nova-compute[72586]: DEBUG nova.compute.manager [req-448cad6a-b1ca-4b87-b715-112ddbc9eb00 req-2100360e-cbcc-4b9f-bfdc-a5a9cae0e498 service nova] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Refreshing instance network info cache due to event network-changed-1dd6baee-ef06-420a-b60b-af402143b22d. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:45:04 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-448cad6a-b1ca-4b87-b715-112ddbc9eb00 req-2100360e-cbcc-4b9f-bfdc-a5a9cae0e498 service nova] Acquiring lock "refresh_cache-2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:45:04 user nova-compute[72586]: DEBUG nova.network.neutron [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Instance cache missing network info. {{(pid=72586) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 21:45:04 user nova-compute[72586]: DEBUG nova.network.neutron [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Updating instance_info_cache with network_info: [{"id": "1dd6baee-ef06-420a-b60b-af402143b22d", "address": "fa:16:3e:d5:4b:c0", "network": {"id": "63b6e8c7-fad0-44bf-a479-9baab6f0d1e3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2101151631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cbab7dfc55429c9b991bf1091a84c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dd6baee-ef", "ovs_interfaceid": "1dd6baee-ef06-420a-b60b-af402143b22d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:45:04 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Releasing lock "refresh_cache-2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:45:04 user nova-compute[72586]: DEBUG nova.compute.manager [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Instance network_info: |[{"id": "1dd6baee-ef06-420a-b60b-af402143b22d", "address": "fa:16:3e:d5:4b:c0", "network": {"id": "63b6e8c7-fad0-44bf-a479-9baab6f0d1e3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2101151631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cbab7dfc55429c9b991bf1091a84c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dd6baee-ef", "ovs_interfaceid": "1dd6baee-ef06-420a-b60b-af402143b22d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 21:45:04 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-448cad6a-b1ca-4b87-b715-112ddbc9eb00 req-2100360e-cbcc-4b9f-bfdc-a5a9cae0e498 service nova] Acquired lock "refresh_cache-2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:45:04 user nova-compute[72586]: DEBUG nova.network.neutron [req-448cad6a-b1ca-4b87-b715-112ddbc9eb00 req-2100360e-cbcc-4b9f-bfdc-a5a9cae0e498 service nova] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Refreshing network info cache for port 1dd6baee-ef06-420a-b60b-af402143b22d {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:45:04 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Start _get_guest_xml network_info=[{"id": "1dd6baee-ef06-420a-b60b-af402143b22d", "address": "fa:16:3e:d5:4b:c0", "network": {"id": "63b6e8c7-fad0-44bf-a479-9baab6f0d1e3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2101151631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cbab7dfc55429c9b991bf1091a84c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dd6baee-ef", "ovs_interfaceid": "1dd6baee-ef06-420a-b60b-af402143b22d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '0243d46b-6819-42a5-926f-42b71f0c97ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:45:04 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:45:04 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:45:04 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:45:04 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:45:04 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:45:04 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:45:04 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:45:04 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:45:04 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:45:04 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:45:04 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:45:04 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:45:04 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:45:04 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:45:04 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:45:04 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:45:04 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:45:04 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:45:04 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:45:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-902787059',display_name='tempest-AttachVolumeTestJSON-server-902787059',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-902787059',id=41,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFDiam4esvU6sK41QNwWSc/2AXzIgLWlUg47PEmBZznbHmM8nh1S2MpzIR5/XtZHNuPKQAtd3NpGTZnLiqFOVHXiiuc/oRr3oAwhWWqOEC1f2CuoAHN8agA/4mikoFGSyA==',key_name='tempest-keypair-16484230',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99cbab7dfc55429c9b991bf1091a84c7',ramdisk_id='',reservation_id='r-ke2od031',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1420576365',owner_user_name='tempest-AttachVolumeTestJSON-1420576365-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:45:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='50893dc844b44f498e1545aeee794742',uuid=2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1dd6baee-ef06-420a-b60b-af402143b22d", "address": "fa:16:3e:d5:4b:c0", "network": {"id": "63b6e8c7-fad0-44bf-a479-9baab6f0d1e3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2101151631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cbab7dfc55429c9b991bf1091a84c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dd6baee-ef", "ovs_interfaceid": "1dd6baee-ef06-420a-b60b-af402143b22d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:45:04 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Converting VIF {"id": "1dd6baee-ef06-420a-b60b-af402143b22d", "address": "fa:16:3e:d5:4b:c0", "network": {"id": "63b6e8c7-fad0-44bf-a479-9baab6f0d1e3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2101151631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cbab7dfc55429c9b991bf1091a84c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dd6baee-ef", "ovs_interfaceid": "1dd6baee-ef06-420a-b60b-af402143b22d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:45:04 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:4b:c0,bridge_name='br-int',has_traffic_filtering=True,id=1dd6baee-ef06-420a-b60b-af402143b22d,network=Network(63b6e8c7-fad0-44bf-a479-9baab6f0d1e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dd6baee-ef') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:45:04 user nova-compute[72586]: DEBUG nova.objects.instance [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lazy-loading 'pci_devices' on Instance uuid 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:45:04 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:45:04 user nova-compute[72586]:   <uuid>2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6</uuid>
Aug 01 21:45:04 user nova-compute[72586]:   <name>instance-00000029</name>
Aug 01 21:45:04 user nova-compute[72586]:   <memory>524288</memory>
Aug 01 21:45:04 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:45:04 user nova-compute[72586]:   <metadata>
Aug 01 21:45:04 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:45:04 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:45:04 user nova-compute[72586]:       <nova:name>tempest-AttachVolumeTestJSON-server-902787059</nova:name>
Aug 01 21:45:04 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:45:04</nova:creationTime>
Aug 01 21:45:04 user nova-compute[72586]:       <nova:flavor name="m1.tiny">
Aug 01 21:45:04 user nova-compute[72586]:         <nova:memory>512</nova:memory>
Aug 01 21:45:04 user nova-compute[72586]:         <nova:disk>1</nova:disk>
Aug 01 21:45:04 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:45:04 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:45:04 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:45:04 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:45:04 user nova-compute[72586]:       <nova:owner>
Aug 01 21:45:04 user nova-compute[72586]:         <nova:user uuid="50893dc844b44f498e1545aeee794742">tempest-AttachVolumeTestJSON-1420576365-project-member</nova:user>
Aug 01 21:45:04 user nova-compute[72586]:         <nova:project uuid="99cbab7dfc55429c9b991bf1091a84c7">tempest-AttachVolumeTestJSON-1420576365</nova:project>
Aug 01 21:45:04 user nova-compute[72586]:       </nova:owner>
Aug 01 21:45:04 user nova-compute[72586]:       <nova:root type="image" uuid="0243d46b-6819-42a5-926f-42b71f0c97ad"/>
Aug 01 21:45:04 user nova-compute[72586]:       <nova:ports>
Aug 01 21:45:04 user nova-compute[72586]:         <nova:port uuid="1dd6baee-ef06-420a-b60b-af402143b22d">
Aug 01 21:45:04 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 01 21:45:04 user nova-compute[72586]:         </nova:port>
Aug 01 21:45:04 user nova-compute[72586]:       </nova:ports>
Aug 01 21:45:04 user nova-compute[72586]:     </nova:instance>
Aug 01 21:45:04 user nova-compute[72586]:   </metadata>
Aug 01 21:45:04 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:45:04 user nova-compute[72586]:     <system>
Aug 01 21:45:04 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:45:04 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:45:04 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:45:04 user nova-compute[72586]:       <entry name="serial">2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6</entry>
Aug 01 21:45:04 user nova-compute[72586]:       <entry name="uuid">2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6</entry>
Aug 01 21:45:04 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:45:04 user nova-compute[72586]:     </system>
Aug 01 21:45:04 user nova-compute[72586]:   </sysinfo>
Aug 01 21:45:04 user nova-compute[72586]:   <os>
Aug 01 21:45:04 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:45:04 user nova-compute[72586]:     <boot dev="hd"/>
Aug 01 21:45:04 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:45:04 user nova-compute[72586]:   </os>
Aug 01 21:45:04 user nova-compute[72586]:   <features>
Aug 01 21:45:04 user nova-compute[72586]:     <acpi/>
Aug 01 21:45:04 user nova-compute[72586]:     <apic/>
Aug 01 21:45:04 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:45:04 user nova-compute[72586]:   </features>
Aug 01 21:45:04 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:45:04 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:45:04 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:45:04 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:45:04 user nova-compute[72586]:   </clock>
Aug 01 21:45:04 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:45:04 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:45:04 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:45:04 user nova-compute[72586]:   </cpu>
Aug 01 21:45:04 user nova-compute[72586]:   <devices>
Aug 01 21:45:04 user nova-compute[72586]:     <disk type="file" device="disk">
Aug 01 21:45:04 user nova-compute[72586]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 21:45:04 user nova-compute[72586]:       <source file="/opt/stack/data/nova/instances/2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6/disk"/>
Aug 01 21:45:04 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:45:04 user nova-compute[72586]:     </disk>
Aug 01 21:45:04 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:45:04 user nova-compute[72586]:       <mac address="fa:16:3e:d5:4b:c0"/>
Aug 01 21:45:04 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:45:04 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:45:04 user nova-compute[72586]:       <target dev="tap1dd6baee-ef"/>
Aug 01 21:45:04 user nova-compute[72586]:     </interface>
Aug 01 21:45:04 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:45:04 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6/console.log" append="off"/>
Aug 01 21:45:04 user nova-compute[72586]:     </serial>
Aug 01 21:45:04 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:45:04 user nova-compute[72586]:     <video>
Aug 01 21:45:04 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:45:04 user nova-compute[72586]:     </video>
Aug 01 21:45:04 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:45:04 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:45:04 user nova-compute[72586]:     </rng>
Aug 01 21:45:04 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:45:04 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:45:04 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:45:04 user nova-compute[72586]:     </memballoon>
Aug 01 21:45:04 user nova-compute[72586]:   </devices>
Aug 01 21:45:04 user nova-compute[72586]: </domain>
Aug 01 21:45:04 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:45:04 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:45:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-902787059',display_name='tempest-AttachVolumeTestJSON-server-902787059',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-902787059',id=41,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFDiam4esvU6sK41QNwWSc/2AXzIgLWlUg47PEmBZznbHmM8nh1S2MpzIR5/XtZHNuPKQAtd3NpGTZnLiqFOVHXiiuc/oRr3oAwhWWqOEC1f2CuoAHN8agA/4mikoFGSyA==',key_name='tempest-keypair-16484230',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99cbab7dfc55429c9b991bf1091a84c7',ramdisk_id='',reservation_id='r-ke2od031',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1420576365',owner_user_name='tempest-AttachVolumeTestJSON-1420576365-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:45:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='50893dc844b44f498e1545aeee794742',uuid=2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1dd6baee-ef06-420a-b60b-af402143b22d", "address": "fa:16:3e:d5:4b:c0", "network": {"id": "63b6e8c7-fad0-44bf-a479-9baab6f0d1e3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2101151631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cbab7dfc55429c9b991bf1091a84c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dd6baee-ef", "ovs_interfaceid": "1dd6baee-ef06-420a-b60b-af402143b22d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:45:04 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Converting VIF {"id": "1dd6baee-ef06-420a-b60b-af402143b22d", "address": "fa:16:3e:d5:4b:c0", "network": {"id": "63b6e8c7-fad0-44bf-a479-9baab6f0d1e3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2101151631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cbab7dfc55429c9b991bf1091a84c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dd6baee-ef", "ovs_interfaceid": "1dd6baee-ef06-420a-b60b-af402143b22d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:45:04 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:4b:c0,bridge_name='br-int',has_traffic_filtering=True,id=1dd6baee-ef06-420a-b60b-af402143b22d,network=Network(63b6e8c7-fad0-44bf-a479-9baab6f0d1e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dd6baee-ef') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:45:04 user nova-compute[72586]: DEBUG os_vif [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:4b:c0,bridge_name='br-int',has_traffic_filtering=True,id=1dd6baee-ef06-420a-b60b-af402143b22d,network=Network(63b6e8c7-fad0-44bf-a479-9baab6f0d1e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dd6baee-ef') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:45:04 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:45:04 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:45:04 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:45:04 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:45:04 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1dd6baee-ef, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:45:04 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1dd6baee-ef, col_values=(('external_ids', {'iface-id': '1dd6baee-ef06-420a-b60b-af402143b22d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:4b:c0', 'vm-uuid': '2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:45:04 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:45:04 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:45:04 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:45:04 user nova-compute[72586]: INFO os_vif [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:4b:c0,bridge_name='br-int',has_traffic_filtering=True,id=1dd6baee-ef06-420a-b60b-af402143b22d,network=Network(63b6e8c7-fad0-44bf-a479-9baab6f0d1e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dd6baee-ef')
Aug 01 21:45:04 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:45:04 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] No VIF found with MAC fa:16:3e:d5:4b:c0, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:45:05 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:45:05 user nova-compute[72586]: DEBUG nova.network.neutron [req-448cad6a-b1ca-4b87-b715-112ddbc9eb00 req-2100360e-cbcc-4b9f-bfdc-a5a9cae0e498 service nova] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Updated VIF entry in instance network info cache for port 1dd6baee-ef06-420a-b60b-af402143b22d. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:45:05 user nova-compute[72586]: DEBUG nova.network.neutron [req-448cad6a-b1ca-4b87-b715-112ddbc9eb00 req-2100360e-cbcc-4b9f-bfdc-a5a9cae0e498 service nova] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Updating instance_info_cache with network_info: [{"id": "1dd6baee-ef06-420a-b60b-af402143b22d", "address": "fa:16:3e:d5:4b:c0", "network": {"id": "63b6e8c7-fad0-44bf-a479-9baab6f0d1e3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2101151631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cbab7dfc55429c9b991bf1091a84c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dd6baee-ef", "ovs_interfaceid": "1dd6baee-ef06-420a-b60b-af402143b22d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:45:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-448cad6a-b1ca-4b87-b715-112ddbc9eb00 req-2100360e-cbcc-4b9f-bfdc-a5a9cae0e498 service nova] Releasing lock "refresh_cache-2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:45:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-50c61a6f-ce61-4190-b719-537abdcee4ae tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Acquiring lock "63625685-227f-48cc-9cc0-594633e0b8bb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:45:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-50c61a6f-ce61-4190-b719-537abdcee4ae tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "63625685-227f-48cc-9cc0-594633e0b8bb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:45:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-50c61a6f-ce61-4190-b719-537abdcee4ae tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Acquiring lock "63625685-227f-48cc-9cc0-594633e0b8bb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:45:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-50c61a6f-ce61-4190-b719-537abdcee4ae tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "63625685-227f-48cc-9cc0-594633e0b8bb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:45:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-50c61a6f-ce61-4190-b719-537abdcee4ae tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "63625685-227f-48cc-9cc0-594633e0b8bb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:45:05 user nova-compute[72586]: INFO nova.compute.manager [None req-50c61a6f-ce61-4190-b719-537abdcee4ae tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Terminating instance
Aug 01 21:45:05 user nova-compute[72586]: DEBUG nova.compute.manager [None req-50c61a6f-ce61-4190-b719-537abdcee4ae tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Start destroying the instance on the hypervisor. {{(pid=72586) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 21:45:05 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:45:05 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:45:05 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:45:05 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:45:05 user nova-compute[72586]: DEBUG nova.compute.manager [req-dec0e499-a658-4fa5-938f-71781f82e0b6 req-f1ced311-758d-48ba-9aed-461baec8f4bb service nova] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Received event network-vif-unplugged-0508879f-0d7d-40ab-adcb-d51a6743fdf2 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:45:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-dec0e499-a658-4fa5-938f-71781f82e0b6 req-f1ced311-758d-48ba-9aed-461baec8f4bb service nova] Acquiring lock "63625685-227f-48cc-9cc0-594633e0b8bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:45:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-dec0e499-a658-4fa5-938f-71781f82e0b6 req-f1ced311-758d-48ba-9aed-461baec8f4bb service nova] Lock "63625685-227f-48cc-9cc0-594633e0b8bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:45:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-dec0e499-a658-4fa5-938f-71781f82e0b6 req-f1ced311-758d-48ba-9aed-461baec8f4bb service nova] Lock "63625685-227f-48cc-9cc0-594633e0b8bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:45:05 user nova-compute[72586]: DEBUG nova.compute.manager [req-dec0e499-a658-4fa5-938f-71781f82e0b6 req-f1ced311-758d-48ba-9aed-461baec8f4bb service nova] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] No waiting events found dispatching network-vif-unplugged-0508879f-0d7d-40ab-adcb-d51a6743fdf2 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:45:05 user nova-compute[72586]: DEBUG nova.compute.manager [req-dec0e499-a658-4fa5-938f-71781f82e0b6 req-f1ced311-758d-48ba-9aed-461baec8f4bb service nova] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Received event network-vif-unplugged-0508879f-0d7d-40ab-adcb-d51a6743fdf2 for instance with task_state deleting. {{(pid=72586) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 21:45:06 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Instance destroyed successfully.
Aug 01 21:45:06 user nova-compute[72586]: DEBUG nova.objects.instance [None req-50c61a6f-ce61-4190-b719-537abdcee4ae tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lazy-loading 'resources' on Instance uuid 63625685-227f-48cc-9cc0-594633e0b8bb {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:45:06 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-50c61a6f-ce61-4190-b719-537abdcee4ae tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:35:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-425585844',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-425585844',id=32,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:35:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88d847d04360420c80ea5608d5a2b15a',ramdisk_id='',reservation_id='r-66i0h2g3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1268085586',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:37:39Z,user_data=None,user_id='a984642731b9413c97038f65052ab92d',uuid=63625685-227f-48cc-9cc0-594633e0b8bb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0508879f-0d7d-40ab-adcb-d51a6743fdf2", "address": "fa:16:3e:ac:c9:31", "network": {"id": "86940e5d-852b-48fc-9b0e-858305321349", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1967467603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d847d04360420c80ea5608d5a2b15a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0508879f-0d", "ovs_interfaceid": "0508879f-0d7d-40ab-adcb-d51a6743fdf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:45:06 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-50c61a6f-ce61-4190-b719-537abdcee4ae tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Converting VIF {"id": "0508879f-0d7d-40ab-adcb-d51a6743fdf2", "address": "fa:16:3e:ac:c9:31", "network": {"id": "86940e5d-852b-48fc-9b0e-858305321349", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1967467603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d847d04360420c80ea5608d5a2b15a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0508879f-0d", "ovs_interfaceid": "0508879f-0d7d-40ab-adcb-d51a6743fdf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:45:06 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-50c61a6f-ce61-4190-b719-537abdcee4ae tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:c9:31,bridge_name='br-int',has_traffic_filtering=True,id=0508879f-0d7d-40ab-adcb-d51a6743fdf2,network=Network(86940e5d-852b-48fc-9b0e-858305321349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0508879f-0d') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:45:06 user nova-compute[72586]: DEBUG os_vif [None req-50c61a6f-ce61-4190-b719-537abdcee4ae tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:c9:31,bridge_name='br-int',has_traffic_filtering=True,id=0508879f-0d7d-40ab-adcb-d51a6743fdf2,network=Network(86940e5d-852b-48fc-9b0e-858305321349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0508879f-0d') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:45:06 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:45:06 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0508879f-0d, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:45:06 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:45:06 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:45:06 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:45:06 user nova-compute[72586]: INFO os_vif [None req-50c61a6f-ce61-4190-b719-537abdcee4ae tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:c9:31,bridge_name='br-int',has_traffic_filtering=True,id=0508879f-0d7d-40ab-adcb-d51a6743fdf2,network=Network(86940e5d-852b-48fc-9b0e-858305321349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0508879f-0d')
Aug 01 21:45:06 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-50c61a6f-ce61-4190-b719-537abdcee4ae tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Deleting instance files /opt/stack/data/nova/instances/63625685-227f-48cc-9cc0-594633e0b8bb_del
Aug 01 21:45:06 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-50c61a6f-ce61-4190-b719-537abdcee4ae tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Deletion of /opt/stack/data/nova/instances/63625685-227f-48cc-9cc0-594633e0b8bb_del complete
Aug 01 21:45:06 user nova-compute[72586]: INFO nova.compute.manager [None req-50c61a6f-ce61-4190-b719-537abdcee4ae tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Took 1.02 seconds to destroy the instance on the hypervisor.
Aug 01 21:45:06 user nova-compute[72586]: DEBUG oslo.service.loopingcall [None req-50c61a6f-ce61-4190-b719-537abdcee4ae tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72586) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 21:45:06 user nova-compute[72586]: DEBUG nova.compute.manager [-] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Deallocating network for instance {{(pid=72586) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 21:45:06 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] deallocate_for_instance() {{(pid=72586) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 21:45:06 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:45:06 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:45:06 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:45:06 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:45:06 user nova-compute[72586]: DEBUG nova.compute.manager [req-1c65451b-6726-4823-be87-68e7d4889f05 req-4ae24da0-abfd-491e-9ed6-1e64beea87ff service nova] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Received event network-vif-plugged-1dd6baee-ef06-420a-b60b-af402143b22d {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:45:06 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-1c65451b-6726-4823-be87-68e7d4889f05 req-4ae24da0-abfd-491e-9ed6-1e64beea87ff service nova] Acquiring lock "2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:45:06 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-1c65451b-6726-4823-be87-68e7d4889f05 req-4ae24da0-abfd-491e-9ed6-1e64beea87ff service nova] Lock "2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:45:06 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-1c65451b-6726-4823-be87-68e7d4889f05 req-4ae24da0-abfd-491e-9ed6-1e64beea87ff service nova] Lock "2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:45:06 user nova-compute[72586]: DEBUG nova.compute.manager [req-1c65451b-6726-4823-be87-68e7d4889f05 req-4ae24da0-abfd-491e-9ed6-1e64beea87ff service nova] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] No waiting events found dispatching network-vif-plugged-1dd6baee-ef06-420a-b60b-af402143b22d {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:45:06 user nova-compute[72586]: WARNING nova.compute.manager [req-1c65451b-6726-4823-be87-68e7d4889f05 req-4ae24da0-abfd-491e-9ed6-1e64beea87ff service nova] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Received unexpected event network-vif-plugged-1dd6baee-ef06-420a-b60b-af402143b22d for instance with vm_state building and task_state spawning.
Aug 01 21:45:07 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:45:07 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Took 0.71 seconds to deallocate network for instance.
Aug 01 21:45:07 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-50c61a6f-ce61-4190-b719-537abdcee4ae tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:45:07 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-50c61a6f-ce61-4190-b719-537abdcee4ae tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:45:07 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:45:07 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:45:07 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:45:07 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:45:07 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-50c61a6f-ce61-4190-b719-537abdcee4ae tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:45:07 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-50c61a6f-ce61-4190-b719-537abdcee4ae tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:45:07 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-50c61a6f-ce61-4190-b719-537abdcee4ae tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.272s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:45:07 user nova-compute[72586]: INFO nova.scheduler.client.report [None req-50c61a6f-ce61-4190-b719-537abdcee4ae tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Deleted allocations for instance 63625685-227f-48cc-9cc0-594633e0b8bb
Aug 01 21:45:07 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-50c61a6f-ce61-4190-b719-537abdcee4ae tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "63625685-227f-48cc-9cc0-594633e0b8bb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.210s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:45:07 user nova-compute[72586]: DEBUG nova.compute.manager [req-b6948607-4553-43ee-9c8e-76b4de2ffbdc req-52627c69-961a-47de-9f66-8ec64508c32d service nova] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Received event network-vif-plugged-0508879f-0d7d-40ab-adcb-d51a6743fdf2 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:45:07 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-b6948607-4553-43ee-9c8e-76b4de2ffbdc req-52627c69-961a-47de-9f66-8ec64508c32d service nova] Acquiring lock "63625685-227f-48cc-9cc0-594633e0b8bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:45:07 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-b6948607-4553-43ee-9c8e-76b4de2ffbdc req-52627c69-961a-47de-9f66-8ec64508c32d service nova] Lock "63625685-227f-48cc-9cc0-594633e0b8bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:45:07 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-b6948607-4553-43ee-9c8e-76b4de2ffbdc req-52627c69-961a-47de-9f66-8ec64508c32d service nova] Lock "63625685-227f-48cc-9cc0-594633e0b8bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:45:07 user nova-compute[72586]: DEBUG nova.compute.manager [req-b6948607-4553-43ee-9c8e-76b4de2ffbdc req-52627c69-961a-47de-9f66-8ec64508c32d service nova] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] No waiting events found dispatching network-vif-plugged-0508879f-0d7d-40ab-adcb-d51a6743fdf2 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:45:07 user nova-compute[72586]: WARNING nova.compute.manager [req-b6948607-4553-43ee-9c8e-76b4de2ffbdc req-52627c69-961a-47de-9f66-8ec64508c32d service nova] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Received unexpected event network-vif-plugged-0508879f-0d7d-40ab-adcb-d51a6743fdf2 for instance with vm_state deleted and task_state None.
Aug 01 21:45:08 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690926308.8419743, 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6 => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:45:08 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] VM Resumed (Lifecycle Event)
Aug 01 21:45:08 user nova-compute[72586]: DEBUG nova.compute.manager [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Instance event wait completed in 0 seconds for  {{(pid=72586) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 21:45:08 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Guest created on hypervisor {{(pid=72586) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 21:45:08 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Instance spawned successfully.
Aug 01 21:45:08 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 21:45:08 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:45:08 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Found default for hw_cdrom_bus of ide {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:45:08 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Found default for hw_disk_bus of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:45:08 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Found default for hw_input_bus of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:45:08 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Found default for hw_pointer_model of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:45:08 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Found default for hw_video_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:45:08 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Found default for hw_vif_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:45:08 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:45:08 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:45:08 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690926308.8429437, 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6 => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:45:08 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] VM Started (Lifecycle Event)
Aug 01 21:45:08 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:45:08 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:45:08 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:45:09 user nova-compute[72586]: DEBUG nova.compute.manager [req-fa87ca85-b480-4e9b-8ee0-5cd8c5fdfa97 req-1c60827f-1fba-4c6f-91b3-c722c942e29e service nova] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Received event network-vif-deleted-0508879f-0d7d-40ab-adcb-d51a6743fdf2 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:45:09 user nova-compute[72586]: DEBUG nova.compute.manager [req-fa87ca85-b480-4e9b-8ee0-5cd8c5fdfa97 req-1c60827f-1fba-4c6f-91b3-c722c942e29e service nova] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Received event network-vif-plugged-1dd6baee-ef06-420a-b60b-af402143b22d {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:45:09 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-fa87ca85-b480-4e9b-8ee0-5cd8c5fdfa97 req-1c60827f-1fba-4c6f-91b3-c722c942e29e service nova] Acquiring lock "2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:45:09 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-fa87ca85-b480-4e9b-8ee0-5cd8c5fdfa97 req-1c60827f-1fba-4c6f-91b3-c722c942e29e service nova] Lock "2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:45:09 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-fa87ca85-b480-4e9b-8ee0-5cd8c5fdfa97 req-1c60827f-1fba-4c6f-91b3-c722c942e29e service nova] Lock "2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:45:09 user nova-compute[72586]: DEBUG nova.compute.manager [req-fa87ca85-b480-4e9b-8ee0-5cd8c5fdfa97 req-1c60827f-1fba-4c6f-91b3-c722c942e29e service nova] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] No waiting events found dispatching network-vif-plugged-1dd6baee-ef06-420a-b60b-af402143b22d {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:45:09 user nova-compute[72586]: WARNING nova.compute.manager [req-fa87ca85-b480-4e9b-8ee0-5cd8c5fdfa97 req-1c60827f-1fba-4c6f-91b3-c722c942e29e service nova] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Received unexpected event network-vif-plugged-1dd6baee-ef06-420a-b60b-af402143b22d for instance with vm_state building and task_state spawning.
Aug 01 21:45:09 user nova-compute[72586]: INFO nova.compute.manager [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Took 6.18 seconds to spawn the instance on the hypervisor.
Aug 01 21:45:09 user nova-compute[72586]: DEBUG nova.compute.manager [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:45:09 user nova-compute[72586]: INFO nova.compute.manager [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Took 7.13 seconds to build instance.
Aug 01 21:45:09 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-339ca1e3-35e2-4169-8e02-6ddd1e796e41 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.243s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:45:10 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:45:11 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:45:15 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:45:16 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:45:20 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:45:21 user nova-compute[72586]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690926306.2808247, 63625685-227f-48cc-9cc0-594633e0b8bb => Stopped> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:45:21 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] VM Stopped (Lifecycle Event)
Aug 01 21:45:21 user nova-compute[72586]: DEBUG nova.compute.manager [None req-8f609aaf-1dd3-44f1-ac98-c1f877b1d08d None None] [instance: 63625685-227f-48cc-9cc0-594633e0b8bb] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:45:21 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:45:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a73fac74-3eb5-473f-94fe-5e86dd3a78e3 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Acquiring lock "8b5b09f4-6973-4b0f-bb46-d6b720a87339" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:45:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a73fac74-3eb5-473f-94fe-5e86dd3a78e3 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Lock "8b5b09f4-6973-4b0f-bb46-d6b720a87339" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:45:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a73fac74-3eb5-473f-94fe-5e86dd3a78e3 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Acquiring lock "8b5b09f4-6973-4b0f-bb46-d6b720a87339-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:45:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a73fac74-3eb5-473f-94fe-5e86dd3a78e3 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Lock "8b5b09f4-6973-4b0f-bb46-d6b720a87339-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:45:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a73fac74-3eb5-473f-94fe-5e86dd3a78e3 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Lock "8b5b09f4-6973-4b0f-bb46-d6b720a87339-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:45:23 user nova-compute[72586]: INFO nova.compute.manager [None req-a73fac74-3eb5-473f-94fe-5e86dd3a78e3 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Terminating instance
Aug 01 21:45:23 user nova-compute[72586]: DEBUG nova.compute.manager [None req-a73fac74-3eb5-473f-94fe-5e86dd3a78e3 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Start destroying the instance on the hypervisor. {{(pid=72586) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 21:45:24 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:45:24 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:45:24 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:45:24 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:45:24 user nova-compute[72586]: DEBUG nova.compute.manager [req-2bda09f4-7f14-4dc7-be3a-fc80937c6307 req-da39a003-e320-4e98-bc12-6282800bad13 service nova] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Received event network-vif-unplugged-9b2bbf44-3450-4de2-bb25-adefa62c1755 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:45:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-2bda09f4-7f14-4dc7-be3a-fc80937c6307 req-da39a003-e320-4e98-bc12-6282800bad13 service nova] Acquiring lock "8b5b09f4-6973-4b0f-bb46-d6b720a87339-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:45:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-2bda09f4-7f14-4dc7-be3a-fc80937c6307 req-da39a003-e320-4e98-bc12-6282800bad13 service nova] Lock "8b5b09f4-6973-4b0f-bb46-d6b720a87339-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:45:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-2bda09f4-7f14-4dc7-be3a-fc80937c6307 req-da39a003-e320-4e98-bc12-6282800bad13 service nova] Lock "8b5b09f4-6973-4b0f-bb46-d6b720a87339-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:45:24 user nova-compute[72586]: DEBUG nova.compute.manager [req-2bda09f4-7f14-4dc7-be3a-fc80937c6307 req-da39a003-e320-4e98-bc12-6282800bad13 service nova] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] No waiting events found dispatching network-vif-unplugged-9b2bbf44-3450-4de2-bb25-adefa62c1755 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:45:24 user nova-compute[72586]: DEBUG nova.compute.manager [req-2bda09f4-7f14-4dc7-be3a-fc80937c6307 req-da39a003-e320-4e98-bc12-6282800bad13 service nova] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Received event network-vif-unplugged-9b2bbf44-3450-4de2-bb25-adefa62c1755 for instance with task_state deleting. {{(pid=72586) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 21:45:24 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Instance destroyed successfully.
Aug 01 21:45:24 user nova-compute[72586]: DEBUG nova.objects.instance [None req-a73fac74-3eb5-473f-94fe-5e86dd3a78e3 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Lazy-loading 'resources' on Instance uuid 8b5b09f4-6973-4b0f-bb46-d6b720a87339 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:45:24 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-a73fac74-3eb5-473f-94fe-5e86dd3a78e3 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:42:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1436732971',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1436732971',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1436732',id=38,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA0FfE2awTcr1VhdiC5n3q/4Yl36+odjHbET3ycxpAOGW4F5uAGKc1CJ3wC8axRXBKeUqNIgjM3rmHw9DtJLM3ctjhrgKGEuvCToTh3L/gCmAwbRL6Vvune3vV7F+q4j/w==',key_name='tempest-keypair-519122917',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:42:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='561de31d533d492782ef0545e2c69adb',ramdisk_id='',reservation_id='r-hxgzf8yi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-273472066',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:42:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9704aa4160c487198d550d9084ae976',uuid=8b5b09f4-6973-4b0f-bb46-d6b720a87339,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b2bbf44-3450-4de2-bb25-adefa62c1755", "address": "fa:16:3e:92:8b:1a", "network": {"id": "ca864e90-8fc3-454d-af99-93600911d16c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1236727659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "561de31d533d492782ef0545e2c69adb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b2bbf44-34", "ovs_interfaceid": "9b2bbf44-3450-4de2-bb25-adefa62c1755", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:45:24 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-a73fac74-3eb5-473f-94fe-5e86dd3a78e3 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Converting VIF {"id": "9b2bbf44-3450-4de2-bb25-adefa62c1755", "address": "fa:16:3e:92:8b:1a", "network": {"id": "ca864e90-8fc3-454d-af99-93600911d16c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1236727659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "561de31d533d492782ef0545e2c69adb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b2bbf44-34", "ovs_interfaceid": "9b2bbf44-3450-4de2-bb25-adefa62c1755", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:45:24 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-a73fac74-3eb5-473f-94fe-5e86dd3a78e3 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:8b:1a,bridge_name='br-int',has_traffic_filtering=True,id=9b2bbf44-3450-4de2-bb25-adefa62c1755,network=Network(ca864e90-8fc3-454d-af99-93600911d16c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b2bbf44-34') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:45:24 user nova-compute[72586]: DEBUG os_vif [None req-a73fac74-3eb5-473f-94fe-5e86dd3a78e3 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:8b:1a,bridge_name='br-int',has_traffic_filtering=True,id=9b2bbf44-3450-4de2-bb25-adefa62c1755,network=Network(ca864e90-8fc3-454d-af99-93600911d16c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b2bbf44-34') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:45:24 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:45:24 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9b2bbf44-34, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:45:24 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:45:24 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:45:24 user nova-compute[72586]: INFO os_vif [None req-a73fac74-3eb5-473f-94fe-5e86dd3a78e3 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:8b:1a,bridge_name='br-int',has_traffic_filtering=True,id=9b2bbf44-3450-4de2-bb25-adefa62c1755,network=Network(ca864e90-8fc3-454d-af99-93600911d16c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b2bbf44-34')
Aug 01 21:45:24 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-a73fac74-3eb5-473f-94fe-5e86dd3a78e3 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Deleting instance files /opt/stack/data/nova/instances/8b5b09f4-6973-4b0f-bb46-d6b720a87339_del
Aug 01 21:45:24 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-a73fac74-3eb5-473f-94fe-5e86dd3a78e3 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Deletion of /opt/stack/data/nova/instances/8b5b09f4-6973-4b0f-bb46-d6b720a87339_del complete
Aug 01 21:45:24 user nova-compute[72586]: INFO nova.compute.manager [None req-a73fac74-3eb5-473f-94fe-5e86dd3a78e3 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 01 21:45:24 user nova-compute[72586]: DEBUG oslo.service.loopingcall [None req-a73fac74-3eb5-473f-94fe-5e86dd3a78e3 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72586) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 21:45:24 user nova-compute[72586]: DEBUG nova.compute.manager [-] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Deallocating network for instance {{(pid=72586) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 21:45:24 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] deallocate_for_instance() {{(pid=72586) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 21:45:25 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:45:25 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:45:25 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Took 1.07 seconds to deallocate network for instance.
Aug 01 21:45:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a73fac74-3eb5-473f-94fe-5e86dd3a78e3 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:45:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a73fac74-3eb5-473f-94fe-5e86dd3a78e3 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:45:26 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-a73fac74-3eb5-473f-94fe-5e86dd3a78e3 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:45:26 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-a73fac74-3eb5-473f-94fe-5e86dd3a78e3 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:45:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a73fac74-3eb5-473f-94fe-5e86dd3a78e3 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.243s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:45:26 user nova-compute[72586]: INFO nova.scheduler.client.report [None req-a73fac74-3eb5-473f-94fe-5e86dd3a78e3 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Deleted allocations for instance 8b5b09f4-6973-4b0f-bb46-d6b720a87339
Aug 01 21:45:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-a73fac74-3eb5-473f-94fe-5e86dd3a78e3 tempest-TestServerVolumeAttachScenarioOldVersion-273472066 tempest-TestServerVolumeAttachScenarioOldVersion-273472066-project-member] Lock "8b5b09f4-6973-4b0f-bb46-d6b720a87339" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.578s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:45:26 user nova-compute[72586]: DEBUG nova.compute.manager [req-01cdcf5d-dcd8-4b2e-865d-f7b7ccecc4c7 req-5e174933-84e2-45e6-b391-2f3e43766b05 service nova] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Received event network-vif-plugged-9b2bbf44-3450-4de2-bb25-adefa62c1755 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:45:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-01cdcf5d-dcd8-4b2e-865d-f7b7ccecc4c7 req-5e174933-84e2-45e6-b391-2f3e43766b05 service nova] Acquiring lock "8b5b09f4-6973-4b0f-bb46-d6b720a87339-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:45:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-01cdcf5d-dcd8-4b2e-865d-f7b7ccecc4c7 req-5e174933-84e2-45e6-b391-2f3e43766b05 service nova] Lock "8b5b09f4-6973-4b0f-bb46-d6b720a87339-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:45:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-01cdcf5d-dcd8-4b2e-865d-f7b7ccecc4c7 req-5e174933-84e2-45e6-b391-2f3e43766b05 service nova] Lock "8b5b09f4-6973-4b0f-bb46-d6b720a87339-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:45:26 user nova-compute[72586]: DEBUG nova.compute.manager [req-01cdcf5d-dcd8-4b2e-865d-f7b7ccecc4c7 req-5e174933-84e2-45e6-b391-2f3e43766b05 service nova] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] No waiting events found dispatching network-vif-plugged-9b2bbf44-3450-4de2-bb25-adefa62c1755 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:45:26 user nova-compute[72586]: WARNING nova.compute.manager [req-01cdcf5d-dcd8-4b2e-865d-f7b7ccecc4c7 req-5e174933-84e2-45e6-b391-2f3e43766b05 service nova] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Received unexpected event network-vif-plugged-9b2bbf44-3450-4de2-bb25-adefa62c1755 for instance with vm_state deleted and task_state None.
Aug 01 21:45:26 user nova-compute[72586]: DEBUG nova.compute.manager [req-01cdcf5d-dcd8-4b2e-865d-f7b7ccecc4c7 req-5e174933-84e2-45e6-b391-2f3e43766b05 service nova] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Received event network-vif-deleted-9b2bbf44-3450-4de2-bb25-adefa62c1755 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:45:29 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:45:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:45:30 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:45:34 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:45:35 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:45:36 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:45:36 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:45:37 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:45:38 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:45:38 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:45:38 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72586) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 21:45:39 user nova-compute[72586]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690926324.7717686, 8b5b09f4-6973-4b0f-bb46-d6b720a87339 => Stopped> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:45:39 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] VM Stopped (Lifecycle Event)
Aug 01 21:45:39 user nova-compute[72586]: DEBUG nova.compute.manager [None req-738bb2b8-6f7e-4988-9c35-b3daf2c76697 None None] [instance: 8b5b09f4-6973-4b0f-bb46-d6b720a87339] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:45:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:45:40 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:45:41 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:45:41 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Cleaning up deleted instances with incomplete migration  {{(pid=72586) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 21:45:43 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:45:43 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Starting heal instance info cache {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 21:45:43 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Didn't find any instances for network info cache update. {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 21:45:43 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:45:44 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:45:44 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:45:44 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:45:44 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Auditing locally available compute resources for user (node: user) {{(pid=72586) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 21:45:44 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:45:44 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:45:44 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:45:44 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:45:44 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:45:44 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:45:44 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:45:44 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:45:44 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:45:44 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:45:44 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:45:44 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee464b0-f75e-4f30-9838-74bca9619a07/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:45:44 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:45:44 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee464b0-f75e-4f30-9838-74bca9619a07/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:45:44 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee464b0-f75e-4f30-9838-74bca9619a07/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:45:45 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee464b0-f75e-4f30-9838-74bca9619a07/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:45:45 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:45:45 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:45:45 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Hypervisor/Node resource view: name=user free_ram=8059MB free_disk=25.18091583251953GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72586) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 21:45:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:45:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:45:45 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance af2de810-b22f-4fa9-835c-c673abd145db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:45:45 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 161fab9d-a7d1-4ea0-b4b9-2afc54040eef actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:45:45 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 8ee464b0-f75e-4f30-9838-74bca9619a07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:45:45 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance f2f4343d-0cab-4ed6-972d-e2bd8a801e8f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:45:45 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 2dd707a7-354a-4563-9c3f-56d9a92dc1b0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:45:45 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:45:45 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 21:45:45 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 21:45:45 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Refreshing inventories for resource provider ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 21:45:45 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Updating ProviderTree inventory for provider ca6775c1-2a64-43f9-9467-372aa0457b1d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 21:45:45 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Updating inventory in ProviderTree for provider ca6775c1-2a64-43f9-9467-372aa0457b1d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 21:45:45 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Refreshing aggregate associations for resource provider ca6775c1-2a64-43f9-9467-372aa0457b1d, aggregates: None {{(pid=72586) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 21:45:45 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Refreshing trait associations for resource provider ca6775c1-2a64-43f9-9467-372aa0457b1d, traits: COMPUTE_NODE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_TRUSTED_CERTS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AMI {{(pid=72586) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 21:45:45 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:45:45 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:45:45 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Compute_service record updated for user:user {{(pid=72586) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 21:45:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.574s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:45:48 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:45:49 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:45:50 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:45:52 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:45:54 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:45:56 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-182f5a8f-18db-4358-8195-109ad995b7f1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Acquiring lock "161fab9d-a7d1-4ea0-b4b9-2afc54040eef" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:45:56 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-182f5a8f-18db-4358-8195-109ad995b7f1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "161fab9d-a7d1-4ea0-b4b9-2afc54040eef" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:45:56 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-182f5a8f-18db-4358-8195-109ad995b7f1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Acquiring lock "161fab9d-a7d1-4ea0-b4b9-2afc54040eef-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:45:56 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-182f5a8f-18db-4358-8195-109ad995b7f1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "161fab9d-a7d1-4ea0-b4b9-2afc54040eef-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:45:56 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-182f5a8f-18db-4358-8195-109ad995b7f1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "161fab9d-a7d1-4ea0-b4b9-2afc54040eef-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:45:56 user nova-compute[72586]: INFO nova.compute.manager [None req-182f5a8f-18db-4358-8195-109ad995b7f1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Terminating instance
Aug 01 21:45:56 user nova-compute[72586]: DEBUG nova.compute.manager [None req-182f5a8f-18db-4358-8195-109ad995b7f1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Start destroying the instance on the hypervisor. {{(pid=72586) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 21:45:56 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:45:56 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:45:56 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:45:56 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:45:56 user nova-compute[72586]: DEBUG nova.compute.manager [req-6bd70d7c-1094-42e9-a91f-356ec1d06661 req-bdff9f01-64ba-44b4-bbe5-8e7ab9c979df service nova] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Received event network-vif-unplugged-c082b11d-fb01-4def-98b8-6b2966ce364c {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:45:56 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-6bd70d7c-1094-42e9-a91f-356ec1d06661 req-bdff9f01-64ba-44b4-bbe5-8e7ab9c979df service nova] Acquiring lock "161fab9d-a7d1-4ea0-b4b9-2afc54040eef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:45:56 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-6bd70d7c-1094-42e9-a91f-356ec1d06661 req-bdff9f01-64ba-44b4-bbe5-8e7ab9c979df service nova] Lock "161fab9d-a7d1-4ea0-b4b9-2afc54040eef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:45:56 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-6bd70d7c-1094-42e9-a91f-356ec1d06661 req-bdff9f01-64ba-44b4-bbe5-8e7ab9c979df service nova] Lock "161fab9d-a7d1-4ea0-b4b9-2afc54040eef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:45:56 user nova-compute[72586]: DEBUG nova.compute.manager [req-6bd70d7c-1094-42e9-a91f-356ec1d06661 req-bdff9f01-64ba-44b4-bbe5-8e7ab9c979df service nova] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] No waiting events found dispatching network-vif-unplugged-c082b11d-fb01-4def-98b8-6b2966ce364c {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:45:56 user nova-compute[72586]: DEBUG nova.compute.manager [req-6bd70d7c-1094-42e9-a91f-356ec1d06661 req-bdff9f01-64ba-44b4-bbe5-8e7ab9c979df service nova] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Received event network-vif-unplugged-c082b11d-fb01-4def-98b8-6b2966ce364c for instance with task_state deleting. {{(pid=72586) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 21:45:56 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Instance destroyed successfully.
Aug 01 21:45:56 user nova-compute[72586]: DEBUG nova.objects.instance [None req-182f5a8f-18db-4358-8195-109ad995b7f1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lazy-loading 'resources' on Instance uuid 161fab9d-a7d1-4ea0-b4b9-2afc54040eef {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:45:56 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-182f5a8f-18db-4358-8195-109ad995b7f1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:30:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1000542455',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1000542455',id=26,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:32:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88d847d04360420c80ea5608d5a2b15a',ramdisk_id='',reservation_id='r-khodwewo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1268085586',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:33:55Z,user_data=None,user_id='a984642731b9413c97038f65052ab92d',uuid=161fab9d-a7d1-4ea0-b4b9-2afc54040eef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c082b11d-fb01-4def-98b8-6b2966ce364c", "address": "fa:16:3e:b6:24:7c", "network": {"id": "86940e5d-852b-48fc-9b0e-858305321349", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1967467603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d847d04360420c80ea5608d5a2b15a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc082b11d-fb", "ovs_interfaceid": "c082b11d-fb01-4def-98b8-6b2966ce364c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:45:56 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-182f5a8f-18db-4358-8195-109ad995b7f1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Converting VIF {"id": "c082b11d-fb01-4def-98b8-6b2966ce364c", "address": "fa:16:3e:b6:24:7c", "network": {"id": "86940e5d-852b-48fc-9b0e-858305321349", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1967467603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d847d04360420c80ea5608d5a2b15a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc082b11d-fb", "ovs_interfaceid": "c082b11d-fb01-4def-98b8-6b2966ce364c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:45:56 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-182f5a8f-18db-4358-8195-109ad995b7f1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:24:7c,bridge_name='br-int',has_traffic_filtering=True,id=c082b11d-fb01-4def-98b8-6b2966ce364c,network=Network(86940e5d-852b-48fc-9b0e-858305321349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc082b11d-fb') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:45:56 user nova-compute[72586]: DEBUG os_vif [None req-182f5a8f-18db-4358-8195-109ad995b7f1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:24:7c,bridge_name='br-int',has_traffic_filtering=True,id=c082b11d-fb01-4def-98b8-6b2966ce364c,network=Network(86940e5d-852b-48fc-9b0e-858305321349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc082b11d-fb') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:45:56 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:45:56 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc082b11d-fb, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:45:56 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:45:56 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:45:56 user nova-compute[72586]: INFO os_vif [None req-182f5a8f-18db-4358-8195-109ad995b7f1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:24:7c,bridge_name='br-int',has_traffic_filtering=True,id=c082b11d-fb01-4def-98b8-6b2966ce364c,network=Network(86940e5d-852b-48fc-9b0e-858305321349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc082b11d-fb')
Aug 01 21:45:56 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-182f5a8f-18db-4358-8195-109ad995b7f1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] calling os-brick to detach iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 21:45:56 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-182f5a8f-18db-4358-8195-109ad995b7f1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, {'target_iqns': ['iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oqjwfXlR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:45:56 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-182f5a8f-18db-4358-8195-109ad995b7f1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:45:56 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-182f5a8f-18db-4358-8195-109ad995b7f1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:45:56 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-182f5a8f-18db-4358-8195-109ad995b7f1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:45:56 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-182f5a8f-18db-4358-8195-109ad995b7f1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33', 0)] {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 21:45:56 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:45:56 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:45:56 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa1e696-95aa-46be-9551-102b133ba147]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:108439f6-3bb3-4d17-a606-8a23163d802c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:45:56 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:45:56 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:45:56 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[5242b478-306b-4fe1-bf8b-4594d2842650]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:108439f6-3bb3-4d17-a606-8a23163d802c (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:45:56 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-182f5a8f-18db-4358-8195-109ad995b7f1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:45:56 user nova-compute[72586]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1 (non-flash)
Aug 01 21:45:56 user nova-compute[72586]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:108439f6-3bb3-4d17-a606-8a23163d802c (non-flash)
Aug 01 21:45:56 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:45:56 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-182f5a8f-18db-4358-8195-109ad995b7f1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 (non-flash)
Aug 01 21:45:56 user nova-compute[72586]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1 (non-flash)
Aug 01 21:45:56 user nova-compute[72586]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:108439f6-3bb3-4d17-a606-8a23163d802c (non-flash)
Aug 01 21:45:56 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:45:56 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-182f5a8f-18db-4358-8195-109ad995b7f1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ed02cdab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33'): ({'sdb'}, set())}) {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 21:45:56 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-182f5a8f-18db-4358-8195-109ad995b7f1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Removing single pathed devices sdb {{(pid=72586) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 21:45:56 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:45:56 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:45:56 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[098ca183-600c-41ff-a630-5658e2586e6a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:45:56 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:45:56 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:45:56 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c259a62-08b3-4ff7-a4aa-06bb1debc811]: (4, ('ok\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:45:56 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-182f5a8f-18db-4358-8195-109ad995b7f1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Flushing IO for device /dev/sdb {{(pid=72586) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 21:45:56 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:45:56 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:45:56 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7d0fe4-cbfd-47ae-a3ba-1435a6d766a9]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:45:56 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-182f5a8f-18db-4358-8195-109ad995b7f1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72586) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 21:45:56 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:45:56 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:45:56 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f18cba8-81d4-4edc-89c6-9836640d1817]: (4, ('1', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:45:56 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-182f5a8f-18db-4358-8195-109ad995b7f1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 21:45:56 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-182f5a8f-18db-4358-8195-109ad995b7f1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] SCSI volumes sdb have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 21:45:56 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-182f5a8f-18db-4358-8195-109ad995b7f1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33')] {{(pid=72586) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 21:45:56 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:45:56 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:45:56 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9644e17e-79cc-45f2-83fb-108e9e598440]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:45:56 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-182f5a8f-18db-4358-8195-109ad995b7f1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:45:56 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 -p 172.16.0.220:3260 --logout {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:45:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:45:57 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c62c7d8-45a6-45fd-880f-e63a172e9c73]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:45:57 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-182f5a8f-18db-4358-8195-109ad995b7f1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33, portal: 172.16.0.220,3260]
Aug 01 21:45:57 user nova-compute[72586]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33, portal: 172.16.0.220,3260] successful.
Aug 01 21:45:57 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:45:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 -p 172.16.0.220:3260 --op delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:45:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0acebba2-aca8-4728-b4d6-0d836a537e33 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:45:57 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc0808c-9c47-4787-9311-b54fa6a852c1]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:45:57 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-182f5a8f-18db-4358-8195-109ad995b7f1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:45:57 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-182f5a8f-18db-4358-8195-109ad995b7f1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.253s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:45:57 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-182f5a8f-18db-4358-8195-109ad995b7f1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] <== disconnect_volume: return (254ms) None {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:45:57 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-182f5a8f-18db-4358-8195-109ad995b7f1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Disconnected iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 21:45:57 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-182f5a8f-18db-4358-8195-109ad995b7f1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Deleting instance files /opt/stack/data/nova/instances/161fab9d-a7d1-4ea0-b4b9-2afc54040eef_del
Aug 01 21:45:57 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-182f5a8f-18db-4358-8195-109ad995b7f1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Deletion of /opt/stack/data/nova/instances/161fab9d-a7d1-4ea0-b4b9-2afc54040eef_del complete
Aug 01 21:45:57 user nova-compute[72586]: INFO nova.compute.manager [None req-182f5a8f-18db-4358-8195-109ad995b7f1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Took 1.09 seconds to destroy the instance on the hypervisor.
Aug 01 21:45:57 user nova-compute[72586]: DEBUG oslo.service.loopingcall [None req-182f5a8f-18db-4358-8195-109ad995b7f1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72586) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 21:45:57 user nova-compute[72586]: DEBUG nova.compute.manager [-] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Deallocating network for instance {{(pid=72586) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 21:45:57 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] deallocate_for_instance() {{(pid=72586) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 21:45:57 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:45:57 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Took 0.45 seconds to deallocate network for instance.
Aug 01 21:45:58 user nova-compute[72586]: INFO nova.compute.manager [None req-182f5a8f-18db-4358-8195-109ad995b7f1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Took 0.80 seconds to detach 1 volumes for instance.
Aug 01 21:45:58 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-182f5a8f-18db-4358-8195-109ad995b7f1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:45:58 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-182f5a8f-18db-4358-8195-109ad995b7f1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:45:58 user nova-compute[72586]: DEBUG nova.compute.manager [req-51404f2b-bebe-4841-9d1b-db6bba468a1f req-69068861-2643-4a58-905d-ea01f0add52e service nova] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Received event network-vif-plugged-c082b11d-fb01-4def-98b8-6b2966ce364c {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:45:58 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-51404f2b-bebe-4841-9d1b-db6bba468a1f req-69068861-2643-4a58-905d-ea01f0add52e service nova] Acquiring lock "161fab9d-a7d1-4ea0-b4b9-2afc54040eef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:45:58 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-51404f2b-bebe-4841-9d1b-db6bba468a1f req-69068861-2643-4a58-905d-ea01f0add52e service nova] Lock "161fab9d-a7d1-4ea0-b4b9-2afc54040eef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:45:58 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-51404f2b-bebe-4841-9d1b-db6bba468a1f req-69068861-2643-4a58-905d-ea01f0add52e service nova] Lock "161fab9d-a7d1-4ea0-b4b9-2afc54040eef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:45:58 user nova-compute[72586]: DEBUG nova.compute.manager [req-51404f2b-bebe-4841-9d1b-db6bba468a1f req-69068861-2643-4a58-905d-ea01f0add52e service nova] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] No waiting events found dispatching network-vif-plugged-c082b11d-fb01-4def-98b8-6b2966ce364c {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:45:58 user nova-compute[72586]: WARNING nova.compute.manager [req-51404f2b-bebe-4841-9d1b-db6bba468a1f req-69068861-2643-4a58-905d-ea01f0add52e service nova] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Received unexpected event network-vif-plugged-c082b11d-fb01-4def-98b8-6b2966ce364c for instance with vm_state deleted and task_state None.
Aug 01 21:45:58 user nova-compute[72586]: DEBUG nova.compute.manager [req-51404f2b-bebe-4841-9d1b-db6bba468a1f req-69068861-2643-4a58-905d-ea01f0add52e service nova] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Received event network-vif-deleted-c082b11d-fb01-4def-98b8-6b2966ce364c {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:45:58 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-182f5a8f-18db-4358-8195-109ad995b7f1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:45:58 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-182f5a8f-18db-4358-8195-109ad995b7f1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:45:58 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-182f5a8f-18db-4358-8195-109ad995b7f1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.248s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:45:58 user nova-compute[72586]: INFO nova.scheduler.client.report [None req-182f5a8f-18db-4358-8195-109ad995b7f1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Deleted allocations for instance 161fab9d-a7d1-4ea0-b4b9-2afc54040eef
Aug 01 21:45:58 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-182f5a8f-18db-4358-8195-109ad995b7f1 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "161fab9d-a7d1-4ea0-b4b9-2afc54040eef" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.763s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:46:00 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:46:00 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Cleaning up deleted instances {{(pid=72586) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 21:46:00 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] There are 0 instances to clean {{(pid=72586) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 21:46:01 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:46:04 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:46:06 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:46:07 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._sync_power_states {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:46:07 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Triggering sync for uuid af2de810-b22f-4fa9-835c-c673abd145db {{(pid=72586) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 21:46:07 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Triggering sync for uuid 8ee464b0-f75e-4f30-9838-74bca9619a07 {{(pid=72586) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 21:46:07 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Triggering sync for uuid f2f4343d-0cab-4ed6-972d-e2bd8a801e8f {{(pid=72586) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 21:46:07 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Triggering sync for uuid 2dd707a7-354a-4563-9c3f-56d9a92dc1b0 {{(pid=72586) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 21:46:07 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Triggering sync for uuid 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6 {{(pid=72586) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 21:46:07 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "af2de810-b22f-4fa9-835c-c673abd145db" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:46:07 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "af2de810-b22f-4fa9-835c-c673abd145db" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:46:07 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "8ee464b0-f75e-4f30-9838-74bca9619a07" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:46:07 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "8ee464b0-f75e-4f30-9838-74bca9619a07" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:46:07 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "f2f4343d-0cab-4ed6-972d-e2bd8a801e8f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:46:07 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "f2f4343d-0cab-4ed6-972d-e2bd8a801e8f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:46:07 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "2dd707a7-354a-4563-9c3f-56d9a92dc1b0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:46:07 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "2dd707a7-354a-4563-9c3f-56d9a92dc1b0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:46:07 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:46:07 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:46:07 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "af2de810-b22f-4fa9-835c-c673abd145db" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:46:07 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "f2f4343d-0cab-4ed6-972d-e2bd8a801e8f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:46:07 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "8ee464b0-f75e-4f30-9838-74bca9619a07" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:46:07 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "2dd707a7-354a-4563-9c3f-56d9a92dc1b0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:46:07 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:46:11 user nova-compute[72586]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690926356.7649732, 161fab9d-a7d1-4ea0-b4b9-2afc54040eef => Stopped> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:46:11 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] VM Stopped (Lifecycle Event)
Aug 01 21:46:11 user nova-compute[72586]: DEBUG nova.compute.manager [None req-6ee86db4-b0f7-4da9-a967-ead059c206dc None None] [instance: 161fab9d-a7d1-4ea0-b4b9-2afc54040eef] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:46:11 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:46:14 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:46:16 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:46:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:46:20 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-6c6f7d23-72ae-4d44-8507-00f4d797b018 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Acquiring lock "8ee464b0-f75e-4f30-9838-74bca9619a07" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:46:20 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-6c6f7d23-72ae-4d44-8507-00f4d797b018 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Lock "8ee464b0-f75e-4f30-9838-74bca9619a07" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:46:20 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-6c6f7d23-72ae-4d44-8507-00f4d797b018 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Acquiring lock "8ee464b0-f75e-4f30-9838-74bca9619a07-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:46:20 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-6c6f7d23-72ae-4d44-8507-00f4d797b018 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Lock "8ee464b0-f75e-4f30-9838-74bca9619a07-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:46:20 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-6c6f7d23-72ae-4d44-8507-00f4d797b018 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Lock "8ee464b0-f75e-4f30-9838-74bca9619a07-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:46:20 user nova-compute[72586]: INFO nova.compute.manager [None req-6c6f7d23-72ae-4d44-8507-00f4d797b018 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] Terminating instance
Aug 01 21:46:20 user nova-compute[72586]: DEBUG nova.compute.manager [None req-6c6f7d23-72ae-4d44-8507-00f4d797b018 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] Start destroying the instance on the hypervisor. {{(pid=72586) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 21:46:20 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:46:20 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:46:20 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:46:20 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:46:20 user nova-compute[72586]: DEBUG nova.compute.manager [req-75a976a9-06d2-4f26-b489-b7fc0df95d52 req-435f792d-a3fb-4426-b830-6858fd4d92a7 service nova] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] Received event network-vif-unplugged-37f8d809-78f6-45fa-a4e8-db8e816f6f6e {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:46:20 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-75a976a9-06d2-4f26-b489-b7fc0df95d52 req-435f792d-a3fb-4426-b830-6858fd4d92a7 service nova] Acquiring lock "8ee464b0-f75e-4f30-9838-74bca9619a07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:46:20 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-75a976a9-06d2-4f26-b489-b7fc0df95d52 req-435f792d-a3fb-4426-b830-6858fd4d92a7 service nova] Lock "8ee464b0-f75e-4f30-9838-74bca9619a07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:46:20 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-75a976a9-06d2-4f26-b489-b7fc0df95d52 req-435f792d-a3fb-4426-b830-6858fd4d92a7 service nova] Lock "8ee464b0-f75e-4f30-9838-74bca9619a07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:46:20 user nova-compute[72586]: DEBUG nova.compute.manager [req-75a976a9-06d2-4f26-b489-b7fc0df95d52 req-435f792d-a3fb-4426-b830-6858fd4d92a7 service nova] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] No waiting events found dispatching network-vif-unplugged-37f8d809-78f6-45fa-a4e8-db8e816f6f6e {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:46:20 user nova-compute[72586]: DEBUG nova.compute.manager [req-75a976a9-06d2-4f26-b489-b7fc0df95d52 req-435f792d-a3fb-4426-b830-6858fd4d92a7 service nova] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] Received event network-vif-unplugged-37f8d809-78f6-45fa-a4e8-db8e816f6f6e for instance with task_state deleting. {{(pid=72586) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 21:46:20 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:46:20 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:46:20 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] Instance destroyed successfully.
Aug 01 21:46:20 user nova-compute[72586]: DEBUG nova.objects.instance [None req-6c6f7d23-72ae-4d44-8507-00f4d797b018 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Lazy-loading 'resources' on Instance uuid 8ee464b0-f75e-4f30-9838-74bca9619a07 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:46:20 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-6c6f7d23-72ae-4d44-8507-00f4d797b018 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:37:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-212400468',display_name='tempest-ServersNegativeTestJSON-server-212400468',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-212400468',id=33,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:37:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2896d39f80af4e07869d3b1acfba1d8b',ramdisk_id='',reservation_id='r-zuyfio31',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-2014666022',owner_user_name='tempest-ServersNegativeTestJSON-2014666022-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:37:37Z,user_data=None,user_id='49d631f793a54e4cbf086cbf89696834',uuid=8ee464b0-f75e-4f30-9838-74bca9619a07,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37f8d809-78f6-45fa-a4e8-db8e816f6f6e", "address": "fa:16:3e:96:29:2e", "network": {"id": "e687eacc-3080-46db-b577-5efb36856dce", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1089459024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2896d39f80af4e07869d3b1acfba1d8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f8d809-78", "ovs_interfaceid": "37f8d809-78f6-45fa-a4e8-db8e816f6f6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:46:20 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-6c6f7d23-72ae-4d44-8507-00f4d797b018 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Converting VIF {"id": "37f8d809-78f6-45fa-a4e8-db8e816f6f6e", "address": "fa:16:3e:96:29:2e", "network": {"id": "e687eacc-3080-46db-b577-5efb36856dce", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1089459024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2896d39f80af4e07869d3b1acfba1d8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f8d809-78", "ovs_interfaceid": "37f8d809-78f6-45fa-a4e8-db8e816f6f6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:46:20 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-6c6f7d23-72ae-4d44-8507-00f4d797b018 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:96:29:2e,bridge_name='br-int',has_traffic_filtering=True,id=37f8d809-78f6-45fa-a4e8-db8e816f6f6e,network=Network(e687eacc-3080-46db-b577-5efb36856dce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37f8d809-78') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:46:20 user nova-compute[72586]: DEBUG os_vif [None req-6c6f7d23-72ae-4d44-8507-00f4d797b018 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:29:2e,bridge_name='br-int',has_traffic_filtering=True,id=37f8d809-78f6-45fa-a4e8-db8e816f6f6e,network=Network(e687eacc-3080-46db-b577-5efb36856dce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37f8d809-78') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:46:20 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:46:20 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37f8d809-78, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:46:20 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:46:20 user nova-compute[72586]: INFO os_vif [None req-6c6f7d23-72ae-4d44-8507-00f4d797b018 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:29:2e,bridge_name='br-int',has_traffic_filtering=True,id=37f8d809-78f6-45fa-a4e8-db8e816f6f6e,network=Network(e687eacc-3080-46db-b577-5efb36856dce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37f8d809-78')
Aug 01 21:46:20 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-6c6f7d23-72ae-4d44-8507-00f4d797b018 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] Deleting instance files /opt/stack/data/nova/instances/8ee464b0-f75e-4f30-9838-74bca9619a07_del
Aug 01 21:46:20 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-6c6f7d23-72ae-4d44-8507-00f4d797b018 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] Deletion of /opt/stack/data/nova/instances/8ee464b0-f75e-4f30-9838-74bca9619a07_del complete
Aug 01 21:46:20 user nova-compute[72586]: INFO nova.compute.manager [None req-6c6f7d23-72ae-4d44-8507-00f4d797b018 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 01 21:46:20 user nova-compute[72586]: DEBUG oslo.service.loopingcall [None req-6c6f7d23-72ae-4d44-8507-00f4d797b018 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72586) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 21:46:20 user nova-compute[72586]: DEBUG nova.compute.manager [-] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] Deallocating network for instance {{(pid=72586) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 21:46:20 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] deallocate_for_instance() {{(pid=72586) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 21:46:21 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:46:21 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] Took 0.88 seconds to deallocate network for instance.
Aug 01 21:46:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-6c6f7d23-72ae-4d44-8507-00f4d797b018 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:46:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-6c6f7d23-72ae-4d44-8507-00f4d797b018 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:46:22 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-6c6f7d23-72ae-4d44-8507-00f4d797b018 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:46:22 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-6c6f7d23-72ae-4d44-8507-00f4d797b018 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:46:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-6c6f7d23-72ae-4d44-8507-00f4d797b018 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.202s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:46:22 user nova-compute[72586]: INFO nova.scheduler.client.report [None req-6c6f7d23-72ae-4d44-8507-00f4d797b018 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Deleted allocations for instance 8ee464b0-f75e-4f30-9838-74bca9619a07
Aug 01 21:46:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-6c6f7d23-72ae-4d44-8507-00f4d797b018 tempest-ServersNegativeTestJSON-2014666022 tempest-ServersNegativeTestJSON-2014666022-project-member] Lock "8ee464b0-f75e-4f30-9838-74bca9619a07" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.152s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:46:22 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:46:22 user nova-compute[72586]: DEBUG nova.compute.manager [req-e1692e29-510d-468a-be5d-a675dd9210ce req-336a7bac-c33e-463e-8779-2fd9e891712d service nova] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] Received event network-vif-plugged-37f8d809-78f6-45fa-a4e8-db8e816f6f6e {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:46:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-e1692e29-510d-468a-be5d-a675dd9210ce req-336a7bac-c33e-463e-8779-2fd9e891712d service nova] Acquiring lock "8ee464b0-f75e-4f30-9838-74bca9619a07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:46:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-e1692e29-510d-468a-be5d-a675dd9210ce req-336a7bac-c33e-463e-8779-2fd9e891712d service nova] Lock "8ee464b0-f75e-4f30-9838-74bca9619a07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:46:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-e1692e29-510d-468a-be5d-a675dd9210ce req-336a7bac-c33e-463e-8779-2fd9e891712d service nova] Lock "8ee464b0-f75e-4f30-9838-74bca9619a07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:46:22 user nova-compute[72586]: DEBUG nova.compute.manager [req-e1692e29-510d-468a-be5d-a675dd9210ce req-336a7bac-c33e-463e-8779-2fd9e891712d service nova] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] No waiting events found dispatching network-vif-plugged-37f8d809-78f6-45fa-a4e8-db8e816f6f6e {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:46:22 user nova-compute[72586]: WARNING nova.compute.manager [req-e1692e29-510d-468a-be5d-a675dd9210ce req-336a7bac-c33e-463e-8779-2fd9e891712d service nova] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] Received unexpected event network-vif-plugged-37f8d809-78f6-45fa-a4e8-db8e816f6f6e for instance with vm_state deleted and task_state None.
Aug 01 21:46:22 user nova-compute[72586]: DEBUG nova.compute.manager [req-e1692e29-510d-468a-be5d-a675dd9210ce req-336a7bac-c33e-463e-8779-2fd9e891712d service nova] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] Received event network-vif-deleted-37f8d809-78f6-45fa-a4e8-db8e816f6f6e {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:46:23 user nova-compute[72586]: DEBUG nova.compute.manager [req-60bde9f1-bc4e-46e8-bc0a-86c0a2818fca req-c88a1dc0-398b-4106-a21a-474a1e4b1334 service nova] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Received event network-changed-c77ce213-734b-4877-80a6-7827c6756b51 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:46:23 user nova-compute[72586]: DEBUG nova.compute.manager [req-60bde9f1-bc4e-46e8-bc0a-86c0a2818fca req-c88a1dc0-398b-4106-a21a-474a1e4b1334 service nova] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Refreshing instance network info cache due to event network-changed-c77ce213-734b-4877-80a6-7827c6756b51. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:46:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-60bde9f1-bc4e-46e8-bc0a-86c0a2818fca req-c88a1dc0-398b-4106-a21a-474a1e4b1334 service nova] Acquiring lock "refresh_cache-2dd707a7-354a-4563-9c3f-56d9a92dc1b0" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:46:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-60bde9f1-bc4e-46e8-bc0a-86c0a2818fca req-c88a1dc0-398b-4106-a21a-474a1e4b1334 service nova] Acquired lock "refresh_cache-2dd707a7-354a-4563-9c3f-56d9a92dc1b0" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:46:23 user nova-compute[72586]: DEBUG nova.network.neutron [req-60bde9f1-bc4e-46e8-bc0a-86c0a2818fca req-c88a1dc0-398b-4106-a21a-474a1e4b1334 service nova] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Refreshing network info cache for port c77ce213-734b-4877-80a6-7827c6756b51 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:46:23 user nova-compute[72586]: DEBUG nova.network.neutron [req-60bde9f1-bc4e-46e8-bc0a-86c0a2818fca req-c88a1dc0-398b-4106-a21a-474a1e4b1334 service nova] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Updated VIF entry in instance network info cache for port c77ce213-734b-4877-80a6-7827c6756b51. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:46:23 user nova-compute[72586]: DEBUG nova.network.neutron [req-60bde9f1-bc4e-46e8-bc0a-86c0a2818fca req-c88a1dc0-398b-4106-a21a-474a1e4b1334 service nova] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Updating instance_info_cache with network_info: [{"id": "c77ce213-734b-4877-80a6-7827c6756b51", "address": "fa:16:3e:e8:22:d9", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc77ce213-73", "ovs_interfaceid": "c77ce213-734b-4877-80a6-7827c6756b51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:46:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-60bde9f1-bc4e-46e8-bc0a-86c0a2818fca req-c88a1dc0-398b-4106-a21a-474a1e4b1334 service nova] Releasing lock "refresh_cache-2dd707a7-354a-4563-9c3f-56d9a92dc1b0" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:46:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0c3811bd-3220-4f18-9582-fda0e8954b7c tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Acquiring lock "2dd707a7-354a-4563-9c3f-56d9a92dc1b0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:46:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0c3811bd-3220-4f18-9582-fda0e8954b7c tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "2dd707a7-354a-4563-9c3f-56d9a92dc1b0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:46:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0c3811bd-3220-4f18-9582-fda0e8954b7c tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Acquiring lock "2dd707a7-354a-4563-9c3f-56d9a92dc1b0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:46:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0c3811bd-3220-4f18-9582-fda0e8954b7c tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "2dd707a7-354a-4563-9c3f-56d9a92dc1b0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:46:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0c3811bd-3220-4f18-9582-fda0e8954b7c tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "2dd707a7-354a-4563-9c3f-56d9a92dc1b0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:46:24 user nova-compute[72586]: INFO nova.compute.manager [None req-0c3811bd-3220-4f18-9582-fda0e8954b7c tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Terminating instance
Aug 01 21:46:24 user nova-compute[72586]: DEBUG nova.compute.manager [None req-0c3811bd-3220-4f18-9582-fda0e8954b7c tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Start destroying the instance on the hypervisor. {{(pid=72586) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 21:46:24 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:46:24 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:46:24 user nova-compute[72586]: DEBUG nova.compute.manager [req-29ffc74c-984e-4f0a-8048-a5f2f9332f97 req-1cb67fa3-c5bf-4add-8ef0-1c51256aee2c service nova] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Received event network-vif-unplugged-c77ce213-734b-4877-80a6-7827c6756b51 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:46:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-29ffc74c-984e-4f0a-8048-a5f2f9332f97 req-1cb67fa3-c5bf-4add-8ef0-1c51256aee2c service nova] Acquiring lock "2dd707a7-354a-4563-9c3f-56d9a92dc1b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:46:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-29ffc74c-984e-4f0a-8048-a5f2f9332f97 req-1cb67fa3-c5bf-4add-8ef0-1c51256aee2c service nova] Lock "2dd707a7-354a-4563-9c3f-56d9a92dc1b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:46:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-29ffc74c-984e-4f0a-8048-a5f2f9332f97 req-1cb67fa3-c5bf-4add-8ef0-1c51256aee2c service nova] Lock "2dd707a7-354a-4563-9c3f-56d9a92dc1b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:46:24 user nova-compute[72586]: DEBUG nova.compute.manager [req-29ffc74c-984e-4f0a-8048-a5f2f9332f97 req-1cb67fa3-c5bf-4add-8ef0-1c51256aee2c service nova] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] No waiting events found dispatching network-vif-unplugged-c77ce213-734b-4877-80a6-7827c6756b51 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:46:24 user nova-compute[72586]: DEBUG nova.compute.manager [req-29ffc74c-984e-4f0a-8048-a5f2f9332f97 req-1cb67fa3-c5bf-4add-8ef0-1c51256aee2c service nova] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Received event network-vif-unplugged-c77ce213-734b-4877-80a6-7827c6756b51 for instance with task_state deleting. {{(pid=72586) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 21:46:24 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:46:24 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:46:25 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:46:25 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Instance destroyed successfully.
Aug 01 21:46:25 user nova-compute[72586]: DEBUG nova.objects.instance [None req-0c3811bd-3220-4f18-9582-fda0e8954b7c tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lazy-loading 'resources' on Instance uuid 2dd707a7-354a-4563-9c3f-56d9a92dc1b0 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:46:25 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-0c3811bd-3220-4f18-9582-fda0e8954b7c tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:44:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-296158979',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-296158979',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-296158979',id=40,image_ref='16514bf0-f9b7-4e6c-ab95-3c846f9cc0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATYd21D981zh36wIBufSPkJZG8vmxKla34eSqQ707Lv6uBiL8y6mGuBQEM+8zzWIgrYCX0v4Pd4D2SvDAkXTIVa8rFUQKrC0wDymVzvEAMa1uagPiObTU3oWLuTNBP86A==',key_name='tempest-keypair-2139281117',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:44:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a631250d39c34afca47a1fa2817e627e',ramdisk_id='',reservation_id='r-267qp8is',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1160754716',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1160754716-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1160754716',owner_user_name='tempest-TestVolumeBootPattern-1160754716-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:44:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76cd0d9d973b410ca4ff08fc7630fbc6',uuid=2dd707a7-354a-4563-9c3f-56d9a92dc1b0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c77ce213-734b-4877-80a6-7827c6756b51", "address": "fa:16:3e:e8:22:d9", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc77ce213-73", "ovs_interfaceid": "c77ce213-734b-4877-80a6-7827c6756b51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:46:25 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-0c3811bd-3220-4f18-9582-fda0e8954b7c tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Converting VIF {"id": "c77ce213-734b-4877-80a6-7827c6756b51", "address": "fa:16:3e:e8:22:d9", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc77ce213-73", "ovs_interfaceid": "c77ce213-734b-4877-80a6-7827c6756b51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:46:25 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-0c3811bd-3220-4f18-9582-fda0e8954b7c tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:22:d9,bridge_name='br-int',has_traffic_filtering=True,id=c77ce213-734b-4877-80a6-7827c6756b51,network=Network(2fbf5ffb-0ec0-403b-bc92-259563ab1d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc77ce213-73') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:46:25 user nova-compute[72586]: DEBUG os_vif [None req-0c3811bd-3220-4f18-9582-fda0e8954b7c tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:22:d9,bridge_name='br-int',has_traffic_filtering=True,id=c77ce213-734b-4877-80a6-7827c6756b51,network=Network(2fbf5ffb-0ec0-403b-bc92-259563ab1d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc77ce213-73') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:46:25 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:46:25 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc77ce213-73, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:46:25 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:46:25 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:46:25 user nova-compute[72586]: INFO os_vif [None req-0c3811bd-3220-4f18-9582-fda0e8954b7c tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:22:d9,bridge_name='br-int',has_traffic_filtering=True,id=c77ce213-734b-4877-80a6-7827c6756b51,network=Network(2fbf5ffb-0ec0-403b-bc92-259563ab1d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc77ce213-73')
Aug 01 21:46:25 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c3811bd-3220-4f18-9582-fda0e8954b7c tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] calling os-brick to detach iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 21:46:25 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3811bd-3220-4f18-9582-fda0e8954b7c tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, {'target_iqns': ['iqn.2010-10.org.openstack:108439f6-3bb3-4d17-a606-8a23163d802c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cpYaPyFk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:46:25 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-0c3811bd-3220-4f18-9582-fda0e8954b7c tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:46:25 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-0c3811bd-3220-4f18-9582-fda0e8954b7c tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:46:25 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-0c3811bd-3220-4f18-9582-fda0e8954b7c tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:46:25 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3811bd-3220-4f18-9582-fda0e8954b7c tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:108439f6-3bb3-4d17-a606-8a23163d802c', 0)] {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 21:46:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:46:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:46:25 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[74589c2e-837a-4bc5-a1e4-6275ed41338b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:108439f6-3bb3-4d17-a606-8a23163d802c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:46:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:46:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:46:25 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[543dd9e6-af33-4c36-90bf-098dfd099ebb]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:108439f6-3bb3-4d17-a606-8a23163d802c (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:46:25 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3811bd-3220-4f18-9582-fda0e8954b7c tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1 (non-flash)
Aug 01 21:46:25 user nova-compute[72586]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:108439f6-3bb3-4d17-a606-8a23163d802c (non-flash)
Aug 01 21:46:25 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:46:25 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3811bd-3220-4f18-9582-fda0e8954b7c tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1 (non-flash)
Aug 01 21:46:25 user nova-compute[72586]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:108439f6-3bb3-4d17-a606-8a23163d802c (non-flash)
Aug 01 21:46:25 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:46:25 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3811bd-3220-4f18-9582-fda0e8954b7c tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ed03d0b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:108439f6-3bb3-4d17-a606-8a23163d802c'): ({'sdd'}, set())}) {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 21:46:25 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-0c3811bd-3220-4f18-9582-fda0e8954b7c tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Removing single pathed devices sdd {{(pid=72586) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 21:46:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:46:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:46:25 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b321f0e-3b33-42be-b20e-504c56651f1e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:46:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:46:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:46:25 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c2e007-92fe-42dc-9dba-a6f25bfdaa1c]: (4, ('ok\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:46:25 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-0c3811bd-3220-4f18-9582-fda0e8954b7c tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Flushing IO for device /dev/sdd {{(pid=72586) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 21:46:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:46:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:46:25 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68ac77c-d73e-4f49-86e6-ca552d8ab290]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:46:25 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-0c3811bd-3220-4f18-9582-fda0e8954b7c tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72586) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 21:46:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:46:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:46:25 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b055edb-f2a0-480a-bf2f-38ba882ea741]: (4, ('1', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:46:25 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-0c3811bd-3220-4f18-9582-fda0e8954b7c tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 21:46:25 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-0c3811bd-3220-4f18-9582-fda0e8954b7c tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] SCSI volumes sdd have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 21:46:25 user nova-compute[72586]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO58ddc1e7-2486016c314081ef', '/dev/disk/by-id/scsi-23234383630313663', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_58ddc1e7') {{(pid=83581) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 01 21:46:25 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ec2e9f-6aee-4639-9b61-35d871b059ee]: (4, None) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:46:25 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3811bd-3220-4f18-9582-fda0e8954b7c tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:108439f6-3bb3-4d17-a606-8a23163d802c')] {{(pid=72586) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 21:46:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:108439f6-3bb3-4d17-a606-8a23163d802c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:46:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:108439f6-3bb3-4d17-a606-8a23163d802c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:46:25 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d918920-1e85-4d33-a674-1a3867664d32]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:46:25 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3811bd-3220-4f18-9582-fda0e8954b7c tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:46:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:108439f6-3bb3-4d17-a606-8a23163d802c -p 172.16.0.220:3260 --logout {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:46:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:108439f6-3bb3-4d17-a606-8a23163d802c -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:46:25 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54a3a0d-dcdb-4180-a99b-32f196c9b5ef]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:108439f6-3bb3-4d17-a606-8a23163d802c, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:108439f6-3bb3-4d17-a606-8a23163d802c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:46:25 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3811bd-3220-4f18-9582-fda0e8954b7c tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:108439f6-3bb3-4d17-a606-8a23163d802c, portal: 172.16.0.220,3260]
Aug 01 21:46:25 user nova-compute[72586]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:108439f6-3bb3-4d17-a606-8a23163d802c, portal: 172.16.0.220,3260] successful.
Aug 01 21:46:25 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:46:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:108439f6-3bb3-4d17-a606-8a23163d802c -p 172.16.0.220:3260 --op delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:46:25 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:108439f6-3bb3-4d17-a606-8a23163d802c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:46:25 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[53584e4f-7409-43f8-90bb-a688523c35ec]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:46:25 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3811bd-3220-4f18-9582-fda0e8954b7c tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:46:25 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-0c3811bd-3220-4f18-9582-fda0e8954b7c tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:46:25 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3811bd-3220-4f18-9582-fda0e8954b7c tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] <== disconnect_volume: return (275ms) None {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:46:25 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c3811bd-3220-4f18-9582-fda0e8954b7c tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Disconnected iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 21:46:25 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-0c3811bd-3220-4f18-9582-fda0e8954b7c tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Deleting instance files /opt/stack/data/nova/instances/2dd707a7-354a-4563-9c3f-56d9a92dc1b0_del
Aug 01 21:46:25 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-0c3811bd-3220-4f18-9582-fda0e8954b7c tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Deletion of /opt/stack/data/nova/instances/2dd707a7-354a-4563-9c3f-56d9a92dc1b0_del complete
Aug 01 21:46:25 user nova-compute[72586]: INFO nova.compute.manager [None req-0c3811bd-3220-4f18-9582-fda0e8954b7c tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Took 1.15 seconds to destroy the instance on the hypervisor.
Aug 01 21:46:25 user nova-compute[72586]: DEBUG oslo.service.loopingcall [None req-0c3811bd-3220-4f18-9582-fda0e8954b7c tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72586) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 21:46:25 user nova-compute[72586]: DEBUG nova.compute.manager [-] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Deallocating network for instance {{(pid=72586) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 21:46:25 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] deallocate_for_instance() {{(pid=72586) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 21:46:26 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:46:26 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Took 1.06 seconds to deallocate network for instance.
Aug 01 21:46:26 user nova-compute[72586]: DEBUG nova.compute.manager [req-82d00876-ce00-490f-bb3b-93e7c249d64c req-b0f4f2be-6b29-49af-b5f8-72635e6d0674 service nova] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Received event network-vif-plugged-c77ce213-734b-4877-80a6-7827c6756b51 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:46:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-82d00876-ce00-490f-bb3b-93e7c249d64c req-b0f4f2be-6b29-49af-b5f8-72635e6d0674 service nova] Acquiring lock "2dd707a7-354a-4563-9c3f-56d9a92dc1b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:46:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-82d00876-ce00-490f-bb3b-93e7c249d64c req-b0f4f2be-6b29-49af-b5f8-72635e6d0674 service nova] Lock "2dd707a7-354a-4563-9c3f-56d9a92dc1b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:46:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-82d00876-ce00-490f-bb3b-93e7c249d64c req-b0f4f2be-6b29-49af-b5f8-72635e6d0674 service nova] Lock "2dd707a7-354a-4563-9c3f-56d9a92dc1b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:46:26 user nova-compute[72586]: DEBUG nova.compute.manager [req-82d00876-ce00-490f-bb3b-93e7c249d64c req-b0f4f2be-6b29-49af-b5f8-72635e6d0674 service nova] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] No waiting events found dispatching network-vif-plugged-c77ce213-734b-4877-80a6-7827c6756b51 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:46:26 user nova-compute[72586]: WARNING nova.compute.manager [req-82d00876-ce00-490f-bb3b-93e7c249d64c req-b0f4f2be-6b29-49af-b5f8-72635e6d0674 service nova] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Received unexpected event network-vif-plugged-c77ce213-734b-4877-80a6-7827c6756b51 for instance with vm_state active and task_state deleting.
Aug 01 21:46:26 user nova-compute[72586]: DEBUG nova.compute.manager [req-82d00876-ce00-490f-bb3b-93e7c249d64c req-b0f4f2be-6b29-49af-b5f8-72635e6d0674 service nova] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Received event network-vif-deleted-c77ce213-734b-4877-80a6-7827c6756b51 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:46:27 user nova-compute[72586]: INFO nova.compute.manager [None req-0c3811bd-3220-4f18-9582-fda0e8954b7c tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Took 0.74 seconds to detach 1 volumes for instance.
Aug 01 21:46:27 user nova-compute[72586]: DEBUG nova.compute.manager [None req-0c3811bd-3220-4f18-9582-fda0e8954b7c tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Deleting volume: 108439f6-3bb3-4d17-a606-8a23163d802c {{(pid=72586) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 01 21:46:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0c3811bd-3220-4f18-9582-fda0e8954b7c tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:46:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0c3811bd-3220-4f18-9582-fda0e8954b7c tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:46:27 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-0c3811bd-3220-4f18-9582-fda0e8954b7c tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:46:27 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-0c3811bd-3220-4f18-9582-fda0e8954b7c tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:46:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0c3811bd-3220-4f18-9582-fda0e8954b7c tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.185s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:46:27 user nova-compute[72586]: INFO nova.scheduler.client.report [None req-0c3811bd-3220-4f18-9582-fda0e8954b7c tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Deleted allocations for instance 2dd707a7-354a-4563-9c3f-56d9a92dc1b0
Aug 01 21:46:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0c3811bd-3220-4f18-9582-fda0e8954b7c tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "2dd707a7-354a-4563-9c3f-56d9a92dc1b0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.428s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:46:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:46:30 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:46:30 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:46:31 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:46:34 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:46:35 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:46:35 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:46:35 user nova-compute[72586]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690926380.8388276, 8ee464b0-f75e-4f30-9838-74bca9619a07 => Stopped> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:46:35 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] VM Stopped (Lifecycle Event)
Aug 01 21:46:35 user nova-compute[72586]: DEBUG nova.compute.manager [None req-10596df3-baf7-4e3d-a01d-d2ccbaec71cf None None] [instance: 8ee464b0-f75e-4f30-9838-74bca9619a07] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:46:36 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:46:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:46:38 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:46:39 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:46:40 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:46:40 user nova-compute[72586]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690926385.3289015, 2dd707a7-354a-4563-9c3f-56d9a92dc1b0 => Stopped> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:46:40 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] VM Stopped (Lifecycle Event)
Aug 01 21:46:40 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:46:40 user nova-compute[72586]: DEBUG nova.compute.manager [None req-e83ee3b2-931d-41fb-a945-06a15bdb1d4a None None] [instance: 2dd707a7-354a-4563-9c3f-56d9a92dc1b0] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:46:40 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:46:40 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:46:40 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72586) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 21:46:44 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:46:44 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Starting heal instance info cache {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 21:46:44 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Rebuilding the list of instances to heal {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 21:46:44 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "refresh_cache-af2de810-b22f-4fa9-835c-c673abd145db" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:46:44 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquired lock "refresh_cache-af2de810-b22f-4fa9-835c-c673abd145db" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:46:44 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Forcefully refreshing network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 21:46:44 user nova-compute[72586]: DEBUG nova.objects.instance [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lazy-loading 'info_cache' on Instance uuid af2de810-b22f-4fa9-835c-c673abd145db {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:46:45 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:46:45 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:46:45 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Updating instance_info_cache with network_info: [{"id": "b3d7d993-0a45-40ab-8cdd-e3eb06183294", "address": "fa:16:3e:29:af:12", "network": {"id": "86940e5d-852b-48fc-9b0e-858305321349", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1967467603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d847d04360420c80ea5608d5a2b15a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3d7d993-0a", "ovs_interfaceid": "b3d7d993-0a45-40ab-8cdd-e3eb06183294", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:46:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Releasing lock "refresh_cache-af2de810-b22f-4fa9-835c-c673abd145db" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:46:45 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Updated the network info_cache for instance {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 21:46:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Acquiring lock "d0fa04b2-75e5-4542-9600-7a1517884041" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:46:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Lock "d0fa04b2-75e5-4542-9600-7a1517884041" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:46:45 user nova-compute[72586]: DEBUG nova.compute.manager [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Starting instance... {{(pid=72586) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 21:46:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:46:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:46:45 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72586) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 21:46:45 user nova-compute[72586]: INFO nova.compute.claims [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Claim successful on node user
Aug 01 21:46:45 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:46:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:46:46 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:46:46 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:46:46 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.307s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:46:46 user nova-compute[72586]: DEBUG nova.compute.manager [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Start building networks asynchronously for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 21:46:46 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.266s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:46:46 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:46:46 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Auditing locally available compute resources for user (node: user) {{(pid=72586) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 21:46:46 user nova-compute[72586]: DEBUG nova.compute.manager [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Allocating IP information in the background. {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 21:46:46 user nova-compute[72586]: DEBUG nova.network.neutron [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] allocate_for_instance() {{(pid=72586) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 21:46:46 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 21:46:46 user nova-compute[72586]: DEBUG nova.compute.manager [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Start building block device mappings for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 21:46:46 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:46:46 user nova-compute[72586]: INFO nova.virt.block_device [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Booting with volume 89992cbb-33b3-4a79-a3b7-534d9854a5a6 at /dev/vda
Aug 01 21:46:46 user nova-compute[72586]: DEBUG nova.policy [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd0e99da03c7045b0bc1213eded097dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd633939ea5ac494c8668f0e5acaba7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72586) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 21:46:46 user nova-compute[72586]: DEBUG os_brick.utils [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:46:46 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:46:46 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:46:46 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[501dec24-c52a-4383-acaa-131cf9715e15]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4bc202fb9cb\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:46:46 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:46:46 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:46:46 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:46:46 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:46:46 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c55cb7-49fd-452d-aa91-e764fad2b33b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:46:46 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:46:46 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:46:46 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8dcdafe-365e-441a-96b3-4ba3a54aabae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:46:46 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6153b9c-1e92-43fa-a609-b88682919d4d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:46:46 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Running cmd (subprocess): nvme version {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:46:46 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] 'nvme version' failed. Not Retrying. {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:46:46 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.nvmeof [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] nvme not present on system {{(pid=72586) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 21:46:46 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:46:46 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:46:46 user nova-compute[72586]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 21:46:46 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04b7c71-8e3d-43fa-aa19-f9f602c73784]: (4, '') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:46:46 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72586) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 21:46:46 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 21:46:46 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] LIGHTOS: no hostnqn found. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 21:46:46 user nova-compute[72586]: DEBUG os_brick.utils [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4bc202fb9cb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:46:46 user nova-compute[72586]: DEBUG nova.virt.block_device [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Updating existing volume attachment record: 3fb063b5-37c4-4265-a21e-f4b01428d90d {{(pid=72586) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 21:46:46 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:46:46 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:46:46 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:46:46 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:46:46 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:46:46 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f546a9eb-4758-46d1-94fc-716397eebda4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Acquiring lock "af2de810-b22f-4fa9-835c-c673abd145db" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:46:46 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f546a9eb-4758-46d1-94fc-716397eebda4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "af2de810-b22f-4fa9-835c-c673abd145db" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:46:46 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f546a9eb-4758-46d1-94fc-716397eebda4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Acquiring lock "af2de810-b22f-4fa9-835c-c673abd145db-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:46:46 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f546a9eb-4758-46d1-94fc-716397eebda4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "af2de810-b22f-4fa9-835c-c673abd145db-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:46:46 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f546a9eb-4758-46d1-94fc-716397eebda4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "af2de810-b22f-4fa9-835c-c673abd145db-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:46:46 user nova-compute[72586]: INFO nova.compute.manager [None req-f546a9eb-4758-46d1-94fc-716397eebda4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Terminating instance
Aug 01 21:46:46 user nova-compute[72586]: DEBUG nova.compute.manager [None req-f546a9eb-4758-46d1-94fc-716397eebda4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Start destroying the instance on the hypervisor. {{(pid=72586) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 21:46:46 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:46:46 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:46:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:46:47 user nova-compute[72586]: DEBUG nova.network.neutron [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Successfully created port: 3acb8318-c6b2-4b99-b441-62488967760d {{(pid=72586) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 21:46:48 user nova-compute[72586]: DEBUG nova.compute.manager [req-88cb7e5e-dbba-41b6-9a1a-475dd52e67bd req-008b2b6d-f2ad-4171-9904-4a967ed29e56 service nova] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Received event network-vif-unplugged-b3d7d993-0a45-40ab-8cdd-e3eb06183294 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:46:48 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-88cb7e5e-dbba-41b6-9a1a-475dd52e67bd req-008b2b6d-f2ad-4171-9904-4a967ed29e56 service nova] Acquiring lock "af2de810-b22f-4fa9-835c-c673abd145db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:46:48 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-88cb7e5e-dbba-41b6-9a1a-475dd52e67bd req-008b2b6d-f2ad-4171-9904-4a967ed29e56 service nova] Lock "af2de810-b22f-4fa9-835c-c673abd145db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:46:48 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-88cb7e5e-dbba-41b6-9a1a-475dd52e67bd req-008b2b6d-f2ad-4171-9904-4a967ed29e56 service nova] Lock "af2de810-b22f-4fa9-835c-c673abd145db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:46:48 user nova-compute[72586]: DEBUG nova.compute.manager [req-88cb7e5e-dbba-41b6-9a1a-475dd52e67bd req-008b2b6d-f2ad-4171-9904-4a967ed29e56 service nova] [instance: af2de810-b22f-4fa9-835c-c673abd145db] No waiting events found dispatching network-vif-unplugged-b3d7d993-0a45-40ab-8cdd-e3eb06183294 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:46:48 user nova-compute[72586]: DEBUG nova.compute.manager [req-88cb7e5e-dbba-41b6-9a1a-475dd52e67bd req-008b2b6d-f2ad-4171-9904-4a967ed29e56 service nova] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Received event network-vif-unplugged-b3d7d993-0a45-40ab-8cdd-e3eb06183294 for instance with task_state deleting. {{(pid=72586) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 21:46:48 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Instance destroyed successfully.
Aug 01 21:46:48 user nova-compute[72586]: DEBUG nova.objects.instance [None req-f546a9eb-4758-46d1-94fc-716397eebda4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lazy-loading 'resources' on Instance uuid af2de810-b22f-4fa9-835c-c673abd145db {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:46:48 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:46:48 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:46:48 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Hypervisor/Node resource view: name=user free_ram=8382MB free_disk=25.205352783203125GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72586) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 21:46:48 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:46:48 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:46:48 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-f546a9eb-4758-46d1-94fc-716397eebda4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:27:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-243741239',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-243741239',id=22,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:27:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88d847d04360420c80ea5608d5a2b15a',ramdisk_id='',reservation_id='r-rjk0saqp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1268085586',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:29:04Z,user_data=None,user_id='a984642731b9413c97038f65052ab92d',uuid=af2de810-b22f-4fa9-835c-c673abd145db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3d7d993-0a45-40ab-8cdd-e3eb06183294", "address": "fa:16:3e:29:af:12", "network": {"id": "86940e5d-852b-48fc-9b0e-858305321349", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1967467603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d847d04360420c80ea5608d5a2b15a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3d7d993-0a", "ovs_interfaceid": "b3d7d993-0a45-40ab-8cdd-e3eb06183294", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:46:48 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-f546a9eb-4758-46d1-94fc-716397eebda4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Converting VIF {"id": "b3d7d993-0a45-40ab-8cdd-e3eb06183294", "address": "fa:16:3e:29:af:12", "network": {"id": "86940e5d-852b-48fc-9b0e-858305321349", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1967467603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d847d04360420c80ea5608d5a2b15a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3d7d993-0a", "ovs_interfaceid": "b3d7d993-0a45-40ab-8cdd-e3eb06183294", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:46:48 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-f546a9eb-4758-46d1-94fc-716397eebda4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:29:af:12,bridge_name='br-int',has_traffic_filtering=True,id=b3d7d993-0a45-40ab-8cdd-e3eb06183294,network=Network(86940e5d-852b-48fc-9b0e-858305321349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3d7d993-0a') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:46:48 user nova-compute[72586]: DEBUG os_vif [None req-f546a9eb-4758-46d1-94fc-716397eebda4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:af:12,bridge_name='br-int',has_traffic_filtering=True,id=b3d7d993-0a45-40ab-8cdd-e3eb06183294,network=Network(86940e5d-852b-48fc-9b0e-858305321349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3d7d993-0a') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:46:48 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:46:48 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3d7d993-0a, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:46:48 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:46:48 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:46:48 user nova-compute[72586]: INFO os_vif [None req-f546a9eb-4758-46d1-94fc-716397eebda4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:af:12,bridge_name='br-int',has_traffic_filtering=True,id=b3d7d993-0a45-40ab-8cdd-e3eb06183294,network=Network(86940e5d-852b-48fc-9b0e-858305321349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3d7d993-0a')
Aug 01 21:46:48 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-f546a9eb-4758-46d1-94fc-716397eebda4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Deleting instance files /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db_del
Aug 01 21:46:48 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-f546a9eb-4758-46d1-94fc-716397eebda4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Deletion of /opt/stack/data/nova/instances/af2de810-b22f-4fa9-835c-c673abd145db_del complete
Aug 01 21:46:48 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance af2de810-b22f-4fa9-835c-c673abd145db actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:46:48 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance f2f4343d-0cab-4ed6-972d-e2bd8a801e8f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:46:48 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:46:48 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance d0fa04b2-75e5-4542-9600-7a1517884041 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:46:48 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 21:46:48 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 21:46:48 user nova-compute[72586]: INFO nova.compute.manager [None req-f546a9eb-4758-46d1-94fc-716397eebda4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Took 1.26 seconds to destroy the instance on the hypervisor.
Aug 01 21:46:48 user nova-compute[72586]: DEBUG oslo.service.loopingcall [None req-f546a9eb-4758-46d1-94fc-716397eebda4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72586) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 21:46:48 user nova-compute[72586]: DEBUG nova.compute.manager [-] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Deallocating network for instance {{(pid=72586) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 21:46:48 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: af2de810-b22f-4fa9-835c-c673abd145db] deallocate_for_instance() {{(pid=72586) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 21:46:48 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:46:48 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:46:48 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:46:48 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:46:48 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:46:48 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Compute_service record updated for user:user {{(pid=72586) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 21:46:48 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.328s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:46:48 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:46:48 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:46:48 user nova-compute[72586]: DEBUG nova.network.neutron [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Successfully updated port: 3acb8318-c6b2-4b99-b441-62488967760d {{(pid=72586) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 21:46:48 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Acquiring lock "refresh_cache-d0fa04b2-75e5-4542-9600-7a1517884041" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:46:48 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Acquired lock "refresh_cache-d0fa04b2-75e5-4542-9600-7a1517884041" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:46:48 user nova-compute[72586]: DEBUG nova.network.neutron [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:46:48 user nova-compute[72586]: DEBUG nova.compute.manager [req-0e88ef07-fe08-40a9-ad98-69254c97b35c req-db3c9907-33d7-4a86-8124-99da72bd0d81 service nova] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Received event network-changed-3acb8318-c6b2-4b99-b441-62488967760d {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:46:48 user nova-compute[72586]: DEBUG nova.compute.manager [req-0e88ef07-fe08-40a9-ad98-69254c97b35c req-db3c9907-33d7-4a86-8124-99da72bd0d81 service nova] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Refreshing instance network info cache due to event network-changed-3acb8318-c6b2-4b99-b441-62488967760d. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:46:48 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-0e88ef07-fe08-40a9-ad98-69254c97b35c req-db3c9907-33d7-4a86-8124-99da72bd0d81 service nova] Acquiring lock "refresh_cache-d0fa04b2-75e5-4542-9600-7a1517884041" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:46:48 user nova-compute[72586]: DEBUG nova.network.neutron [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Instance cache missing network info. {{(pid=72586) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 21:46:49 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:46:49 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Took 0.89 seconds to deallocate network for instance.
Aug 01 21:46:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f546a9eb-4758-46d1-94fc-716397eebda4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:46:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f546a9eb-4758-46d1-94fc-716397eebda4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:46:49 user nova-compute[72586]: DEBUG nova.network.neutron [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Updating instance_info_cache with network_info: [{"id": "3acb8318-c6b2-4b99-b441-62488967760d", "address": "fa:16:3e:c4:14:cf", "network": {"id": "e072f7ac-9dd8-4e5c-9de2-5d6ef08c261b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1788451595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d633939ea5ac494c8668f0e5acaba7f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3acb8318-c6", "ovs_interfaceid": "3acb8318-c6b2-4b99-b441-62488967760d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:46:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Releasing lock "refresh_cache-d0fa04b2-75e5-4542-9600-7a1517884041" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:46:49 user nova-compute[72586]: DEBUG nova.compute.manager [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Instance network_info: |[{"id": "3acb8318-c6b2-4b99-b441-62488967760d", "address": "fa:16:3e:c4:14:cf", "network": {"id": "e072f7ac-9dd8-4e5c-9de2-5d6ef08c261b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1788451595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d633939ea5ac494c8668f0e5acaba7f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3acb8318-c6", "ovs_interfaceid": "3acb8318-c6b2-4b99-b441-62488967760d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 21:46:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-0e88ef07-fe08-40a9-ad98-69254c97b35c req-db3c9907-33d7-4a86-8124-99da72bd0d81 service nova] Acquired lock "refresh_cache-d0fa04b2-75e5-4542-9600-7a1517884041" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:46:49 user nova-compute[72586]: DEBUG nova.network.neutron [req-0e88ef07-fe08-40a9-ad98-69254c97b35c req-db3c9907-33d7-4a86-8124-99da72bd0d81 service nova] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Refreshing network info cache for port 3acb8318-c6b2-4b99-b441-62488967760d {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:46:49 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-f546a9eb-4758-46d1-94fc-716397eebda4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:46:49 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-f546a9eb-4758-46d1-94fc-716397eebda4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:46:49 user nova-compute[72586]: DEBUG nova.compute.manager [req-df5de2c3-0f45-47f4-b69f-c1fb28450552 req-1ec459ce-2c96-4e1d-95e8-3b970c89df3c service nova] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Received event network-vif-plugged-b3d7d993-0a45-40ab-8cdd-e3eb06183294 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:46:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-df5de2c3-0f45-47f4-b69f-c1fb28450552 req-1ec459ce-2c96-4e1d-95e8-3b970c89df3c service nova] Acquiring lock "af2de810-b22f-4fa9-835c-c673abd145db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:46:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-df5de2c3-0f45-47f4-b69f-c1fb28450552 req-1ec459ce-2c96-4e1d-95e8-3b970c89df3c service nova] Lock "af2de810-b22f-4fa9-835c-c673abd145db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:46:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-df5de2c3-0f45-47f4-b69f-c1fb28450552 req-1ec459ce-2c96-4e1d-95e8-3b970c89df3c service nova] Lock "af2de810-b22f-4fa9-835c-c673abd145db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:46:49 user nova-compute[72586]: DEBUG nova.compute.manager [req-df5de2c3-0f45-47f4-b69f-c1fb28450552 req-1ec459ce-2c96-4e1d-95e8-3b970c89df3c service nova] [instance: af2de810-b22f-4fa9-835c-c673abd145db] No waiting events found dispatching network-vif-plugged-b3d7d993-0a45-40ab-8cdd-e3eb06183294 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:46:49 user nova-compute[72586]: WARNING nova.compute.manager [req-df5de2c3-0f45-47f4-b69f-c1fb28450552 req-1ec459ce-2c96-4e1d-95e8-3b970c89df3c service nova] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Received unexpected event network-vif-plugged-b3d7d993-0a45-40ab-8cdd-e3eb06183294 for instance with vm_state deleted and task_state None.
Aug 01 21:46:49 user nova-compute[72586]: DEBUG nova.compute.manager [req-df5de2c3-0f45-47f4-b69f-c1fb28450552 req-1ec459ce-2c96-4e1d-95e8-3b970c89df3c service nova] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Received event network-vif-plugged-b3d7d993-0a45-40ab-8cdd-e3eb06183294 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:46:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-df5de2c3-0f45-47f4-b69f-c1fb28450552 req-1ec459ce-2c96-4e1d-95e8-3b970c89df3c service nova] Acquiring lock "af2de810-b22f-4fa9-835c-c673abd145db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:46:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-df5de2c3-0f45-47f4-b69f-c1fb28450552 req-1ec459ce-2c96-4e1d-95e8-3b970c89df3c service nova] Lock "af2de810-b22f-4fa9-835c-c673abd145db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:46:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-df5de2c3-0f45-47f4-b69f-c1fb28450552 req-1ec459ce-2c96-4e1d-95e8-3b970c89df3c service nova] Lock "af2de810-b22f-4fa9-835c-c673abd145db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:46:49 user nova-compute[72586]: DEBUG nova.compute.manager [req-df5de2c3-0f45-47f4-b69f-c1fb28450552 req-1ec459ce-2c96-4e1d-95e8-3b970c89df3c service nova] [instance: af2de810-b22f-4fa9-835c-c673abd145db] No waiting events found dispatching network-vif-plugged-b3d7d993-0a45-40ab-8cdd-e3eb06183294 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:46:49 user nova-compute[72586]: WARNING nova.compute.manager [req-df5de2c3-0f45-47f4-b69f-c1fb28450552 req-1ec459ce-2c96-4e1d-95e8-3b970c89df3c service nova] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Received unexpected event network-vif-plugged-b3d7d993-0a45-40ab-8cdd-e3eb06183294 for instance with vm_state deleted and task_state None.
Aug 01 21:46:49 user nova-compute[72586]: DEBUG nova.compute.manager [req-df5de2c3-0f45-47f4-b69f-c1fb28450552 req-1ec459ce-2c96-4e1d-95e8-3b970c89df3c service nova] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Received event network-vif-plugged-b3d7d993-0a45-40ab-8cdd-e3eb06183294 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:46:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-df5de2c3-0f45-47f4-b69f-c1fb28450552 req-1ec459ce-2c96-4e1d-95e8-3b970c89df3c service nova] Acquiring lock "af2de810-b22f-4fa9-835c-c673abd145db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:46:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-df5de2c3-0f45-47f4-b69f-c1fb28450552 req-1ec459ce-2c96-4e1d-95e8-3b970c89df3c service nova] Lock "af2de810-b22f-4fa9-835c-c673abd145db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:46:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-df5de2c3-0f45-47f4-b69f-c1fb28450552 req-1ec459ce-2c96-4e1d-95e8-3b970c89df3c service nova] Lock "af2de810-b22f-4fa9-835c-c673abd145db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:46:49 user nova-compute[72586]: DEBUG nova.compute.manager [req-df5de2c3-0f45-47f4-b69f-c1fb28450552 req-1ec459ce-2c96-4e1d-95e8-3b970c89df3c service nova] [instance: af2de810-b22f-4fa9-835c-c673abd145db] No waiting events found dispatching network-vif-plugged-b3d7d993-0a45-40ab-8cdd-e3eb06183294 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:46:49 user nova-compute[72586]: WARNING nova.compute.manager [req-df5de2c3-0f45-47f4-b69f-c1fb28450552 req-1ec459ce-2c96-4e1d-95e8-3b970c89df3c service nova] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Received unexpected event network-vif-plugged-b3d7d993-0a45-40ab-8cdd-e3eb06183294 for instance with vm_state deleted and task_state None.
Aug 01 21:46:49 user nova-compute[72586]: DEBUG nova.compute.manager [req-df5de2c3-0f45-47f4-b69f-c1fb28450552 req-1ec459ce-2c96-4e1d-95e8-3b970c89df3c service nova] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Received event network-vif-unplugged-b3d7d993-0a45-40ab-8cdd-e3eb06183294 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:46:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-df5de2c3-0f45-47f4-b69f-c1fb28450552 req-1ec459ce-2c96-4e1d-95e8-3b970c89df3c service nova] Acquiring lock "af2de810-b22f-4fa9-835c-c673abd145db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:46:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-df5de2c3-0f45-47f4-b69f-c1fb28450552 req-1ec459ce-2c96-4e1d-95e8-3b970c89df3c service nova] Lock "af2de810-b22f-4fa9-835c-c673abd145db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:46:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-df5de2c3-0f45-47f4-b69f-c1fb28450552 req-1ec459ce-2c96-4e1d-95e8-3b970c89df3c service nova] Lock "af2de810-b22f-4fa9-835c-c673abd145db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:46:49 user nova-compute[72586]: DEBUG nova.compute.manager [req-df5de2c3-0f45-47f4-b69f-c1fb28450552 req-1ec459ce-2c96-4e1d-95e8-3b970c89df3c service nova] [instance: af2de810-b22f-4fa9-835c-c673abd145db] No waiting events found dispatching network-vif-unplugged-b3d7d993-0a45-40ab-8cdd-e3eb06183294 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:46:49 user nova-compute[72586]: WARNING nova.compute.manager [req-df5de2c3-0f45-47f4-b69f-c1fb28450552 req-1ec459ce-2c96-4e1d-95e8-3b970c89df3c service nova] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Received unexpected event network-vif-unplugged-b3d7d993-0a45-40ab-8cdd-e3eb06183294 for instance with vm_state deleted and task_state None.
Aug 01 21:46:49 user nova-compute[72586]: DEBUG nova.compute.manager [req-df5de2c3-0f45-47f4-b69f-c1fb28450552 req-1ec459ce-2c96-4e1d-95e8-3b970c89df3c service nova] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Received event network-vif-plugged-b3d7d993-0a45-40ab-8cdd-e3eb06183294 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:46:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-df5de2c3-0f45-47f4-b69f-c1fb28450552 req-1ec459ce-2c96-4e1d-95e8-3b970c89df3c service nova] Acquiring lock "af2de810-b22f-4fa9-835c-c673abd145db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:46:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-df5de2c3-0f45-47f4-b69f-c1fb28450552 req-1ec459ce-2c96-4e1d-95e8-3b970c89df3c service nova] Lock "af2de810-b22f-4fa9-835c-c673abd145db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:46:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-df5de2c3-0f45-47f4-b69f-c1fb28450552 req-1ec459ce-2c96-4e1d-95e8-3b970c89df3c service nova] Lock "af2de810-b22f-4fa9-835c-c673abd145db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:46:49 user nova-compute[72586]: DEBUG nova.compute.manager [req-df5de2c3-0f45-47f4-b69f-c1fb28450552 req-1ec459ce-2c96-4e1d-95e8-3b970c89df3c service nova] [instance: af2de810-b22f-4fa9-835c-c673abd145db] No waiting events found dispatching network-vif-plugged-b3d7d993-0a45-40ab-8cdd-e3eb06183294 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:46:49 user nova-compute[72586]: WARNING nova.compute.manager [req-df5de2c3-0f45-47f4-b69f-c1fb28450552 req-1ec459ce-2c96-4e1d-95e8-3b970c89df3c service nova] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Received unexpected event network-vif-plugged-b3d7d993-0a45-40ab-8cdd-e3eb06183294 for instance with vm_state deleted and task_state None.
Aug 01 21:46:49 user nova-compute[72586]: DEBUG nova.compute.manager [req-df5de2c3-0f45-47f4-b69f-c1fb28450552 req-1ec459ce-2c96-4e1d-95e8-3b970c89df3c service nova] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Received event network-vif-deleted-b3d7d993-0a45-40ab-8cdd-e3eb06183294 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:46:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f546a9eb-4758-46d1-94fc-716397eebda4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.193s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:46:49 user nova-compute[72586]: INFO nova.scheduler.client.report [None req-f546a9eb-4758-46d1-94fc-716397eebda4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Deleted allocations for instance af2de810-b22f-4fa9-835c-c673abd145db
Aug 01 21:46:49 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:46:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f546a9eb-4758-46d1-94fc-716397eebda4 tempest-ServerBootFromVolumeStableRescueTest-1268085586 tempest-ServerBootFromVolumeStableRescueTest-1268085586-project-member] Lock "af2de810-b22f-4fa9-835c-c673abd145db" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.527s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:46:49 user nova-compute[72586]: DEBUG nova.network.neutron [req-0e88ef07-fe08-40a9-ad98-69254c97b35c req-db3c9907-33d7-4a86-8124-99da72bd0d81 service nova] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Updated VIF entry in instance network info cache for port 3acb8318-c6b2-4b99-b441-62488967760d. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:46:49 user nova-compute[72586]: DEBUG nova.network.neutron [req-0e88ef07-fe08-40a9-ad98-69254c97b35c req-db3c9907-33d7-4a86-8124-99da72bd0d81 service nova] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Updating instance_info_cache with network_info: [{"id": "3acb8318-c6b2-4b99-b441-62488967760d", "address": "fa:16:3e:c4:14:cf", "network": {"id": "e072f7ac-9dd8-4e5c-9de2-5d6ef08c261b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1788451595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d633939ea5ac494c8668f0e5acaba7f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3acb8318-c6", "ovs_interfaceid": "3acb8318-c6b2-4b99-b441-62488967760d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:46:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-0e88ef07-fe08-40a9-ad98-69254c97b35c req-db3c9907-33d7-4a86-8124-99da72bd0d81 service nova] Releasing lock "refresh_cache-d0fa04b2-75e5-4542-9600-7a1517884041" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:46:50 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:46:50 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:46:53 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:46:53 user nova-compute[72586]: DEBUG nova.compute.manager [req-e4ca30fd-7c86-40d3-ba91-fff942f35d79 req-37f65dbd-551a-4eaf-b188-48c2c78461c2 service nova] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Received event network-changed-1dd6baee-ef06-420a-b60b-af402143b22d {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:46:53 user nova-compute[72586]: DEBUG nova.compute.manager [req-e4ca30fd-7c86-40d3-ba91-fff942f35d79 req-37f65dbd-551a-4eaf-b188-48c2c78461c2 service nova] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Refreshing instance network info cache due to event network-changed-1dd6baee-ef06-420a-b60b-af402143b22d. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:46:53 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-e4ca30fd-7c86-40d3-ba91-fff942f35d79 req-37f65dbd-551a-4eaf-b188-48c2c78461c2 service nova] Acquiring lock "refresh_cache-2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:46:53 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-e4ca30fd-7c86-40d3-ba91-fff942f35d79 req-37f65dbd-551a-4eaf-b188-48c2c78461c2 service nova] Acquired lock "refresh_cache-2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:46:53 user nova-compute[72586]: DEBUG nova.network.neutron [req-e4ca30fd-7c86-40d3-ba91-fff942f35d79 req-37f65dbd-551a-4eaf-b188-48c2c78461c2 service nova] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Refreshing network info cache for port 1dd6baee-ef06-420a-b60b-af402143b22d {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG nova.network.neutron [req-e4ca30fd-7c86-40d3-ba91-fff942f35d79 req-37f65dbd-551a-4eaf-b188-48c2c78461c2 service nova] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Updated VIF entry in instance network info cache for port 1dd6baee-ef06-420a-b60b-af402143b22d. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG nova.network.neutron [req-e4ca30fd-7c86-40d3-ba91-fff942f35d79 req-37f65dbd-551a-4eaf-b188-48c2c78461c2 service nova] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Updating instance_info_cache with network_info: [{"id": "1dd6baee-ef06-420a-b60b-af402143b22d", "address": "fa:16:3e:d5:4b:c0", "network": {"id": "63b6e8c7-fad0-44bf-a479-9baab6f0d1e3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2101151631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cbab7dfc55429c9b991bf1091a84c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dd6baee-ef", "ovs_interfaceid": "1dd6baee-ef06-420a-b60b-af402143b22d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-e4ca30fd-7c86-40d3-ba91-fff942f35d79 req-37f65dbd-551a-4eaf-b188-48c2c78461c2 service nova] Releasing lock "refresh_cache-2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG nova.compute.manager [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Start spawning the instance on the hypervisor. {{(pid=72586) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Creating instance directory {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 21:46:54 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Creating image(s)
Aug 01 21:46:54 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Did not create local disks {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Ensure instance console log exists: /opt/stack/data/nova/instances/d0fa04b2-75e5-4542-9600-7a1517884041/console.log {{(pid=72586) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Start _get_guest_xml network_info=[{"id": "3acb8318-c6b2-4b99-b441-62488967760d", "address": "fa:16:3e:c4:14:cf", "network": {"id": "e072f7ac-9dd8-4e5c-9de2-5d6ef08c261b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1788451595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d633939ea5ac494c8668f0e5acaba7f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3acb8318-c6", "ovs_interfaceid": "3acb8318-c6b2-4b99-b441-62488967760d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CBSbrpog', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd0fa04b2-75e5-4542-9600-7a1517884041', 'attached_at': '', 'detached_at': '', 'volume_id': '89992cbb-33b3-4a79-a3b7-534d9854a5a6', 'serial': '89992cbb-33b3-4a79-a3b7-534d9854a5a6'}, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '3fb063b5-37c4-4265-a21e-f4b01428d90d', 'delete_on_termination': True, 'volume_type': None} {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:46:54 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:46:54 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:46:54 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Calling os-brick to attach iSCSI Volume {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CBSbrpog', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:46:54 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:46:54 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:46:54 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:46:54 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:46:54 user nova-compute[72586]: INFO os_brick.initiator.connectors.iscsi [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 21:46:54 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 -p 172.16.0.220:3260 {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[50eff567-c886-409c-a520-2fc632beb533]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 21:46:54 user nova-compute[72586]:  {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 -p 172.16.0.220:3260 --interface default --op new {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6e99c9-9fd6-4c44-96e0-a18a0496f0c8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6] added\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6] added
Aug 01 21:46:54 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[2276d524-ef11-4745-8f7d-c7bd2361d381]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cdc2dbd-e37d-4cea-b014-cb680633d0ee]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CBSbrpog {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CBSbrpog" returned: 0 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[6852b9d9-4d9c-4956-b331-f1161b72fe7f]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CBSbrpog'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f09075-42ae-4a1f-b3dc-f709d3220c46]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bbdf5ee-9b7b-4475-a4ae-aaabf123a29c]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1 (non-flash)
Aug 01 21:46:54 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1 (non-flash)
Aug 01 21:46:54 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 -p 172.16.0.220:3260 --login {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[34fbb1a2-2041-4398-b9ba-bde4eeaf6b9e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6, portal: 172.16.0.220,3260]
Aug 01 21:46:54 user nova-compute[72586]: Login to [iface: default, target: iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6, portal: 172.16.0.220,3260] successful.
Aug 01 21:46:54 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d76be96d-8220-401c-b465-4c04113a8c2c]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[860fc26c-8b60-4250-bfd6-2b1c1d37cf99]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1 (non-flash)
Aug 01 21:46:54 user nova-compute[72586]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 (non-flash)
Aug 01 21:46:54 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1 (non-flash)
Aug 01 21:46:54 user nova-compute[72586]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 (non-flash)
Aug 01 21:46:54 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Connected to 172.16.0.220:3260 {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=72586) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72586) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4f4817-5ff2-48d4-ae0d-914633f0eb2b]: (4, ('- - 0', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:46:54 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: None {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:46:55 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:46:55 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:46:55 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CBSbrpog', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 21:46:55 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:46:55 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23163663863646131', 'path': '/dev/sdb'} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:46:55 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23163663863646131', 'path': '/dev/sdb'} {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 21:46:55 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:46:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1377950842',display_name='tempest-TestShelveInstance-server-1377950842',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1377950842',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB4GX0o8jqyM0mvDzTq47xn7L41FYkxZaqxMMdhfIoyuA1AuqUIPQwXdQlKJh3CoshNHRfVXo+AB0NJD8DSA6Oz1QmbjVr9ojuL7LK7H9A2TUm7EdlrJztLuFeIP+5Kp8Q==',key_name='tempest-TestShelveInstance-70441469',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d633939ea5ac494c8668f0e5acaba7f1',ramdisk_id='',reservation_id='r-nmpthpez',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1887634001',owner_user_name='tempest-TestShelveInstance-1887634001-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:46:46Z,user_data=None,user_id='d0e99da03c7045b0bc1213eded097dfe',uuid=d0fa04b2-75e5-4542-9600-7a1517884041,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3acb8318-c6b2-4b99-b441-62488967760d", "address": "fa:16:3e:c4:14:cf", "network": {"id": "e072f7ac-9dd8-4e5c-9de2-5d6ef08c261b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1788451595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d633939ea5ac494c8668f0e5acaba7f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3acb8318-c6", "ovs_interfaceid": "3acb8318-c6b2-4b99-b441-62488967760d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:46:55 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Converting VIF {"id": "3acb8318-c6b2-4b99-b441-62488967760d", "address": "fa:16:3e:c4:14:cf", "network": {"id": "e072f7ac-9dd8-4e5c-9de2-5d6ef08c261b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1788451595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d633939ea5ac494c8668f0e5acaba7f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3acb8318-c6", "ovs_interfaceid": "3acb8318-c6b2-4b99-b441-62488967760d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:46:55 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:14:cf,bridge_name='br-int',has_traffic_filtering=True,id=3acb8318-c6b2-4b99-b441-62488967760d,network=Network(e072f7ac-9dd8-4e5c-9de2-5d6ef08c261b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3acb8318-c6') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:46:55 user nova-compute[72586]: DEBUG nova.objects.instance [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Lazy-loading 'pci_devices' on Instance uuid d0fa04b2-75e5-4542-9600-7a1517884041 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:46:55 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:46:55 user nova-compute[72586]:   <uuid>d0fa04b2-75e5-4542-9600-7a1517884041</uuid>
Aug 01 21:46:55 user nova-compute[72586]:   <name>instance-0000002a</name>
Aug 01 21:46:55 user nova-compute[72586]:   <memory>524288</memory>
Aug 01 21:46:55 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:46:55 user nova-compute[72586]:   <metadata>
Aug 01 21:46:55 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:46:55 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:46:55 user nova-compute[72586]:       <nova:name>tempest-TestShelveInstance-server-1377950842</nova:name>
Aug 01 21:46:55 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:46:54</nova:creationTime>
Aug 01 21:46:55 user nova-compute[72586]:       <nova:flavor name="m1.tiny">
Aug 01 21:46:55 user nova-compute[72586]:         <nova:memory>512</nova:memory>
Aug 01 21:46:55 user nova-compute[72586]:         <nova:disk>1</nova:disk>
Aug 01 21:46:55 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:46:55 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:46:55 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:46:55 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:46:55 user nova-compute[72586]:       <nova:owner>
Aug 01 21:46:55 user nova-compute[72586]:         <nova:user uuid="d0e99da03c7045b0bc1213eded097dfe">tempest-TestShelveInstance-1887634001-project-member</nova:user>
Aug 01 21:46:55 user nova-compute[72586]:         <nova:project uuid="d633939ea5ac494c8668f0e5acaba7f1">tempest-TestShelveInstance-1887634001</nova:project>
Aug 01 21:46:55 user nova-compute[72586]:       </nova:owner>
Aug 01 21:46:55 user nova-compute[72586]:       <nova:ports>
Aug 01 21:46:55 user nova-compute[72586]:         <nova:port uuid="3acb8318-c6b2-4b99-b441-62488967760d">
Aug 01 21:46:55 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 01 21:46:55 user nova-compute[72586]:         </nova:port>
Aug 01 21:46:55 user nova-compute[72586]:       </nova:ports>
Aug 01 21:46:55 user nova-compute[72586]:     </nova:instance>
Aug 01 21:46:55 user nova-compute[72586]:   </metadata>
Aug 01 21:46:55 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:46:55 user nova-compute[72586]:     <system>
Aug 01 21:46:55 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:46:55 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:46:55 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:46:55 user nova-compute[72586]:       <entry name="serial">d0fa04b2-75e5-4542-9600-7a1517884041</entry>
Aug 01 21:46:55 user nova-compute[72586]:       <entry name="uuid">d0fa04b2-75e5-4542-9600-7a1517884041</entry>
Aug 01 21:46:55 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:46:55 user nova-compute[72586]:     </system>
Aug 01 21:46:55 user nova-compute[72586]:   </sysinfo>
Aug 01 21:46:55 user nova-compute[72586]:   <os>
Aug 01 21:46:55 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:46:55 user nova-compute[72586]:     <boot dev="hd"/>
Aug 01 21:46:55 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:46:55 user nova-compute[72586]:   </os>
Aug 01 21:46:55 user nova-compute[72586]:   <features>
Aug 01 21:46:55 user nova-compute[72586]:     <acpi/>
Aug 01 21:46:55 user nova-compute[72586]:     <apic/>
Aug 01 21:46:55 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:46:55 user nova-compute[72586]:   </features>
Aug 01 21:46:55 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:46:55 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:46:55 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:46:55 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:46:55 user nova-compute[72586]:   </clock>
Aug 01 21:46:55 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:46:55 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:46:55 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:46:55 user nova-compute[72586]:   </cpu>
Aug 01 21:46:55 user nova-compute[72586]:   <devices>
Aug 01 21:46:55 user nova-compute[72586]:     <disk type="block" device="disk">
Aug 01 21:46:55 user nova-compute[72586]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:46:55 user nova-compute[72586]:       <source dev="/dev/sdb"/>
Aug 01 21:46:55 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:46:55 user nova-compute[72586]:       <serial>89992cbb-33b3-4a79-a3b7-534d9854a5a6</serial>
Aug 01 21:46:55 user nova-compute[72586]:     </disk>
Aug 01 21:46:55 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:46:55 user nova-compute[72586]:       <mac address="fa:16:3e:c4:14:cf"/>
Aug 01 21:46:55 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:46:55 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:46:55 user nova-compute[72586]:       <target dev="tap3acb8318-c6"/>
Aug 01 21:46:55 user nova-compute[72586]:     </interface>
Aug 01 21:46:55 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:46:55 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/d0fa04b2-75e5-4542-9600-7a1517884041/console.log" append="off"/>
Aug 01 21:46:55 user nova-compute[72586]:     </serial>
Aug 01 21:46:55 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:46:55 user nova-compute[72586]:     <video>
Aug 01 21:46:55 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:46:55 user nova-compute[72586]:     </video>
Aug 01 21:46:55 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:46:55 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:46:55 user nova-compute[72586]:     </rng>
Aug 01 21:46:55 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:46:55 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:46:55 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:46:55 user nova-compute[72586]:     </memballoon>
Aug 01 21:46:55 user nova-compute[72586]:   </devices>
Aug 01 21:46:55 user nova-compute[72586]: </domain>
Aug 01 21:46:55 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:46:55 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:46:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1377950842',display_name='tempest-TestShelveInstance-server-1377950842',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1377950842',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB4GX0o8jqyM0mvDzTq47xn7L41FYkxZaqxMMdhfIoyuA1AuqUIPQwXdQlKJh3CoshNHRfVXo+AB0NJD8DSA6Oz1QmbjVr9ojuL7LK7H9A2TUm7EdlrJztLuFeIP+5Kp8Q==',key_name='tempest-TestShelveInstance-70441469',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d633939ea5ac494c8668f0e5acaba7f1',ramdisk_id='',reservation_id='r-nmpthpez',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1887634001',owner_user_name='tempest-TestShelveInstance-1887634001-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:46:46Z,user_data=None,user_id='d0e99da03c7045b0bc1213eded097dfe',uuid=d0fa04b2-75e5-4542-9600-7a1517884041,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3acb8318-c6b2-4b99-b441-62488967760d", "address": "fa:16:3e:c4:14:cf", "network": {"id": "e072f7ac-9dd8-4e5c-9de2-5d6ef08c261b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1788451595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d633939ea5ac494c8668f0e5acaba7f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3acb8318-c6", "ovs_interfaceid": "3acb8318-c6b2-4b99-b441-62488967760d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:46:55 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Converting VIF {"id": "3acb8318-c6b2-4b99-b441-62488967760d", "address": "fa:16:3e:c4:14:cf", "network": {"id": "e072f7ac-9dd8-4e5c-9de2-5d6ef08c261b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1788451595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d633939ea5ac494c8668f0e5acaba7f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3acb8318-c6", "ovs_interfaceid": "3acb8318-c6b2-4b99-b441-62488967760d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:46:55 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:14:cf,bridge_name='br-int',has_traffic_filtering=True,id=3acb8318-c6b2-4b99-b441-62488967760d,network=Network(e072f7ac-9dd8-4e5c-9de2-5d6ef08c261b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3acb8318-c6') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:46:55 user nova-compute[72586]: DEBUG os_vif [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:14:cf,bridge_name='br-int',has_traffic_filtering=True,id=3acb8318-c6b2-4b99-b441-62488967760d,network=Network(e072f7ac-9dd8-4e5c-9de2-5d6ef08c261b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3acb8318-c6') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:46:55 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:46:55 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:46:55 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:46:55 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:46:55 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3acb8318-c6, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:46:55 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3acb8318-c6, col_values=(('external_ids', {'iface-id': '3acb8318-c6b2-4b99-b441-62488967760d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:14:cf', 'vm-uuid': 'd0fa04b2-75e5-4542-9600-7a1517884041'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:46:55 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:46:55 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:46:55 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:46:55 user nova-compute[72586]: INFO os_vif [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:14:cf,bridge_name='br-int',has_traffic_filtering=True,id=3acb8318-c6b2-4b99-b441-62488967760d,network=Network(e072f7ac-9dd8-4e5c-9de2-5d6ef08c261b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3acb8318-c6')
Aug 01 21:46:55 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:46:55 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] No VIF found with MAC fa:16:3e:c4:14:cf, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:46:57 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:46:57 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:46:57 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-bdde07c1-ae70-4afb-912a-db37065b5613 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Acquiring lock "2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:46:57 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-bdde07c1-ae70-4afb-912a-db37065b5613 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:46:57 user nova-compute[72586]: DEBUG nova.objects.instance [None req-bdde07c1-ae70-4afb-912a-db37065b5613 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lazy-loading 'flavor' on Instance uuid 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:46:57 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-bdde07c1-ae70-4afb-912a-db37065b5613 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:46:57 user nova-compute[72586]: DEBUG nova.compute.manager [req-154ca7a4-7b60-4395-b900-769e33084811 req-a30d78f2-69d8-422f-bb64-f447ce1e427c service nova] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Received event network-vif-plugged-3acb8318-c6b2-4b99-b441-62488967760d {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:46:57 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-154ca7a4-7b60-4395-b900-769e33084811 req-a30d78f2-69d8-422f-bb64-f447ce1e427c service nova] Acquiring lock "d0fa04b2-75e5-4542-9600-7a1517884041-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:46:57 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-154ca7a4-7b60-4395-b900-769e33084811 req-a30d78f2-69d8-422f-bb64-f447ce1e427c service nova] Lock "d0fa04b2-75e5-4542-9600-7a1517884041-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:46:57 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-154ca7a4-7b60-4395-b900-769e33084811 req-a30d78f2-69d8-422f-bb64-f447ce1e427c service nova] Lock "d0fa04b2-75e5-4542-9600-7a1517884041-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:46:57 user nova-compute[72586]: DEBUG nova.compute.manager [req-154ca7a4-7b60-4395-b900-769e33084811 req-a30d78f2-69d8-422f-bb64-f447ce1e427c service nova] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] No waiting events found dispatching network-vif-plugged-3acb8318-c6b2-4b99-b441-62488967760d {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:46:57 user nova-compute[72586]: WARNING nova.compute.manager [req-154ca7a4-7b60-4395-b900-769e33084811 req-a30d78f2-69d8-422f-bb64-f447ce1e427c service nova] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Received unexpected event network-vif-plugged-3acb8318-c6b2-4b99-b441-62488967760d for instance with vm_state building and task_state spawning.
Aug 01 21:46:57 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-bdde07c1-ae70-4afb-912a-db37065b5613 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Acquiring lock "2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:46:57 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-bdde07c1-ae70-4afb-912a-db37065b5613 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:46:57 user nova-compute[72586]: INFO nova.compute.manager [None req-bdde07c1-ae70-4afb-912a-db37065b5613 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Attaching volume 0fe344d1-6541-4a77-984f-dd633decfebe to /dev/vdb
Aug 01 21:46:57 user nova-compute[72586]: DEBUG os_brick.utils [None req-bdde07c1-ae70-4afb-912a-db37065b5613 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:46:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:46:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:46:57 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb56f93f-ff62-4c65-9011-2d21651e3f75]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4bc202fb9cb\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:46:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:46:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:46:57 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[8442ca3c-714f-4b8a-82cb-8e923686cdcf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:46:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:46:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:46:57 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c6bc48-2c9d-48b7-bf36-f2bdce620b3c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:46:57 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a794e2-592e-4171-9330-d4df366df367]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:46:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-bdde07c1-ae70-4afb-912a-db37065b5613 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Running cmd (subprocess): nvme version {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:46:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-bdde07c1-ae70-4afb-912a-db37065b5613 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] 'nvme version' failed. Not Retrying. {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:46:57 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bdde07c1-ae70-4afb-912a-db37065b5613 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] nvme not present on system {{(pid=72586) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 21:46:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:46:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:46:57 user nova-compute[72586]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 21:46:57 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d886b2b-2f3a-4a5d-a603-27b5765f0b0d]: (4, '') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:46:57 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-bdde07c1-ae70-4afb-912a-db37065b5613 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72586) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 21:46:57 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-bdde07c1-ae70-4afb-912a-db37065b5613 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 21:46:57 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-bdde07c1-ae70-4afb-912a-db37065b5613 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] LIGHTOS: no hostnqn found. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 21:46:57 user nova-compute[72586]: DEBUG os_brick.utils [None req-bdde07c1-ae70-4afb-912a-db37065b5613 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4bc202fb9cb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:46:57 user nova-compute[72586]: DEBUG nova.virt.block_device [None req-bdde07c1-ae70-4afb-912a-db37065b5613 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Updating existing volume attachment record: b0f1eb95-3f58-4723-82fc-8b57665336cd {{(pid=72586) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 21:46:57 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:46:57 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:46:59 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690926419.3749943, d0fa04b2-75e5-4542-9600-7a1517884041 => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:46:59 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] VM Resumed (Lifecycle Event)
Aug 01 21:46:59 user nova-compute[72586]: DEBUG nova.compute.manager [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Instance event wait completed in 0 seconds for  {{(pid=72586) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 21:46:59 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Guest created on hypervisor {{(pid=72586) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 21:46:59 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Instance spawned successfully.
Aug 01 21:46:59 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 21:46:59 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:46:59 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:46:59 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Found default for hw_cdrom_bus of ide {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:46:59 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Found default for hw_disk_bus of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:46:59 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Found default for hw_input_bus of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:46:59 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Found default for hw_pointer_model of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:46:59 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Found default for hw_video_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:46:59 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Found default for hw_vif_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:46:59 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:46:59 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690926419.377709, d0fa04b2-75e5-4542-9600-7a1517884041 => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:46:59 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] VM Started (Lifecycle Event)
Aug 01 21:46:59 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:46:59 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:46:59 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:46:59 user nova-compute[72586]: INFO nova.compute.manager [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Took 5.13 seconds to spawn the instance on the hypervisor.
Aug 01 21:46:59 user nova-compute[72586]: DEBUG nova.compute.manager [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:46:59 user nova-compute[72586]: DEBUG nova.compute.manager [req-ebd1b93a-f88c-4d52-82d9-3deefe23390e req-704a8360-d2cb-4cf1-ae15-ba6b4a1f5064 service nova] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Received event network-vif-plugged-3acb8318-c6b2-4b99-b441-62488967760d {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:46:59 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ebd1b93a-f88c-4d52-82d9-3deefe23390e req-704a8360-d2cb-4cf1-ae15-ba6b4a1f5064 service nova] Acquiring lock "d0fa04b2-75e5-4542-9600-7a1517884041-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:46:59 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ebd1b93a-f88c-4d52-82d9-3deefe23390e req-704a8360-d2cb-4cf1-ae15-ba6b4a1f5064 service nova] Lock "d0fa04b2-75e5-4542-9600-7a1517884041-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:46:59 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ebd1b93a-f88c-4d52-82d9-3deefe23390e req-704a8360-d2cb-4cf1-ae15-ba6b4a1f5064 service nova] Lock "d0fa04b2-75e5-4542-9600-7a1517884041-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:46:59 user nova-compute[72586]: DEBUG nova.compute.manager [req-ebd1b93a-f88c-4d52-82d9-3deefe23390e req-704a8360-d2cb-4cf1-ae15-ba6b4a1f5064 service nova] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] No waiting events found dispatching network-vif-plugged-3acb8318-c6b2-4b99-b441-62488967760d {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:46:59 user nova-compute[72586]: WARNING nova.compute.manager [req-ebd1b93a-f88c-4d52-82d9-3deefe23390e req-704a8360-d2cb-4cf1-ae15-ba6b4a1f5064 service nova] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Received unexpected event network-vif-plugged-3acb8318-c6b2-4b99-b441-62488967760d for instance with vm_state building and task_state spawning.
Aug 01 21:46:59 user nova-compute[72586]: INFO nova.compute.manager [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Took 13.83 seconds to build instance.
Aug 01 21:46:59 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-700aa098-8b6c-424c-a790-22ec090ea52c tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Lock "d0fa04b2-75e5-4542-9600-7a1517884041" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.934s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:47:00 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:47:00 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:47:02 user nova-compute[72586]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690926407.6587164, af2de810-b22f-4fa9-835c-c673abd145db => Stopped> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:47:02 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: af2de810-b22f-4fa9-835c-c673abd145db] VM Stopped (Lifecycle Event)
Aug 01 21:47:03 user nova-compute[72586]: DEBUG nova.compute.manager [None req-c2db6736-87f9-4a58-b23f-abb4db3dd48e None None] [instance: af2de810-b22f-4fa9-835c-c673abd145db] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:47:05 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:47:05 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdde07c1-ae70-4afb-912a-db37065b5613 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Calling os-brick to attach iSCSI Volume {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 21:47:05 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdde07c1-ae70-4afb-912a-db37065b5613 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0fe344d1-6541-4a77-984f-dd633decfebe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QHyRCmwE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:47:05 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-bdde07c1-ae70-4afb-912a-db37065b5613 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:47:05 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-bdde07c1-ae70-4afb-912a-db37065b5613 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:47:05 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-bdde07c1-ae70-4afb-912a-db37065b5613 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:47:05 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-bdde07c1-ae70-4afb-912a-db37065b5613 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:47:05 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-bdde07c1-ae70-4afb-912a-db37065b5613 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fe344d1-6541-4a77-984f-dd633decfebe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:47:05 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-bdde07c1-ae70-4afb-912a-db37065b5613 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fe344d1-6541-4a77-984f-dd633decfebe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:47:05 user nova-compute[72586]: INFO os_brick.initiator.connectors.iscsi [None req-bdde07c1-ae70-4afb-912a-db37065b5613 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 21:47:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fe344d1-6541-4a77-984f-dd633decfebe -p 172.16.0.220:3260 {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:47:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fe344d1-6541-4a77-984f-dd633decfebe -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:47:05 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d938c112-c3c4-4f36-ba39-84ff4645b2fe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:47:05 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdde07c1-ae70-4afb-912a-db37065b5613 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 21:47:05 user nova-compute[72586]:  {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:47:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fe344d1-6541-4a77-984f-dd633decfebe -p 172.16.0.220:3260 --interface default --op new {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:47:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fe344d1-6541-4a77-984f-dd633decfebe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:47:05 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b93d9fa-c620-481f-a6d6-d98875a6b44e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0fe344d1-6541-4a77-984f-dd633decfebe] added\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:47:05 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdde07c1-ae70-4afb-912a-db37065b5613 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0fe344d1-6541-4a77-984f-dd633decfebe] added
Aug 01 21:47:05 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:47:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fe344d1-6541-4a77-984f-dd633decfebe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:47:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fe344d1-6541-4a77-984f-dd633decfebe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:47:05 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a3dcd8-83d2-45c2-bc75-c3e27d1d7276]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:47:05 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdde07c1-ae70-4afb-912a-db37065b5613 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:47:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fe344d1-6541-4a77-984f-dd633decfebe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:47:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fe344d1-6541-4a77-984f-dd633decfebe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:47:05 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b1cdba-7808-43ad-b22d-494d3258b40d]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:47:05 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdde07c1-ae70-4afb-912a-db37065b5613 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:47:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fe344d1-6541-4a77-984f-dd633decfebe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QHyRCmwE {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:47:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fe344d1-6541-4a77-984f-dd633decfebe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QHyRCmwE" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:47:05 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0bf9ad-879c-456a-af72-1974b8288ca9]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:47:05 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdde07c1-ae70-4afb-912a-db37065b5613 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QHyRCmwE'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:47:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fe344d1-6541-4a77-984f-dd633decfebe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:47:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fe344d1-6541-4a77-984f-dd633decfebe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:47:05 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8952461-ed5e-489d-a363-5cc85f46e622]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:47:05 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdde07c1-ae70-4afb-912a-db37065b5613 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:47:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:47:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:47:05 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[91dc75b5-4fa6-4fac-9e8c-0016e265c3a2]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:47:05 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdde07c1-ae70-4afb-912a-db37065b5613 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1 (non-flash)
Aug 01 21:47:05 user nova-compute[72586]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 (non-flash)
Aug 01 21:47:05 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:47:05 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdde07c1-ae70-4afb-912a-db37065b5613 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1 (non-flash)
Aug 01 21:47:05 user nova-compute[72586]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 (non-flash)
Aug 01 21:47:05 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:47:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fe344d1-6541-4a77-984f-dd633decfebe -p 172.16.0.220:3260 --login {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:47:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fe344d1-6541-4a77-984f-dd633decfebe -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:47:05 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb031cb-b123-4a62-be69-bb5b9d903905]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0fe344d1-6541-4a77-984f-dd633decfebe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0fe344d1-6541-4a77-984f-dd633decfebe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:47:05 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdde07c1-ae70-4afb-912a-db37065b5613 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0fe344d1-6541-4a77-984f-dd633decfebe, portal: 172.16.0.220,3260]
Aug 01 21:47:05 user nova-compute[72586]: Login to [iface: default, target: iqn.2010-10.org.openstack:0fe344d1-6541-4a77-984f-dd633decfebe, portal: 172.16.0.220,3260] successful.
Aug 01 21:47:05 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:47:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fe344d1-6541-4a77-984f-dd633decfebe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:47:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fe344d1-6541-4a77-984f-dd633decfebe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:47:05 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe88c56-0938-44fa-aa16-100d0f78c7b7]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:47:05 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdde07c1-ae70-4afb-912a-db37065b5613 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:47:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:47:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:47:05 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3839dd4-e93f-468c-9570-5b9c828959ae]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe344d1-6541-4a77-984f-dd633decfebe (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:47:05 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdde07c1-ae70-4afb-912a-db37065b5613 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1 (non-flash)
Aug 01 21:47:05 user nova-compute[72586]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 (non-flash)
Aug 01 21:47:05 user nova-compute[72586]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe344d1-6541-4a77-984f-dd633decfebe (non-flash)
Aug 01 21:47:05 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:47:05 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdde07c1-ae70-4afb-912a-db37065b5613 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1 (non-flash)
Aug 01 21:47:05 user nova-compute[72586]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 (non-flash)
Aug 01 21:47:05 user nova-compute[72586]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe344d1-6541-4a77-984f-dd633decfebe (non-flash)
Aug 01 21:47:05 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:47:05 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-bdde07c1-ae70-4afb-912a-db37065b5613 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fe344d1-6541-4a77-984f-dd633decfebe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:47:05 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdde07c1-ae70-4afb-912a-db37065b5613 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Connected to 172.16.0.220:3260 {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 21:47:05 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-bdde07c1-ae70-4afb-912a-db37065b5613 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] HCTL ('35', '-', '-', 0) found on session 49 with lun 0 {{(pid=72586) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 21:47:05 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-bdde07c1-ae70-4afb-912a-db37065b5613 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72586) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 21:47:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:47:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:47:05 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[832a3a98-9e04-4fe0-a4d1-a2f97bfe6259]: (4, ('- - 0', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:47:05 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-bdde07c1-ae70-4afb-912a-db37065b5613 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Searching for a device in session 49 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:47:05 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdde07c1-ae70-4afb-912a-db37065b5613 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QHyRCmwE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 21:47:05 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:47:06 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-bdde07c1-ae70-4afb-912a-db37065b5613 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:47:06 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdde07c1-ae70-4afb-912a-db37065b5613 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23630396233643032', 'path': '/dev/sdd'} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:47:06 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdde07c1-ae70-4afb-912a-db37065b5613 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630396233643032', 'path': '/dev/sdd'} {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 21:47:06 user nova-compute[72586]: DEBUG nova.objects.instance [None req-bdde07c1-ae70-4afb-912a-db37065b5613 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lazy-loading 'flavor' on Instance uuid 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:47:06 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-bdde07c1-ae70-4afb-912a-db37065b5613 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 21:47:06 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:47:06 user nova-compute[72586]:   <source dev="/dev/sdd"/>
Aug 01 21:47:06 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:47:06 user nova-compute[72586]:   <serial>0fe344d1-6541-4a77-984f-dd633decfebe</serial>
Aug 01 21:47:06 user nova-compute[72586]: </disk>
Aug 01 21:47:06 user nova-compute[72586]:  {{(pid=72586) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 21:47:07 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-bdde07c1-ae70-4afb-912a-db37065b5613 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:47:07 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-bdde07c1-ae70-4afb-912a-db37065b5613 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:47:07 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-bdde07c1-ae70-4afb-912a-db37065b5613 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] No VIF found with MAC fa:16:3e:d5:4b:c0, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:47:07 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-bdde07c1-ae70-4afb-912a-db37065b5613 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.878s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:47:10 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:47:10 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:47:11 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1491c4eb-683e-40fb-8e2c-a03d895ca743 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Acquiring lock "2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:47:11 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1491c4eb-683e-40fb-8e2c-a03d895ca743 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:47:11 user nova-compute[72586]: DEBUG nova.objects.instance [None req-1491c4eb-683e-40fb-8e2c-a03d895ca743 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lazy-loading 'flavor' on Instance uuid 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:47:11 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1491c4eb-683e-40fb-8e2c-a03d895ca743 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:47:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1491c4eb-683e-40fb-8e2c-a03d895ca743 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Acquiring lock "2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:47:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1491c4eb-683e-40fb-8e2c-a03d895ca743 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:47:12 user nova-compute[72586]: INFO nova.compute.manager [None req-1491c4eb-683e-40fb-8e2c-a03d895ca743 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Attaching volume 59b8a15c-3f5b-411b-9fc5-06aee3c421fc to /dev/vdc
Aug 01 21:47:12 user nova-compute[72586]: DEBUG os_brick.utils [None req-1491c4eb-683e-40fb-8e2c-a03d895ca743 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:47:12 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:47:12 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:47:12 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[04325ac4-9523-4555-aef6-6b50c0c57242]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4bc202fb9cb\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:47:12 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:47:12 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:47:12 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e91665d-23a8-4f3c-befe-a58651f1672b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:47:12 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:47:12 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:47:12 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[57650183-1c67-4ce3-8807-13670a54087b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:47:12 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5da732a-0965-4a0d-903b-1f90681afc32]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:47:12 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-1491c4eb-683e-40fb-8e2c-a03d895ca743 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Running cmd (subprocess): nvme version {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:47:12 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-1491c4eb-683e-40fb-8e2c-a03d895ca743 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] 'nvme version' failed. Not Retrying. {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:47:12 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1491c4eb-683e-40fb-8e2c-a03d895ca743 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] nvme not present on system {{(pid=72586) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 21:47:12 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:47:12 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:47:12 user nova-compute[72586]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 21:47:12 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e4a1f1-f8b5-488d-abb5-a199afef4337]: (4, '') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:47:12 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-1491c4eb-683e-40fb-8e2c-a03d895ca743 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72586) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 21:47:12 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-1491c4eb-683e-40fb-8e2c-a03d895ca743 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 21:47:12 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-1491c4eb-683e-40fb-8e2c-a03d895ca743 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] LIGHTOS: no hostnqn found. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 21:47:12 user nova-compute[72586]: DEBUG os_brick.utils [None req-1491c4eb-683e-40fb-8e2c-a03d895ca743 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4bc202fb9cb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:47:12 user nova-compute[72586]: DEBUG nova.virt.block_device [None req-1491c4eb-683e-40fb-8e2c-a03d895ca743 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Updating existing volume attachment record: 81845c49-5bb6-4cbd-b2b7-d568efa6d67c {{(pid=72586) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 21:47:13 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:47:15 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:47:15 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:47:17 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:47:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c8b46028-e2d8-41f3-9c08-02c2db660e85 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Acquiring lock "f2f4343d-0cab-4ed6-972d-e2bd8a801e8f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:47:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c8b46028-e2d8-41f3-9c08-02c2db660e85 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "f2f4343d-0cab-4ed6-972d-e2bd8a801e8f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:47:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c8b46028-e2d8-41f3-9c08-02c2db660e85 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Acquiring lock "f2f4343d-0cab-4ed6-972d-e2bd8a801e8f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:47:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c8b46028-e2d8-41f3-9c08-02c2db660e85 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "f2f4343d-0cab-4ed6-972d-e2bd8a801e8f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:47:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c8b46028-e2d8-41f3-9c08-02c2db660e85 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "f2f4343d-0cab-4ed6-972d-e2bd8a801e8f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:47:18 user nova-compute[72586]: INFO nova.compute.manager [None req-c8b46028-e2d8-41f3-9c08-02c2db660e85 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Terminating instance
Aug 01 21:47:18 user nova-compute[72586]: DEBUG nova.compute.manager [None req-c8b46028-e2d8-41f3-9c08-02c2db660e85 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Start destroying the instance on the hypervisor. {{(pid=72586) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 21:47:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:47:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:47:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:47:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:47:18 user nova-compute[72586]: DEBUG nova.compute.manager [req-fa3a75a0-93e1-4bd5-906f-b1163150f240 req-448e2b56-7fe2-4788-bd51-ef1fba005640 service nova] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Received event network-vif-unplugged-69059e55-c62d-461b-860f-f638d25c9351 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:47:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-fa3a75a0-93e1-4bd5-906f-b1163150f240 req-448e2b56-7fe2-4788-bd51-ef1fba005640 service nova] Acquiring lock "f2f4343d-0cab-4ed6-972d-e2bd8a801e8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:47:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-fa3a75a0-93e1-4bd5-906f-b1163150f240 req-448e2b56-7fe2-4788-bd51-ef1fba005640 service nova] Lock "f2f4343d-0cab-4ed6-972d-e2bd8a801e8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:47:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-fa3a75a0-93e1-4bd5-906f-b1163150f240 req-448e2b56-7fe2-4788-bd51-ef1fba005640 service nova] Lock "f2f4343d-0cab-4ed6-972d-e2bd8a801e8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:47:18 user nova-compute[72586]: DEBUG nova.compute.manager [req-fa3a75a0-93e1-4bd5-906f-b1163150f240 req-448e2b56-7fe2-4788-bd51-ef1fba005640 service nova] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] No waiting events found dispatching network-vif-unplugged-69059e55-c62d-461b-860f-f638d25c9351 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:47:18 user nova-compute[72586]: DEBUG nova.compute.manager [req-fa3a75a0-93e1-4bd5-906f-b1163150f240 req-448e2b56-7fe2-4788-bd51-ef1fba005640 service nova] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Received event network-vif-unplugged-69059e55-c62d-461b-860f-f638d25c9351 for instance with task_state deleting. {{(pid=72586) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 21:47:18 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Instance destroyed successfully.
Aug 01 21:47:18 user nova-compute[72586]: DEBUG nova.objects.instance [None req-c8b46028-e2d8-41f3-9c08-02c2db660e85 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lazy-loading 'resources' on Instance uuid f2f4343d-0cab-4ed6-972d-e2bd8a801e8f {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:47:18 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-c8b46028-e2d8-41f3-9c08-02c2db660e85 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:42:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-207875059',display_name='tempest-TestVolumeBootPattern-volume-backed-server-207875059',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-207875059',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjJN2/edARG7yQjIN0zv12sSNLb5T+PntMhWviPB9DN83wlKev1TsK5+Bb/k6EQiFO3XyBfFW37jtAbk4OiCH7l6zRFtSX4JoeJU7Lyo/i6SlaWlqzVBKOKEd/iVO52Rg==',key_name='tempest-keypair-13475106',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:42:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a631250d39c34afca47a1fa2817e627e',ramdisk_id='',reservation_id='r-qvukxx03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1160754716',owner_user_name='tempest-TestVolumeBootPattern-1160754716-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:42:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76cd0d9d973b410ca4ff08fc7630fbc6',uuid=f2f4343d-0cab-4ed6-972d-e2bd8a801e8f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "69059e55-c62d-461b-860f-f638d25c9351", "address": "fa:16:3e:5e:53:9a", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69059e55-c6", "ovs_interfaceid": "69059e55-c62d-461b-860f-f638d25c9351", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:47:18 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-c8b46028-e2d8-41f3-9c08-02c2db660e85 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Converting VIF {"id": "69059e55-c62d-461b-860f-f638d25c9351", "address": "fa:16:3e:5e:53:9a", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69059e55-c6", "ovs_interfaceid": "69059e55-c62d-461b-860f-f638d25c9351", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:47:18 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-c8b46028-e2d8-41f3-9c08-02c2db660e85 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:53:9a,bridge_name='br-int',has_traffic_filtering=True,id=69059e55-c62d-461b-860f-f638d25c9351,network=Network(2fbf5ffb-0ec0-403b-bc92-259563ab1d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69059e55-c6') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:47:18 user nova-compute[72586]: DEBUG os_vif [None req-c8b46028-e2d8-41f3-9c08-02c2db660e85 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:53:9a,bridge_name='br-int',has_traffic_filtering=True,id=69059e55-c62d-461b-860f-f638d25c9351,network=Network(2fbf5ffb-0ec0-403b-bc92-259563ab1d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69059e55-c6') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:47:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:47:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap69059e55-c6, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:47:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:47:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:47:18 user nova-compute[72586]: INFO os_vif [None req-c8b46028-e2d8-41f3-9c08-02c2db660e85 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:53:9a,bridge_name='br-int',has_traffic_filtering=True,id=69059e55-c62d-461b-860f-f638d25c9351,network=Network(2fbf5ffb-0ec0-403b-bc92-259563ab1d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69059e55-c6')
Aug 01 21:47:18 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8b46028-e2d8-41f3-9c08-02c2db660e85 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] calling os-brick to detach iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 21:47:18 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b46028-e2d8-41f3-9c08-02c2db660e85 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, {'target_iqns': ['iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zjHcWePn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:47:18 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-c8b46028-e2d8-41f3-9c08-02c2db660e85 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:47:18 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-c8b46028-e2d8-41f3-9c08-02c2db660e85 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:47:18 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-c8b46028-e2d8-41f3-9c08-02c2db660e85 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:47:18 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b46028-e2d8-41f3-9c08-02c2db660e85 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1', 0)] {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 21:47:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:47:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:47:18 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f1f87d-fdd4-49d7-b9c1-a7ee448477c7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fe344d1-6541-4a77-984f-dd633decfebe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:47:18 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:47:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:47:19 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9866c609-4ffe-4e2a-9ac4-b2af7740da8e]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe344d1-6541-4a77-984f-dd633decfebe (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:47:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b46028-e2d8-41f3-9c08-02c2db660e85 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1 (non-flash)
Aug 01 21:47:19 user nova-compute[72586]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 (non-flash)
Aug 01 21:47:19 user nova-compute[72586]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe344d1-6541-4a77-984f-dd633decfebe (non-flash)
Aug 01 21:47:19 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:47:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b46028-e2d8-41f3-9c08-02c2db660e85 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1 (non-flash)
Aug 01 21:47:19 user nova-compute[72586]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 (non-flash)
Aug 01 21:47:19 user nova-compute[72586]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe344d1-6541-4a77-984f-dd633decfebe (non-flash)
Aug 01 21:47:19 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:47:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b46028-e2d8-41f3-9c08-02c2db660e85 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4eac76ea70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1'): ({'sdc'}, set())}) {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 21:47:19 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-c8b46028-e2d8-41f3-9c08-02c2db660e85 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Removing single pathed devices sdc {{(pid=72586) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 21:47:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:47:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:47:19 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d237652-abfe-4053-9843-510e7dbe152b]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:47:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:47:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:47:19 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd55b3c6-698a-4d6d-9d3d-059062f62e9e]: (4, ('ok\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:47:19 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-c8b46028-e2d8-41f3-9c08-02c2db660e85 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Flushing IO for device /dev/sdc {{(pid=72586) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 21:47:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:47:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:47:19 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[306c11d6-8cdc-4eb5-bd51-6e03e8fb5aee]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:47:19 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-c8b46028-e2d8-41f3-9c08-02c2db660e85 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72586) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 21:47:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:47:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:47:19 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7de275b-f8b7-48cf-aa3a-0c7641d2e4fe]: (4, ('1', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:47:19 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-c8b46028-e2d8-41f3-9c08-02c2db660e85 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 21:47:19 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-c8b46028-e2d8-41f3-9c08-02c2db660e85 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] SCSI volumes sdc have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 21:47:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b46028-e2d8-41f3-9c08-02c2db660e85 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1')] {{(pid=72586) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 21:47:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:47:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:47:19 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4f7f87-409d-4f48-93b7-f0ac92c0433e]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:47:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b46028-e2d8-41f3-9c08-02c2db660e85 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:47:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1 -p 172.16.0.220:3260 --logout {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:47:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:47:19 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c888a8f-0975-495e-a388-c1110faa5cdf]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:47:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b46028-e2d8-41f3-9c08-02c2db660e85 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1, portal: 172.16.0.220,3260]
Aug 01 21:47:19 user nova-compute[72586]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1, portal: 172.16.0.220,3260] successful.
Aug 01 21:47:19 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:47:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1 -p 172.16.0.220:3260 --op delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:47:19 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a204c0-4010-4245-8c44-3f0fbedcf4a1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:47:19 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab95b50-2d24-45a5-80b7-5caf1c7933c5]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:47:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b46028-e2d8-41f3-9c08-02c2db660e85 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:47:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-c8b46028-e2d8-41f3-9c08-02c2db660e85 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:47:19 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b46028-e2d8-41f3-9c08-02c2db660e85 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] <== disconnect_volume: return (313ms) None {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:47:19 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8b46028-e2d8-41f3-9c08-02c2db660e85 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Disconnected iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 21:47:19 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-c8b46028-e2d8-41f3-9c08-02c2db660e85 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Deleting instance files /opt/stack/data/nova/instances/f2f4343d-0cab-4ed6-972d-e2bd8a801e8f_del
Aug 01 21:47:19 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-c8b46028-e2d8-41f3-9c08-02c2db660e85 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Deletion of /opt/stack/data/nova/instances/f2f4343d-0cab-4ed6-972d-e2bd8a801e8f_del complete
Aug 01 21:47:19 user nova-compute[72586]: INFO nova.compute.manager [None req-c8b46028-e2d8-41f3-9c08-02c2db660e85 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Took 1.19 seconds to destroy the instance on the hypervisor.
Aug 01 21:47:19 user nova-compute[72586]: DEBUG oslo.service.loopingcall [None req-c8b46028-e2d8-41f3-9c08-02c2db660e85 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72586) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 21:47:19 user nova-compute[72586]: DEBUG nova.compute.manager [-] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Deallocating network for instance {{(pid=72586) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 21:47:19 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] deallocate_for_instance() {{(pid=72586) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 21:47:20 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:47:20 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:47:20 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Took 0.81 seconds to deallocate network for instance.
Aug 01 21:47:20 user nova-compute[72586]: DEBUG nova.compute.manager [req-3ebb4ebe-968a-417a-9a90-743e809c9843 req-74de28ba-ca7e-4162-b5e3-9df2d2d0a1c4 service nova] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Received event network-vif-deleted-69059e55-c62d-461b-860f-f638d25c9351 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:47:20 user nova-compute[72586]: INFO nova.compute.manager [req-3ebb4ebe-968a-417a-9a90-743e809c9843 req-74de28ba-ca7e-4162-b5e3-9df2d2d0a1c4 service nova] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Neutron deleted interface 69059e55-c62d-461b-860f-f638d25c9351; detaching it from the instance and deleting it from the info cache
Aug 01 21:47:20 user nova-compute[72586]: DEBUG nova.network.neutron [req-3ebb4ebe-968a-417a-9a90-743e809c9843 req-74de28ba-ca7e-4162-b5e3-9df2d2d0a1c4 service nova] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:47:20 user nova-compute[72586]: DEBUG nova.compute.manager [req-3ebb4ebe-968a-417a-9a90-743e809c9843 req-74de28ba-ca7e-4162-b5e3-9df2d2d0a1c4 service nova] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Detach interface failed, port_id=69059e55-c62d-461b-860f-f638d25c9351, reason: Instance f2f4343d-0cab-4ed6-972d-e2bd8a801e8f could not be found. {{(pid=72586) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 21:47:20 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1491c4eb-683e-40fb-8e2c-a03d895ca743 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Calling os-brick to attach iSCSI Volume {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 21:47:20 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1491c4eb-683e-40fb-8e2c-a03d895ca743 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:59b8a15c-3f5b-411b-9fc5-06aee3c421fc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WNGTgQSc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:47:20 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-1491c4eb-683e-40fb-8e2c-a03d895ca743 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:47:20 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-1491c4eb-683e-40fb-8e2c-a03d895ca743 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:47:20 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-1491c4eb-683e-40fb-8e2c-a03d895ca743 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:47:20 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-1491c4eb-683e-40fb-8e2c-a03d895ca743 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:47:20 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-1491c4eb-683e-40fb-8e2c-a03d895ca743 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59b8a15c-3f5b-411b-9fc5-06aee3c421fc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:47:20 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-1491c4eb-683e-40fb-8e2c-a03d895ca743 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59b8a15c-3f5b-411b-9fc5-06aee3c421fc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:47:20 user nova-compute[72586]: INFO os_brick.initiator.connectors.iscsi [None req-1491c4eb-683e-40fb-8e2c-a03d895ca743 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 21:47:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59b8a15c-3f5b-411b-9fc5-06aee3c421fc -p 172.16.0.220:3260 {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:47:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59b8a15c-3f5b-411b-9fc5-06aee3c421fc -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:47:20 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[a935af22-003f-4dee-a264-7621bb80d146]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:47:20 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1491c4eb-683e-40fb-8e2c-a03d895ca743 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 21:47:20 user nova-compute[72586]:  {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:47:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59b8a15c-3f5b-411b-9fc5-06aee3c421fc -p 172.16.0.220:3260 --interface default --op new {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:47:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59b8a15c-3f5b-411b-9fc5-06aee3c421fc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:47:20 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[234b9e9d-516a-419d-a7b4-9d14eb5a1814]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:59b8a15c-3f5b-411b-9fc5-06aee3c421fc] added\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:47:20 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1491c4eb-683e-40fb-8e2c-a03d895ca743 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:59b8a15c-3f5b-411b-9fc5-06aee3c421fc] added
Aug 01 21:47:20 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:47:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59b8a15c-3f5b-411b-9fc5-06aee3c421fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:47:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59b8a15c-3f5b-411b-9fc5-06aee3c421fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:47:20 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1145a489-c178-45e4-89ee-39d7f4e9606b]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:47:20 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1491c4eb-683e-40fb-8e2c-a03d895ca743 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:47:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59b8a15c-3f5b-411b-9fc5-06aee3c421fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:47:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59b8a15c-3f5b-411b-9fc5-06aee3c421fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:47:20 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[6acaf505-fc75-4b23-996d-936753d656ef]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:47:20 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1491c4eb-683e-40fb-8e2c-a03d895ca743 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:47:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59b8a15c-3f5b-411b-9fc5-06aee3c421fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WNGTgQSc {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:47:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59b8a15c-3f5b-411b-9fc5-06aee3c421fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WNGTgQSc" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:47:20 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1182278d-ec81-4ed1-80cc-7adc9020f8b3]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:47:20 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1491c4eb-683e-40fb-8e2c-a03d895ca743 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WNGTgQSc'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:47:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59b8a15c-3f5b-411b-9fc5-06aee3c421fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:47:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59b8a15c-3f5b-411b-9fc5-06aee3c421fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:47:20 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18dc08e-b00f-4cae-b271-99b6755a0e4a]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:47:20 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1491c4eb-683e-40fb-8e2c-a03d895ca743 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:47:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:47:20 user nova-compute[72586]: DEBUG nova.compute.manager [req-6f4c0b3b-6ba5-4f77-b505-842f95b10584 req-51823367-d918-4849-adc5-80eeffbe85ec service nova] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Received event network-vif-plugged-69059e55-c62d-461b-860f-f638d25c9351 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:47:20 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-6f4c0b3b-6ba5-4f77-b505-842f95b10584 req-51823367-d918-4849-adc5-80eeffbe85ec service nova] Acquiring lock "f2f4343d-0cab-4ed6-972d-e2bd8a801e8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:47:20 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-6f4c0b3b-6ba5-4f77-b505-842f95b10584 req-51823367-d918-4849-adc5-80eeffbe85ec service nova] Lock "f2f4343d-0cab-4ed6-972d-e2bd8a801e8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:47:20 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-6f4c0b3b-6ba5-4f77-b505-842f95b10584 req-51823367-d918-4849-adc5-80eeffbe85ec service nova] Lock "f2f4343d-0cab-4ed6-972d-e2bd8a801e8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:47:20 user nova-compute[72586]: DEBUG nova.compute.manager [req-6f4c0b3b-6ba5-4f77-b505-842f95b10584 req-51823367-d918-4849-adc5-80eeffbe85ec service nova] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] No waiting events found dispatching network-vif-plugged-69059e55-c62d-461b-860f-f638d25c9351 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:47:20 user nova-compute[72586]: WARNING nova.compute.manager [req-6f4c0b3b-6ba5-4f77-b505-842f95b10584 req-51823367-d918-4849-adc5-80eeffbe85ec service nova] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Received unexpected event network-vif-plugged-69059e55-c62d-461b-860f-f638d25c9351 for instance with vm_state active and task_state deleting.
Aug 01 21:47:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:47:20 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[76807f54-dc7f-4c81-a5b8-93d3b4a6681f]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe344d1-6541-4a77-984f-dd633decfebe (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:47:20 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1491c4eb-683e-40fb-8e2c-a03d895ca743 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 (non-flash)
Aug 01 21:47:20 user nova-compute[72586]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe344d1-6541-4a77-984f-dd633decfebe (non-flash)
Aug 01 21:47:20 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:47:20 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1491c4eb-683e-40fb-8e2c-a03d895ca743 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 (non-flash)
Aug 01 21:47:20 user nova-compute[72586]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe344d1-6541-4a77-984f-dd633decfebe (non-flash)
Aug 01 21:47:20 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:47:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59b8a15c-3f5b-411b-9fc5-06aee3c421fc -p 172.16.0.220:3260 --login {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:47:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59b8a15c-3f5b-411b-9fc5-06aee3c421fc -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:47:20 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[290d6a97-9057-48e6-a8f9-dcac2eff247b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:59b8a15c-3f5b-411b-9fc5-06aee3c421fc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:59b8a15c-3f5b-411b-9fc5-06aee3c421fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:47:20 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1491c4eb-683e-40fb-8e2c-a03d895ca743 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:59b8a15c-3f5b-411b-9fc5-06aee3c421fc, portal: 172.16.0.220,3260]
Aug 01 21:47:20 user nova-compute[72586]: Login to [iface: default, target: iqn.2010-10.org.openstack:59b8a15c-3f5b-411b-9fc5-06aee3c421fc, portal: 172.16.0.220,3260] successful.
Aug 01 21:47:20 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:47:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59b8a15c-3f5b-411b-9fc5-06aee3c421fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:47:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59b8a15c-3f5b-411b-9fc5-06aee3c421fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:47:20 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[2427a61e-ded2-4a77-aa3e-d43a9457640c]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:47:20 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1491c4eb-683e-40fb-8e2c-a03d895ca743 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:47:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:47:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:47:20 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9924800-4570-4b36-99af-434c1e48e3b9]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe344d1-6541-4a77-984f-dd633decfebe (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59b8a15c-3f5b-411b-9fc5-06aee3c421fc (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:47:20 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1491c4eb-683e-40fb-8e2c-a03d895ca743 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 (non-flash)
Aug 01 21:47:20 user nova-compute[72586]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe344d1-6541-4a77-984f-dd633decfebe (non-flash)
Aug 01 21:47:20 user nova-compute[72586]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59b8a15c-3f5b-411b-9fc5-06aee3c421fc (non-flash)
Aug 01 21:47:20 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:47:20 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1491c4eb-683e-40fb-8e2c-a03d895ca743 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 (non-flash)
Aug 01 21:47:20 user nova-compute[72586]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe344d1-6541-4a77-984f-dd633decfebe (non-flash)
Aug 01 21:47:20 user nova-compute[72586]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59b8a15c-3f5b-411b-9fc5-06aee3c421fc (non-flash)
Aug 01 21:47:20 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:47:20 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-1491c4eb-683e-40fb-8e2c-a03d895ca743 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59b8a15c-3f5b-411b-9fc5-06aee3c421fc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:47:20 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1491c4eb-683e-40fb-8e2c-a03d895ca743 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Connected to 172.16.0.220:3260 {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 21:47:20 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-1491c4eb-683e-40fb-8e2c-a03d895ca743 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=72586) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 21:47:20 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-1491c4eb-683e-40fb-8e2c-a03d895ca743 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72586) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 21:47:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:47:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:47:20 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b7abc3-f3bb-4f3c-9e1e-28e42d07f48b]: (4, ('- - 0', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:47:20 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-1491c4eb-683e-40fb-8e2c-a03d895ca743 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:47:20 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1491c4eb-683e-40fb-8e2c-a03d895ca743 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WNGTgQSc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 21:47:20 user nova-compute[72586]: INFO nova.compute.manager [None req-c8b46028-e2d8-41f3-9c08-02c2db660e85 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Took 0.80 seconds to detach 1 volumes for instance.
Aug 01 21:47:20 user nova-compute[72586]: DEBUG nova.compute.manager [None req-c8b46028-e2d8-41f3-9c08-02c2db660e85 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Deleting volume: 50a204c0-4010-4245-8c44-3f0fbedcf4a1 {{(pid=72586) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 01 21:47:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c8b46028-e2d8-41f3-9c08-02c2db660e85 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:47:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c8b46028-e2d8-41f3-9c08-02c2db660e85 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:47:21 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-c8b46028-e2d8-41f3-9c08-02c2db660e85 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:47:21 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-c8b46028-e2d8-41f3-9c08-02c2db660e85 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:47:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c8b46028-e2d8-41f3-9c08-02c2db660e85 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.157s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:47:21 user nova-compute[72586]: INFO nova.scheduler.client.report [None req-c8b46028-e2d8-41f3-9c08-02c2db660e85 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Deleted allocations for instance f2f4343d-0cab-4ed6-972d-e2bd8a801e8f
Aug 01 21:47:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c8b46028-e2d8-41f3-9c08-02c2db660e85 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "f2f4343d-0cab-4ed6-972d-e2bd8a801e8f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.230s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:47:21 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-1491c4eb-683e-40fb-8e2c-a03d895ca743 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:47:21 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1491c4eb-683e-40fb-8e2c-a03d895ca743 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23838333662656536', 'path': '/dev/sdc'} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:47:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1491c4eb-683e-40fb-8e2c-a03d895ca743 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838333662656536', 'path': '/dev/sdc'} {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 21:47:21 user nova-compute[72586]: DEBUG nova.objects.instance [None req-1491c4eb-683e-40fb-8e2c-a03d895ca743 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lazy-loading 'flavor' on Instance uuid 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:47:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-1491c4eb-683e-40fb-8e2c-a03d895ca743 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 21:47:21 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:47:21 user nova-compute[72586]:   <source dev="/dev/sdc"/>
Aug 01 21:47:21 user nova-compute[72586]:   <target dev="vdc" bus="virtio"/>
Aug 01 21:47:21 user nova-compute[72586]:   <serial>59b8a15c-3f5b-411b-9fc5-06aee3c421fc</serial>
Aug 01 21:47:21 user nova-compute[72586]: </disk>
Aug 01 21:47:21 user nova-compute[72586]:  {{(pid=72586) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 21:47:22 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-1491c4eb-683e-40fb-8e2c-a03d895ca743 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:47:22 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-1491c4eb-683e-40fb-8e2c-a03d895ca743 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:47:22 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-1491c4eb-683e-40fb-8e2c-a03d895ca743 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:47:22 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-1491c4eb-683e-40fb-8e2c-a03d895ca743 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] No VIF found with MAC fa:16:3e:d5:4b:c0, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:47:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1491c4eb-683e-40fb-8e2c-a03d895ca743 tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.282s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:47:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-4695cc44-2b5e-47f6-9916-3b2263f896aa tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Acquiring lock "2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:47:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-4695cc44-2b5e-47f6-9916-3b2263f896aa tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:47:23 user nova-compute[72586]: INFO nova.compute.manager [None req-4695cc44-2b5e-47f6-9916-3b2263f896aa tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Detaching volume 0fe344d1-6541-4a77-984f-dd633decfebe
Aug 01 21:47:23 user nova-compute[72586]: INFO nova.virt.block_device [None req-4695cc44-2b5e-47f6-9916-3b2263f896aa tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Attempting to driver detach volume 0fe344d1-6541-4a77-984f-dd633decfebe from mountpoint /dev/vdb
Aug 01 21:47:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-4695cc44-2b5e-47f6-9916-3b2263f896aa tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Attempting to detach device vdb from instance 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6 from the persistent domain config. {{(pid=72586) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 21:47:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-4695cc44-2b5e-47f6-9916-3b2263f896aa tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 21:47:23 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:47:23 user nova-compute[72586]:   <source dev="/dev/sdd"/>
Aug 01 21:47:23 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:47:23 user nova-compute[72586]:   <serial>0fe344d1-6541-4a77-984f-dd633decfebe</serial>
Aug 01 21:47:23 user nova-compute[72586]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 21:47:23 user nova-compute[72586]: </disk>
Aug 01 21:47:23 user nova-compute[72586]:  {{(pid=72586) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 21:47:23 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-4695cc44-2b5e-47f6-9916-3b2263f896aa tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Successfully detached device vdb from instance 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6 from the persistent domain config.
Aug 01 21:47:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-4695cc44-2b5e-47f6-9916-3b2263f896aa tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6 from the live domain config. {{(pid=72586) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 21:47:23 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-4695cc44-2b5e-47f6-9916-3b2263f896aa tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 21:47:23 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:47:23 user nova-compute[72586]:   <source dev="/dev/sdd"/>
Aug 01 21:47:23 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:47:23 user nova-compute[72586]:   <serial>0fe344d1-6541-4a77-984f-dd633decfebe</serial>
Aug 01 21:47:23 user nova-compute[72586]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 21:47:23 user nova-compute[72586]: </disk>
Aug 01 21:47:23 user nova-compute[72586]:  {{(pid=72586) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 21:47:24 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Received event <DeviceRemovedEvent: 1690926443.9432194, 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72586) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 21:47:24 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:47:24 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-4695cc44-2b5e-47f6-9916-3b2263f896aa tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6 {{(pid=72586) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 21:47:24 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-4695cc44-2b5e-47f6-9916-3b2263f896aa tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Successfully detached device vdb from instance 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6 from the live domain config.
Aug 01 21:47:24 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4695cc44-2b5e-47f6-9916-3b2263f896aa tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] calling os-brick to detach iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 21:47:24 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-4695cc44-2b5e-47f6-9916-3b2263f896aa tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, {'target_iqns': ['iqn.2010-10.org.openstack:0fe344d1-6541-4a77-984f-dd633decfebe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QHyRCmwE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:47:24 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-4695cc44-2b5e-47f6-9916-3b2263f896aa tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:47:24 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-4695cc44-2b5e-47f6-9916-3b2263f896aa tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:47:24 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-4695cc44-2b5e-47f6-9916-3b2263f896aa tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:47:24 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-4695cc44-2b5e-47f6-9916-3b2263f896aa tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fe344d1-6541-4a77-984f-dd633decfebe', 0)] {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 21:47:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:47:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:47:24 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[468c0eed-e68e-46d3-9f32-94d66cf9b672]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fe344d1-6541-4a77-984f-dd633decfebe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59b8a15c-3f5b-411b-9fc5-06aee3c421fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:47:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:47:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:47:24 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ad4803-d6a8-4e22-8449-f30ec24dec1d]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe344d1-6541-4a77-984f-dd633decfebe (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59b8a15c-3f5b-411b-9fc5-06aee3c421fc (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:47:24 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-4695cc44-2b5e-47f6-9916-3b2263f896aa tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 (non-flash)
Aug 01 21:47:24 user nova-compute[72586]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe344d1-6541-4a77-984f-dd633decfebe (non-flash)
Aug 01 21:47:24 user nova-compute[72586]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59b8a15c-3f5b-411b-9fc5-06aee3c421fc (non-flash)
Aug 01 21:47:24 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:47:24 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-4695cc44-2b5e-47f6-9916-3b2263f896aa tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 (non-flash)
Aug 01 21:47:24 user nova-compute[72586]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe344d1-6541-4a77-984f-dd633decfebe (non-flash)
Aug 01 21:47:24 user nova-compute[72586]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59b8a15c-3f5b-411b-9fc5-06aee3c421fc (non-flash)
Aug 01 21:47:24 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:47:24 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-4695cc44-2b5e-47f6-9916-3b2263f896aa tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4eac7b17e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fe344d1-6541-4a77-984f-dd633decfebe'): ({'sdd'}, set())}) {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 21:47:24 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-4695cc44-2b5e-47f6-9916-3b2263f896aa tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Removing single pathed devices sdd {{(pid=72586) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 21:47:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:47:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:47:24 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0b47b6-5299-4dad-bbbd-db1c8043f606]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:47:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:47:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.026s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:47:24 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae281b2-910d-4c52-aa22-e980f2b8033b]: (4, ('ok\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:47:24 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-4695cc44-2b5e-47f6-9916-3b2263f896aa tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Flushing IO for device /dev/sdd {{(pid=72586) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 21:47:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:47:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:47:24 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee48bb8c-6364-4d5c-ba96-4895fc6727f2]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:47:24 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-4695cc44-2b5e-47f6-9916-3b2263f896aa tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72586) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 21:47:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:47:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:47:24 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[92196276-4530-466b-acd0-a1a58663ab4a]: (4, ('1', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:47:24 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-4695cc44-2b5e-47f6-9916-3b2263f896aa tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 21:47:24 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-4695cc44-2b5e-47f6-9916-3b2263f896aa tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] SCSI volumes sdd have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 21:47:24 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-4695cc44-2b5e-47f6-9916-3b2263f896aa tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fe344d1-6541-4a77-984f-dd633decfebe')] {{(pid=72586) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 21:47:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fe344d1-6541-4a77-984f-dd633decfebe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:47:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fe344d1-6541-4a77-984f-dd633decfebe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:47:24 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c90eff9-817b-4042-8392-3821bb8deee5]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:47:24 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-4695cc44-2b5e-47f6-9916-3b2263f896aa tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:47:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fe344d1-6541-4a77-984f-dd633decfebe -p 172.16.0.220:3260 --logout {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:47:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fe344d1-6541-4a77-984f-dd633decfebe -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:47:24 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[453dfa19-a851-49df-99b5-2dd573a977c1]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:0fe344d1-6541-4a77-984f-dd633decfebe, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:0fe344d1-6541-4a77-984f-dd633decfebe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:47:24 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-4695cc44-2b5e-47f6-9916-3b2263f896aa tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:0fe344d1-6541-4a77-984f-dd633decfebe, portal: 172.16.0.220,3260]
Aug 01 21:47:24 user nova-compute[72586]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:0fe344d1-6541-4a77-984f-dd633decfebe, portal: 172.16.0.220,3260] successful.
Aug 01 21:47:24 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:47:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fe344d1-6541-4a77-984f-dd633decfebe -p 172.16.0.220:3260 --op delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:47:24 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fe344d1-6541-4a77-984f-dd633decfebe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:47:24 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd31a65-34a2-4eae-8c46-6e6f99c9e83c]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:47:24 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-4695cc44-2b5e-47f6-9916-3b2263f896aa tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:47:24 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-4695cc44-2b5e-47f6-9916-3b2263f896aa tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:47:24 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-4695cc44-2b5e-47f6-9916-3b2263f896aa tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] <== disconnect_volume: return (298ms) None {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:47:24 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4695cc44-2b5e-47f6-9916-3b2263f896aa tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Disconnected iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 21:47:25 user nova-compute[72586]: DEBUG nova.objects.instance [None req-4695cc44-2b5e-47f6-9916-3b2263f896aa tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lazy-loading 'flavor' on Instance uuid 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:47:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-4695cc44-2b5e-47f6-9916-3b2263f896aa tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.800s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:47:25 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:47:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-666ae869-6597-4bdc-aa5d-3c1d627f7b1b tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Acquiring lock "2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:47:25 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-666ae869-6597-4bdc-aa5d-3c1d627f7b1b tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:47:25 user nova-compute[72586]: INFO nova.compute.manager [None req-666ae869-6597-4bdc-aa5d-3c1d627f7b1b tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Detaching volume 59b8a15c-3f5b-411b-9fc5-06aee3c421fc
Aug 01 21:47:25 user nova-compute[72586]: INFO nova.virt.block_device [None req-666ae869-6597-4bdc-aa5d-3c1d627f7b1b tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Attempting to driver detach volume 59b8a15c-3f5b-411b-9fc5-06aee3c421fc from mountpoint /dev/vdc
Aug 01 21:47:25 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-666ae869-6597-4bdc-aa5d-3c1d627f7b1b tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Attempting to detach device vdc from instance 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6 from the persistent domain config. {{(pid=72586) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 21:47:25 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-666ae869-6597-4bdc-aa5d-3c1d627f7b1b tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 21:47:25 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:47:25 user nova-compute[72586]:   <source dev="/dev/sdc"/>
Aug 01 21:47:25 user nova-compute[72586]:   <target dev="vdc" bus="virtio"/>
Aug 01 21:47:25 user nova-compute[72586]:   <serial>59b8a15c-3f5b-411b-9fc5-06aee3c421fc</serial>
Aug 01 21:47:25 user nova-compute[72586]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 01 21:47:25 user nova-compute[72586]: </disk>
Aug 01 21:47:25 user nova-compute[72586]:  {{(pid=72586) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 21:47:25 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-666ae869-6597-4bdc-aa5d-3c1d627f7b1b tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Successfully detached device vdc from instance 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6 from the persistent domain config.
Aug 01 21:47:25 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-666ae869-6597-4bdc-aa5d-3c1d627f7b1b tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6 from the live domain config. {{(pid=72586) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 21:47:25 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-666ae869-6597-4bdc-aa5d-3c1d627f7b1b tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 21:47:25 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:47:25 user nova-compute[72586]:   <source dev="/dev/sdc"/>
Aug 01 21:47:25 user nova-compute[72586]:   <target dev="vdc" bus="virtio"/>
Aug 01 21:47:25 user nova-compute[72586]:   <serial>59b8a15c-3f5b-411b-9fc5-06aee3c421fc</serial>
Aug 01 21:47:25 user nova-compute[72586]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 01 21:47:25 user nova-compute[72586]: </disk>
Aug 01 21:47:25 user nova-compute[72586]:  {{(pid=72586) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 21:47:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Received event <DeviceRemovedEvent: 1690926446.2178168, 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72586) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 21:47:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-666ae869-6597-4bdc-aa5d-3c1d627f7b1b tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6 {{(pid=72586) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 21:47:26 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-666ae869-6597-4bdc-aa5d-3c1d627f7b1b tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Successfully detached device vdc from instance 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6 from the live domain config.
Aug 01 21:47:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-666ae869-6597-4bdc-aa5d-3c1d627f7b1b tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] calling os-brick to detach iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 21:47:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-666ae869-6597-4bdc-aa5d-3c1d627f7b1b tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, {'target_iqns': ['iqn.2010-10.org.openstack:59b8a15c-3f5b-411b-9fc5-06aee3c421fc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WNGTgQSc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:47:26 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-666ae869-6597-4bdc-aa5d-3c1d627f7b1b tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:47:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-666ae869-6597-4bdc-aa5d-3c1d627f7b1b tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:47:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-666ae869-6597-4bdc-aa5d-3c1d627f7b1b tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:47:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-666ae869-6597-4bdc-aa5d-3c1d627f7b1b tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59b8a15c-3f5b-411b-9fc5-06aee3c421fc', 0)] {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 21:47:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:47:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:47:26 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9303e4fa-648c-485c-9998-38930a159c34]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59b8a15c-3f5b-411b-9fc5-06aee3c421fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:47:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:47:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:47:26 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07936f6-9e0d-4b80-847c-dd74c40d4134]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59b8a15c-3f5b-411b-9fc5-06aee3c421fc (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:47:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-666ae869-6597-4bdc-aa5d-3c1d627f7b1b tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 (non-flash)
Aug 01 21:47:26 user nova-compute[72586]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59b8a15c-3f5b-411b-9fc5-06aee3c421fc (non-flash)
Aug 01 21:47:26 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:47:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-666ae869-6597-4bdc-aa5d-3c1d627f7b1b tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 (non-flash)
Aug 01 21:47:26 user nova-compute[72586]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59b8a15c-3f5b-411b-9fc5-06aee3c421fc (non-flash)
Aug 01 21:47:26 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:47:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-666ae869-6597-4bdc-aa5d-3c1d627f7b1b tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ee837ab90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59b8a15c-3f5b-411b-9fc5-06aee3c421fc'): ({'sdc'}, set())}) {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 21:47:26 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-666ae869-6597-4bdc-aa5d-3c1d627f7b1b tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Removing single pathed devices sdc {{(pid=72586) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 21:47:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:47:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:47:26 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b948cd74-e664-4e1c-90d0-785c5d0f6559]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:47:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:47:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:47:26 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b990f96-37fe-491d-adf6-41dfe0a84434]: (4, ('ok\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:47:26 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-666ae869-6597-4bdc-aa5d-3c1d627f7b1b tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Flushing IO for device /dev/sdc {{(pid=72586) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 21:47:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:47:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:47:26 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08c2f12-b5b8-4fa4-9fd9-49694a128605]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:47:26 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-666ae869-6597-4bdc-aa5d-3c1d627f7b1b tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72586) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 21:47:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:47:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:47:26 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a71642-cac4-41bc-937f-95a746eb0152]: (4, ('1', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:47:26 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-666ae869-6597-4bdc-aa5d-3c1d627f7b1b tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 21:47:26 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-666ae869-6597-4bdc-aa5d-3c1d627f7b1b tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] SCSI volumes sdc have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 21:47:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-666ae869-6597-4bdc-aa5d-3c1d627f7b1b tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59b8a15c-3f5b-411b-9fc5-06aee3c421fc')] {{(pid=72586) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 21:47:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59b8a15c-3f5b-411b-9fc5-06aee3c421fc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:47:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59b8a15c-3f5b-411b-9fc5-06aee3c421fc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:47:26 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67a2a75-52f0-4ac4-8240-34a9735088ef]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:47:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-666ae869-6597-4bdc-aa5d-3c1d627f7b1b tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:47:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59b8a15c-3f5b-411b-9fc5-06aee3c421fc -p 172.16.0.220:3260 --logout {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:47:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59b8a15c-3f5b-411b-9fc5-06aee3c421fc -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:47:26 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[861cf925-01f6-42ea-a395-57376b4b0025]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:59b8a15c-3f5b-411b-9fc5-06aee3c421fc, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:59b8a15c-3f5b-411b-9fc5-06aee3c421fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:47:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-666ae869-6597-4bdc-aa5d-3c1d627f7b1b tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:59b8a15c-3f5b-411b-9fc5-06aee3c421fc, portal: 172.16.0.220,3260]
Aug 01 21:47:26 user nova-compute[72586]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:59b8a15c-3f5b-411b-9fc5-06aee3c421fc, portal: 172.16.0.220,3260] successful.
Aug 01 21:47:26 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:47:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59b8a15c-3f5b-411b-9fc5-06aee3c421fc -p 172.16.0.220:3260 --op delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:47:26 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59b8a15c-3f5b-411b-9fc5-06aee3c421fc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:47:26 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4695183-5bee-459b-8d0b-37bb2f58e0b4]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:47:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-666ae869-6597-4bdc-aa5d-3c1d627f7b1b tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:47:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-666ae869-6597-4bdc-aa5d-3c1d627f7b1b tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:47:26 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-666ae869-6597-4bdc-aa5d-3c1d627f7b1b tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] <== disconnect_volume: return (277ms) None {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:47:26 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-666ae869-6597-4bdc-aa5d-3c1d627f7b1b tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Disconnected iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 21:47:27 user nova-compute[72586]: DEBUG nova.objects.instance [None req-666ae869-6597-4bdc-aa5d-3c1d627f7b1b tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lazy-loading 'flavor' on Instance uuid 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:47:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-666ae869-6597-4bdc-aa5d-3c1d627f7b1b tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.576s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:47:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0d66b7bb-bda4-4451-b96f-fbc5f716d33c tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Acquiring lock "2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:47:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0d66b7bb-bda4-4451-b96f-fbc5f716d33c tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:47:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0d66b7bb-bda4-4451-b96f-fbc5f716d33c tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Acquiring lock "2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:47:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0d66b7bb-bda4-4451-b96f-fbc5f716d33c tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:47:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0d66b7bb-bda4-4451-b96f-fbc5f716d33c tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:47:28 user nova-compute[72586]: INFO nova.compute.manager [None req-0d66b7bb-bda4-4451-b96f-fbc5f716d33c tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Terminating instance
Aug 01 21:47:28 user nova-compute[72586]: DEBUG nova.compute.manager [None req-0d66b7bb-bda4-4451-b96f-fbc5f716d33c tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Start destroying the instance on the hypervisor. {{(pid=72586) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 21:47:28 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:47:28 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:47:28 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:47:28 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:47:28 user nova-compute[72586]: DEBUG nova.compute.manager [req-e1f9a6f7-1de2-4ce7-a06d-a9e7e99d131c req-8b95296c-7d1e-49c5-a2ac-eba716f8eba1 service nova] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Received event network-vif-unplugged-1dd6baee-ef06-420a-b60b-af402143b22d {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:47:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-e1f9a6f7-1de2-4ce7-a06d-a9e7e99d131c req-8b95296c-7d1e-49c5-a2ac-eba716f8eba1 service nova] Acquiring lock "2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:47:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-e1f9a6f7-1de2-4ce7-a06d-a9e7e99d131c req-8b95296c-7d1e-49c5-a2ac-eba716f8eba1 service nova] Lock "2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:47:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-e1f9a6f7-1de2-4ce7-a06d-a9e7e99d131c req-8b95296c-7d1e-49c5-a2ac-eba716f8eba1 service nova] Lock "2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:47:28 user nova-compute[72586]: DEBUG nova.compute.manager [req-e1f9a6f7-1de2-4ce7-a06d-a9e7e99d131c req-8b95296c-7d1e-49c5-a2ac-eba716f8eba1 service nova] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] No waiting events found dispatching network-vif-unplugged-1dd6baee-ef06-420a-b60b-af402143b22d {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:47:28 user nova-compute[72586]: DEBUG nova.compute.manager [req-e1f9a6f7-1de2-4ce7-a06d-a9e7e99d131c req-8b95296c-7d1e-49c5-a2ac-eba716f8eba1 service nova] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Received event network-vif-unplugged-1dd6baee-ef06-420a-b60b-af402143b22d for instance with task_state deleting. {{(pid=72586) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 21:47:28 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:47:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:47:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:47:29 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Instance destroyed successfully.
Aug 01 21:47:29 user nova-compute[72586]: DEBUG nova.objects.instance [None req-0d66b7bb-bda4-4451-b96f-fbc5f716d33c tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lazy-loading 'resources' on Instance uuid 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:47:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-0d66b7bb-bda4-4451-b96f-fbc5f716d33c tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:45:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-902787059',display_name='tempest-AttachVolumeTestJSON-server-902787059',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-902787059',id=41,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFDiam4esvU6sK41QNwWSc/2AXzIgLWlUg47PEmBZznbHmM8nh1S2MpzIR5/XtZHNuPKQAtd3NpGTZnLiqFOVHXiiuc/oRr3oAwhWWqOEC1f2CuoAHN8agA/4mikoFGSyA==',key_name='tempest-keypair-16484230',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:45:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='99cbab7dfc55429c9b991bf1091a84c7',ramdisk_id='',reservation_id='r-ke2od031',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1420576365',owner_user_name='tempest-AttachVolumeTestJSON-1420576365-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:45:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='50893dc844b44f498e1545aeee794742',uuid=2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1dd6baee-ef06-420a-b60b-af402143b22d", "address": "fa:16:3e:d5:4b:c0", "network": {"id": "63b6e8c7-fad0-44bf-a479-9baab6f0d1e3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2101151631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cbab7dfc55429c9b991bf1091a84c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dd6baee-ef", "ovs_interfaceid": "1dd6baee-ef06-420a-b60b-af402143b22d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:47:29 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-0d66b7bb-bda4-4451-b96f-fbc5f716d33c tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Converting VIF {"id": "1dd6baee-ef06-420a-b60b-af402143b22d", "address": "fa:16:3e:d5:4b:c0", "network": {"id": "63b6e8c7-fad0-44bf-a479-9baab6f0d1e3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2101151631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cbab7dfc55429c9b991bf1091a84c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dd6baee-ef", "ovs_interfaceid": "1dd6baee-ef06-420a-b60b-af402143b22d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:47:29 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-0d66b7bb-bda4-4451-b96f-fbc5f716d33c tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:4b:c0,bridge_name='br-int',has_traffic_filtering=True,id=1dd6baee-ef06-420a-b60b-af402143b22d,network=Network(63b6e8c7-fad0-44bf-a479-9baab6f0d1e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dd6baee-ef') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:47:29 user nova-compute[72586]: DEBUG os_vif [None req-0d66b7bb-bda4-4451-b96f-fbc5f716d33c tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:4b:c0,bridge_name='br-int',has_traffic_filtering=True,id=1dd6baee-ef06-420a-b60b-af402143b22d,network=Network(63b6e8c7-fad0-44bf-a479-9baab6f0d1e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dd6baee-ef') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:47:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:47:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1dd6baee-ef, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:47:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:47:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:47:29 user nova-compute[72586]: INFO os_vif [None req-0d66b7bb-bda4-4451-b96f-fbc5f716d33c tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:4b:c0,bridge_name='br-int',has_traffic_filtering=True,id=1dd6baee-ef06-420a-b60b-af402143b22d,network=Network(63b6e8c7-fad0-44bf-a479-9baab6f0d1e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dd6baee-ef')
Aug 01 21:47:29 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-0d66b7bb-bda4-4451-b96f-fbc5f716d33c tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Deleting instance files /opt/stack/data/nova/instances/2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6_del
Aug 01 21:47:29 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-0d66b7bb-bda4-4451-b96f-fbc5f716d33c tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Deletion of /opt/stack/data/nova/instances/2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6_del complete
Aug 01 21:47:29 user nova-compute[72586]: INFO nova.compute.manager [None req-0d66b7bb-bda4-4451-b96f-fbc5f716d33c tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 01 21:47:29 user nova-compute[72586]: DEBUG oslo.service.loopingcall [None req-0d66b7bb-bda4-4451-b96f-fbc5f716d33c tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72586) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 21:47:29 user nova-compute[72586]: DEBUG nova.compute.manager [-] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Deallocating network for instance {{(pid=72586) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 21:47:29 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] deallocate_for_instance() {{(pid=72586) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 21:47:30 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:47:30 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:47:30 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Took 0.95 seconds to deallocate network for instance.
Aug 01 21:47:30 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0d66b7bb-bda4-4451-b96f-fbc5f716d33c tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:47:30 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0d66b7bb-bda4-4451-b96f-fbc5f716d33c tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:47:30 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-0d66b7bb-bda4-4451-b96f-fbc5f716d33c tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:47:30 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-0d66b7bb-bda4-4451-b96f-fbc5f716d33c tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:47:30 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0d66b7bb-bda4-4451-b96f-fbc5f716d33c tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.128s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:47:30 user nova-compute[72586]: INFO nova.scheduler.client.report [None req-0d66b7bb-bda4-4451-b96f-fbc5f716d33c tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Deleted allocations for instance 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6
Aug 01 21:47:30 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0d66b7bb-bda4-4451-b96f-fbc5f716d33c tempest-AttachVolumeTestJSON-1420576365 tempest-AttachVolumeTestJSON-1420576365-project-member] Lock "2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.118s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:47:30 user nova-compute[72586]: DEBUG nova.compute.manager [req-36d7df10-fde1-46b4-8a57-b5a705af79f8 req-9bcb5f58-1756-4286-8c7d-473abcbb2ca8 service nova] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Received event network-vif-plugged-1dd6baee-ef06-420a-b60b-af402143b22d {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:47:30 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-36d7df10-fde1-46b4-8a57-b5a705af79f8 req-9bcb5f58-1756-4286-8c7d-473abcbb2ca8 service nova] Acquiring lock "2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:47:30 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-36d7df10-fde1-46b4-8a57-b5a705af79f8 req-9bcb5f58-1756-4286-8c7d-473abcbb2ca8 service nova] Lock "2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:47:30 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-36d7df10-fde1-46b4-8a57-b5a705af79f8 req-9bcb5f58-1756-4286-8c7d-473abcbb2ca8 service nova] Lock "2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:47:30 user nova-compute[72586]: DEBUG nova.compute.manager [req-36d7df10-fde1-46b4-8a57-b5a705af79f8 req-9bcb5f58-1756-4286-8c7d-473abcbb2ca8 service nova] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] No waiting events found dispatching network-vif-plugged-1dd6baee-ef06-420a-b60b-af402143b22d {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:47:30 user nova-compute[72586]: WARNING nova.compute.manager [req-36d7df10-fde1-46b4-8a57-b5a705af79f8 req-9bcb5f58-1756-4286-8c7d-473abcbb2ca8 service nova] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Received unexpected event network-vif-plugged-1dd6baee-ef06-420a-b60b-af402143b22d for instance with vm_state deleted and task_state None.
Aug 01 21:47:30 user nova-compute[72586]: DEBUG nova.compute.manager [req-36d7df10-fde1-46b4-8a57-b5a705af79f8 req-9bcb5f58-1756-4286-8c7d-473abcbb2ca8 service nova] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Received event network-vif-deleted-1dd6baee-ef06-420a-b60b-af402143b22d {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:47:33 user nova-compute[72586]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690926438.9060218, f2f4343d-0cab-4ed6-972d-e2bd8a801e8f => Stopped> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:47:33 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] VM Stopped (Lifecycle Event)
Aug 01 21:47:33 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5a921781-39ba-46d1-ab16-ccb173fa3075 None None] [instance: f2f4343d-0cab-4ed6-972d-e2bd8a801e8f] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:47:34 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:47:38 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:47:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:47:39 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:47:40 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:47:41 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:47:41 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:47:42 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:47:42 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72586) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 21:47:44 user nova-compute[72586]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690926449.0804107, 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6 => Stopped> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:47:44 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] VM Stopped (Lifecycle Event)
Aug 01 21:47:44 user nova-compute[72586]: DEBUG nova.compute.manager [None req-40d4d007-addf-48d7-b2ad-e666e3eb13d1 None None] [instance: 2a28b1dd-5b9b-4155-bee2-b3e49c27b8d6] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:47:44 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:47:45 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:47:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:47:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:47:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:47:45 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Auditing locally available compute resources for user (node: user) {{(pid=72586) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 21:47:46 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:47:46 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:47:46 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:47:46 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Hypervisor/Node resource view: name=user free_ram=8543MB free_disk=25.33031463623047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72586) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 21:47:46 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:47:46 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:47:46 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance d0fa04b2-75e5-4542-9600-7a1517884041 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:47:46 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 21:47:46 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 21:47:46 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:47:46 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:47:46 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Compute_service record updated for user:user {{(pid=72586) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 21:47:46 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.196s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:47:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:47:47 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:47:47 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Starting heal instance info cache {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 21:47:47 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Didn't find any instances for network info cache update. {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 21:47:47 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:47:49 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:47:49 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:47:50 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:47:50 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:47:52 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Acquiring lock "8ae37bb9-cf4e-46e1-b5e5-81930cdfa824" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:47:52 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "8ae37bb9-cf4e-46e1-b5e5-81930cdfa824" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:47:52 user nova-compute[72586]: DEBUG nova.compute.manager [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Starting instance... {{(pid=72586) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 21:47:52 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:47:52 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:47:52 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72586) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 21:47:52 user nova-compute[72586]: INFO nova.compute.claims [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Claim successful on node user
Aug 01 21:47:52 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:47:52 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:47:52 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.249s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:47:52 user nova-compute[72586]: DEBUG nova.compute.manager [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Start building networks asynchronously for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 21:47:52 user nova-compute[72586]: DEBUG nova.compute.manager [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Allocating IP information in the background. {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 21:47:52 user nova-compute[72586]: DEBUG nova.network.neutron [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] allocate_for_instance() {{(pid=72586) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 21:47:52 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 21:47:52 user nova-compute[72586]: DEBUG nova.compute.manager [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Start building block device mappings for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 21:47:53 user nova-compute[72586]: DEBUG nova.policy [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '37663bab7d31400c8399451058bd5936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063dd272226340d49a7ac0756413cadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72586) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 21:47:53 user nova-compute[72586]: DEBUG nova.compute.manager [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Start spawning the instance on the hypervisor. {{(pid=72586) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 21:47:53 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Creating instance directory {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 21:47:53 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Creating image(s)
Aug 01 21:47:53 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Acquiring lock "/opt/stack/data/nova/instances/8ae37bb9-cf4e-46e1-b5e5-81930cdfa824/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:47:53 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "/opt/stack/data/nova/instances/8ae37bb9-cf4e-46e1-b5e5-81930cdfa824/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:47:53 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "/opt/stack/data/nova/instances/8ae37bb9-cf4e-46e1-b5e5-81930cdfa824/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:47:53 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:47:53 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.149s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:47:53 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Acquiring lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:47:53 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:47:53 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:47:53 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.144s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:47:53 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/8ae37bb9-cf4e-46e1-b5e5-81930cdfa824/disk 1073741824 {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:47:53 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/8ae37bb9-cf4e-46e1-b5e5-81930cdfa824/disk 1073741824" returned: 0 in 0.051s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:47:53 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:47:53 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:47:53 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.140s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:47:53 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8ae37bb9-cf4e-46e1-b5e5-81930cdfa824/disk. size=1073741824 {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 21:47:53 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae37bb9-cf4e-46e1-b5e5-81930cdfa824/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:47:53 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae37bb9-cf4e-46e1-b5e5-81930cdfa824/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:47:53 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Cannot resize image /opt/stack/data/nova/instances/8ae37bb9-cf4e-46e1-b5e5-81930cdfa824/disk to a smaller size. {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 21:47:53 user nova-compute[72586]: DEBUG nova.objects.instance [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lazy-loading 'migration_context' on Instance uuid 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:47:53 user nova-compute[72586]: DEBUG nova.network.neutron [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Successfully created port: daadbb57-a9b9-4cef-bded-1ac2305b55de {{(pid=72586) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 21:47:53 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Created local disks {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 21:47:53 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Ensure instance console log exists: /opt/stack/data/nova/instances/8ae37bb9-cf4e-46e1-b5e5-81930cdfa824/console.log {{(pid=72586) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 21:47:53 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:47:53 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:47:53 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:47:54 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:47:54 user nova-compute[72586]: DEBUG nova.network.neutron [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Successfully updated port: daadbb57-a9b9-4cef-bded-1ac2305b55de {{(pid=72586) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 21:47:54 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Acquiring lock "refresh_cache-8ae37bb9-cf4e-46e1-b5e5-81930cdfa824" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:47:54 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Acquired lock "refresh_cache-8ae37bb9-cf4e-46e1-b5e5-81930cdfa824" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:47:54 user nova-compute[72586]: DEBUG nova.network.neutron [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:47:54 user nova-compute[72586]: DEBUG nova.compute.manager [req-32727324-72a4-4534-8fbf-08ee539877f9 req-03840224-eebb-49b7-b1f0-5925218608e2 service nova] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Received event network-changed-daadbb57-a9b9-4cef-bded-1ac2305b55de {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:47:54 user nova-compute[72586]: DEBUG nova.compute.manager [req-32727324-72a4-4534-8fbf-08ee539877f9 req-03840224-eebb-49b7-b1f0-5925218608e2 service nova] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Refreshing instance network info cache due to event network-changed-daadbb57-a9b9-4cef-bded-1ac2305b55de. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:47:54 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-32727324-72a4-4534-8fbf-08ee539877f9 req-03840224-eebb-49b7-b1f0-5925218608e2 service nova] Acquiring lock "refresh_cache-8ae37bb9-cf4e-46e1-b5e5-81930cdfa824" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:47:54 user nova-compute[72586]: DEBUG nova.network.neutron [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Instance cache missing network info. {{(pid=72586) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 21:47:55 user nova-compute[72586]: DEBUG nova.network.neutron [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Updating instance_info_cache with network_info: [{"id": "daadbb57-a9b9-4cef-bded-1ac2305b55de", "address": "fa:16:3e:37:de:60", "network": {"id": "52ee6623-01e5-491e-ab5e-d1d0511bd15f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-765176125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063dd272226340d49a7ac0756413cadf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaadbb57-a9", "ovs_interfaceid": "daadbb57-a9b9-4cef-bded-1ac2305b55de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:47:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Releasing lock "refresh_cache-8ae37bb9-cf4e-46e1-b5e5-81930cdfa824" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:47:55 user nova-compute[72586]: DEBUG nova.compute.manager [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Instance network_info: |[{"id": "daadbb57-a9b9-4cef-bded-1ac2305b55de", "address": "fa:16:3e:37:de:60", "network": {"id": "52ee6623-01e5-491e-ab5e-d1d0511bd15f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-765176125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063dd272226340d49a7ac0756413cadf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaadbb57-a9", "ovs_interfaceid": "daadbb57-a9b9-4cef-bded-1ac2305b55de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 21:47:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-32727324-72a4-4534-8fbf-08ee539877f9 req-03840224-eebb-49b7-b1f0-5925218608e2 service nova] Acquired lock "refresh_cache-8ae37bb9-cf4e-46e1-b5e5-81930cdfa824" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:47:55 user nova-compute[72586]: DEBUG nova.network.neutron [req-32727324-72a4-4534-8fbf-08ee539877f9 req-03840224-eebb-49b7-b1f0-5925218608e2 service nova] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Refreshing network info cache for port daadbb57-a9b9-4cef-bded-1ac2305b55de {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:47:55 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Start _get_guest_xml network_info=[{"id": "daadbb57-a9b9-4cef-bded-1ac2305b55de", "address": "fa:16:3e:37:de:60", "network": {"id": "52ee6623-01e5-491e-ab5e-d1d0511bd15f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-765176125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063dd272226340d49a7ac0756413cadf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaadbb57-a9", "ovs_interfaceid": "daadbb57-a9b9-4cef-bded-1ac2305b55de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '0243d46b-6819-42a5-926f-42b71f0c97ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:47:55 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:47:55 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:47:55 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:47:55 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:47:55 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:47:55 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:47:55 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:47:55 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:47:55 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:47:55 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:47:55 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:47:55 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:47:55 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:47:55 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:47:55 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:47:55 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:47:55 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:47:55 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:47:55 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:47:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1992943926',display_name='tempest-AttachVolumeNegativeTest-server-1992943926',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1992943926',id=43,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCSaCiQ+befkc2a/bfDu4liiF7A3SI4dSfyPTltopt5Q+9MokWzu2UdXxWqI6ihMLr6fQh5czcJ/Lq7wAuTOhLkRvpFYhO+lnr5FNMz2ZOPuFOZvASM7ur1MoIoZyLOlQg==',key_name='tempest-keypair-2009438128',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='063dd272226340d49a7ac0756413cadf',ramdisk_id='',reservation_id='r-dpn6dzrz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-717043369',owner_user_name='tempest-AttachVolumeNegativeTest-717043369-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:47:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37663bab7d31400c8399451058bd5936',uuid=8ae37bb9-cf4e-46e1-b5e5-81930cdfa824,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "daadbb57-a9b9-4cef-bded-1ac2305b55de", "address": "fa:16:3e:37:de:60", "network": {"id": "52ee6623-01e5-491e-ab5e-d1d0511bd15f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-765176125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063dd272226340d49a7ac0756413cadf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaadbb57-a9", "ovs_interfaceid": "daadbb57-a9b9-4cef-bded-1ac2305b55de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:47:55 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Converting VIF {"id": "daadbb57-a9b9-4cef-bded-1ac2305b55de", "address": "fa:16:3e:37:de:60", "network": {"id": "52ee6623-01e5-491e-ab5e-d1d0511bd15f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-765176125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063dd272226340d49a7ac0756413cadf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaadbb57-a9", "ovs_interfaceid": "daadbb57-a9b9-4cef-bded-1ac2305b55de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:47:55 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:de:60,bridge_name='br-int',has_traffic_filtering=True,id=daadbb57-a9b9-4cef-bded-1ac2305b55de,network=Network(52ee6623-01e5-491e-ab5e-d1d0511bd15f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaadbb57-a9') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:47:55 user nova-compute[72586]: DEBUG nova.objects.instance [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lazy-loading 'pci_devices' on Instance uuid 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:47:55 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:47:55 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:47:55 user nova-compute[72586]:   <uuid>8ae37bb9-cf4e-46e1-b5e5-81930cdfa824</uuid>
Aug 01 21:47:55 user nova-compute[72586]:   <name>instance-0000002b</name>
Aug 01 21:47:55 user nova-compute[72586]:   <memory>524288</memory>
Aug 01 21:47:55 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:47:55 user nova-compute[72586]:   <metadata>
Aug 01 21:47:55 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:47:55 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:47:55 user nova-compute[72586]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1992943926</nova:name>
Aug 01 21:47:55 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:47:55</nova:creationTime>
Aug 01 21:47:55 user nova-compute[72586]:       <nova:flavor name="m1.tiny">
Aug 01 21:47:55 user nova-compute[72586]:         <nova:memory>512</nova:memory>
Aug 01 21:47:55 user nova-compute[72586]:         <nova:disk>1</nova:disk>
Aug 01 21:47:55 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:47:55 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:47:55 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:47:55 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:47:55 user nova-compute[72586]:       <nova:owner>
Aug 01 21:47:55 user nova-compute[72586]:         <nova:user uuid="37663bab7d31400c8399451058bd5936">tempest-AttachVolumeNegativeTest-717043369-project-member</nova:user>
Aug 01 21:47:55 user nova-compute[72586]:         <nova:project uuid="063dd272226340d49a7ac0756413cadf">tempest-AttachVolumeNegativeTest-717043369</nova:project>
Aug 01 21:47:55 user nova-compute[72586]:       </nova:owner>
Aug 01 21:47:55 user nova-compute[72586]:       <nova:root type="image" uuid="0243d46b-6819-42a5-926f-42b71f0c97ad"/>
Aug 01 21:47:55 user nova-compute[72586]:       <nova:ports>
Aug 01 21:47:55 user nova-compute[72586]:         <nova:port uuid="daadbb57-a9b9-4cef-bded-1ac2305b55de">
Aug 01 21:47:55 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 01 21:47:55 user nova-compute[72586]:         </nova:port>
Aug 01 21:47:55 user nova-compute[72586]:       </nova:ports>
Aug 01 21:47:55 user nova-compute[72586]:     </nova:instance>
Aug 01 21:47:55 user nova-compute[72586]:   </metadata>
Aug 01 21:47:55 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:47:55 user nova-compute[72586]:     <system>
Aug 01 21:47:55 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:47:55 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:47:55 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:47:55 user nova-compute[72586]:       <entry name="serial">8ae37bb9-cf4e-46e1-b5e5-81930cdfa824</entry>
Aug 01 21:47:55 user nova-compute[72586]:       <entry name="uuid">8ae37bb9-cf4e-46e1-b5e5-81930cdfa824</entry>
Aug 01 21:47:55 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:47:55 user nova-compute[72586]:     </system>
Aug 01 21:47:55 user nova-compute[72586]:   </sysinfo>
Aug 01 21:47:55 user nova-compute[72586]:   <os>
Aug 01 21:47:55 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:47:55 user nova-compute[72586]:     <boot dev="hd"/>
Aug 01 21:47:55 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:47:55 user nova-compute[72586]:   </os>
Aug 01 21:47:55 user nova-compute[72586]:   <features>
Aug 01 21:47:55 user nova-compute[72586]:     <acpi/>
Aug 01 21:47:55 user nova-compute[72586]:     <apic/>
Aug 01 21:47:55 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:47:55 user nova-compute[72586]:   </features>
Aug 01 21:47:55 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:47:55 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:47:55 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:47:55 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:47:55 user nova-compute[72586]:   </clock>
Aug 01 21:47:55 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:47:55 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:47:55 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:47:55 user nova-compute[72586]:   </cpu>
Aug 01 21:47:55 user nova-compute[72586]:   <devices>
Aug 01 21:47:55 user nova-compute[72586]:     <disk type="file" device="disk">
Aug 01 21:47:55 user nova-compute[72586]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 21:47:55 user nova-compute[72586]:       <source file="/opt/stack/data/nova/instances/8ae37bb9-cf4e-46e1-b5e5-81930cdfa824/disk"/>
Aug 01 21:47:55 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:47:55 user nova-compute[72586]:     </disk>
Aug 01 21:47:55 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:47:55 user nova-compute[72586]:       <mac address="fa:16:3e:37:de:60"/>
Aug 01 21:47:55 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:47:55 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:47:55 user nova-compute[72586]:       <target dev="tapdaadbb57-a9"/>
Aug 01 21:47:55 user nova-compute[72586]:     </interface>
Aug 01 21:47:55 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:47:55 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/8ae37bb9-cf4e-46e1-b5e5-81930cdfa824/console.log" append="off"/>
Aug 01 21:47:55 user nova-compute[72586]:     </serial>
Aug 01 21:47:55 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:47:55 user nova-compute[72586]:     <video>
Aug 01 21:47:55 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:47:55 user nova-compute[72586]:     </video>
Aug 01 21:47:55 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:47:55 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:47:55 user nova-compute[72586]:     </rng>
Aug 01 21:47:55 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:47:55 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:47:55 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:47:55 user nova-compute[72586]:     </memballoon>
Aug 01 21:47:55 user nova-compute[72586]:   </devices>
Aug 01 21:47:55 user nova-compute[72586]: </domain>
Aug 01 21:47:55 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:47:55 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:47:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1992943926',display_name='tempest-AttachVolumeNegativeTest-server-1992943926',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1992943926',id=43,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCSaCiQ+befkc2a/bfDu4liiF7A3SI4dSfyPTltopt5Q+9MokWzu2UdXxWqI6ihMLr6fQh5czcJ/Lq7wAuTOhLkRvpFYhO+lnr5FNMz2ZOPuFOZvASM7ur1MoIoZyLOlQg==',key_name='tempest-keypair-2009438128',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='063dd272226340d49a7ac0756413cadf',ramdisk_id='',reservation_id='r-dpn6dzrz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-717043369',owner_user_name='tempest-AttachVolumeNegativeTest-717043369-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:47:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37663bab7d31400c8399451058bd5936',uuid=8ae37bb9-cf4e-46e1-b5e5-81930cdfa824,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "daadbb57-a9b9-4cef-bded-1ac2305b55de", "address": "fa:16:3e:37:de:60", "network": {"id": "52ee6623-01e5-491e-ab5e-d1d0511bd15f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-765176125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063dd272226340d49a7ac0756413cadf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaadbb57-a9", "ovs_interfaceid": "daadbb57-a9b9-4cef-bded-1ac2305b55de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:47:55 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Converting VIF {"id": "daadbb57-a9b9-4cef-bded-1ac2305b55de", "address": "fa:16:3e:37:de:60", "network": {"id": "52ee6623-01e5-491e-ab5e-d1d0511bd15f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-765176125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063dd272226340d49a7ac0756413cadf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaadbb57-a9", "ovs_interfaceid": "daadbb57-a9b9-4cef-bded-1ac2305b55de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:47:55 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:de:60,bridge_name='br-int',has_traffic_filtering=True,id=daadbb57-a9b9-4cef-bded-1ac2305b55de,network=Network(52ee6623-01e5-491e-ab5e-d1d0511bd15f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaadbb57-a9') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:47:55 user nova-compute[72586]: DEBUG os_vif [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:de:60,bridge_name='br-int',has_traffic_filtering=True,id=daadbb57-a9b9-4cef-bded-1ac2305b55de,network=Network(52ee6623-01e5-491e-ab5e-d1d0511bd15f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaadbb57-a9') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:47:55 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:47:55 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:47:55 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:47:55 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:47:55 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdaadbb57-a9, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:47:55 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdaadbb57-a9, col_values=(('external_ids', {'iface-id': 'daadbb57-a9b9-4cef-bded-1ac2305b55de', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:de:60', 'vm-uuid': '8ae37bb9-cf4e-46e1-b5e5-81930cdfa824'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:47:55 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:47:55 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:47:55 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:47:55 user nova-compute[72586]: INFO os_vif [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:de:60,bridge_name='br-int',has_traffic_filtering=True,id=daadbb57-a9b9-4cef-bded-1ac2305b55de,network=Network(52ee6623-01e5-491e-ab5e-d1d0511bd15f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaadbb57-a9')
Aug 01 21:47:55 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:47:55 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] No VIF found with MAC fa:16:3e:37:de:60, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:47:55 user nova-compute[72586]: DEBUG nova.network.neutron [req-32727324-72a4-4534-8fbf-08ee539877f9 req-03840224-eebb-49b7-b1f0-5925218608e2 service nova] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Updated VIF entry in instance network info cache for port daadbb57-a9b9-4cef-bded-1ac2305b55de. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:47:55 user nova-compute[72586]: DEBUG nova.network.neutron [req-32727324-72a4-4534-8fbf-08ee539877f9 req-03840224-eebb-49b7-b1f0-5925218608e2 service nova] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Updating instance_info_cache with network_info: [{"id": "daadbb57-a9b9-4cef-bded-1ac2305b55de", "address": "fa:16:3e:37:de:60", "network": {"id": "52ee6623-01e5-491e-ab5e-d1d0511bd15f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-765176125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063dd272226340d49a7ac0756413cadf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaadbb57-a9", "ovs_interfaceid": "daadbb57-a9b9-4cef-bded-1ac2305b55de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:47:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-32727324-72a4-4534-8fbf-08ee539877f9 req-03840224-eebb-49b7-b1f0-5925218608e2 service nova] Releasing lock "refresh_cache-8ae37bb9-cf4e-46e1-b5e5-81930cdfa824" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:47:55 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:47:56 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:47:56 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:47:56 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:47:56 user nova-compute[72586]: DEBUG nova.compute.manager [req-43936805-e816-46c3-8bda-81a5fb0606ac req-85cef623-2f33-4bb7-9e6f-60d6163eff68 service nova] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Received event network-vif-plugged-daadbb57-a9b9-4cef-bded-1ac2305b55de {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:47:56 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-43936805-e816-46c3-8bda-81a5fb0606ac req-85cef623-2f33-4bb7-9e6f-60d6163eff68 service nova] Acquiring lock "8ae37bb9-cf4e-46e1-b5e5-81930cdfa824-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:47:56 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-43936805-e816-46c3-8bda-81a5fb0606ac req-85cef623-2f33-4bb7-9e6f-60d6163eff68 service nova] Lock "8ae37bb9-cf4e-46e1-b5e5-81930cdfa824-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:47:56 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-43936805-e816-46c3-8bda-81a5fb0606ac req-85cef623-2f33-4bb7-9e6f-60d6163eff68 service nova] Lock "8ae37bb9-cf4e-46e1-b5e5-81930cdfa824-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:47:56 user nova-compute[72586]: DEBUG nova.compute.manager [req-43936805-e816-46c3-8bda-81a5fb0606ac req-85cef623-2f33-4bb7-9e6f-60d6163eff68 service nova] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] No waiting events found dispatching network-vif-plugged-daadbb57-a9b9-4cef-bded-1ac2305b55de {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:47:56 user nova-compute[72586]: WARNING nova.compute.manager [req-43936805-e816-46c3-8bda-81a5fb0606ac req-85cef623-2f33-4bb7-9e6f-60d6163eff68 service nova] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Received unexpected event network-vif-plugged-daadbb57-a9b9-4cef-bded-1ac2305b55de for instance with vm_state building and task_state spawning.
Aug 01 21:47:57 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:47:57 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:47:57 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:47:57 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:47:58 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690926478.6177478, 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824 => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:47:58 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] VM Resumed (Lifecycle Event)
Aug 01 21:47:58 user nova-compute[72586]: DEBUG nova.compute.manager [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Instance event wait completed in 0 seconds for  {{(pid=72586) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 21:47:58 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Guest created on hypervisor {{(pid=72586) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 21:47:58 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Instance spawned successfully.
Aug 01 21:47:58 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 21:47:58 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:47:58 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:47:58 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Found default for hw_cdrom_bus of ide {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:47:58 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Found default for hw_disk_bus of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:47:58 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Found default for hw_input_bus of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:47:58 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Found default for hw_pointer_model of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:47:58 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Found default for hw_video_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:47:58 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Found default for hw_vif_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:47:58 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:47:58 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690926478.6197488, 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824 => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:47:58 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] VM Started (Lifecycle Event)
Aug 01 21:47:58 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:47:58 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:47:58 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:47:58 user nova-compute[72586]: INFO nova.compute.manager [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Took 5.60 seconds to spawn the instance on the hypervisor.
Aug 01 21:47:58 user nova-compute[72586]: DEBUG nova.compute.manager [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:47:58 user nova-compute[72586]: INFO nova.compute.manager [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Took 6.25 seconds to build instance.
Aug 01 21:47:58 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-3a427fc2-3228-4209-b7bc-c593938a4658 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "8ae37bb9-cf4e-46e1-b5e5-81930cdfa824" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.342s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:47:58 user nova-compute[72586]: DEBUG nova.compute.manager [req-c96d0f1f-78e0-4eb5-a09f-0d8800e5acb3 req-870a1e37-77e6-4499-a970-322e3ecfae6d service nova] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Received event network-vif-plugged-daadbb57-a9b9-4cef-bded-1ac2305b55de {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:47:58 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-c96d0f1f-78e0-4eb5-a09f-0d8800e5acb3 req-870a1e37-77e6-4499-a970-322e3ecfae6d service nova] Acquiring lock "8ae37bb9-cf4e-46e1-b5e5-81930cdfa824-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:47:58 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-c96d0f1f-78e0-4eb5-a09f-0d8800e5acb3 req-870a1e37-77e6-4499-a970-322e3ecfae6d service nova] Lock "8ae37bb9-cf4e-46e1-b5e5-81930cdfa824-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:47:58 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-c96d0f1f-78e0-4eb5-a09f-0d8800e5acb3 req-870a1e37-77e6-4499-a970-322e3ecfae6d service nova] Lock "8ae37bb9-cf4e-46e1-b5e5-81930cdfa824-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:47:58 user nova-compute[72586]: DEBUG nova.compute.manager [req-c96d0f1f-78e0-4eb5-a09f-0d8800e5acb3 req-870a1e37-77e6-4499-a970-322e3ecfae6d service nova] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] No waiting events found dispatching network-vif-plugged-daadbb57-a9b9-4cef-bded-1ac2305b55de {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:47:58 user nova-compute[72586]: WARNING nova.compute.manager [req-c96d0f1f-78e0-4eb5-a09f-0d8800e5acb3 req-870a1e37-77e6-4499-a970-322e3ecfae6d service nova] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Received unexpected event network-vif-plugged-daadbb57-a9b9-4cef-bded-1ac2305b55de for instance with vm_state active and task_state None.
Aug 01 21:48:00 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:48:00 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:48:05 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:48:05 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:48:10 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:48:15 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:48:15 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:48:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:48:19 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Acquiring lock "71d8bdf9-f90d-4335-9f60-dbdc4380b1d7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:48:19 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "71d8bdf9-f90d-4335-9f60-dbdc4380b1d7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:48:19 user nova-compute[72586]: DEBUG nova.compute.manager [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Starting instance... {{(pid=72586) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 21:48:19 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:48:19 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:48:19 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72586) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 21:48:19 user nova-compute[72586]: INFO nova.compute.claims [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Claim successful on node user
Aug 01 21:48:20 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:48:20 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:48:20 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:48:20 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:48:20 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.279s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:48:20 user nova-compute[72586]: DEBUG nova.compute.manager [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Start building networks asynchronously for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 21:48:20 user nova-compute[72586]: DEBUG nova.compute.manager [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Allocating IP information in the background. {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 21:48:20 user nova-compute[72586]: DEBUG nova.network.neutron [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] allocate_for_instance() {{(pid=72586) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 21:48:20 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 21:48:20 user nova-compute[72586]: DEBUG nova.compute.manager [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Start building block device mappings for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 21:48:20 user nova-compute[72586]: INFO nova.virt.block_device [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Booting with volume 902655e6-2982-46c0-a124-0255707cd178 at /dev/vda
Aug 01 21:48:20 user nova-compute[72586]: DEBUG nova.policy [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '76cd0d9d973b410ca4ff08fc7630fbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a631250d39c34afca47a1fa2817e627e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72586) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 21:48:20 user nova-compute[72586]: DEBUG os_brick.utils [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:48:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:48:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:48:20 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f028913-4422-4374-bfd4-18de621fc95c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4bc202fb9cb\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:48:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:48:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:48:20 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[3648bc46-ca76-4915-8db9-1c76bb1a1e98]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:48:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:48:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:48:20 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[374d8080-fa81-4bbf-bdaf-bd4620c5995d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:48:20 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d28dac7-4fcd-4635-bcdf-9f91a6755e7d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:48:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Running cmd (subprocess): nvme version {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:48:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] 'nvme version' failed. Not Retrying. {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:48:20 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.nvmeof [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] nvme not present on system {{(pid=72586) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 21:48:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:48:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:48:20 user nova-compute[72586]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 21:48:20 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab6725c9-1418-4478-84b9-60f55a3ad8f1]: (4, '') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:48:20 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72586) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 21:48:20 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 21:48:20 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] LIGHTOS: no hostnqn found. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 21:48:20 user nova-compute[72586]: DEBUG os_brick.utils [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4bc202fb9cb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:48:20 user nova-compute[72586]: DEBUG nova.virt.block_device [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Updating existing volume attachment record: c9c11380-f319-4674-b6b3-85809e63daf4 {{(pid=72586) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 21:48:21 user nova-compute[72586]: DEBUG nova.network.neutron [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Successfully created port: 6486639b-ff35-44da-9139-dd485a1e6eb7 {{(pid=72586) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 21:48:22 user nova-compute[72586]: DEBUG nova.network.neutron [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Successfully updated port: 6486639b-ff35-44da-9139-dd485a1e6eb7 {{(pid=72586) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 21:48:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Acquiring lock "refresh_cache-71d8bdf9-f90d-4335-9f60-dbdc4380b1d7" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:48:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Acquired lock "refresh_cache-71d8bdf9-f90d-4335-9f60-dbdc4380b1d7" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:48:22 user nova-compute[72586]: DEBUG nova.network.neutron [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:48:22 user nova-compute[72586]: DEBUG nova.compute.manager [req-7eb2beea-21e9-43fd-a3c9-166fad70af5f req-46149ba0-8d5e-4bab-9f96-80039f0b894a service nova] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Received event network-changed-6486639b-ff35-44da-9139-dd485a1e6eb7 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:48:22 user nova-compute[72586]: DEBUG nova.compute.manager [req-7eb2beea-21e9-43fd-a3c9-166fad70af5f req-46149ba0-8d5e-4bab-9f96-80039f0b894a service nova] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Refreshing instance network info cache due to event network-changed-6486639b-ff35-44da-9139-dd485a1e6eb7. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:48:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-7eb2beea-21e9-43fd-a3c9-166fad70af5f req-46149ba0-8d5e-4bab-9f96-80039f0b894a service nova] Acquiring lock "refresh_cache-71d8bdf9-f90d-4335-9f60-dbdc4380b1d7" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:48:22 user nova-compute[72586]: DEBUG nova.network.neutron [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Instance cache missing network info. {{(pid=72586) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 21:48:22 user nova-compute[72586]: DEBUG nova.network.neutron [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Updating instance_info_cache with network_info: [{"id": "6486639b-ff35-44da-9139-dd485a1e6eb7", "address": "fa:16:3e:1e:da:69", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6486639b-ff", "ovs_interfaceid": "6486639b-ff35-44da-9139-dd485a1e6eb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:48:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Releasing lock "refresh_cache-71d8bdf9-f90d-4335-9f60-dbdc4380b1d7" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:48:22 user nova-compute[72586]: DEBUG nova.compute.manager [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Instance network_info: |[{"id": "6486639b-ff35-44da-9139-dd485a1e6eb7", "address": "fa:16:3e:1e:da:69", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6486639b-ff", "ovs_interfaceid": "6486639b-ff35-44da-9139-dd485a1e6eb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 21:48:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-7eb2beea-21e9-43fd-a3c9-166fad70af5f req-46149ba0-8d5e-4bab-9f96-80039f0b894a service nova] Acquired lock "refresh_cache-71d8bdf9-f90d-4335-9f60-dbdc4380b1d7" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:48:22 user nova-compute[72586]: DEBUG nova.network.neutron [req-7eb2beea-21e9-43fd-a3c9-166fad70af5f req-46149ba0-8d5e-4bab-9f96-80039f0b894a service nova] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Refreshing network info cache for port 6486639b-ff35-44da-9139-dd485a1e6eb7 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:48:23 user nova-compute[72586]: DEBUG nova.network.neutron [req-7eb2beea-21e9-43fd-a3c9-166fad70af5f req-46149ba0-8d5e-4bab-9f96-80039f0b894a service nova] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Updated VIF entry in instance network info cache for port 6486639b-ff35-44da-9139-dd485a1e6eb7. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:48:23 user nova-compute[72586]: DEBUG nova.network.neutron [req-7eb2beea-21e9-43fd-a3c9-166fad70af5f req-46149ba0-8d5e-4bab-9f96-80039f0b894a service nova] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Updating instance_info_cache with network_info: [{"id": "6486639b-ff35-44da-9139-dd485a1e6eb7", "address": "fa:16:3e:1e:da:69", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6486639b-ff", "ovs_interfaceid": "6486639b-ff35-44da-9139-dd485a1e6eb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:48:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-7eb2beea-21e9-43fd-a3c9-166fad70af5f req-46149ba0-8d5e-4bab-9f96-80039f0b894a service nova] Releasing lock "refresh_cache-71d8bdf9-f90d-4335-9f60-dbdc4380b1d7" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:48:25 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:48:25 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG nova.compute.manager [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Start spawning the instance on the hypervisor. {{(pid=72586) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Creating instance directory {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 21:48:28 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Creating image(s)
Aug 01 21:48:28 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Did not create local disks {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Ensure instance console log exists: /opt/stack/data/nova/instances/71d8bdf9-f90d-4335-9f60-dbdc4380b1d7/console.log {{(pid=72586) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Start _get_guest_xml network_info=[{"id": "6486639b-ff35-44da-9139-dd485a1e6eb7", "address": "fa:16:3e:1e:da:69", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6486639b-ff", "ovs_interfaceid": "6486639b-ff35-44da-9139-dd485a1e6eb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QeybaUVI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '71d8bdf9-f90d-4335-9f60-dbdc4380b1d7', 'attached_at': '', 'detached_at': '', 'volume_id': '902655e6-2982-46c0-a124-0255707cd178', 'serial': '902655e6-2982-46c0-a124-0255707cd178'}, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'c9c11380-f319-4674-b6b3-85809e63daf4', 'delete_on_termination': False, 'volume_type': None} {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:48:28 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:48:28 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:48:28 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Calling os-brick to attach iSCSI Volume {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QeybaUVI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:48:28 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:48:28 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:48:28 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:48:28 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:48:28 user nova-compute[72586]: INFO os_brick.initiator.connectors.iscsi [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 21:48:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 -p 172.16.0.220:3260 {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e76979-ac20-44c1-b10f-b0ac00163d67]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 21:48:28 user nova-compute[72586]:  {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 -p 172.16.0.220:3260 --interface default --op new {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[288f7689-1d79-445f-ac67-c7587393c962]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178] added\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178] added
Aug 01 21:48:28 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b5479f4-03a0-4f08-a89d-fe3cc325a2f3]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.069s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[5808ede0-a503-4d5a-89b8-a7f696334140]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QeybaUVI {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QeybaUVI" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d4f9fb-a020-4b39-8fd9-462e89e7bacf]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QeybaUVI'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d716eb-dafa-4490-9837-eba63d6dcc08]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[86969b71-002a-4759-b943-852b7e9e5fd9]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 (non-flash)
Aug 01 21:48:28 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 (non-flash)
Aug 01 21:48:28 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 -p 172.16.0.220:3260 --login {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aceea83-d4e5-4819-9dcb-03c7e1d8ae7b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178, portal: 172.16.0.220,3260]
Aug 01 21:48:28 user nova-compute[72586]: Login to [iface: default, target: iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178, portal: 172.16.0.220,3260] successful.
Aug 01 21:48:28 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06ddf94-b35b-48e1-9126-ca9c7684453d]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6af33b-3e0b-4c61-8e53-e443341a89bc]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 (non-flash)
Aug 01 21:48:28 user nova-compute[72586]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 (non-flash)
Aug 01 21:48:28 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 (non-flash)
Aug 01 21:48:28 user nova-compute[72586]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 (non-flash)
Aug 01 21:48:28 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Connected to 172.16.0.220:3260 {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=72586) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72586) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd6c759-08d1-48ce-84d4-b521b514921a]: (4, ('- - 0', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:48:28 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QeybaUVI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 21:48:29 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:48:29 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '26261386133303839', 'path': '/dev/sdc'} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:48:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26261386133303839', 'path': '/dev/sdc'} {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 21:48:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:48:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1733853456',display_name='tempest-TestVolumeBootPattern-server-1733853456',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1733853456',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHNJjSduTMasTSgviwHre/FYLh+Mp4kuIJ4iuAJ7FsI2FanPe3E7nT7btn/7CziUSz0I1qByH5+ECZVnIY2RecZsBlCuwfU8kwCbqZrJSP50B9MRG5Gjmo9qdN10n6adqA==',key_name='tempest-TestVolumeBootPattern-705389702',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a631250d39c34afca47a1fa2817e627e',ramdisk_id='',reservation_id='r-x7zwq0hz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1160754716',owner_user_name='tempest-TestVolumeBootPattern-1160754716-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:48:20Z,user_data=None,user_id='76cd0d9d973b410ca4ff08fc7630fbc6',uuid=71d8bdf9-f90d-4335-9f60-dbdc4380b1d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6486639b-ff35-44da-9139-dd485a1e6eb7", "address": "fa:16:3e:1e:da:69", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6486639b-ff", "ovs_interfaceid": "6486639b-ff35-44da-9139-dd485a1e6eb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:48:29 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Converting VIF {"id": "6486639b-ff35-44da-9139-dd485a1e6eb7", "address": "fa:16:3e:1e:da:69", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6486639b-ff", "ovs_interfaceid": "6486639b-ff35-44da-9139-dd485a1e6eb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:48:29 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:da:69,bridge_name='br-int',has_traffic_filtering=True,id=6486639b-ff35-44da-9139-dd485a1e6eb7,network=Network(2fbf5ffb-0ec0-403b-bc92-259563ab1d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6486639b-ff') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:48:29 user nova-compute[72586]: DEBUG nova.objects.instance [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lazy-loading 'pci_devices' on Instance uuid 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:48:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:48:29 user nova-compute[72586]:   <uuid>71d8bdf9-f90d-4335-9f60-dbdc4380b1d7</uuid>
Aug 01 21:48:29 user nova-compute[72586]:   <name>instance-0000002c</name>
Aug 01 21:48:29 user nova-compute[72586]:   <memory>524288</memory>
Aug 01 21:48:29 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:48:29 user nova-compute[72586]:   <metadata>
Aug 01 21:48:29 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:48:29 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:48:29 user nova-compute[72586]:       <nova:name>tempest-TestVolumeBootPattern-server-1733853456</nova:name>
Aug 01 21:48:29 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:48:28</nova:creationTime>
Aug 01 21:48:29 user nova-compute[72586]:       <nova:flavor name="m1.tiny">
Aug 01 21:48:29 user nova-compute[72586]:         <nova:memory>512</nova:memory>
Aug 01 21:48:29 user nova-compute[72586]:         <nova:disk>1</nova:disk>
Aug 01 21:48:29 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:48:29 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:48:29 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:48:29 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:48:29 user nova-compute[72586]:       <nova:owner>
Aug 01 21:48:29 user nova-compute[72586]:         <nova:user uuid="76cd0d9d973b410ca4ff08fc7630fbc6">tempest-TestVolumeBootPattern-1160754716-project-member</nova:user>
Aug 01 21:48:29 user nova-compute[72586]:         <nova:project uuid="a631250d39c34afca47a1fa2817e627e">tempest-TestVolumeBootPattern-1160754716</nova:project>
Aug 01 21:48:29 user nova-compute[72586]:       </nova:owner>
Aug 01 21:48:29 user nova-compute[72586]:       <nova:ports>
Aug 01 21:48:29 user nova-compute[72586]:         <nova:port uuid="6486639b-ff35-44da-9139-dd485a1e6eb7">
Aug 01 21:48:29 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 01 21:48:29 user nova-compute[72586]:         </nova:port>
Aug 01 21:48:29 user nova-compute[72586]:       </nova:ports>
Aug 01 21:48:29 user nova-compute[72586]:     </nova:instance>
Aug 01 21:48:29 user nova-compute[72586]:   </metadata>
Aug 01 21:48:29 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:48:29 user nova-compute[72586]:     <system>
Aug 01 21:48:29 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:48:29 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:48:29 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:48:29 user nova-compute[72586]:       <entry name="serial">71d8bdf9-f90d-4335-9f60-dbdc4380b1d7</entry>
Aug 01 21:48:29 user nova-compute[72586]:       <entry name="uuid">71d8bdf9-f90d-4335-9f60-dbdc4380b1d7</entry>
Aug 01 21:48:29 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:48:29 user nova-compute[72586]:     </system>
Aug 01 21:48:29 user nova-compute[72586]:   </sysinfo>
Aug 01 21:48:29 user nova-compute[72586]:   <os>
Aug 01 21:48:29 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:48:29 user nova-compute[72586]:     <boot dev="hd"/>
Aug 01 21:48:29 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:48:29 user nova-compute[72586]:   </os>
Aug 01 21:48:29 user nova-compute[72586]:   <features>
Aug 01 21:48:29 user nova-compute[72586]:     <acpi/>
Aug 01 21:48:29 user nova-compute[72586]:     <apic/>
Aug 01 21:48:29 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:48:29 user nova-compute[72586]:   </features>
Aug 01 21:48:29 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:48:29 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:48:29 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:48:29 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:48:29 user nova-compute[72586]:   </clock>
Aug 01 21:48:29 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:48:29 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:48:29 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:48:29 user nova-compute[72586]:   </cpu>
Aug 01 21:48:29 user nova-compute[72586]:   <devices>
Aug 01 21:48:29 user nova-compute[72586]:     <disk type="block" device="disk">
Aug 01 21:48:29 user nova-compute[72586]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:48:29 user nova-compute[72586]:       <source dev="/dev/sdc"/>
Aug 01 21:48:29 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:48:29 user nova-compute[72586]:       <serial>902655e6-2982-46c0-a124-0255707cd178</serial>
Aug 01 21:48:29 user nova-compute[72586]:     </disk>
Aug 01 21:48:29 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:48:29 user nova-compute[72586]:       <mac address="fa:16:3e:1e:da:69"/>
Aug 01 21:48:29 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:48:29 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:48:29 user nova-compute[72586]:       <target dev="tap6486639b-ff"/>
Aug 01 21:48:29 user nova-compute[72586]:     </interface>
Aug 01 21:48:29 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:48:29 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/71d8bdf9-f90d-4335-9f60-dbdc4380b1d7/console.log" append="off"/>
Aug 01 21:48:29 user nova-compute[72586]:     </serial>
Aug 01 21:48:29 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:48:29 user nova-compute[72586]:     <video>
Aug 01 21:48:29 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:48:29 user nova-compute[72586]:     </video>
Aug 01 21:48:29 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:48:29 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:48:29 user nova-compute[72586]:     </rng>
Aug 01 21:48:29 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:48:29 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:48:29 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:48:29 user nova-compute[72586]:     </memballoon>
Aug 01 21:48:29 user nova-compute[72586]:   </devices>
Aug 01 21:48:29 user nova-compute[72586]: </domain>
Aug 01 21:48:29 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:48:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:48:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1733853456',display_name='tempest-TestVolumeBootPattern-server-1733853456',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1733853456',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHNJjSduTMasTSgviwHre/FYLh+Mp4kuIJ4iuAJ7FsI2FanPe3E7nT7btn/7CziUSz0I1qByH5+ECZVnIY2RecZsBlCuwfU8kwCbqZrJSP50B9MRG5Gjmo9qdN10n6adqA==',key_name='tempest-TestVolumeBootPattern-705389702',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a631250d39c34afca47a1fa2817e627e',ramdisk_id='',reservation_id='r-x7zwq0hz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1160754716',owner_user_name='tempest-TestVolumeBootPattern-1160754716-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:48:20Z,user_data=None,user_id='76cd0d9d973b410ca4ff08fc7630fbc6',uuid=71d8bdf9-f90d-4335-9f60-dbdc4380b1d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6486639b-ff35-44da-9139-dd485a1e6eb7", "address": "fa:16:3e:1e:da:69", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6486639b-ff", "ovs_interfaceid": "6486639b-ff35-44da-9139-dd485a1e6eb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:48:29 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Converting VIF {"id": "6486639b-ff35-44da-9139-dd485a1e6eb7", "address": "fa:16:3e:1e:da:69", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6486639b-ff", "ovs_interfaceid": "6486639b-ff35-44da-9139-dd485a1e6eb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:48:29 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:da:69,bridge_name='br-int',has_traffic_filtering=True,id=6486639b-ff35-44da-9139-dd485a1e6eb7,network=Network(2fbf5ffb-0ec0-403b-bc92-259563ab1d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6486639b-ff') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:48:29 user nova-compute[72586]: DEBUG os_vif [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:da:69,bridge_name='br-int',has_traffic_filtering=True,id=6486639b-ff35-44da-9139-dd485a1e6eb7,network=Network(2fbf5ffb-0ec0-403b-bc92-259563ab1d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6486639b-ff') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:48:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:48:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:48:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:48:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:48:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6486639b-ff, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:48:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6486639b-ff, col_values=(('external_ids', {'iface-id': '6486639b-ff35-44da-9139-dd485a1e6eb7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:da:69', 'vm-uuid': '71d8bdf9-f90d-4335-9f60-dbdc4380b1d7'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:48:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:48:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:48:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:48:29 user nova-compute[72586]: INFO os_vif [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:da:69,bridge_name='br-int',has_traffic_filtering=True,id=6486639b-ff35-44da-9139-dd485a1e6eb7,network=Network(2fbf5ffb-0ec0-403b-bc92-259563ab1d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6486639b-ff')
Aug 01 21:48:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:48:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] No VIF found with MAC fa:16:3e:1e:da:69, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:48:30 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:48:30 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:48:31 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:48:31 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:48:31 user nova-compute[72586]: DEBUG nova.compute.manager [req-7dc8744c-21f1-4067-abac-5da795725e6d req-9c63d8d1-74cd-47d8-b7fc-360903b9f8ea service nova] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Received event network-vif-plugged-6486639b-ff35-44da-9139-dd485a1e6eb7 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:48:31 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-7dc8744c-21f1-4067-abac-5da795725e6d req-9c63d8d1-74cd-47d8-b7fc-360903b9f8ea service nova] Acquiring lock "71d8bdf9-f90d-4335-9f60-dbdc4380b1d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:48:31 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-7dc8744c-21f1-4067-abac-5da795725e6d req-9c63d8d1-74cd-47d8-b7fc-360903b9f8ea service nova] Lock "71d8bdf9-f90d-4335-9f60-dbdc4380b1d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:48:31 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-7dc8744c-21f1-4067-abac-5da795725e6d req-9c63d8d1-74cd-47d8-b7fc-360903b9f8ea service nova] Lock "71d8bdf9-f90d-4335-9f60-dbdc4380b1d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:48:31 user nova-compute[72586]: DEBUG nova.compute.manager [req-7dc8744c-21f1-4067-abac-5da795725e6d req-9c63d8d1-74cd-47d8-b7fc-360903b9f8ea service nova] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] No waiting events found dispatching network-vif-plugged-6486639b-ff35-44da-9139-dd485a1e6eb7 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:48:31 user nova-compute[72586]: WARNING nova.compute.manager [req-7dc8744c-21f1-4067-abac-5da795725e6d req-9c63d8d1-74cd-47d8-b7fc-360903b9f8ea service nova] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Received unexpected event network-vif-plugged-6486639b-ff35-44da-9139-dd485a1e6eb7 for instance with vm_state building and task_state spawning.
Aug 01 21:48:31 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:48:31 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:48:31 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:48:33 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690926513.0820024, 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7 => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:48:33 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] VM Resumed (Lifecycle Event)
Aug 01 21:48:33 user nova-compute[72586]: DEBUG nova.compute.manager [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Instance event wait completed in 0 seconds for  {{(pid=72586) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 21:48:33 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Guest created on hypervisor {{(pid=72586) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 21:48:33 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Instance spawned successfully.
Aug 01 21:48:33 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 21:48:33 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:48:33 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:48:33 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Found default for hw_cdrom_bus of ide {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:48:33 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Found default for hw_disk_bus of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:48:33 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Found default for hw_input_bus of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:48:33 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Found default for hw_pointer_model of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:48:33 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Found default for hw_video_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:48:33 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Found default for hw_vif_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:48:33 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:48:33 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690926513.0843458, 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7 => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:48:33 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] VM Started (Lifecycle Event)
Aug 01 21:48:33 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:48:33 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:48:33 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:48:33 user nova-compute[72586]: INFO nova.compute.manager [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Took 5.00 seconds to spawn the instance on the hypervisor.
Aug 01 21:48:33 user nova-compute[72586]: DEBUG nova.compute.manager [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:48:33 user nova-compute[72586]: DEBUG nova.compute.manager [req-7fab09ca-fdeb-41be-9583-7eac08a85a20 req-52a6212b-a9af-4f37-9f53-d383454352af service nova] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Received event network-vif-plugged-6486639b-ff35-44da-9139-dd485a1e6eb7 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:48:33 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-7fab09ca-fdeb-41be-9583-7eac08a85a20 req-52a6212b-a9af-4f37-9f53-d383454352af service nova] Acquiring lock "71d8bdf9-f90d-4335-9f60-dbdc4380b1d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:48:33 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-7fab09ca-fdeb-41be-9583-7eac08a85a20 req-52a6212b-a9af-4f37-9f53-d383454352af service nova] Lock "71d8bdf9-f90d-4335-9f60-dbdc4380b1d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:48:33 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-7fab09ca-fdeb-41be-9583-7eac08a85a20 req-52a6212b-a9af-4f37-9f53-d383454352af service nova] Lock "71d8bdf9-f90d-4335-9f60-dbdc4380b1d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:48:33 user nova-compute[72586]: DEBUG nova.compute.manager [req-7fab09ca-fdeb-41be-9583-7eac08a85a20 req-52a6212b-a9af-4f37-9f53-d383454352af service nova] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] No waiting events found dispatching network-vif-plugged-6486639b-ff35-44da-9139-dd485a1e6eb7 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:48:33 user nova-compute[72586]: WARNING nova.compute.manager [req-7fab09ca-fdeb-41be-9583-7eac08a85a20 req-52a6212b-a9af-4f37-9f53-d383454352af service nova] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Received unexpected event network-vif-plugged-6486639b-ff35-44da-9139-dd485a1e6eb7 for instance with vm_state building and task_state spawning.
Aug 01 21:48:33 user nova-compute[72586]: INFO nova.compute.manager [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Took 13.39 seconds to build instance.
Aug 01 21:48:33 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-49137209-6372-4970-856b-55f4156fc766 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "71d8bdf9-f90d-4335-9f60-dbdc4380b1d7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.497s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:48:34 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:48:35 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:48:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:48:38 user nova-compute[72586]: DEBUG nova.compute.manager [req-363a8381-323c-4b6b-9e3b-cb593e8049ab req-2537c2bf-8a04-4268-bf97-47266b915b9c service nova] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Received event network-changed-3acb8318-c6b2-4b99-b441-62488967760d {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:48:38 user nova-compute[72586]: DEBUG nova.compute.manager [req-363a8381-323c-4b6b-9e3b-cb593e8049ab req-2537c2bf-8a04-4268-bf97-47266b915b9c service nova] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Refreshing instance network info cache due to event network-changed-3acb8318-c6b2-4b99-b441-62488967760d. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:48:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-363a8381-323c-4b6b-9e3b-cb593e8049ab req-2537c2bf-8a04-4268-bf97-47266b915b9c service nova] Acquiring lock "refresh_cache-d0fa04b2-75e5-4542-9600-7a1517884041" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:48:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-363a8381-323c-4b6b-9e3b-cb593e8049ab req-2537c2bf-8a04-4268-bf97-47266b915b9c service nova] Acquired lock "refresh_cache-d0fa04b2-75e5-4542-9600-7a1517884041" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:48:38 user nova-compute[72586]: DEBUG nova.network.neutron [req-363a8381-323c-4b6b-9e3b-cb593e8049ab req-2537c2bf-8a04-4268-bf97-47266b915b9c service nova] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Refreshing network info cache for port 3acb8318-c6b2-4b99-b441-62488967760d {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:48:38 user nova-compute[72586]: DEBUG nova.network.neutron [req-363a8381-323c-4b6b-9e3b-cb593e8049ab req-2537c2bf-8a04-4268-bf97-47266b915b9c service nova] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Updated VIF entry in instance network info cache for port 3acb8318-c6b2-4b99-b441-62488967760d. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:48:38 user nova-compute[72586]: DEBUG nova.network.neutron [req-363a8381-323c-4b6b-9e3b-cb593e8049ab req-2537c2bf-8a04-4268-bf97-47266b915b9c service nova] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Updating instance_info_cache with network_info: [{"id": "3acb8318-c6b2-4b99-b441-62488967760d", "address": "fa:16:3e:c4:14:cf", "network": {"id": "e072f7ac-9dd8-4e5c-9de2-5d6ef08c261b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1788451595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d633939ea5ac494c8668f0e5acaba7f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3acb8318-c6", "ovs_interfaceid": "3acb8318-c6b2-4b99-b441-62488967760d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:48:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-363a8381-323c-4b6b-9e3b-cb593e8049ab req-2537c2bf-8a04-4268-bf97-47266b915b9c service nova] Releasing lock "refresh_cache-d0fa04b2-75e5-4542-9600-7a1517884041" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:48:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f5097e44-9d98-49eb-91a5-216e8f33c82a tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Acquiring lock "d0fa04b2-75e5-4542-9600-7a1517884041" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:48:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f5097e44-9d98-49eb-91a5-216e8f33c82a tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Lock "d0fa04b2-75e5-4542-9600-7a1517884041" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:48:38 user nova-compute[72586]: INFO nova.compute.manager [None req-f5097e44-9d98-49eb-91a5-216e8f33c82a tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Shelve offloading
Aug 01 21:48:38 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:48:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:48:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:48:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:48:39 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Instance destroyed successfully.
Aug 01 21:48:39 user nova-compute[72586]: DEBUG nova.compute.manager [None req-f5097e44-9d98-49eb-91a5-216e8f33c82a tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:48:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f5097e44-9d98-49eb-91a5-216e8f33c82a tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Acquiring lock "refresh_cache-d0fa04b2-75e5-4542-9600-7a1517884041" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:48:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f5097e44-9d98-49eb-91a5-216e8f33c82a tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Acquired lock "refresh_cache-d0fa04b2-75e5-4542-9600-7a1517884041" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:48:39 user nova-compute[72586]: DEBUG nova.network.neutron [None req-f5097e44-9d98-49eb-91a5-216e8f33c82a tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:48:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:48:40 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:48:40 user nova-compute[72586]: DEBUG nova.network.neutron [None req-f5097e44-9d98-49eb-91a5-216e8f33c82a tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Updating instance_info_cache with network_info: [{"id": "3acb8318-c6b2-4b99-b441-62488967760d", "address": "fa:16:3e:c4:14:cf", "network": {"id": "e072f7ac-9dd8-4e5c-9de2-5d6ef08c261b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1788451595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d633939ea5ac494c8668f0e5acaba7f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3acb8318-c6", "ovs_interfaceid": "3acb8318-c6b2-4b99-b441-62488967760d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:48:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f5097e44-9d98-49eb-91a5-216e8f33c82a tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Releasing lock "refresh_cache-d0fa04b2-75e5-4542-9600-7a1517884041" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:48:40 user nova-compute[72586]: DEBUG nova.compute.manager [req-8ab088de-bf10-4acd-aff3-2b2714843cdc req-efb7d7e4-d540-400d-a28d-543885fef3b5 service nova] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Received event network-vif-unplugged-3acb8318-c6b2-4b99-b441-62488967760d {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:48:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-8ab088de-bf10-4acd-aff3-2b2714843cdc req-efb7d7e4-d540-400d-a28d-543885fef3b5 service nova] Acquiring lock "d0fa04b2-75e5-4542-9600-7a1517884041-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:48:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-8ab088de-bf10-4acd-aff3-2b2714843cdc req-efb7d7e4-d540-400d-a28d-543885fef3b5 service nova] Lock "d0fa04b2-75e5-4542-9600-7a1517884041-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:48:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-8ab088de-bf10-4acd-aff3-2b2714843cdc req-efb7d7e4-d540-400d-a28d-543885fef3b5 service nova] Lock "d0fa04b2-75e5-4542-9600-7a1517884041-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:48:40 user nova-compute[72586]: DEBUG nova.compute.manager [req-8ab088de-bf10-4acd-aff3-2b2714843cdc req-efb7d7e4-d540-400d-a28d-543885fef3b5 service nova] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] No waiting events found dispatching network-vif-unplugged-3acb8318-c6b2-4b99-b441-62488967760d {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:48:40 user nova-compute[72586]: WARNING nova.compute.manager [req-8ab088de-bf10-4acd-aff3-2b2714843cdc req-efb7d7e4-d540-400d-a28d-543885fef3b5 service nova] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Received unexpected event network-vif-unplugged-3acb8318-c6b2-4b99-b441-62488967760d for instance with vm_state active and task_state shelving.
Aug 01 21:48:40 user nova-compute[72586]: DEBUG nova.compute.manager [req-8ab088de-bf10-4acd-aff3-2b2714843cdc req-efb7d7e4-d540-400d-a28d-543885fef3b5 service nova] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Received event network-vif-plugged-3acb8318-c6b2-4b99-b441-62488967760d {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:48:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-8ab088de-bf10-4acd-aff3-2b2714843cdc req-efb7d7e4-d540-400d-a28d-543885fef3b5 service nova] Acquiring lock "d0fa04b2-75e5-4542-9600-7a1517884041-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:48:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-8ab088de-bf10-4acd-aff3-2b2714843cdc req-efb7d7e4-d540-400d-a28d-543885fef3b5 service nova] Lock "d0fa04b2-75e5-4542-9600-7a1517884041-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:48:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-8ab088de-bf10-4acd-aff3-2b2714843cdc req-efb7d7e4-d540-400d-a28d-543885fef3b5 service nova] Lock "d0fa04b2-75e5-4542-9600-7a1517884041-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:48:40 user nova-compute[72586]: DEBUG nova.compute.manager [req-8ab088de-bf10-4acd-aff3-2b2714843cdc req-efb7d7e4-d540-400d-a28d-543885fef3b5 service nova] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] No waiting events found dispatching network-vif-plugged-3acb8318-c6b2-4b99-b441-62488967760d {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:48:40 user nova-compute[72586]: WARNING nova.compute.manager [req-8ab088de-bf10-4acd-aff3-2b2714843cdc req-efb7d7e4-d540-400d-a28d-543885fef3b5 service nova] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Received unexpected event network-vif-plugged-3acb8318-c6b2-4b99-b441-62488967760d for instance with vm_state active and task_state shelving.
Aug 01 21:48:40 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Instance destroyed successfully.
Aug 01 21:48:40 user nova-compute[72586]: DEBUG nova.objects.instance [None req-f5097e44-9d98-49eb-91a5-216e8f33c82a tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Lazy-loading 'resources' on Instance uuid d0fa04b2-75e5-4542-9600-7a1517884041 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:48:40 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-f5097e44-9d98-49eb-91a5-216e8f33c82a tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:46:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1377950842',display_name='tempest-TestShelveInstance-server-1377950842',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1377950842',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB4GX0o8jqyM0mvDzTq47xn7L41FYkxZaqxMMdhfIoyuA1AuqUIPQwXdQlKJh3CoshNHRfVXo+AB0NJD8DSA6Oz1QmbjVr9ojuL7LK7H9A2TUm7EdlrJztLuFeIP+5Kp8Q==',key_name='tempest-TestShelveInstance-70441469',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:46:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d633939ea5ac494c8668f0e5acaba7f1',ramdisk_id='',reservation_id='r-nmpthpez',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1887634001',owner_user_name='tempest-TestShelveInstance-1887634001-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:47:00Z,user_data=None,user_id='d0e99da03c7045b0bc1213eded097dfe',uuid=d0fa04b2-75e5-4542-9600-7a1517884041,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3acb8318-c6b2-4b99-b441-62488967760d", "address": "fa:16:3e:c4:14:cf", "network": {"id": "e072f7ac-9dd8-4e5c-9de2-5d6ef08c261b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1788451595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d633939ea5ac494c8668f0e5acaba7f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3acb8318-c6", "ovs_interfaceid": "3acb8318-c6b2-4b99-b441-62488967760d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:48:40 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-f5097e44-9d98-49eb-91a5-216e8f33c82a tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Converting VIF {"id": "3acb8318-c6b2-4b99-b441-62488967760d", "address": "fa:16:3e:c4:14:cf", "network": {"id": "e072f7ac-9dd8-4e5c-9de2-5d6ef08c261b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1788451595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d633939ea5ac494c8668f0e5acaba7f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3acb8318-c6", "ovs_interfaceid": "3acb8318-c6b2-4b99-b441-62488967760d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:48:40 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-f5097e44-9d98-49eb-91a5-216e8f33c82a tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:14:cf,bridge_name='br-int',has_traffic_filtering=True,id=3acb8318-c6b2-4b99-b441-62488967760d,network=Network(e072f7ac-9dd8-4e5c-9de2-5d6ef08c261b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3acb8318-c6') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:48:40 user nova-compute[72586]: DEBUG os_vif [None req-f5097e44-9d98-49eb-91a5-216e8f33c82a tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:14:cf,bridge_name='br-int',has_traffic_filtering=True,id=3acb8318-c6b2-4b99-b441-62488967760d,network=Network(e072f7ac-9dd8-4e5c-9de2-5d6ef08c261b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3acb8318-c6') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:48:40 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:48:40 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3acb8318-c6, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:48:40 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:48:40 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:48:40 user nova-compute[72586]: DEBUG nova.compute.manager [req-92a80fc4-2034-450a-bde8-163d4c0ec043 req-4166a329-1641-4d17-8a12-737d7398386c service nova] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Received event network-changed-3acb8318-c6b2-4b99-b441-62488967760d {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:48:40 user nova-compute[72586]: DEBUG nova.compute.manager [req-92a80fc4-2034-450a-bde8-163d4c0ec043 req-4166a329-1641-4d17-8a12-737d7398386c service nova] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Refreshing instance network info cache due to event network-changed-3acb8318-c6b2-4b99-b441-62488967760d. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:48:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-92a80fc4-2034-450a-bde8-163d4c0ec043 req-4166a329-1641-4d17-8a12-737d7398386c service nova] Acquiring lock "refresh_cache-d0fa04b2-75e5-4542-9600-7a1517884041" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:48:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-92a80fc4-2034-450a-bde8-163d4c0ec043 req-4166a329-1641-4d17-8a12-737d7398386c service nova] Acquired lock "refresh_cache-d0fa04b2-75e5-4542-9600-7a1517884041" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:48:40 user nova-compute[72586]: DEBUG nova.network.neutron [req-92a80fc4-2034-450a-bde8-163d4c0ec043 req-4166a329-1641-4d17-8a12-737d7398386c service nova] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Refreshing network info cache for port 3acb8318-c6b2-4b99-b441-62488967760d {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:48:40 user nova-compute[72586]: INFO os_vif [None req-f5097e44-9d98-49eb-91a5-216e8f33c82a tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:14:cf,bridge_name='br-int',has_traffic_filtering=True,id=3acb8318-c6b2-4b99-b441-62488967760d,network=Network(e072f7ac-9dd8-4e5c-9de2-5d6ef08c261b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3acb8318-c6')
Aug 01 21:48:40 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5097e44-9d98-49eb-91a5-216e8f33c82a tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] calling os-brick to detach iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 21:48:40 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5097e44-9d98-49eb-91a5-216e8f33c82a tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, {'target_iqns': ['iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CBSbrpog', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:48:40 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-f5097e44-9d98-49eb-91a5-216e8f33c82a tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:48:40 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-f5097e44-9d98-49eb-91a5-216e8f33c82a tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:48:40 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-f5097e44-9d98-49eb-91a5-216e8f33c82a tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:48:40 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5097e44-9d98-49eb-91a5-216e8f33c82a tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6', 0)] {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 21:48:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:48:40 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:48:40 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:48:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:48:40 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae9605a-d98a-491a-897c-a1d983f8ae99]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:48:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:48:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:48:40 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76f7a45-a612-49c6-8a56-88e7c0cad71a]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:48:40 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5097e44-9d98-49eb-91a5-216e8f33c82a tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 (non-flash)
Aug 01 21:48:40 user nova-compute[72586]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 (non-flash)
Aug 01 21:48:40 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:48:40 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5097e44-9d98-49eb-91a5-216e8f33c82a tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 (non-flash)
Aug 01 21:48:40 user nova-compute[72586]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 (non-flash)
Aug 01 21:48:40 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:48:40 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5097e44-9d98-49eb-91a5-216e8f33c82a tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ed02ce7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6'): ({'sdb'}, set())}) {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 21:48:40 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-f5097e44-9d98-49eb-91a5-216e8f33c82a tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Removing single pathed devices sdb {{(pid=72586) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 21:48:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:48:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:48:40 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[07bb8020-50a2-4567-8a60-799558567829]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:48:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:48:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:48:40 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a51512-703e-41fe-a1de-bde0ed70199c]: (4, ('ok\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:48:40 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-f5097e44-9d98-49eb-91a5-216e8f33c82a tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Flushing IO for device /dev/sdb {{(pid=72586) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 21:48:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:48:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:48:41 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e3d64e-885c-4a72-83f7-5af6ce2e907b]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:48:41 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-f5097e44-9d98-49eb-91a5-216e8f33c82a tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72586) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 21:48:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:48:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:48:41 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61eab17-765c-4e22-9219-0aa8e72ec84b]: (4, ('1', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:48:41 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-f5097e44-9d98-49eb-91a5-216e8f33c82a tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 21:48:41 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-f5097e44-9d98-49eb-91a5-216e8f33c82a tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] SCSI volumes sdb have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 21:48:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5097e44-9d98-49eb-91a5-216e8f33c82a tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6')] {{(pid=72586) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 21:48:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:48:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:48:41 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae8bbbc-bddb-4073-9be5-e9a7ece9a21c]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:48:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5097e44-9d98-49eb-91a5-216e8f33c82a tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:48:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 -p 172.16.0.220:3260 --logout {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:48:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:48:41 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[112dfef5-6dbd-4288-a79e-a6b65d81b802]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:48:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5097e44-9d98-49eb-91a5-216e8f33c82a tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6, portal: 172.16.0.220,3260]
Aug 01 21:48:41 user nova-compute[72586]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6, portal: 172.16.0.220,3260] successful.
Aug 01 21:48:41 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:48:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 -p 172.16.0.220:3260 --op delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:48:41 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:48:41 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[11515ece-6a0f-48a2-9139-974b9938bcf7]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:48:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5097e44-9d98-49eb-91a5-216e8f33c82a tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:48:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-f5097e44-9d98-49eb-91a5-216e8f33c82a tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:48:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5097e44-9d98-49eb-91a5-216e8f33c82a tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] <== disconnect_volume: return (299ms) None {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:48:41 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5097e44-9d98-49eb-91a5-216e8f33c82a tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Disconnected iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 21:48:41 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-f5097e44-9d98-49eb-91a5-216e8f33c82a tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Deleting instance files /opt/stack/data/nova/instances/d0fa04b2-75e5-4542-9600-7a1517884041_del
Aug 01 21:48:41 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-f5097e44-9d98-49eb-91a5-216e8f33c82a tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Deletion of /opt/stack/data/nova/instances/d0fa04b2-75e5-4542-9600-7a1517884041_del complete
Aug 01 21:48:41 user nova-compute[72586]: DEBUG nova.network.neutron [req-92a80fc4-2034-450a-bde8-163d4c0ec043 req-4166a329-1641-4d17-8a12-737d7398386c service nova] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Updated VIF entry in instance network info cache for port 3acb8318-c6b2-4b99-b441-62488967760d. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:48:41 user nova-compute[72586]: DEBUG nova.network.neutron [req-92a80fc4-2034-450a-bde8-163d4c0ec043 req-4166a329-1641-4d17-8a12-737d7398386c service nova] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Updating instance_info_cache with network_info: [{"id": "3acb8318-c6b2-4b99-b441-62488967760d", "address": "fa:16:3e:c4:14:cf", "network": {"id": "e072f7ac-9dd8-4e5c-9de2-5d6ef08c261b", "bridge": null, "label": "tempest-TestShelveInstance-1788451595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d633939ea5ac494c8668f0e5acaba7f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap3acb8318-c6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:48:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-92a80fc4-2034-450a-bde8-163d4c0ec043 req-4166a329-1641-4d17-8a12-737d7398386c service nova] Releasing lock "refresh_cache-d0fa04b2-75e5-4542-9600-7a1517884041" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:48:41 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:48:41 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:48:42 user nova-compute[72586]: INFO nova.scheduler.client.report [None req-f5097e44-9d98-49eb-91a5-216e8f33c82a tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Deleted allocations for instance d0fa04b2-75e5-4542-9600-7a1517884041
Aug 01 21:48:42 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f5097e44-9d98-49eb-91a5-216e8f33c82a tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:48:42 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f5097e44-9d98-49eb-91a5-216e8f33c82a tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:48:42 user nova-compute[72586]: DEBUG nova.objects.instance [None req-f5097e44-9d98-49eb-91a5-216e8f33c82a tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Lazy-loading 'numa_topology' on Instance uuid d0fa04b2-75e5-4542-9600-7a1517884041 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:48:42 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-f5097e44-9d98-49eb-91a5-216e8f33c82a tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:48:42 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-f5097e44-9d98-49eb-91a5-216e8f33c82a tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:48:42 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f5097e44-9d98-49eb-91a5-216e8f33c82a tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.151s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:48:42 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f5097e44-9d98-49eb-91a5-216e8f33c82a tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Lock "d0fa04b2-75e5-4542-9600-7a1517884041" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.547s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:48:42 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:48:42 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72586) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 21:48:45 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:48:45 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:48:45 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:48:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:48:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:48:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:48:45 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Auditing locally available compute resources for user (node: user) {{(pid=72586) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 21:48:46 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae37bb9-cf4e-46e1-b5e5-81930cdfa824/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:48:46 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae37bb9-cf4e-46e1-b5e5-81930cdfa824/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:48:46 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae37bb9-cf4e-46e1-b5e5-81930cdfa824/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:48:46 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae37bb9-cf4e-46e1-b5e5-81930cdfa824/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:48:46 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:48:46 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:48:46 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:48:46 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Hypervisor/Node resource view: name=user free_ram=8456MB free_disk=25.296131134033203GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72586) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 21:48:46 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:48:46 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:48:46 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:48:46 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:48:46 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 21:48:46 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 21:48:46 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:48:46 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:48:46 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Compute_service record updated for user:user {{(pid=72586) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 21:48:46 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.211s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:48:48 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:48:48 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Starting heal instance info cache {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 21:48:48 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Rebuilding the list of instances to heal {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 21:48:48 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "refresh_cache-8ae37bb9-cf4e-46e1-b5e5-81930cdfa824" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:48:48 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquired lock "refresh_cache-8ae37bb9-cf4e-46e1-b5e5-81930cdfa824" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:48:48 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Forcefully refreshing network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 21:48:48 user nova-compute[72586]: DEBUG nova.objects.instance [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lazy-loading 'info_cache' on Instance uuid 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:48:49 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Updating instance_info_cache with network_info: [{"id": "daadbb57-a9b9-4cef-bded-1ac2305b55de", "address": "fa:16:3e:37:de:60", "network": {"id": "52ee6623-01e5-491e-ab5e-d1d0511bd15f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-765176125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063dd272226340d49a7ac0756413cadf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaadbb57-a9", "ovs_interfaceid": "daadbb57-a9b9-4cef-bded-1ac2305b55de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:48:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Releasing lock "refresh_cache-8ae37bb9-cf4e-46e1-b5e5-81930cdfa824" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:48:49 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Updated the network info_cache for instance {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 21:48:49 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:48:50 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:48:50 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:48:50 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:48:54 user nova-compute[72586]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690926519.6383433, d0fa04b2-75e5-4542-9600-7a1517884041 => Stopped> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:48:54 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] VM Stopped (Lifecycle Event)
Aug 01 21:48:54 user nova-compute[72586]: DEBUG nova.compute.manager [None req-840a7582-b1f4-4f23-8193-97e466e7a5e4 None None] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:48:55 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:48:55 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:49:00 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:49:00 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:49:05 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:49:05 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:49:10 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:49:10 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:49:15 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:49:20 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:49:20 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:49:20 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72586) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 21:49:20 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72586) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 21:49:20 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72586) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 21:49:20 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:49:25 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:49:25 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:49:25 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72586) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 21:49:25 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72586) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 21:49:25 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72586) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 21:49:25 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:49:30 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:49:35 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:49:40 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:49:40 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:49:40 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72586) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 21:49:40 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72586) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 21:49:40 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72586) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 21:49:40 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:49:41 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:49:41 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:49:41 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:49:42 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:49:43 user nova-compute[72586]: DEBUG nova.compute.manager [req-4b461e02-4c9c-47de-a0fb-d163cbb89c2f req-75b12ac8-6ee3-4cba-a609-a31e48d23b42 service nova] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Received event network-changed-daadbb57-a9b9-4cef-bded-1ac2305b55de {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:49:43 user nova-compute[72586]: DEBUG nova.compute.manager [req-4b461e02-4c9c-47de-a0fb-d163cbb89c2f req-75b12ac8-6ee3-4cba-a609-a31e48d23b42 service nova] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Refreshing instance network info cache due to event network-changed-daadbb57-a9b9-4cef-bded-1ac2305b55de. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:49:43 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-4b461e02-4c9c-47de-a0fb-d163cbb89c2f req-75b12ac8-6ee3-4cba-a609-a31e48d23b42 service nova] Acquiring lock "refresh_cache-8ae37bb9-cf4e-46e1-b5e5-81930cdfa824" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:49:43 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-4b461e02-4c9c-47de-a0fb-d163cbb89c2f req-75b12ac8-6ee3-4cba-a609-a31e48d23b42 service nova] Acquired lock "refresh_cache-8ae37bb9-cf4e-46e1-b5e5-81930cdfa824" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:49:43 user nova-compute[72586]: DEBUG nova.network.neutron [req-4b461e02-4c9c-47de-a0fb-d163cbb89c2f req-75b12ac8-6ee3-4cba-a609-a31e48d23b42 service nova] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Refreshing network info cache for port daadbb57-a9b9-4cef-bded-1ac2305b55de {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:49:43 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:49:43 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72586) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 21:49:44 user nova-compute[72586]: DEBUG nova.network.neutron [req-4b461e02-4c9c-47de-a0fb-d163cbb89c2f req-75b12ac8-6ee3-4cba-a609-a31e48d23b42 service nova] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Updated VIF entry in instance network info cache for port daadbb57-a9b9-4cef-bded-1ac2305b55de. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:49:44 user nova-compute[72586]: DEBUG nova.network.neutron [req-4b461e02-4c9c-47de-a0fb-d163cbb89c2f req-75b12ac8-6ee3-4cba-a609-a31e48d23b42 service nova] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Updating instance_info_cache with network_info: [{"id": "daadbb57-a9b9-4cef-bded-1ac2305b55de", "address": "fa:16:3e:37:de:60", "network": {"id": "52ee6623-01e5-491e-ab5e-d1d0511bd15f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-765176125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063dd272226340d49a7ac0756413cadf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaadbb57-a9", "ovs_interfaceid": "daadbb57-a9b9-4cef-bded-1ac2305b55de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:49:44 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-4b461e02-4c9c-47de-a0fb-d163cbb89c2f req-75b12ac8-6ee3-4cba-a609-a31e48d23b42 service nova] Releasing lock "refresh_cache-8ae37bb9-cf4e-46e1-b5e5-81930cdfa824" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:49:45 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:49:45 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:49:47 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0fe85d43-4dcb-4cde-b970-5dae623936fe tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Acquiring lock "8ae37bb9-cf4e-46e1-b5e5-81930cdfa824" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:49:47 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0fe85d43-4dcb-4cde-b970-5dae623936fe tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "8ae37bb9-cf4e-46e1-b5e5-81930cdfa824" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:49:47 user nova-compute[72586]: DEBUG nova.objects.instance [None req-0fe85d43-4dcb-4cde-b970-5dae623936fe tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lazy-loading 'flavor' on Instance uuid 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:49:47 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0fe85d43-4dcb-4cde-b970-5dae623936fe tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "8ae37bb9-cf4e-46e1-b5e5-81930cdfa824" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:49:47 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0fe85d43-4dcb-4cde-b970-5dae623936fe tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Acquiring lock "8ae37bb9-cf4e-46e1-b5e5-81930cdfa824" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:49:47 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0fe85d43-4dcb-4cde-b970-5dae623936fe tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "8ae37bb9-cf4e-46e1-b5e5-81930cdfa824" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:49:47 user nova-compute[72586]: INFO nova.compute.manager [None req-0fe85d43-4dcb-4cde-b970-5dae623936fe tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Attaching volume fbf45a4b-e005-42ee-83c8-81e38152df29 to /dev/vdb
Aug 01 21:49:47 user nova-compute[72586]: DEBUG os_brick.utils [None req-0fe85d43-4dcb-4cde-b970-5dae623936fe tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:49:47 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:49:47 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:49:47 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7810d8-56a9-4d31-b294-9755594acb00]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4bc202fb9cb\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:49:47 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:49:47 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:49:47 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[75263c97-f83f-4d48-9194-67fb52d2239a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:49:47 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:49:47 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:49:47 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[2876b77d-090b-43b6-8268-740dfb67dde2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:49:47 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca372fb-3cd6-459a-943a-0f269d5431b2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:49:47 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-0fe85d43-4dcb-4cde-b970-5dae623936fe tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Running cmd (subprocess): nvme version {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:49:47 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-0fe85d43-4dcb-4cde-b970-5dae623936fe tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] 'nvme version' failed. Not Retrying. {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:49:47 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0fe85d43-4dcb-4cde-b970-5dae623936fe tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] nvme not present on system {{(pid=72586) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 21:49:47 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:49:47 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:49:47 user nova-compute[72586]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 21:49:47 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1babd602-216e-42dd-9ecb-42d223cc8d50]: (4, '') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:49:47 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-0fe85d43-4dcb-4cde-b970-5dae623936fe tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72586) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 21:49:47 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-0fe85d43-4dcb-4cde-b970-5dae623936fe tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 21:49:47 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-0fe85d43-4dcb-4cde-b970-5dae623936fe tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] LIGHTOS: no hostnqn found. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 21:49:47 user nova-compute[72586]: DEBUG os_brick.utils [None req-0fe85d43-4dcb-4cde-b970-5dae623936fe tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4bc202fb9cb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:49:47 user nova-compute[72586]: DEBUG nova.virt.block_device [None req-0fe85d43-4dcb-4cde-b970-5dae623936fe tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Updating existing volume attachment record: 33873546-b361-44d5-8fc5-f1c54c268467 {{(pid=72586) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 21:49:47 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:49:47 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:49:47 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:49:47 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:49:47 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Auditing locally available compute resources for user (node: user) {{(pid=72586) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 21:49:48 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae37bb9-cf4e-46e1-b5e5-81930cdfa824/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:49:48 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae37bb9-cf4e-46e1-b5e5-81930cdfa824/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:49:48 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae37bb9-cf4e-46e1-b5e5-81930cdfa824/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:49:48 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae37bb9-cf4e-46e1-b5e5-81930cdfa824/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:49:48 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:49:48 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:49:48 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:49:48 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Hypervisor/Node resource view: name=user free_ram=8579MB free_disk=25.28634262084961GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72586) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 21:49:48 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:49:48 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:49:48 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:49:48 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:49:48 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 21:49:48 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 21:49:49 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:49:49 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:49:49 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Compute_service record updated for user:user {{(pid=72586) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 21:49:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.258s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:49:50 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:49:50 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Starting heal instance info cache {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 21:49:50 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "refresh_cache-71d8bdf9-f90d-4335-9f60-dbdc4380b1d7" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:49:50 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquired lock "refresh_cache-71d8bdf9-f90d-4335-9f60-dbdc4380b1d7" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:49:50 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Forcefully refreshing network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 21:49:50 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:49:50 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Updating instance_info_cache with network_info: [{"id": "6486639b-ff35-44da-9139-dd485a1e6eb7", "address": "fa:16:3e:1e:da:69", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6486639b-ff", "ovs_interfaceid": "6486639b-ff35-44da-9139-dd485a1e6eb7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:49:50 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Releasing lock "refresh_cache-71d8bdf9-f90d-4335-9f60-dbdc4380b1d7" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:49:50 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Updated the network info_cache for instance {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 21:49:50 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:49:50 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:49:50 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:49:54 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fe85d43-4dcb-4cde-b970-5dae623936fe tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Calling os-brick to attach iSCSI Volume {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 21:49:54 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe85d43-4dcb-4cde-b970-5dae623936fe tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VUiQvMJo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:49:54 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-0fe85d43-4dcb-4cde-b970-5dae623936fe tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:49:54 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-0fe85d43-4dcb-4cde-b970-5dae623936fe tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:49:54 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-0fe85d43-4dcb-4cde-b970-5dae623936fe tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:49:54 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-0fe85d43-4dcb-4cde-b970-5dae623936fe tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:49:54 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-0fe85d43-4dcb-4cde-b970-5dae623936fe tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:49:54 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-0fe85d43-4dcb-4cde-b970-5dae623936fe tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:49:54 user nova-compute[72586]: INFO os_brick.initiator.connectors.iscsi [None req-0fe85d43-4dcb-4cde-b970-5dae623936fe tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 21:49:54 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29 -p 172.16.0.220:3260 {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:49:54 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:49:54 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[627e6db9-4d00-499d-9991-599e3f94dca9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:49:54 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe85d43-4dcb-4cde-b970-5dae623936fe tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 21:49:54 user nova-compute[72586]:  {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:49:54 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29 -p 172.16.0.220:3260 --interface default --op new {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:49:54 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:49:54 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[166e7856-543f-4106-b13a-c4be19b75ec1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29] added\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:49:54 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe85d43-4dcb-4cde-b970-5dae623936fe tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29] added
Aug 01 21:49:54 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:49:54 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:49:54 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:49:54 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15d634a-d603-4a60-a00e-55bef70b283d]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:49:54 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe85d43-4dcb-4cde-b970-5dae623936fe tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:49:54 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:49:54 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:49:54 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d95c46-7c7d-40cd-a576-4eab7d87852a]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:49:54 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe85d43-4dcb-4cde-b970-5dae623936fe tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:49:54 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VUiQvMJo {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:49:55 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VUiQvMJo" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:49:55 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87e0085-2520-4ca6-9f21-62282739cc9b]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:49:55 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe85d43-4dcb-4cde-b970-5dae623936fe tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VUiQvMJo'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:49:55 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:49:55 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:49:55 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[461ebd50-72b3-467f-9aaa-4fd290661bae]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:49:55 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe85d43-4dcb-4cde-b970-5dae623936fe tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:49:55 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:49:55 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:49:55 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8fb23d8-9bb2-4b38-b08a-f53a16005f6a]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:49:55 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe85d43-4dcb-4cde-b970-5dae623936fe tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 (non-flash)
Aug 01 21:49:55 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:49:55 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe85d43-4dcb-4cde-b970-5dae623936fe tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 (non-flash)
Aug 01 21:49:55 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:49:55 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29 -p 172.16.0.220:3260 --login {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:49:55 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:49:55 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b4ba7b-2777-472e-bb13-cdbf5d62ef83]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:49:55 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe85d43-4dcb-4cde-b970-5dae623936fe tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29, portal: 172.16.0.220,3260]
Aug 01 21:49:55 user nova-compute[72586]: Login to [iface: default, target: iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29, portal: 172.16.0.220,3260] successful.
Aug 01 21:49:55 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:49:55 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:49:55 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:49:55 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef2d58e-1996-4b4c-b9d1-91dec63a2343]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:49:55 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe85d43-4dcb-4cde-b970-5dae623936fe tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:49:55 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:49:55 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:49:55 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c82fe35-0a18-4830-af1a-757c3ffad91c]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:49:55 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe85d43-4dcb-4cde-b970-5dae623936fe tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 (non-flash)
Aug 01 21:49:55 user nova-compute[72586]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29 (non-flash)
Aug 01 21:49:55 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:49:55 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe85d43-4dcb-4cde-b970-5dae623936fe tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 (non-flash)
Aug 01 21:49:55 user nova-compute[72586]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29 (non-flash)
Aug 01 21:49:55 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:49:55 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-0fe85d43-4dcb-4cde-b970-5dae623936fe tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:49:55 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe85d43-4dcb-4cde-b970-5dae623936fe tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Connected to 172.16.0.220:3260 {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 21:49:55 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-0fe85d43-4dcb-4cde-b970-5dae623936fe tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=72586) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 21:49:55 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-0fe85d43-4dcb-4cde-b970-5dae623936fe tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72586) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 21:49:55 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:49:55 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:49:55 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa564a76-af47-498e-98c8-87bcb4df868c]: (4, ('- - 0', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:49:55 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-0fe85d43-4dcb-4cde-b970-5dae623936fe tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:49:55 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe85d43-4dcb-4cde-b970-5dae623936fe tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VUiQvMJo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 21:49:55 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:49:56 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-0fe85d43-4dcb-4cde-b970-5dae623936fe tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:49:56 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe85d43-4dcb-4cde-b970-5dae623936fe tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '26466366566643966', 'path': '/dev/sdb'} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:49:56 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fe85d43-4dcb-4cde-b970-5dae623936fe tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26466366566643966', 'path': '/dev/sdb'} {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 21:49:56 user nova-compute[72586]: DEBUG nova.objects.instance [None req-0fe85d43-4dcb-4cde-b970-5dae623936fe tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lazy-loading 'flavor' on Instance uuid 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:49:56 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-0fe85d43-4dcb-4cde-b970-5dae623936fe tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 21:49:56 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:49:56 user nova-compute[72586]:   <source dev="/dev/sdb"/>
Aug 01 21:49:56 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:49:56 user nova-compute[72586]:   <serial>fbf45a4b-e005-42ee-83c8-81e38152df29</serial>
Aug 01 21:49:56 user nova-compute[72586]: </disk>
Aug 01 21:49:56 user nova-compute[72586]:  {{(pid=72586) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 21:49:56 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-0fe85d43-4dcb-4cde-b970-5dae623936fe tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:49:56 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-0fe85d43-4dcb-4cde-b970-5dae623936fe tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:49:56 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-0fe85d43-4dcb-4cde-b970-5dae623936fe tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] No VIF found with MAC fa:16:3e:37:de:60, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:49:56 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0fe85d43-4dcb-4cde-b970-5dae623936fe tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "8ae37bb9-cf4e-46e1-b5e5-81930cdfa824" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.280s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:49:57 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:49:58 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:49:59 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Acquiring lock "c93ae122-c523-498c-acbc-d2518e228584" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:49:59 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "c93ae122-c523-498c-acbc-d2518e228584" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:49:59 user nova-compute[72586]: DEBUG nova.compute.manager [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: c93ae122-c523-498c-acbc-d2518e228584] Starting instance... {{(pid=72586) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 21:49:59 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:49:59 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:49:59 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72586) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 21:49:59 user nova-compute[72586]: INFO nova.compute.claims [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: c93ae122-c523-498c-acbc-d2518e228584] Claim successful on node user
Aug 01 21:50:00 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:50:00 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:50:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.267s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:50:00 user nova-compute[72586]: DEBUG nova.compute.manager [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: c93ae122-c523-498c-acbc-d2518e228584] Start building networks asynchronously for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 21:50:00 user nova-compute[72586]: DEBUG nova.compute.manager [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: c93ae122-c523-498c-acbc-d2518e228584] Allocating IP information in the background. {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 21:50:00 user nova-compute[72586]: DEBUG nova.network.neutron [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: c93ae122-c523-498c-acbc-d2518e228584] allocate_for_instance() {{(pid=72586) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 21:50:00 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:50:00 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: c93ae122-c523-498c-acbc-d2518e228584] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 21:50:00 user nova-compute[72586]: DEBUG nova.compute.manager [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: c93ae122-c523-498c-acbc-d2518e228584] Start building block device mappings for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 21:50:00 user nova-compute[72586]: DEBUG nova.policy [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '37663bab7d31400c8399451058bd5936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063dd272226340d49a7ac0756413cadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72586) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 21:50:00 user nova-compute[72586]: DEBUG nova.compute.manager [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: c93ae122-c523-498c-acbc-d2518e228584] Start spawning the instance on the hypervisor. {{(pid=72586) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 21:50:00 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: c93ae122-c523-498c-acbc-d2518e228584] Creating instance directory {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 21:50:00 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: c93ae122-c523-498c-acbc-d2518e228584] Creating image(s)
Aug 01 21:50:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Acquiring lock "/opt/stack/data/nova/instances/c93ae122-c523-498c-acbc-d2518e228584/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:50:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "/opt/stack/data/nova/instances/c93ae122-c523-498c-acbc-d2518e228584/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:50:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "/opt/stack/data/nova/instances/c93ae122-c523-498c-acbc-d2518e228584/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:50:00 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:50:00 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.135s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:50:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Acquiring lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:50:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:50:00 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:50:00 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.137s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:50:00 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/c93ae122-c523-498c-acbc-d2518e228584/disk 1073741824 {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:50:00 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/c93ae122-c523-498c-acbc-d2518e228584/disk 1073741824" returned: 0 in 0.050s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:50:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:50:00 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:50:00 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.139s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:50:00 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c93ae122-c523-498c-acbc-d2518e228584/disk. size=1073741824 {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 21:50:00 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c93ae122-c523-498c-acbc-d2518e228584/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:50:00 user nova-compute[72586]: DEBUG nova.network.neutron [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: c93ae122-c523-498c-acbc-d2518e228584] Successfully created port: 9493a899-e71d-4abd-83fd-1e78b06eab07 {{(pid=72586) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 21:50:00 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:50:00 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c93ae122-c523-498c-acbc-d2518e228584/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:50:00 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Cannot resize image /opt/stack/data/nova/instances/c93ae122-c523-498c-acbc-d2518e228584/disk to a smaller size. {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 21:50:00 user nova-compute[72586]: DEBUG nova.objects.instance [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lazy-loading 'migration_context' on Instance uuid c93ae122-c523-498c-acbc-d2518e228584 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:50:00 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: c93ae122-c523-498c-acbc-d2518e228584] Created local disks {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 21:50:00 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: c93ae122-c523-498c-acbc-d2518e228584] Ensure instance console log exists: /opt/stack/data/nova/instances/c93ae122-c523-498c-acbc-d2518e228584/console.log {{(pid=72586) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 21:50:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:50:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:50:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:50:01 user nova-compute[72586]: DEBUG nova.network.neutron [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: c93ae122-c523-498c-acbc-d2518e228584] Successfully updated port: 9493a899-e71d-4abd-83fd-1e78b06eab07 {{(pid=72586) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 21:50:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Acquiring lock "refresh_cache-c93ae122-c523-498c-acbc-d2518e228584" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:50:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Acquired lock "refresh_cache-c93ae122-c523-498c-acbc-d2518e228584" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:50:01 user nova-compute[72586]: DEBUG nova.network.neutron [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: c93ae122-c523-498c-acbc-d2518e228584] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:50:01 user nova-compute[72586]: DEBUG nova.compute.manager [req-bb887e2d-ac02-447f-89f1-aec344721889 req-e684bd44-f39d-463d-8c04-9436c4da5f57 service nova] [instance: c93ae122-c523-498c-acbc-d2518e228584] Received event network-changed-9493a899-e71d-4abd-83fd-1e78b06eab07 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:50:01 user nova-compute[72586]: DEBUG nova.compute.manager [req-bb887e2d-ac02-447f-89f1-aec344721889 req-e684bd44-f39d-463d-8c04-9436c4da5f57 service nova] [instance: c93ae122-c523-498c-acbc-d2518e228584] Refreshing instance network info cache due to event network-changed-9493a899-e71d-4abd-83fd-1e78b06eab07. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:50:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-bb887e2d-ac02-447f-89f1-aec344721889 req-e684bd44-f39d-463d-8c04-9436c4da5f57 service nova] Acquiring lock "refresh_cache-c93ae122-c523-498c-acbc-d2518e228584" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:50:01 user nova-compute[72586]: DEBUG nova.network.neutron [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: c93ae122-c523-498c-acbc-d2518e228584] Instance cache missing network info. {{(pid=72586) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 21:50:01 user nova-compute[72586]: DEBUG nova.network.neutron [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: c93ae122-c523-498c-acbc-d2518e228584] Updating instance_info_cache with network_info: [{"id": "9493a899-e71d-4abd-83fd-1e78b06eab07", "address": "fa:16:3e:f0:02:db", "network": {"id": "52ee6623-01e5-491e-ab5e-d1d0511bd15f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-765176125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063dd272226340d49a7ac0756413cadf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9493a899-e7", "ovs_interfaceid": "9493a899-e71d-4abd-83fd-1e78b06eab07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:50:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Releasing lock "refresh_cache-c93ae122-c523-498c-acbc-d2518e228584" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:50:01 user nova-compute[72586]: DEBUG nova.compute.manager [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: c93ae122-c523-498c-acbc-d2518e228584] Instance network_info: |[{"id": "9493a899-e71d-4abd-83fd-1e78b06eab07", "address": "fa:16:3e:f0:02:db", "network": {"id": "52ee6623-01e5-491e-ab5e-d1d0511bd15f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-765176125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063dd272226340d49a7ac0756413cadf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9493a899-e7", "ovs_interfaceid": "9493a899-e71d-4abd-83fd-1e78b06eab07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 21:50:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-bb887e2d-ac02-447f-89f1-aec344721889 req-e684bd44-f39d-463d-8c04-9436c4da5f57 service nova] Acquired lock "refresh_cache-c93ae122-c523-498c-acbc-d2518e228584" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:50:01 user nova-compute[72586]: DEBUG nova.network.neutron [req-bb887e2d-ac02-447f-89f1-aec344721889 req-e684bd44-f39d-463d-8c04-9436c4da5f57 service nova] [instance: c93ae122-c523-498c-acbc-d2518e228584] Refreshing network info cache for port 9493a899-e71d-4abd-83fd-1e78b06eab07 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:50:01 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: c93ae122-c523-498c-acbc-d2518e228584] Start _get_guest_xml network_info=[{"id": "9493a899-e71d-4abd-83fd-1e78b06eab07", "address": "fa:16:3e:f0:02:db", "network": {"id": "52ee6623-01e5-491e-ab5e-d1d0511bd15f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-765176125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063dd272226340d49a7ac0756413cadf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9493a899-e7", "ovs_interfaceid": "9493a899-e71d-4abd-83fd-1e78b06eab07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '0243d46b-6819-42a5-926f-42b71f0c97ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:50:01 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:50:01 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:50:01 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:50:01 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:50:01 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:50:01 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:50:01 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:50:01 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:50:01 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:50:01 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:50:01 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:50:01 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:50:01 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:50:01 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:50:01 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:50:01 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:50:01 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:50:01 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:50:02 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:49:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1110837703',display_name='tempest-AttachVolumeNegativeTest-server-1110837703',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1110837703',id=45,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGm+wMgaTAldyl/Zc4cLFO4q13bhy7gytWAOfX0ujhTtX1ybHPHZ2nHoEgiF5hZGRp+91xXy97uqlmftjKkEdM75vM8GhkXRsGx+8vTXsbdXUogmcgyqwB4lp00svm5/tw==',key_name='tempest-keypair-1590125696',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='063dd272226340d49a7ac0756413cadf',ramdisk_id='',reservation_id='r-rt2psqv1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-717043369',owner_user_name='tempest-AttachVolumeNegativeTest-717043369-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:50:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37663bab7d31400c8399451058bd5936',uuid=c93ae122-c523-498c-acbc-d2518e228584,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9493a899-e71d-4abd-83fd-1e78b06eab07", "address": "fa:16:3e:f0:02:db", "network": {"id": "52ee6623-01e5-491e-ab5e-d1d0511bd15f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-765176125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063dd272226340d49a7ac0756413cadf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9493a899-e7", "ovs_interfaceid": "9493a899-e71d-4abd-83fd-1e78b06eab07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:50:02 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Converting VIF {"id": "9493a899-e71d-4abd-83fd-1e78b06eab07", "address": "fa:16:3e:f0:02:db", "network": {"id": "52ee6623-01e5-491e-ab5e-d1d0511bd15f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-765176125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063dd272226340d49a7ac0756413cadf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9493a899-e7", "ovs_interfaceid": "9493a899-e71d-4abd-83fd-1e78b06eab07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:50:02 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:02:db,bridge_name='br-int',has_traffic_filtering=True,id=9493a899-e71d-4abd-83fd-1e78b06eab07,network=Network(52ee6623-01e5-491e-ab5e-d1d0511bd15f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9493a899-e7') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:50:02 user nova-compute[72586]: DEBUG nova.objects.instance [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lazy-loading 'pci_devices' on Instance uuid c93ae122-c523-498c-acbc-d2518e228584 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:50:02 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: c93ae122-c523-498c-acbc-d2518e228584] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:50:02 user nova-compute[72586]:   <uuid>c93ae122-c523-498c-acbc-d2518e228584</uuid>
Aug 01 21:50:02 user nova-compute[72586]:   <name>instance-0000002d</name>
Aug 01 21:50:02 user nova-compute[72586]:   <memory>524288</memory>
Aug 01 21:50:02 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:50:02 user nova-compute[72586]:   <metadata>
Aug 01 21:50:02 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:50:02 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:50:02 user nova-compute[72586]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1110837703</nova:name>
Aug 01 21:50:02 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:50:01</nova:creationTime>
Aug 01 21:50:02 user nova-compute[72586]:       <nova:flavor name="m1.tiny">
Aug 01 21:50:02 user nova-compute[72586]:         <nova:memory>512</nova:memory>
Aug 01 21:50:02 user nova-compute[72586]:         <nova:disk>1</nova:disk>
Aug 01 21:50:02 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:50:02 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:50:02 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:50:02 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:50:02 user nova-compute[72586]:       <nova:owner>
Aug 01 21:50:02 user nova-compute[72586]:         <nova:user uuid="37663bab7d31400c8399451058bd5936">tempest-AttachVolumeNegativeTest-717043369-project-member</nova:user>
Aug 01 21:50:02 user nova-compute[72586]:         <nova:project uuid="063dd272226340d49a7ac0756413cadf">tempest-AttachVolumeNegativeTest-717043369</nova:project>
Aug 01 21:50:02 user nova-compute[72586]:       </nova:owner>
Aug 01 21:50:02 user nova-compute[72586]:       <nova:root type="image" uuid="0243d46b-6819-42a5-926f-42b71f0c97ad"/>
Aug 01 21:50:02 user nova-compute[72586]:       <nova:ports>
Aug 01 21:50:02 user nova-compute[72586]:         <nova:port uuid="9493a899-e71d-4abd-83fd-1e78b06eab07">
Aug 01 21:50:02 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 01 21:50:02 user nova-compute[72586]:         </nova:port>
Aug 01 21:50:02 user nova-compute[72586]:       </nova:ports>
Aug 01 21:50:02 user nova-compute[72586]:     </nova:instance>
Aug 01 21:50:02 user nova-compute[72586]:   </metadata>
Aug 01 21:50:02 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:50:02 user nova-compute[72586]:     <system>
Aug 01 21:50:02 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:50:02 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:50:02 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:50:02 user nova-compute[72586]:       <entry name="serial">c93ae122-c523-498c-acbc-d2518e228584</entry>
Aug 01 21:50:02 user nova-compute[72586]:       <entry name="uuid">c93ae122-c523-498c-acbc-d2518e228584</entry>
Aug 01 21:50:02 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:50:02 user nova-compute[72586]:     </system>
Aug 01 21:50:02 user nova-compute[72586]:   </sysinfo>
Aug 01 21:50:02 user nova-compute[72586]:   <os>
Aug 01 21:50:02 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:50:02 user nova-compute[72586]:     <boot dev="hd"/>
Aug 01 21:50:02 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:50:02 user nova-compute[72586]:   </os>
Aug 01 21:50:02 user nova-compute[72586]:   <features>
Aug 01 21:50:02 user nova-compute[72586]:     <acpi/>
Aug 01 21:50:02 user nova-compute[72586]:     <apic/>
Aug 01 21:50:02 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:50:02 user nova-compute[72586]:   </features>
Aug 01 21:50:02 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:50:02 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:50:02 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:50:02 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:50:02 user nova-compute[72586]:   </clock>
Aug 01 21:50:02 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:50:02 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:50:02 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:50:02 user nova-compute[72586]:   </cpu>
Aug 01 21:50:02 user nova-compute[72586]:   <devices>
Aug 01 21:50:02 user nova-compute[72586]:     <disk type="file" device="disk">
Aug 01 21:50:02 user nova-compute[72586]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 21:50:02 user nova-compute[72586]:       <source file="/opt/stack/data/nova/instances/c93ae122-c523-498c-acbc-d2518e228584/disk"/>
Aug 01 21:50:02 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:50:02 user nova-compute[72586]:     </disk>
Aug 01 21:50:02 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:50:02 user nova-compute[72586]:       <mac address="fa:16:3e:f0:02:db"/>
Aug 01 21:50:02 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:50:02 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:50:02 user nova-compute[72586]:       <target dev="tap9493a899-e7"/>
Aug 01 21:50:02 user nova-compute[72586]:     </interface>
Aug 01 21:50:02 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:50:02 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/c93ae122-c523-498c-acbc-d2518e228584/console.log" append="off"/>
Aug 01 21:50:02 user nova-compute[72586]:     </serial>
Aug 01 21:50:02 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:50:02 user nova-compute[72586]:     <video>
Aug 01 21:50:02 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:50:02 user nova-compute[72586]:     </video>
Aug 01 21:50:02 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:50:02 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:50:02 user nova-compute[72586]:     </rng>
Aug 01 21:50:02 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:50:02 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:50:02 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:50:02 user nova-compute[72586]:     </memballoon>
Aug 01 21:50:02 user nova-compute[72586]:   </devices>
Aug 01 21:50:02 user nova-compute[72586]: </domain>
Aug 01 21:50:02 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:50:02 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:49:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1110837703',display_name='tempest-AttachVolumeNegativeTest-server-1110837703',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1110837703',id=45,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGm+wMgaTAldyl/Zc4cLFO4q13bhy7gytWAOfX0ujhTtX1ybHPHZ2nHoEgiF5hZGRp+91xXy97uqlmftjKkEdM75vM8GhkXRsGx+8vTXsbdXUogmcgyqwB4lp00svm5/tw==',key_name='tempest-keypair-1590125696',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='063dd272226340d49a7ac0756413cadf',ramdisk_id='',reservation_id='r-rt2psqv1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-717043369',owner_user_name='tempest-AttachVolumeNegativeTest-717043369-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:50:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37663bab7d31400c8399451058bd5936',uuid=c93ae122-c523-498c-acbc-d2518e228584,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9493a899-e71d-4abd-83fd-1e78b06eab07", "address": "fa:16:3e:f0:02:db", "network": {"id": "52ee6623-01e5-491e-ab5e-d1d0511bd15f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-765176125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063dd272226340d49a7ac0756413cadf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9493a899-e7", "ovs_interfaceid": "9493a899-e71d-4abd-83fd-1e78b06eab07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:50:02 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Converting VIF {"id": "9493a899-e71d-4abd-83fd-1e78b06eab07", "address": "fa:16:3e:f0:02:db", "network": {"id": "52ee6623-01e5-491e-ab5e-d1d0511bd15f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-765176125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063dd272226340d49a7ac0756413cadf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9493a899-e7", "ovs_interfaceid": "9493a899-e71d-4abd-83fd-1e78b06eab07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:50:02 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:02:db,bridge_name='br-int',has_traffic_filtering=True,id=9493a899-e71d-4abd-83fd-1e78b06eab07,network=Network(52ee6623-01e5-491e-ab5e-d1d0511bd15f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9493a899-e7') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:50:02 user nova-compute[72586]: DEBUG os_vif [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:02:db,bridge_name='br-int',has_traffic_filtering=True,id=9493a899-e71d-4abd-83fd-1e78b06eab07,network=Network(52ee6623-01e5-491e-ab5e-d1d0511bd15f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9493a899-e7') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:50:02 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:50:02 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:50:02 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:50:02 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:50:02 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9493a899-e7, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:50:02 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9493a899-e7, col_values=(('external_ids', {'iface-id': '9493a899-e71d-4abd-83fd-1e78b06eab07', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:02:db', 'vm-uuid': 'c93ae122-c523-498c-acbc-d2518e228584'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:50:02 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:50:02 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:50:02 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:50:02 user nova-compute[72586]: INFO os_vif [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:02:db,bridge_name='br-int',has_traffic_filtering=True,id=9493a899-e71d-4abd-83fd-1e78b06eab07,network=Network(52ee6623-01e5-491e-ab5e-d1d0511bd15f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9493a899-e7')
Aug 01 21:50:02 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:50:02 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] No VIF found with MAC fa:16:3e:f0:02:db, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:50:02 user nova-compute[72586]: DEBUG nova.network.neutron [req-bb887e2d-ac02-447f-89f1-aec344721889 req-e684bd44-f39d-463d-8c04-9436c4da5f57 service nova] [instance: c93ae122-c523-498c-acbc-d2518e228584] Updated VIF entry in instance network info cache for port 9493a899-e71d-4abd-83fd-1e78b06eab07. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:50:02 user nova-compute[72586]: DEBUG nova.network.neutron [req-bb887e2d-ac02-447f-89f1-aec344721889 req-e684bd44-f39d-463d-8c04-9436c4da5f57 service nova] [instance: c93ae122-c523-498c-acbc-d2518e228584] Updating instance_info_cache with network_info: [{"id": "9493a899-e71d-4abd-83fd-1e78b06eab07", "address": "fa:16:3e:f0:02:db", "network": {"id": "52ee6623-01e5-491e-ab5e-d1d0511bd15f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-765176125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063dd272226340d49a7ac0756413cadf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9493a899-e7", "ovs_interfaceid": "9493a899-e71d-4abd-83fd-1e78b06eab07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:50:02 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-bb887e2d-ac02-447f-89f1-aec344721889 req-e684bd44-f39d-463d-8c04-9436c4da5f57 service nova] Releasing lock "refresh_cache-c93ae122-c523-498c-acbc-d2518e228584" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:50:03 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:50:03 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:50:03 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:50:03 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:50:03 user nova-compute[72586]: DEBUG nova.compute.manager [req-51013d44-4232-47df-9918-55d235a4236e req-dfb0351f-c056-4ac3-b0d5-bf2fed38379c service nova] [instance: c93ae122-c523-498c-acbc-d2518e228584] Received event network-vif-plugged-9493a899-e71d-4abd-83fd-1e78b06eab07 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:50:03 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-51013d44-4232-47df-9918-55d235a4236e req-dfb0351f-c056-4ac3-b0d5-bf2fed38379c service nova] Acquiring lock "c93ae122-c523-498c-acbc-d2518e228584-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:50:03 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-51013d44-4232-47df-9918-55d235a4236e req-dfb0351f-c056-4ac3-b0d5-bf2fed38379c service nova] Lock "c93ae122-c523-498c-acbc-d2518e228584-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:50:03 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-51013d44-4232-47df-9918-55d235a4236e req-dfb0351f-c056-4ac3-b0d5-bf2fed38379c service nova] Lock "c93ae122-c523-498c-acbc-d2518e228584-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:50:03 user nova-compute[72586]: DEBUG nova.compute.manager [req-51013d44-4232-47df-9918-55d235a4236e req-dfb0351f-c056-4ac3-b0d5-bf2fed38379c service nova] [instance: c93ae122-c523-498c-acbc-d2518e228584] No waiting events found dispatching network-vif-plugged-9493a899-e71d-4abd-83fd-1e78b06eab07 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:50:03 user nova-compute[72586]: WARNING nova.compute.manager [req-51013d44-4232-47df-9918-55d235a4236e req-dfb0351f-c056-4ac3-b0d5-bf2fed38379c service nova] [instance: c93ae122-c523-498c-acbc-d2518e228584] Received unexpected event network-vif-plugged-9493a899-e71d-4abd-83fd-1e78b06eab07 for instance with vm_state building and task_state spawning.
Aug 01 21:50:05 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:50:05 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690926605.8024385, c93ae122-c523-498c-acbc-d2518e228584 => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:50:05 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: c93ae122-c523-498c-acbc-d2518e228584] VM Resumed (Lifecycle Event)
Aug 01 21:50:05 user nova-compute[72586]: DEBUG nova.compute.manager [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: c93ae122-c523-498c-acbc-d2518e228584] Instance event wait completed in 0 seconds for  {{(pid=72586) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 21:50:05 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: c93ae122-c523-498c-acbc-d2518e228584] Guest created on hypervisor {{(pid=72586) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 21:50:05 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: c93ae122-c523-498c-acbc-d2518e228584] Instance spawned successfully.
Aug 01 21:50:05 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: c93ae122-c523-498c-acbc-d2518e228584] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 21:50:05 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: c93ae122-c523-498c-acbc-d2518e228584] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:50:05 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: c93ae122-c523-498c-acbc-d2518e228584] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:50:05 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: c93ae122-c523-498c-acbc-d2518e228584] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:50:05 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690926605.8034005, c93ae122-c523-498c-acbc-d2518e228584 => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:50:05 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: c93ae122-c523-498c-acbc-d2518e228584] VM Started (Lifecycle Event)
Aug 01 21:50:05 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: c93ae122-c523-498c-acbc-d2518e228584] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:50:05 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: c93ae122-c523-498c-acbc-d2518e228584] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:50:05 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: c93ae122-c523-498c-acbc-d2518e228584] Found default for hw_cdrom_bus of ide {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:50:05 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: c93ae122-c523-498c-acbc-d2518e228584] Found default for hw_disk_bus of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:50:05 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: c93ae122-c523-498c-acbc-d2518e228584] Found default for hw_input_bus of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:50:05 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: c93ae122-c523-498c-acbc-d2518e228584] Found default for hw_pointer_model of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:50:05 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: c93ae122-c523-498c-acbc-d2518e228584] Found default for hw_video_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:50:05 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: c93ae122-c523-498c-acbc-d2518e228584] Found default for hw_vif_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:50:05 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: c93ae122-c523-498c-acbc-d2518e228584] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:50:05 user nova-compute[72586]: INFO nova.compute.manager [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: c93ae122-c523-498c-acbc-d2518e228584] Took 5.66 seconds to spawn the instance on the hypervisor.
Aug 01 21:50:05 user nova-compute[72586]: DEBUG nova.compute.manager [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: c93ae122-c523-498c-acbc-d2518e228584] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:50:05 user nova-compute[72586]: DEBUG nova.compute.manager [req-7bfec419-0c9c-405e-a551-c76886684274 req-61575ad5-7d7d-43fd-9ac0-1b1869bcdeaf service nova] [instance: c93ae122-c523-498c-acbc-d2518e228584] Received event network-vif-plugged-9493a899-e71d-4abd-83fd-1e78b06eab07 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:50:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-7bfec419-0c9c-405e-a551-c76886684274 req-61575ad5-7d7d-43fd-9ac0-1b1869bcdeaf service nova] Acquiring lock "c93ae122-c523-498c-acbc-d2518e228584-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:50:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-7bfec419-0c9c-405e-a551-c76886684274 req-61575ad5-7d7d-43fd-9ac0-1b1869bcdeaf service nova] Lock "c93ae122-c523-498c-acbc-d2518e228584-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:50:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-7bfec419-0c9c-405e-a551-c76886684274 req-61575ad5-7d7d-43fd-9ac0-1b1869bcdeaf service nova] Lock "c93ae122-c523-498c-acbc-d2518e228584-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:50:05 user nova-compute[72586]: DEBUG nova.compute.manager [req-7bfec419-0c9c-405e-a551-c76886684274 req-61575ad5-7d7d-43fd-9ac0-1b1869bcdeaf service nova] [instance: c93ae122-c523-498c-acbc-d2518e228584] No waiting events found dispatching network-vif-plugged-9493a899-e71d-4abd-83fd-1e78b06eab07 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:50:05 user nova-compute[72586]: WARNING nova.compute.manager [req-7bfec419-0c9c-405e-a551-c76886684274 req-61575ad5-7d7d-43fd-9ac0-1b1869bcdeaf service nova] [instance: c93ae122-c523-498c-acbc-d2518e228584] Received unexpected event network-vif-plugged-9493a899-e71d-4abd-83fd-1e78b06eab07 for instance with vm_state building and task_state spawning.
Aug 01 21:50:06 user nova-compute[72586]: INFO nova.compute.manager [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: c93ae122-c523-498c-acbc-d2518e228584] Took 6.26 seconds to build instance.
Aug 01 21:50:06 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-dd0b4ab8-74d6-4a22-9d4a-160400a84a1d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "c93ae122-c523-498c-acbc-d2518e228584" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.366s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:50:07 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:50:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:50:12 user nova-compute[72586]: DEBUG nova.compute.manager [req-3fea338e-03c9-4a33-99e7-4b41a0ecca93 req-82af8cf6-56b7-4b27-8531-57229fd446b0 service nova] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Received event network-changed-6486639b-ff35-44da-9139-dd485a1e6eb7 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:50:12 user nova-compute[72586]: DEBUG nova.compute.manager [req-3fea338e-03c9-4a33-99e7-4b41a0ecca93 req-82af8cf6-56b7-4b27-8531-57229fd446b0 service nova] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Refreshing instance network info cache due to event network-changed-6486639b-ff35-44da-9139-dd485a1e6eb7. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:50:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-3fea338e-03c9-4a33-99e7-4b41a0ecca93 req-82af8cf6-56b7-4b27-8531-57229fd446b0 service nova] Acquiring lock "refresh_cache-71d8bdf9-f90d-4335-9f60-dbdc4380b1d7" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:50:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-3fea338e-03c9-4a33-99e7-4b41a0ecca93 req-82af8cf6-56b7-4b27-8531-57229fd446b0 service nova] Acquired lock "refresh_cache-71d8bdf9-f90d-4335-9f60-dbdc4380b1d7" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:50:12 user nova-compute[72586]: DEBUG nova.network.neutron [req-3fea338e-03c9-4a33-99e7-4b41a0ecca93 req-82af8cf6-56b7-4b27-8531-57229fd446b0 service nova] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Refreshing network info cache for port 6486639b-ff35-44da-9139-dd485a1e6eb7 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:50:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-247e252a-3a50-41c1-8016-be880e3fa6b8 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Acquiring lock "71d8bdf9-f90d-4335-9f60-dbdc4380b1d7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:50:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-247e252a-3a50-41c1-8016-be880e3fa6b8 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "71d8bdf9-f90d-4335-9f60-dbdc4380b1d7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:50:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-247e252a-3a50-41c1-8016-be880e3fa6b8 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Acquiring lock "71d8bdf9-f90d-4335-9f60-dbdc4380b1d7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:50:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-247e252a-3a50-41c1-8016-be880e3fa6b8 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "71d8bdf9-f90d-4335-9f60-dbdc4380b1d7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:50:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-247e252a-3a50-41c1-8016-be880e3fa6b8 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "71d8bdf9-f90d-4335-9f60-dbdc4380b1d7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:50:12 user nova-compute[72586]: INFO nova.compute.manager [None req-247e252a-3a50-41c1-8016-be880e3fa6b8 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Terminating instance
Aug 01 21:50:12 user nova-compute[72586]: DEBUG nova.compute.manager [None req-247e252a-3a50-41c1-8016-be880e3fa6b8 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Start destroying the instance on the hypervisor. {{(pid=72586) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 21:50:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:50:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:50:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:50:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:50:13 user nova-compute[72586]: DEBUG nova.network.neutron [req-3fea338e-03c9-4a33-99e7-4b41a0ecca93 req-82af8cf6-56b7-4b27-8531-57229fd446b0 service nova] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Updated VIF entry in instance network info cache for port 6486639b-ff35-44da-9139-dd485a1e6eb7. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:50:13 user nova-compute[72586]: DEBUG nova.network.neutron [req-3fea338e-03c9-4a33-99e7-4b41a0ecca93 req-82af8cf6-56b7-4b27-8531-57229fd446b0 service nova] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Updating instance_info_cache with network_info: [{"id": "6486639b-ff35-44da-9139-dd485a1e6eb7", "address": "fa:16:3e:1e:da:69", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6486639b-ff", "ovs_interfaceid": "6486639b-ff35-44da-9139-dd485a1e6eb7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:50:13 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-3fea338e-03c9-4a33-99e7-4b41a0ecca93 req-82af8cf6-56b7-4b27-8531-57229fd446b0 service nova] Releasing lock "refresh_cache-71d8bdf9-f90d-4335-9f60-dbdc4380b1d7" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:50:13 user nova-compute[72586]: DEBUG nova.compute.manager [req-4d92b3ba-794b-4fc7-82a5-09e6d16046ed req-06e70a68-22f2-4372-abd3-de3b95ab436d service nova] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Received event network-vif-unplugged-6486639b-ff35-44da-9139-dd485a1e6eb7 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:50:13 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-4d92b3ba-794b-4fc7-82a5-09e6d16046ed req-06e70a68-22f2-4372-abd3-de3b95ab436d service nova] Acquiring lock "71d8bdf9-f90d-4335-9f60-dbdc4380b1d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:50:13 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-4d92b3ba-794b-4fc7-82a5-09e6d16046ed req-06e70a68-22f2-4372-abd3-de3b95ab436d service nova] Lock "71d8bdf9-f90d-4335-9f60-dbdc4380b1d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:50:13 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-4d92b3ba-794b-4fc7-82a5-09e6d16046ed req-06e70a68-22f2-4372-abd3-de3b95ab436d service nova] Lock "71d8bdf9-f90d-4335-9f60-dbdc4380b1d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:50:13 user nova-compute[72586]: DEBUG nova.compute.manager [req-4d92b3ba-794b-4fc7-82a5-09e6d16046ed req-06e70a68-22f2-4372-abd3-de3b95ab436d service nova] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] No waiting events found dispatching network-vif-unplugged-6486639b-ff35-44da-9139-dd485a1e6eb7 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:50:13 user nova-compute[72586]: DEBUG nova.compute.manager [req-4d92b3ba-794b-4fc7-82a5-09e6d16046ed req-06e70a68-22f2-4372-abd3-de3b95ab436d service nova] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Received event network-vif-unplugged-6486639b-ff35-44da-9139-dd485a1e6eb7 for instance with task_state deleting. {{(pid=72586) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 21:50:13 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Instance destroyed successfully.
Aug 01 21:50:13 user nova-compute[72586]: DEBUG nova.objects.instance [None req-247e252a-3a50-41c1-8016-be880e3fa6b8 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lazy-loading 'resources' on Instance uuid 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:50:13 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-247e252a-3a50-41c1-8016-be880e3fa6b8 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:48:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1733853456',display_name='tempest-TestVolumeBootPattern-server-1733853456',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1733853456',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHNJjSduTMasTSgviwHre/FYLh+Mp4kuIJ4iuAJ7FsI2FanPe3E7nT7btn/7CziUSz0I1qByH5+ECZVnIY2RecZsBlCuwfU8kwCbqZrJSP50B9MRG5Gjmo9qdN10n6adqA==',key_name='tempest-TestVolumeBootPattern-705389702',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:48:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a631250d39c34afca47a1fa2817e627e',ramdisk_id='',reservation_id='r-x7zwq0hz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1160754716',owner_user_name='tempest-TestVolumeBootPattern-1160754716-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:48:33Z,user_data=None,user_id='76cd0d9d973b410ca4ff08fc7630fbc6',uuid=71d8bdf9-f90d-4335-9f60-dbdc4380b1d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6486639b-ff35-44da-9139-dd485a1e6eb7", "address": "fa:16:3e:1e:da:69", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6486639b-ff", "ovs_interfaceid": "6486639b-ff35-44da-9139-dd485a1e6eb7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:50:13 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-247e252a-3a50-41c1-8016-be880e3fa6b8 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Converting VIF {"id": "6486639b-ff35-44da-9139-dd485a1e6eb7", "address": "fa:16:3e:1e:da:69", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6486639b-ff", "ovs_interfaceid": "6486639b-ff35-44da-9139-dd485a1e6eb7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:50:13 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-247e252a-3a50-41c1-8016-be880e3fa6b8 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:da:69,bridge_name='br-int',has_traffic_filtering=True,id=6486639b-ff35-44da-9139-dd485a1e6eb7,network=Network(2fbf5ffb-0ec0-403b-bc92-259563ab1d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6486639b-ff') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:50:13 user nova-compute[72586]: DEBUG os_vif [None req-247e252a-3a50-41c1-8016-be880e3fa6b8 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:da:69,bridge_name='br-int',has_traffic_filtering=True,id=6486639b-ff35-44da-9139-dd485a1e6eb7,network=Network(2fbf5ffb-0ec0-403b-bc92-259563ab1d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6486639b-ff') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:50:13 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:50:13 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6486639b-ff, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:50:13 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:50:13 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:50:13 user nova-compute[72586]: INFO os_vif [None req-247e252a-3a50-41c1-8016-be880e3fa6b8 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:da:69,bridge_name='br-int',has_traffic_filtering=True,id=6486639b-ff35-44da-9139-dd485a1e6eb7,network=Network(2fbf5ffb-0ec0-403b-bc92-259563ab1d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6486639b-ff')
Aug 01 21:50:13 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-247e252a-3a50-41c1-8016-be880e3fa6b8 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] calling os-brick to detach iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 21:50:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-247e252a-3a50-41c1-8016-be880e3fa6b8 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, {'target_iqns': ['iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QeybaUVI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:50:13 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-247e252a-3a50-41c1-8016-be880e3fa6b8 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:50:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-247e252a-3a50-41c1-8016-be880e3fa6b8 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:50:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-247e252a-3a50-41c1-8016-be880e3fa6b8 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:50:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-247e252a-3a50-41c1-8016-be880e3fa6b8 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178', 0)] {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 21:50:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:50:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:50:13 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de942ed-b6e2-411d-a382-706e83883e89]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:50:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:50:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:50:13 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6fab49b-5c23-4f00-9904-b3be54d94b55]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:50:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-247e252a-3a50-41c1-8016-be880e3fa6b8 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 (non-flash)
Aug 01 21:50:13 user nova-compute[72586]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29 (non-flash)
Aug 01 21:50:13 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:50:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-247e252a-3a50-41c1-8016-be880e3fa6b8 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 (non-flash)
Aug 01 21:50:13 user nova-compute[72586]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29 (non-flash)
Aug 01 21:50:13 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:50:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-247e252a-3a50-41c1-8016-be880e3fa6b8 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4eac76f7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178'): ({'sdc'}, set())}) {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 21:50:13 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-247e252a-3a50-41c1-8016-be880e3fa6b8 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Removing single pathed devices sdc {{(pid=72586) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 21:50:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:50:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:50:13 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddde862a-b6e0-4adf-957b-c23d288afa3d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:50:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:50:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:50:13 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[540c8b49-0c9e-4847-9848-dbf7b94ea778]: (4, ('ok\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:50:13 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-247e252a-3a50-41c1-8016-be880e3fa6b8 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Flushing IO for device /dev/sdc {{(pid=72586) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 21:50:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:50:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:50:13 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[18cfae1c-58ef-4efa-983d-8b240b6790f7]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:50:13 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-247e252a-3a50-41c1-8016-be880e3fa6b8 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72586) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 21:50:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:50:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:50:13 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[673b5e89-9242-4003-98ee-2c03302fc576]: (4, ('1', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:50:13 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-247e252a-3a50-41c1-8016-be880e3fa6b8 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 21:50:13 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-247e252a-3a50-41c1-8016-be880e3fa6b8 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] SCSI volumes sdc have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 21:50:13 user nova-compute[72586]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26261386133303839', '/dev/disk/by-id/scsi-1SCST_BIO14df97ec-ba8a3089420d631f', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_14df97ec') {{(pid=83581) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 01 21:50:13 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fcf3656-1dd8-4816-82cc-c280fa0fceaf]: (4, None) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:50:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-247e252a-3a50-41c1-8016-be880e3fa6b8 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178')] {{(pid=72586) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 21:50:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:50:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:50:13 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2884ebf-a51b-4bda-9dab-46493b4a2523]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:50:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-247e252a-3a50-41c1-8016-be880e3fa6b8 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:50:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 -p 172.16.0.220:3260 --logout {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:50:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:50:13 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[4394df39-036f-41f5-8c70-ae0a1c2c1ecf]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:50:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-247e252a-3a50-41c1-8016-be880e3fa6b8 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178, portal: 172.16.0.220,3260]
Aug 01 21:50:13 user nova-compute[72586]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178, portal: 172.16.0.220,3260] successful.
Aug 01 21:50:13 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:50:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 -p 172.16.0.220:3260 --op delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:50:13 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:50:13 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ace9459-a56b-4869-8a08-30a754d6e92c]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:50:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-247e252a-3a50-41c1-8016-be880e3fa6b8 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:50:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-247e252a-3a50-41c1-8016-be880e3fa6b8 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:50:13 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-247e252a-3a50-41c1-8016-be880e3fa6b8 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] <== disconnect_volume: return (303ms) None {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:50:13 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-247e252a-3a50-41c1-8016-be880e3fa6b8 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Disconnected iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 21:50:13 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-247e252a-3a50-41c1-8016-be880e3fa6b8 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Deleting instance files /opt/stack/data/nova/instances/71d8bdf9-f90d-4335-9f60-dbdc4380b1d7_del
Aug 01 21:50:13 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-247e252a-3a50-41c1-8016-be880e3fa6b8 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Deletion of /opt/stack/data/nova/instances/71d8bdf9-f90d-4335-9f60-dbdc4380b1d7_del complete
Aug 01 21:50:13 user nova-compute[72586]: INFO nova.compute.manager [None req-247e252a-3a50-41c1-8016-be880e3fa6b8 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Took 1.21 seconds to destroy the instance on the hypervisor.
Aug 01 21:50:13 user nova-compute[72586]: DEBUG oslo.service.loopingcall [None req-247e252a-3a50-41c1-8016-be880e3fa6b8 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72586) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 21:50:13 user nova-compute[72586]: DEBUG nova.compute.manager [-] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Deallocating network for instance {{(pid=72586) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 21:50:13 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] deallocate_for_instance() {{(pid=72586) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 21:50:14 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:50:14 user nova-compute[72586]: DEBUG nova.compute.manager [req-68620b67-a161-48d4-b333-03f397521cb4 req-7022cedd-8e11-4209-8dfe-7faa4d26c832 service nova] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Received event network-vif-deleted-6486639b-ff35-44da-9139-dd485a1e6eb7 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:50:14 user nova-compute[72586]: INFO nova.compute.manager [req-68620b67-a161-48d4-b333-03f397521cb4 req-7022cedd-8e11-4209-8dfe-7faa4d26c832 service nova] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Neutron deleted interface 6486639b-ff35-44da-9139-dd485a1e6eb7; detaching it from the instance and deleting it from the info cache
Aug 01 21:50:14 user nova-compute[72586]: DEBUG nova.network.neutron [req-68620b67-a161-48d4-b333-03f397521cb4 req-7022cedd-8e11-4209-8dfe-7faa4d26c832 service nova] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:50:14 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Took 0.92 seconds to deallocate network for instance.
Aug 01 21:50:14 user nova-compute[72586]: DEBUG nova.compute.manager [req-68620b67-a161-48d4-b333-03f397521cb4 req-7022cedd-8e11-4209-8dfe-7faa4d26c832 service nova] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Detach interface failed, port_id=6486639b-ff35-44da-9139-dd485a1e6eb7, reason: Instance 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7 could not be found. {{(pid=72586) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 21:50:15 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:50:15 user nova-compute[72586]: DEBUG nova.compute.manager [req-7184a98f-459c-4c52-b1c9-e5585ad1177f req-6ae28671-0d7e-4414-99bc-2c96a13494a1 service nova] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Received event network-vif-plugged-6486639b-ff35-44da-9139-dd485a1e6eb7 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:50:15 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-7184a98f-459c-4c52-b1c9-e5585ad1177f req-6ae28671-0d7e-4414-99bc-2c96a13494a1 service nova] Acquiring lock "71d8bdf9-f90d-4335-9f60-dbdc4380b1d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:50:15 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-7184a98f-459c-4c52-b1c9-e5585ad1177f req-6ae28671-0d7e-4414-99bc-2c96a13494a1 service nova] Lock "71d8bdf9-f90d-4335-9f60-dbdc4380b1d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:50:15 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-7184a98f-459c-4c52-b1c9-e5585ad1177f req-6ae28671-0d7e-4414-99bc-2c96a13494a1 service nova] Lock "71d8bdf9-f90d-4335-9f60-dbdc4380b1d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:50:15 user nova-compute[72586]: DEBUG nova.compute.manager [req-7184a98f-459c-4c52-b1c9-e5585ad1177f req-6ae28671-0d7e-4414-99bc-2c96a13494a1 service nova] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] No waiting events found dispatching network-vif-plugged-6486639b-ff35-44da-9139-dd485a1e6eb7 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:50:15 user nova-compute[72586]: WARNING nova.compute.manager [req-7184a98f-459c-4c52-b1c9-e5585ad1177f req-6ae28671-0d7e-4414-99bc-2c96a13494a1 service nova] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Received unexpected event network-vif-plugged-6486639b-ff35-44da-9139-dd485a1e6eb7 for instance with vm_state active and task_state deleting.
Aug 01 21:50:15 user nova-compute[72586]: INFO nova.compute.manager [None req-247e252a-3a50-41c1-8016-be880e3fa6b8 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Took 0.87 seconds to detach 1 volumes for instance.
Aug 01 21:50:15 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-247e252a-3a50-41c1-8016-be880e3fa6b8 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:50:15 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-247e252a-3a50-41c1-8016-be880e3fa6b8 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:50:16 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-247e252a-3a50-41c1-8016-be880e3fa6b8 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:50:16 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-247e252a-3a50-41c1-8016-be880e3fa6b8 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:50:16 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-247e252a-3a50-41c1-8016-be880e3fa6b8 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.253s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:50:16 user nova-compute[72586]: INFO nova.scheduler.client.report [None req-247e252a-3a50-41c1-8016-be880e3fa6b8 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Deleted allocations for instance 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7
Aug 01 21:50:16 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-247e252a-3a50-41c1-8016-be880e3fa6b8 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "71d8bdf9-f90d-4335-9f60-dbdc4380b1d7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.497s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:50:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:50:20 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:50:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:50:25 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:50:28 user nova-compute[72586]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690926613.5536802, 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7 => Stopped> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:50:28 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] VM Stopped (Lifecycle Event)
Aug 01 21:50:28 user nova-compute[72586]: DEBUG nova.compute.manager [None req-8f75e7df-8de7-4d83-adcf-147819eb2ba2 None None] [instance: 71d8bdf9-f90d-4335-9f60-dbdc4380b1d7] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:50:28 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:50:30 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:50:30 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Acquiring lock "d0fa04b2-75e5-4542-9600-7a1517884041" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:50:30 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Lock "d0fa04b2-75e5-4542-9600-7a1517884041" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:50:30 user nova-compute[72586]: INFO nova.compute.manager [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Unshelving
Aug 01 21:50:30 user nova-compute[72586]: INFO nova.virt.block_device [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Booting with volume 89992cbb-33b3-4a79-a3b7-534d9854a5a6 at /dev/vda
Aug 01 21:50:30 user nova-compute[72586]: DEBUG os_brick.utils [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:50:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:50:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:50:30 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[8716a4eb-5538-4156-97fb-c721df6f2d45]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4bc202fb9cb\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:50:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:50:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:50:30 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7280ffb-dea7-4295-9efb-2e4e3b485318]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:50:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:50:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:50:30 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d26959-dee0-4f0f-b7c9-61b0fb63d66f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:50:30 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe99c4b-4612-47a7-a702-4d4557ae277e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:50:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Running cmd (subprocess): nvme version {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:50:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] 'nvme version' failed. Not Retrying. {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:50:30 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] nvme not present on system {{(pid=72586) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 21:50:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:50:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:50:30 user nova-compute[72586]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 21:50:30 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[946485f4-b628-434a-8445-6a6924c80a64]: (4, '') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:50:30 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72586) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 21:50:30 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 21:50:30 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] LIGHTOS: no hostnqn found. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 21:50:30 user nova-compute[72586]: DEBUG os_brick.utils [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4bc202fb9cb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:50:30 user nova-compute[72586]: DEBUG nova.virt.block_device [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Updating existing volume attachment record: 96592609-f483-44a6-9d84-47620f0d3aca {{(pid=72586) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 21:50:33 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:50:35 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:50:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:50:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:50:38 user nova-compute[72586]: DEBUG nova.objects.instance [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Lazy-loading 'pci_requests' on Instance uuid d0fa04b2-75e5-4542-9600-7a1517884041 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:50:38 user nova-compute[72586]: DEBUG nova.objects.instance [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Lazy-loading 'numa_topology' on Instance uuid d0fa04b2-75e5-4542-9600-7a1517884041 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:50:38 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72586) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 21:50:38 user nova-compute[72586]: INFO nova.compute.claims [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Claim successful on node user
Aug 01 21:50:38 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:50:38 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:50:38 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:50:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.314s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:50:39 user nova-compute[72586]: INFO nova.network.neutron [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Updating port 3acb8318-c6b2-4b99-b441-62488967760d with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Acquiring lock "refresh_cache-d0fa04b2-75e5-4542-9600-7a1517884041" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Acquired lock "refresh_cache-d0fa04b2-75e5-4542-9600-7a1517884041" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG nova.network.neutron [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG nova.compute.manager [req-18cd903f-49c0-4db2-8132-f97093fd3814 req-c463cd58-5fcc-45a8-8c52-ac9e33cce61e service nova] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Received event network-changed-3acb8318-c6b2-4b99-b441-62488967760d {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG nova.compute.manager [req-18cd903f-49c0-4db2-8132-f97093fd3814 req-c463cd58-5fcc-45a8-8c52-ac9e33cce61e service nova] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Refreshing instance network info cache due to event network-changed-3acb8318-c6b2-4b99-b441-62488967760d. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-18cd903f-49c0-4db2-8132-f97093fd3814 req-c463cd58-5fcc-45a8-8c52-ac9e33cce61e service nova] Acquiring lock "refresh_cache-d0fa04b2-75e5-4542-9600-7a1517884041" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG nova.network.neutron [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Updating instance_info_cache with network_info: [{"id": "3acb8318-c6b2-4b99-b441-62488967760d", "address": "fa:16:3e:c4:14:cf", "network": {"id": "e072f7ac-9dd8-4e5c-9de2-5d6ef08c261b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1788451595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d633939ea5ac494c8668f0e5acaba7f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3acb8318-c6", "ovs_interfaceid": "3acb8318-c6b2-4b99-b441-62488967760d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Releasing lock "refresh_cache-d0fa04b2-75e5-4542-9600-7a1517884041" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Creating instance directory {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 21:50:40 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Creating image(s)
Aug 01 21:50:40 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Did not create local disks {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Ensure instance console log exists: /opt/stack/data/nova/instances/d0fa04b2-75e5-4542-9600-7a1517884041/console.log {{(pid=72586) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Start _get_guest_xml network_info=[{"id": "3acb8318-c6b2-4b99-b441-62488967760d", "address": "fa:16:3e:c4:14:cf", "network": {"id": "e072f7ac-9dd8-4e5c-9de2-5d6ef08c261b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1788451595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d633939ea5ac494c8668f0e5acaba7f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3acb8318-c6", "ovs_interfaceid": "3acb8318-c6b2-4b99-b441-62488967760d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CBSbrpog', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd0fa04b2-75e5-4542-9600-7a1517884041', 'attached_at': '', 'detached_at': '', 'volume_id': '89992cbb-33b3-4a79-a3b7-534d9854a5a6', 'serial': '89992cbb-33b3-4a79-a3b7-534d9854a5a6'}, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '96592609-f483-44a6-9d84-47620f0d3aca', 'delete_on_termination': True, 'volume_type': None} {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-18cd903f-49c0-4db2-8132-f97093fd3814 req-c463cd58-5fcc-45a8-8c52-ac9e33cce61e service nova] Acquired lock "refresh_cache-d0fa04b2-75e5-4542-9600-7a1517884041" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG nova.network.neutron [req-18cd903f-49c0-4db2-8132-f97093fd3814 req-c463cd58-5fcc-45a8-8c52-ac9e33cce61e service nova] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Refreshing network info cache for port 3acb8318-c6b2-4b99-b441-62488967760d {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:50:40 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:50:40 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:50:40 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG nova.objects.instance [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Lazy-loading 'vcpu_model' on Instance uuid d0fa04b2-75e5-4542-9600-7a1517884041 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Calling os-brick to attach iSCSI Volume {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CBSbrpog', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:50:40 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:50:40 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:50:40 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:50:40 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:50:40 user nova-compute[72586]: INFO os_brick.initiator.connectors.iscsi [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 21:50:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 -p 172.16.0.220:3260 {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1830cf-e26f-41ef-b072-771c03df2826]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 21:50:40 user nova-compute[72586]:  {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 -p 172.16.0.220:3260 --interface default --op new {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce56965f-0414-47ea-94be-2d9522128851]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6] added\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6] added
Aug 01 21:50:40 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[216860c7-332c-4694-bf21-c51a9ef83b73]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[44914946-8ae6-43a1-8587-76da7eb243c4]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CBSbrpog {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CBSbrpog" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b308384-b734-496b-9625-b4a33222bd31]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CBSbrpog'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.042s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1967e94-08ba-4d5e-8967-58ffbacc80de]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d21df16-794e-4c18-bfb1-e5606e30f585]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29 (non-flash)
Aug 01 21:50:40 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29 (non-flash)
Aug 01 21:50:40 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 -p 172.16.0.220:3260 --login {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[59bfbad1-fda2-4b05-b9c7-7f6cc8ef5fa2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6, portal: 172.16.0.220,3260]
Aug 01 21:50:40 user nova-compute[72586]: Login to [iface: default, target: iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6, portal: 172.16.0.220,3260] successful.
Aug 01 21:50:40 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e7a872-88ed-4aba-a100-227270bd74a4]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d149a75-29ac-446d-b6e1-6a657386428b]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29 (non-flash)
Aug 01 21:50:40 user nova-compute[72586]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 (non-flash)
Aug 01 21:50:40 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29 (non-flash)
Aug 01 21:50:40 user nova-compute[72586]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 (non-flash)
Aug 01 21:50:40 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Connected to 172.16.0.220:3260 {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=72586) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72586) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27493af-1c1a-4d5b-89a2-c4c0fb088ffb]: (4, ('- - 0', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:50:40 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CBSbrpog', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 21:50:41 user nova-compute[72586]: DEBUG nova.network.neutron [req-18cd903f-49c0-4db2-8132-f97093fd3814 req-c463cd58-5fcc-45a8-8c52-ac9e33cce61e service nova] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Updated VIF entry in instance network info cache for port 3acb8318-c6b2-4b99-b441-62488967760d. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:50:41 user nova-compute[72586]: DEBUG nova.network.neutron [req-18cd903f-49c0-4db2-8132-f97093fd3814 req-c463cd58-5fcc-45a8-8c52-ac9e33cce61e service nova] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Updating instance_info_cache with network_info: [{"id": "3acb8318-c6b2-4b99-b441-62488967760d", "address": "fa:16:3e:c4:14:cf", "network": {"id": "e072f7ac-9dd8-4e5c-9de2-5d6ef08c261b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1788451595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d633939ea5ac494c8668f0e5acaba7f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3acb8318-c6", "ovs_interfaceid": "3acb8318-c6b2-4b99-b441-62488967760d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:50:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-18cd903f-49c0-4db2-8132-f97093fd3814 req-c463cd58-5fcc-45a8-8c52-ac9e33cce61e service nova] Releasing lock "refresh_cache-d0fa04b2-75e5-4542-9600-7a1517884041" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:50:41 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:50:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:50:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '23163663863646131', 'path': '/dev/sdc'} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:50:41 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23163663863646131', 'path': '/dev/sdc'} {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 21:50:42 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T21:46:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1377950842',display_name='tempest-TestShelveInstance-server-1377950842',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1377950842',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-70441469',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:46:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='d633939ea5ac494c8668f0e5acaba7f1',ramdisk_id='',reservation_id='r-nmpthpez',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1887634001',owner_user_name='tempest-TestShelveInstance-1887634001-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:50:30Z,user_data=None,user_id='d0e99da03c7045b0bc1213eded097dfe',uuid=d0fa04b2-75e5-4542-9600-7a1517884041,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "3acb8318-c6b2-4b99-b441-62488967760d", "address": "fa:16:3e:c4:14:cf", "network": {"id": "e072f7ac-9dd8-4e5c-9de2-5d6ef08c261b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1788451595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d633939ea5ac494c8668f0e5acaba7f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3acb8318-c6", "ovs_interfaceid": "3acb8318-c6b2-4b99-b441-62488967760d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:50:42 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Converting VIF {"id": "3acb8318-c6b2-4b99-b441-62488967760d", "address": "fa:16:3e:c4:14:cf", "network": {"id": "e072f7ac-9dd8-4e5c-9de2-5d6ef08c261b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1788451595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d633939ea5ac494c8668f0e5acaba7f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3acb8318-c6", "ovs_interfaceid": "3acb8318-c6b2-4b99-b441-62488967760d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:50:42 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:14:cf,bridge_name='br-int',has_traffic_filtering=True,id=3acb8318-c6b2-4b99-b441-62488967760d,network=Network(e072f7ac-9dd8-4e5c-9de2-5d6ef08c261b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3acb8318-c6') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:50:42 user nova-compute[72586]: DEBUG nova.objects.instance [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Lazy-loading 'pci_devices' on Instance uuid d0fa04b2-75e5-4542-9600-7a1517884041 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:50:42 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:50:42 user nova-compute[72586]:   <uuid>d0fa04b2-75e5-4542-9600-7a1517884041</uuid>
Aug 01 21:50:42 user nova-compute[72586]:   <name>instance-0000002a</name>
Aug 01 21:50:42 user nova-compute[72586]:   <memory>524288</memory>
Aug 01 21:50:42 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:50:42 user nova-compute[72586]:   <metadata>
Aug 01 21:50:42 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:50:42 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:50:42 user nova-compute[72586]:       <nova:name>tempest-TestShelveInstance-server-1377950842</nova:name>
Aug 01 21:50:42 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:50:40</nova:creationTime>
Aug 01 21:50:42 user nova-compute[72586]:       <nova:flavor name="m1.tiny">
Aug 01 21:50:42 user nova-compute[72586]:         <nova:memory>512</nova:memory>
Aug 01 21:50:42 user nova-compute[72586]:         <nova:disk>1</nova:disk>
Aug 01 21:50:42 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:50:42 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:50:42 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:50:42 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:50:42 user nova-compute[72586]:       <nova:owner>
Aug 01 21:50:42 user nova-compute[72586]:         <nova:user uuid="d0e99da03c7045b0bc1213eded097dfe">tempest-TestShelveInstance-1887634001-project-member</nova:user>
Aug 01 21:50:42 user nova-compute[72586]:         <nova:project uuid="d633939ea5ac494c8668f0e5acaba7f1">tempest-TestShelveInstance-1887634001</nova:project>
Aug 01 21:50:42 user nova-compute[72586]:       </nova:owner>
Aug 01 21:50:42 user nova-compute[72586]:       <nova:ports>
Aug 01 21:50:42 user nova-compute[72586]:         <nova:port uuid="3acb8318-c6b2-4b99-b441-62488967760d">
Aug 01 21:50:42 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 01 21:50:42 user nova-compute[72586]:         </nova:port>
Aug 01 21:50:42 user nova-compute[72586]:       </nova:ports>
Aug 01 21:50:42 user nova-compute[72586]:     </nova:instance>
Aug 01 21:50:42 user nova-compute[72586]:   </metadata>
Aug 01 21:50:42 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:50:42 user nova-compute[72586]:     <system>
Aug 01 21:50:42 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:50:42 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:50:42 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:50:42 user nova-compute[72586]:       <entry name="serial">d0fa04b2-75e5-4542-9600-7a1517884041</entry>
Aug 01 21:50:42 user nova-compute[72586]:       <entry name="uuid">d0fa04b2-75e5-4542-9600-7a1517884041</entry>
Aug 01 21:50:42 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:50:42 user nova-compute[72586]:     </system>
Aug 01 21:50:42 user nova-compute[72586]:   </sysinfo>
Aug 01 21:50:42 user nova-compute[72586]:   <os>
Aug 01 21:50:42 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:50:42 user nova-compute[72586]:     <boot dev="hd"/>
Aug 01 21:50:42 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:50:42 user nova-compute[72586]:   </os>
Aug 01 21:50:42 user nova-compute[72586]:   <features>
Aug 01 21:50:42 user nova-compute[72586]:     <acpi/>
Aug 01 21:50:42 user nova-compute[72586]:     <apic/>
Aug 01 21:50:42 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:50:42 user nova-compute[72586]:   </features>
Aug 01 21:50:42 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:50:42 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:50:42 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:50:42 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:50:42 user nova-compute[72586]:   </clock>
Aug 01 21:50:42 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:50:42 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:50:42 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:50:42 user nova-compute[72586]:   </cpu>
Aug 01 21:50:42 user nova-compute[72586]:   <devices>
Aug 01 21:50:42 user nova-compute[72586]:     <disk type="block" device="disk">
Aug 01 21:50:42 user nova-compute[72586]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:50:42 user nova-compute[72586]:       <source dev="/dev/sdc"/>
Aug 01 21:50:42 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:50:42 user nova-compute[72586]:       <serial>89992cbb-33b3-4a79-a3b7-534d9854a5a6</serial>
Aug 01 21:50:42 user nova-compute[72586]:     </disk>
Aug 01 21:50:42 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:50:42 user nova-compute[72586]:       <mac address="fa:16:3e:c4:14:cf"/>
Aug 01 21:50:42 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:50:42 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:50:42 user nova-compute[72586]:       <target dev="tap3acb8318-c6"/>
Aug 01 21:50:42 user nova-compute[72586]:     </interface>
Aug 01 21:50:42 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:50:42 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/d0fa04b2-75e5-4542-9600-7a1517884041/console.log" append="off"/>
Aug 01 21:50:42 user nova-compute[72586]:     </serial>
Aug 01 21:50:42 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:50:42 user nova-compute[72586]:     <video>
Aug 01 21:50:42 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:50:42 user nova-compute[72586]:     </video>
Aug 01 21:50:42 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:50:42 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:50:42 user nova-compute[72586]:     </rng>
Aug 01 21:50:42 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:50:42 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:50:42 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:50:42 user nova-compute[72586]:     </memballoon>
Aug 01 21:50:42 user nova-compute[72586]:   </devices>
Aug 01 21:50:42 user nova-compute[72586]: </domain>
Aug 01 21:50:42 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:50:42 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T21:46:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1377950842',display_name='tempest-TestShelveInstance-server-1377950842',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1377950842',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-70441469',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:46:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='d633939ea5ac494c8668f0e5acaba7f1',ramdisk_id='',reservation_id='r-nmpthpez',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1887634001',owner_user_name='tempest-TestShelveInstance-1887634001-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:50:30Z,user_data=None,user_id='d0e99da03c7045b0bc1213eded097dfe',uuid=d0fa04b2-75e5-4542-9600-7a1517884041,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "3acb8318-c6b2-4b99-b441-62488967760d", "address": "fa:16:3e:c4:14:cf", "network": {"id": "e072f7ac-9dd8-4e5c-9de2-5d6ef08c261b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1788451595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d633939ea5ac494c8668f0e5acaba7f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3acb8318-c6", "ovs_interfaceid": "3acb8318-c6b2-4b99-b441-62488967760d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:50:42 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Converting VIF {"id": "3acb8318-c6b2-4b99-b441-62488967760d", "address": "fa:16:3e:c4:14:cf", "network": {"id": "e072f7ac-9dd8-4e5c-9de2-5d6ef08c261b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1788451595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d633939ea5ac494c8668f0e5acaba7f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3acb8318-c6", "ovs_interfaceid": "3acb8318-c6b2-4b99-b441-62488967760d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:50:42 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:14:cf,bridge_name='br-int',has_traffic_filtering=True,id=3acb8318-c6b2-4b99-b441-62488967760d,network=Network(e072f7ac-9dd8-4e5c-9de2-5d6ef08c261b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3acb8318-c6') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:50:42 user nova-compute[72586]: DEBUG os_vif [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:14:cf,bridge_name='br-int',has_traffic_filtering=True,id=3acb8318-c6b2-4b99-b441-62488967760d,network=Network(e072f7ac-9dd8-4e5c-9de2-5d6ef08c261b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3acb8318-c6') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:50:42 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:50:42 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:50:42 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:50:42 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:50:42 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3acb8318-c6, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:50:42 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3acb8318-c6, col_values=(('external_ids', {'iface-id': '3acb8318-c6b2-4b99-b441-62488967760d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:14:cf', 'vm-uuid': 'd0fa04b2-75e5-4542-9600-7a1517884041'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:50:42 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:50:42 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:50:42 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:50:42 user nova-compute[72586]: INFO os_vif [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:14:cf,bridge_name='br-int',has_traffic_filtering=True,id=3acb8318-c6b2-4b99-b441-62488967760d,network=Network(e072f7ac-9dd8-4e5c-9de2-5d6ef08c261b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3acb8318-c6')
Aug 01 21:50:42 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:50:42 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] No VIF found with MAC fa:16:3e:c4:14:cf, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:50:42 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:50:42 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:50:42 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:50:42 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Cleaning up deleted instances with incomplete migration  {{(pid=72586) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 21:50:43 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:50:43 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:50:43 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:50:43 user nova-compute[72586]: DEBUG nova.compute.manager [req-f129f3d6-15bd-419b-9a4b-5480d5ddd815 req-6084d638-2cb5-4d30-97c5-6fbac8f1e75d service nova] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Received event network-vif-plugged-3acb8318-c6b2-4b99-b441-62488967760d {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:50:43 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-f129f3d6-15bd-419b-9a4b-5480d5ddd815 req-6084d638-2cb5-4d30-97c5-6fbac8f1e75d service nova] Acquiring lock "d0fa04b2-75e5-4542-9600-7a1517884041-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:50:43 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-f129f3d6-15bd-419b-9a4b-5480d5ddd815 req-6084d638-2cb5-4d30-97c5-6fbac8f1e75d service nova] Lock "d0fa04b2-75e5-4542-9600-7a1517884041-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:50:43 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-f129f3d6-15bd-419b-9a4b-5480d5ddd815 req-6084d638-2cb5-4d30-97c5-6fbac8f1e75d service nova] Lock "d0fa04b2-75e5-4542-9600-7a1517884041-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:50:43 user nova-compute[72586]: DEBUG nova.compute.manager [req-f129f3d6-15bd-419b-9a4b-5480d5ddd815 req-6084d638-2cb5-4d30-97c5-6fbac8f1e75d service nova] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] No waiting events found dispatching network-vif-plugged-3acb8318-c6b2-4b99-b441-62488967760d {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:50:43 user nova-compute[72586]: WARNING nova.compute.manager [req-f129f3d6-15bd-419b-9a4b-5480d5ddd815 req-6084d638-2cb5-4d30-97c5-6fbac8f1e75d service nova] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Received unexpected event network-vif-plugged-3acb8318-c6b2-4b99-b441-62488967760d for instance with vm_state shelved_offloaded and task_state spawning.
Aug 01 21:50:43 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:50:43 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72586) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 21:50:43 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:50:44 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:50:44 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:50:45 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:50:45 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690926645.5178888, d0fa04b2-75e5-4542-9600-7a1517884041 => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:50:45 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] VM Resumed (Lifecycle Event)
Aug 01 21:50:45 user nova-compute[72586]: DEBUG nova.compute.manager [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Instance event wait completed in 0 seconds for  {{(pid=72586) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 21:50:45 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Guest created on hypervisor {{(pid=72586) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 21:50:45 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Instance spawned successfully.
Aug 01 21:50:45 user nova-compute[72586]: DEBUG nova.compute.manager [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:50:45 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:50:45 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:50:45 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:50:45 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690926645.518906, d0fa04b2-75e5-4542-9600-7a1517884041 => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:50:45 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] VM Started (Lifecycle Event)
Aug 01 21:50:45 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:50:45 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:50:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-f74d0b61-db43-49fc-8a56-fd2f5e90102d tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Lock "d0fa04b2-75e5-4542-9600-7a1517884041" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 15.210s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:50:45 user nova-compute[72586]: DEBUG nova.compute.manager [req-0be0673a-b6ef-405c-a3c5-8b2646b1a0ad req-324d5a3f-8a30-41b8-b658-82127cad8132 service nova] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Received event network-vif-plugged-3acb8318-c6b2-4b99-b441-62488967760d {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:50:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-0be0673a-b6ef-405c-a3c5-8b2646b1a0ad req-324d5a3f-8a30-41b8-b658-82127cad8132 service nova] Acquiring lock "d0fa04b2-75e5-4542-9600-7a1517884041-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:50:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-0be0673a-b6ef-405c-a3c5-8b2646b1a0ad req-324d5a3f-8a30-41b8-b658-82127cad8132 service nova] Lock "d0fa04b2-75e5-4542-9600-7a1517884041-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:50:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-0be0673a-b6ef-405c-a3c5-8b2646b1a0ad req-324d5a3f-8a30-41b8-b658-82127cad8132 service nova] Lock "d0fa04b2-75e5-4542-9600-7a1517884041-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:50:45 user nova-compute[72586]: DEBUG nova.compute.manager [req-0be0673a-b6ef-405c-a3c5-8b2646b1a0ad req-324d5a3f-8a30-41b8-b658-82127cad8132 service nova] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] No waiting events found dispatching network-vif-plugged-3acb8318-c6b2-4b99-b441-62488967760d {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:50:45 user nova-compute[72586]: WARNING nova.compute.manager [req-0be0673a-b6ef-405c-a3c5-8b2646b1a0ad req-324d5a3f-8a30-41b8-b658-82127cad8132 service nova] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Received unexpected event network-vif-plugged-3acb8318-c6b2-4b99-b441-62488967760d for instance with vm_state active and task_state None.
Aug 01 21:50:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:50:47 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:50:47 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:50:47 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:50:47 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:50:47 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Auditing locally available compute resources for user (node: user) {{(pid=72586) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 21:50:48 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c93ae122-c523-498c-acbc-d2518e228584/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:50:48 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c93ae122-c523-498c-acbc-d2518e228584/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:50:48 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c93ae122-c523-498c-acbc-d2518e228584/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:50:48 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c93ae122-c523-498c-acbc-d2518e228584/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:50:48 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:50:48 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae37bb9-cf4e-46e1-b5e5-81930cdfa824/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:50:48 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae37bb9-cf4e-46e1-b5e5-81930cdfa824/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:50:48 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae37bb9-cf4e-46e1-b5e5-81930cdfa824/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:50:48 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae37bb9-cf4e-46e1-b5e5-81930cdfa824/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:50:48 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:50:49 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:50:49 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:50:49 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Hypervisor/Node resource view: name=user free_ram=8500MB free_disk=25.253215789794922GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72586) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 21:50:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:50:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:50:49 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:50:49 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance c93ae122-c523-498c-acbc-d2518e228584 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:50:49 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance d0fa04b2-75e5-4542-9600-7a1517884041 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:50:49 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 21:50:49 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 21:50:49 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Refreshing inventories for resource provider ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 21:50:49 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Updating ProviderTree inventory for provider ca6775c1-2a64-43f9-9467-372aa0457b1d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 21:50:49 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Updating inventory in ProviderTree for provider ca6775c1-2a64-43f9-9467-372aa0457b1d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 21:50:49 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Refreshing aggregate associations for resource provider ca6775c1-2a64-43f9-9467-372aa0457b1d, aggregates: None {{(pid=72586) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 21:50:49 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Refreshing trait associations for resource provider ca6775c1-2a64-43f9-9467-372aa0457b1d, traits: COMPUTE_NODE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_TRUSTED_CERTS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AMI {{(pid=72586) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 21:50:49 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:50:49 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:50:49 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Compute_service record updated for user:user {{(pid=72586) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 21:50:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.499s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:50:50 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:50:52 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:50:52 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:50:52 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Starting heal instance info cache {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 21:50:52 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Rebuilding the list of instances to heal {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 21:50:52 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "refresh_cache-d0fa04b2-75e5-4542-9600-7a1517884041" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:50:52 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquired lock "refresh_cache-d0fa04b2-75e5-4542-9600-7a1517884041" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:50:52 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Forcefully refreshing network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 21:50:52 user nova-compute[72586]: DEBUG nova.objects.instance [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lazy-loading 'info_cache' on Instance uuid d0fa04b2-75e5-4542-9600-7a1517884041 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:50:53 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Updating instance_info_cache with network_info: [{"id": "3acb8318-c6b2-4b99-b441-62488967760d", "address": "fa:16:3e:c4:14:cf", "network": {"id": "e072f7ac-9dd8-4e5c-9de2-5d6ef08c261b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1788451595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d633939ea5ac494c8668f0e5acaba7f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3acb8318-c6", "ovs_interfaceid": "3acb8318-c6b2-4b99-b441-62488967760d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:50:53 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Releasing lock "refresh_cache-d0fa04b2-75e5-4542-9600-7a1517884041" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:50:53 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Updated the network info_cache for instance {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 21:50:53 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:50:53 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:50:57 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:50:57 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:50:57 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72586) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 21:50:57 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72586) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 21:50:57 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72586) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 21:50:57 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:51:00 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:51:02 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:51:04 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Acquiring lock "055a4027-b090-43f3-998e-5bd3ba3c0109" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:51:04 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "055a4027-b090-43f3-998e-5bd3ba3c0109" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:51:04 user nova-compute[72586]: DEBUG nova.compute.manager [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Starting instance... {{(pid=72586) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 21:51:04 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:51:04 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:51:04 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72586) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 21:51:04 user nova-compute[72586]: INFO nova.compute.claims [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Claim successful on node user
Aug 01 21:51:04 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:51:04 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Cleaning up deleted instances {{(pid=72586) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 21:51:04 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] There are 0 instances to clean {{(pid=72586) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 21:51:05 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:51:05 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:51:05 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.283s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:51:05 user nova-compute[72586]: DEBUG nova.compute.manager [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Start building networks asynchronously for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 21:51:05 user nova-compute[72586]: DEBUG nova.compute.manager [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Allocating IP information in the background. {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 21:51:05 user nova-compute[72586]: DEBUG nova.network.neutron [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] allocate_for_instance() {{(pid=72586) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 21:51:05 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 21:51:05 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:51:05 user nova-compute[72586]: DEBUG nova.compute.manager [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Start building block device mappings for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 21:51:05 user nova-compute[72586]: INFO nova.virt.block_device [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Booting with volume 902655e6-2982-46c0-a124-0255707cd178 at /dev/vda
Aug 01 21:51:05 user nova-compute[72586]: DEBUG nova.policy [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '76cd0d9d973b410ca4ff08fc7630fbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a631250d39c34afca47a1fa2817e627e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72586) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 21:51:05 user nova-compute[72586]: DEBUG os_brick.utils [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:51:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:51:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:51:05 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5716691-eb7c-4b65-8f24-19c78b99e296]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4bc202fb9cb\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:51:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:51:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:51:05 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[393c3a21-6abe-40e8-855d-3e3d2b8b555b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:51:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:51:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:51:05 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[731367c4-f040-4d75-92f4-3651c82e3adc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:51:05 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[8644c5a1-0d28-4acc-9f97-234b91c738ae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:51:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Running cmd (subprocess): nvme version {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:51:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] 'nvme version' failed. Not Retrying. {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:51:05 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] nvme not present on system {{(pid=72586) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 21:51:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:51:05 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:51:05 user nova-compute[72586]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 21:51:05 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77ac361-0c59-468a-8e72-3822541f9f48]: (4, '') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:51:05 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72586) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 21:51:05 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 21:51:05 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] LIGHTOS: no hostnqn found. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 21:51:05 user nova-compute[72586]: DEBUG os_brick.utils [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4bc202fb9cb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:51:05 user nova-compute[72586]: DEBUG nova.virt.block_device [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Updating existing volume attachment record: 2166006f-d216-4473-b728-48f13594f051 {{(pid=72586) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 21:51:05 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:51:06 user nova-compute[72586]: DEBUG nova.network.neutron [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Successfully created port: 65240d77-844f-4d37-9b69-972686cb6c95 {{(pid=72586) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 21:51:06 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:51:07 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:51:07 user nova-compute[72586]: DEBUG nova.network.neutron [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Successfully updated port: 65240d77-844f-4d37-9b69-972686cb6c95 {{(pid=72586) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 21:51:07 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Acquiring lock "refresh_cache-055a4027-b090-43f3-998e-5bd3ba3c0109" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:51:07 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Acquired lock "refresh_cache-055a4027-b090-43f3-998e-5bd3ba3c0109" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:51:07 user nova-compute[72586]: DEBUG nova.network.neutron [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:51:07 user nova-compute[72586]: DEBUG nova.compute.manager [req-00df3dd9-823d-40c8-8675-d6f61c37ee3f req-02c288dd-db6d-41ea-81c3-f57458a8395a service nova] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Received event network-changed-65240d77-844f-4d37-9b69-972686cb6c95 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:51:07 user nova-compute[72586]: DEBUG nova.compute.manager [req-00df3dd9-823d-40c8-8675-d6f61c37ee3f req-02c288dd-db6d-41ea-81c3-f57458a8395a service nova] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Refreshing instance network info cache due to event network-changed-65240d77-844f-4d37-9b69-972686cb6c95. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:51:07 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-00df3dd9-823d-40c8-8675-d6f61c37ee3f req-02c288dd-db6d-41ea-81c3-f57458a8395a service nova] Acquiring lock "refresh_cache-055a4027-b090-43f3-998e-5bd3ba3c0109" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:51:07 user nova-compute[72586]: DEBUG nova.network.neutron [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Instance cache missing network info. {{(pid=72586) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 21:51:07 user nova-compute[72586]: DEBUG nova.network.neutron [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Updating instance_info_cache with network_info: [{"id": "65240d77-844f-4d37-9b69-972686cb6c95", "address": "fa:16:3e:b4:82:5a", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65240d77-84", "ovs_interfaceid": "65240d77-844f-4d37-9b69-972686cb6c95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:51:07 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Releasing lock "refresh_cache-055a4027-b090-43f3-998e-5bd3ba3c0109" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:51:07 user nova-compute[72586]: DEBUG nova.compute.manager [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Instance network_info: |[{"id": "65240d77-844f-4d37-9b69-972686cb6c95", "address": "fa:16:3e:b4:82:5a", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65240d77-84", "ovs_interfaceid": "65240d77-844f-4d37-9b69-972686cb6c95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 21:51:07 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-00df3dd9-823d-40c8-8675-d6f61c37ee3f req-02c288dd-db6d-41ea-81c3-f57458a8395a service nova] Acquired lock "refresh_cache-055a4027-b090-43f3-998e-5bd3ba3c0109" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:51:07 user nova-compute[72586]: DEBUG nova.network.neutron [req-00df3dd9-823d-40c8-8675-d6f61c37ee3f req-02c288dd-db6d-41ea-81c3-f57458a8395a service nova] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Refreshing network info cache for port 65240d77-844f-4d37-9b69-972686cb6c95 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:51:08 user nova-compute[72586]: DEBUG nova.network.neutron [req-00df3dd9-823d-40c8-8675-d6f61c37ee3f req-02c288dd-db6d-41ea-81c3-f57458a8395a service nova] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Updated VIF entry in instance network info cache for port 65240d77-844f-4d37-9b69-972686cb6c95. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:51:08 user nova-compute[72586]: DEBUG nova.network.neutron [req-00df3dd9-823d-40c8-8675-d6f61c37ee3f req-02c288dd-db6d-41ea-81c3-f57458a8395a service nova] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Updating instance_info_cache with network_info: [{"id": "65240d77-844f-4d37-9b69-972686cb6c95", "address": "fa:16:3e:b4:82:5a", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65240d77-84", "ovs_interfaceid": "65240d77-844f-4d37-9b69-972686cb6c95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:51:08 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-00df3dd9-823d-40c8-8675-d6f61c37ee3f req-02c288dd-db6d-41ea-81c3-f57458a8395a service nova] Releasing lock "refresh_cache-055a4027-b090-43f3-998e-5bd3ba3c0109" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:51:10 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:51:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:51:15 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:51:15 user nova-compute[72586]: DEBUG nova.compute.manager [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Start spawning the instance on the hypervisor. {{(pid=72586) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 21:51:15 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Creating instance directory {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 21:51:15 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Creating image(s)
Aug 01 21:51:15 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Did not create local disks {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 21:51:15 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Ensure instance console log exists: /opt/stack/data/nova/instances/055a4027-b090-43f3-998e-5bd3ba3c0109/console.log {{(pid=72586) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 21:51:15 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:51:15 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:51:15 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:51:15 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Start _get_guest_xml network_info=[{"id": "65240d77-844f-4d37-9b69-972686cb6c95", "address": "fa:16:3e:b4:82:5a", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65240d77-84", "ovs_interfaceid": "65240d77-844f-4d37-9b69-972686cb6c95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QeybaUVI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '055a4027-b090-43f3-998e-5bd3ba3c0109', 'attached_at': '', 'detached_at': '', 'volume_id': '902655e6-2982-46c0-a124-0255707cd178', 'serial': '902655e6-2982-46c0-a124-0255707cd178'}, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '2166006f-d216-4473-b728-48f13594f051', 'delete_on_termination': False, 'volume_type': None} {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:51:15 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:51:15 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:51:15 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:51:15 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:51:15 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:51:15 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:51:15 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:51:15 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:51:15 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:51:15 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:51:15 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:51:15 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:51:15 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:51:15 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:51:15 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:51:15 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:51:15 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:51:15 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:51:15 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Calling os-brick to attach iSCSI Volume {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 21:51:15 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QeybaUVI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:51:15 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:51:15 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:51:15 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:51:15 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:51:15 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:51:15 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:51:15 user nova-compute[72586]: INFO os_brick.initiator.connectors.iscsi [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 21:51:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 -p 172.16.0.220:3260 {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:51:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:51:15 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[236a7199-7815-43f7-a250-a38cb132462a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:51:15 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 21:51:15 user nova-compute[72586]:  {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:51:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 -p 172.16.0.220:3260 --interface default --op new {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:51:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:51:15 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d41283a-63aa-4ae0-94f1-8715f18dba9b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178] added\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:51:15 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178] added
Aug 01 21:51:15 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:51:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:51:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:51:15 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2ac1fa-e8b8-4ec9-9ba7-7b02cfca5afd]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:51:15 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:51:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:51:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:51:15 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6095be-dd1c-4b56-8ed7-4d25e728db09]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:51:15 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:51:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QeybaUVI {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:51:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QeybaUVI" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:51:15 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43ace21-a1aa-4f53-87c2-187a146edd88]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:51:15 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QeybaUVI'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:51:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:51:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:51:15 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[680f0cce-d146-4c5a-a996-9b11dd113657]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:51:15 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:51:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:51:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:51:15 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[219b1714-d171-46d4-be0c-4eaf95a9e558]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:51:15 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29 (non-flash)
Aug 01 21:51:15 user nova-compute[72586]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 (non-flash)
Aug 01 21:51:15 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:51:15 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29 (non-flash)
Aug 01 21:51:15 user nova-compute[72586]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 (non-flash)
Aug 01 21:51:15 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:51:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 -p 172.16.0.220:3260 --login {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:51:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:51:16 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f680df1-538d-4829-b2f6-fcd1c2e1145a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:51:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178, portal: 172.16.0.220,3260]
Aug 01 21:51:16 user nova-compute[72586]: Login to [iface: default, target: iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178, portal: 172.16.0.220,3260] successful.
Aug 01 21:51:16 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:51:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:51:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:51:16 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a279b27-5c7f-4da2-aae7-22e292dd1265]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:51:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:51:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:51:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:51:16 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b9623d-1aab-4e81-9627-900db5ce887a]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:51:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29 (non-flash)
Aug 01 21:51:16 user nova-compute[72586]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 (non-flash)
Aug 01 21:51:16 user nova-compute[72586]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 (non-flash)
Aug 01 21:51:16 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:51:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29 (non-flash)
Aug 01 21:51:16 user nova-compute[72586]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 (non-flash)
Aug 01 21:51:16 user nova-compute[72586]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 (non-flash)
Aug 01 21:51:16 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:51:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:51:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Connected to 172.16.0.220:3260 {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 21:51:16 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] HCTL ('35', '-', '-', 0) found on session 55 with lun 0 {{(pid=72586) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 21:51:16 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72586) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 21:51:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:51:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:51:16 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ceb4a5-0ad1-4f3d-9360-7d35b37df8c7]: (4, ('- - 0', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:51:16 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Searching for a device in session 55 and hctl ['35', '*', '*', 0] yield: None {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:51:17 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:51:17 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Searching for a device in session 55 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:51:17 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QeybaUVI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 21:51:17 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:51:17 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '26261386133303839', 'path': '/dev/sdd'} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:51:17 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26261386133303839', 'path': '/dev/sdd'} {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 21:51:17 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:51:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-490189203',display_name='tempest-TestVolumeBootPattern-server-490189203',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-490189203',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHNJjSduTMasTSgviwHre/FYLh+Mp4kuIJ4iuAJ7FsI2FanPe3E7nT7btn/7CziUSz0I1qByH5+ECZVnIY2RecZsBlCuwfU8kwCbqZrJSP50B9MRG5Gjmo9qdN10n6adqA==',key_name='tempest-TestVolumeBootPattern-705389702',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a631250d39c34afca47a1fa2817e627e',ramdisk_id='',reservation_id='r-2raf2770',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1160754716',owner_user_name='tempest-TestVolumeBootPattern-1160754716-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:51:05Z,user_data=None,user_id='76cd0d9d973b410ca4ff08fc7630fbc6',uuid=055a4027-b090-43f3-998e-5bd3ba3c0109,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65240d77-844f-4d37-9b69-972686cb6c95", "address": "fa:16:3e:b4:82:5a", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65240d77-84", "ovs_interfaceid": "65240d77-844f-4d37-9b69-972686cb6c95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:51:17 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Converting VIF {"id": "65240d77-844f-4d37-9b69-972686cb6c95", "address": "fa:16:3e:b4:82:5a", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65240d77-84", "ovs_interfaceid": "65240d77-844f-4d37-9b69-972686cb6c95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:51:17 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:82:5a,bridge_name='br-int',has_traffic_filtering=True,id=65240d77-844f-4d37-9b69-972686cb6c95,network=Network(2fbf5ffb-0ec0-403b-bc92-259563ab1d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65240d77-84') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:51:17 user nova-compute[72586]: DEBUG nova.objects.instance [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lazy-loading 'pci_devices' on Instance uuid 055a4027-b090-43f3-998e-5bd3ba3c0109 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:51:17 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:51:17 user nova-compute[72586]:   <uuid>055a4027-b090-43f3-998e-5bd3ba3c0109</uuid>
Aug 01 21:51:17 user nova-compute[72586]:   <name>instance-0000002e</name>
Aug 01 21:51:17 user nova-compute[72586]:   <memory>524288</memory>
Aug 01 21:51:17 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:51:17 user nova-compute[72586]:   <metadata>
Aug 01 21:51:17 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:51:17 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:51:17 user nova-compute[72586]:       <nova:name>tempest-TestVolumeBootPattern-server-490189203</nova:name>
Aug 01 21:51:17 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:51:15</nova:creationTime>
Aug 01 21:51:17 user nova-compute[72586]:       <nova:flavor name="m1.tiny">
Aug 01 21:51:17 user nova-compute[72586]:         <nova:memory>512</nova:memory>
Aug 01 21:51:17 user nova-compute[72586]:         <nova:disk>1</nova:disk>
Aug 01 21:51:17 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:51:17 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:51:17 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:51:17 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:51:17 user nova-compute[72586]:       <nova:owner>
Aug 01 21:51:17 user nova-compute[72586]:         <nova:user uuid="76cd0d9d973b410ca4ff08fc7630fbc6">tempest-TestVolumeBootPattern-1160754716-project-member</nova:user>
Aug 01 21:51:17 user nova-compute[72586]:         <nova:project uuid="a631250d39c34afca47a1fa2817e627e">tempest-TestVolumeBootPattern-1160754716</nova:project>
Aug 01 21:51:17 user nova-compute[72586]:       </nova:owner>
Aug 01 21:51:17 user nova-compute[72586]:       <nova:ports>
Aug 01 21:51:17 user nova-compute[72586]:         <nova:port uuid="65240d77-844f-4d37-9b69-972686cb6c95">
Aug 01 21:51:17 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 01 21:51:17 user nova-compute[72586]:         </nova:port>
Aug 01 21:51:17 user nova-compute[72586]:       </nova:ports>
Aug 01 21:51:17 user nova-compute[72586]:     </nova:instance>
Aug 01 21:51:17 user nova-compute[72586]:   </metadata>
Aug 01 21:51:17 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:51:17 user nova-compute[72586]:     <system>
Aug 01 21:51:17 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:51:17 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:51:17 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:51:17 user nova-compute[72586]:       <entry name="serial">055a4027-b090-43f3-998e-5bd3ba3c0109</entry>
Aug 01 21:51:17 user nova-compute[72586]:       <entry name="uuid">055a4027-b090-43f3-998e-5bd3ba3c0109</entry>
Aug 01 21:51:17 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:51:17 user nova-compute[72586]:     </system>
Aug 01 21:51:17 user nova-compute[72586]:   </sysinfo>
Aug 01 21:51:17 user nova-compute[72586]:   <os>
Aug 01 21:51:17 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:51:17 user nova-compute[72586]:     <boot dev="hd"/>
Aug 01 21:51:17 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:51:17 user nova-compute[72586]:   </os>
Aug 01 21:51:17 user nova-compute[72586]:   <features>
Aug 01 21:51:17 user nova-compute[72586]:     <acpi/>
Aug 01 21:51:17 user nova-compute[72586]:     <apic/>
Aug 01 21:51:17 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:51:17 user nova-compute[72586]:   </features>
Aug 01 21:51:17 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:51:17 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:51:17 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:51:17 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:51:17 user nova-compute[72586]:   </clock>
Aug 01 21:51:17 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:51:17 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:51:17 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:51:17 user nova-compute[72586]:   </cpu>
Aug 01 21:51:17 user nova-compute[72586]:   <devices>
Aug 01 21:51:17 user nova-compute[72586]:     <disk type="block" device="disk">
Aug 01 21:51:17 user nova-compute[72586]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:51:17 user nova-compute[72586]:       <source dev="/dev/sdd"/>
Aug 01 21:51:17 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:51:17 user nova-compute[72586]:       <serial>902655e6-2982-46c0-a124-0255707cd178</serial>
Aug 01 21:51:17 user nova-compute[72586]:     </disk>
Aug 01 21:51:17 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:51:17 user nova-compute[72586]:       <mac address="fa:16:3e:b4:82:5a"/>
Aug 01 21:51:17 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:51:17 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:51:17 user nova-compute[72586]:       <target dev="tap65240d77-84"/>
Aug 01 21:51:17 user nova-compute[72586]:     </interface>
Aug 01 21:51:17 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:51:17 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/055a4027-b090-43f3-998e-5bd3ba3c0109/console.log" append="off"/>
Aug 01 21:51:17 user nova-compute[72586]:     </serial>
Aug 01 21:51:17 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:51:17 user nova-compute[72586]:     <video>
Aug 01 21:51:17 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:51:17 user nova-compute[72586]:     </video>
Aug 01 21:51:17 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:51:17 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:51:17 user nova-compute[72586]:     </rng>
Aug 01 21:51:17 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:51:17 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:51:17 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:51:17 user nova-compute[72586]:     </memballoon>
Aug 01 21:51:17 user nova-compute[72586]:   </devices>
Aug 01 21:51:17 user nova-compute[72586]: </domain>
Aug 01 21:51:17 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:51:17 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:51:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-490189203',display_name='tempest-TestVolumeBootPattern-server-490189203',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-490189203',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHNJjSduTMasTSgviwHre/FYLh+Mp4kuIJ4iuAJ7FsI2FanPe3E7nT7btn/7CziUSz0I1qByH5+ECZVnIY2RecZsBlCuwfU8kwCbqZrJSP50B9MRG5Gjmo9qdN10n6adqA==',key_name='tempest-TestVolumeBootPattern-705389702',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a631250d39c34afca47a1fa2817e627e',ramdisk_id='',reservation_id='r-2raf2770',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1160754716',owner_user_name='tempest-TestVolumeBootPattern-1160754716-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:51:05Z,user_data=None,user_id='76cd0d9d973b410ca4ff08fc7630fbc6',uuid=055a4027-b090-43f3-998e-5bd3ba3c0109,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65240d77-844f-4d37-9b69-972686cb6c95", "address": "fa:16:3e:b4:82:5a", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65240d77-84", "ovs_interfaceid": "65240d77-844f-4d37-9b69-972686cb6c95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:51:17 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Converting VIF {"id": "65240d77-844f-4d37-9b69-972686cb6c95", "address": "fa:16:3e:b4:82:5a", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65240d77-84", "ovs_interfaceid": "65240d77-844f-4d37-9b69-972686cb6c95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:51:17 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:82:5a,bridge_name='br-int',has_traffic_filtering=True,id=65240d77-844f-4d37-9b69-972686cb6c95,network=Network(2fbf5ffb-0ec0-403b-bc92-259563ab1d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65240d77-84') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:51:17 user nova-compute[72586]: DEBUG os_vif [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:82:5a,bridge_name='br-int',has_traffic_filtering=True,id=65240d77-844f-4d37-9b69-972686cb6c95,network=Network(2fbf5ffb-0ec0-403b-bc92-259563ab1d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65240d77-84') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:51:17 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:51:17 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:51:17 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:51:17 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:51:17 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap65240d77-84, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:51:17 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap65240d77-84, col_values=(('external_ids', {'iface-id': '65240d77-844f-4d37-9b69-972686cb6c95', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:82:5a', 'vm-uuid': '055a4027-b090-43f3-998e-5bd3ba3c0109'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:51:17 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:51:17 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:51:17 user nova-compute[72586]: INFO os_vif [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:82:5a,bridge_name='br-int',has_traffic_filtering=True,id=65240d77-844f-4d37-9b69-972686cb6c95,network=Network(2fbf5ffb-0ec0-403b-bc92-259563ab1d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65240d77-84')
Aug 01 21:51:17 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:51:17 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] No VIF found with MAC fa:16:3e:b4:82:5a, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:51:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:51:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:51:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:51:18 user nova-compute[72586]: DEBUG nova.compute.manager [req-9a89a749-a51c-46b6-a819-dbf8301c9af9 req-42c105b1-c527-4fc5-976c-f7210cdcaceb service nova] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Received event network-vif-plugged-65240d77-844f-4d37-9b69-972686cb6c95 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:51:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-9a89a749-a51c-46b6-a819-dbf8301c9af9 req-42c105b1-c527-4fc5-976c-f7210cdcaceb service nova] Acquiring lock "055a4027-b090-43f3-998e-5bd3ba3c0109-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:51:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-9a89a749-a51c-46b6-a819-dbf8301c9af9 req-42c105b1-c527-4fc5-976c-f7210cdcaceb service nova] Lock "055a4027-b090-43f3-998e-5bd3ba3c0109-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:51:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-9a89a749-a51c-46b6-a819-dbf8301c9af9 req-42c105b1-c527-4fc5-976c-f7210cdcaceb service nova] Lock "055a4027-b090-43f3-998e-5bd3ba3c0109-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:51:18 user nova-compute[72586]: DEBUG nova.compute.manager [req-9a89a749-a51c-46b6-a819-dbf8301c9af9 req-42c105b1-c527-4fc5-976c-f7210cdcaceb service nova] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] No waiting events found dispatching network-vif-plugged-65240d77-844f-4d37-9b69-972686cb6c95 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:51:18 user nova-compute[72586]: WARNING nova.compute.manager [req-9a89a749-a51c-46b6-a819-dbf8301c9af9 req-42c105b1-c527-4fc5-976c-f7210cdcaceb service nova] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Received unexpected event network-vif-plugged-65240d77-844f-4d37-9b69-972686cb6c95 for instance with vm_state building and task_state spawning.
Aug 01 21:51:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:51:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:51:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:51:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:51:20 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:51:20 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690926680.4858098, 055a4027-b090-43f3-998e-5bd3ba3c0109 => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:51:20 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] VM Resumed (Lifecycle Event)
Aug 01 21:51:20 user nova-compute[72586]: DEBUG nova.compute.manager [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Instance event wait completed in 0 seconds for  {{(pid=72586) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 21:51:20 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Guest created on hypervisor {{(pid=72586) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 21:51:20 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Instance spawned successfully.
Aug 01 21:51:20 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 21:51:20 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:51:20 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:51:20 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Found default for hw_cdrom_bus of ide {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:51:20 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Found default for hw_disk_bus of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:51:20 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Found default for hw_input_bus of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:51:20 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Found default for hw_pointer_model of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:51:20 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Found default for hw_video_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:51:20 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Found default for hw_vif_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:51:20 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:51:20 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690926680.4895513, 055a4027-b090-43f3-998e-5bd3ba3c0109 => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:51:20 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] VM Started (Lifecycle Event)
Aug 01 21:51:20 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:51:20 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:51:20 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:51:20 user nova-compute[72586]: INFO nova.compute.manager [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Took 4.89 seconds to spawn the instance on the hypervisor.
Aug 01 21:51:20 user nova-compute[72586]: DEBUG nova.compute.manager [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:51:20 user nova-compute[72586]: INFO nova.compute.manager [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Took 15.89 seconds to build instance.
Aug 01 21:51:20 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-1bcee7d7-fca7-4118-a1a3-80c2bc8268da tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "055a4027-b090-43f3-998e-5bd3ba3c0109" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.005s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:51:20 user nova-compute[72586]: DEBUG nova.compute.manager [req-4e6d1752-34b8-417d-b243-244d73224331 req-fa04d47b-3037-4407-906a-78675209bde1 service nova] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Received event network-vif-plugged-65240d77-844f-4d37-9b69-972686cb6c95 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:51:20 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-4e6d1752-34b8-417d-b243-244d73224331 req-fa04d47b-3037-4407-906a-78675209bde1 service nova] Acquiring lock "055a4027-b090-43f3-998e-5bd3ba3c0109-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:51:20 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-4e6d1752-34b8-417d-b243-244d73224331 req-fa04d47b-3037-4407-906a-78675209bde1 service nova] Lock "055a4027-b090-43f3-998e-5bd3ba3c0109-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:51:20 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-4e6d1752-34b8-417d-b243-244d73224331 req-fa04d47b-3037-4407-906a-78675209bde1 service nova] Lock "055a4027-b090-43f3-998e-5bd3ba3c0109-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:51:20 user nova-compute[72586]: DEBUG nova.compute.manager [req-4e6d1752-34b8-417d-b243-244d73224331 req-fa04d47b-3037-4407-906a-78675209bde1 service nova] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] No waiting events found dispatching network-vif-plugged-65240d77-844f-4d37-9b69-972686cb6c95 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:51:20 user nova-compute[72586]: WARNING nova.compute.manager [req-4e6d1752-34b8-417d-b243-244d73224331 req-fa04d47b-3037-4407-906a-78675209bde1 service nova] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Received unexpected event network-vif-plugged-65240d77-844f-4d37-9b69-972686cb6c95 for instance with vm_state active and task_state None.
Aug 01 21:51:22 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:51:25 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:51:27 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:51:32 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:51:35 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:51:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:51:40 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:51:42 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:51:42 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:51:42 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:51:43 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:51:43 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:51:43 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72586) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 21:51:44 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:51:45 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:51:46 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:51:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:51:49 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:51:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:51:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:51:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:51:49 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Auditing locally available compute resources for user (node: user) {{(pid=72586) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 21:51:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c93ae122-c523-498c-acbc-d2518e228584/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:51:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c93ae122-c523-498c-acbc-d2518e228584/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:51:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c93ae122-c523-498c-acbc-d2518e228584/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:51:50 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:51:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c93ae122-c523-498c-acbc-d2518e228584/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:51:50 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:51:50 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:51:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae37bb9-cf4e-46e1-b5e5-81930cdfa824/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:51:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae37bb9-cf4e-46e1-b5e5-81930cdfa824/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:51:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae37bb9-cf4e-46e1-b5e5-81930cdfa824/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:51:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae37bb9-cf4e-46e1-b5e5-81930cdfa824/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:51:50 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:51:51 user nova-compute[72586]: DEBUG nova.compute.manager [req-6fc1f0aa-bd4b-4612-bdc6-9ded284e40e8 req-8ac38ac8-befc-4e19-9767-3b592557a86e service nova] [instance: c93ae122-c523-498c-acbc-d2518e228584] Received event network-changed-9493a899-e71d-4abd-83fd-1e78b06eab07 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:51:51 user nova-compute[72586]: DEBUG nova.compute.manager [req-6fc1f0aa-bd4b-4612-bdc6-9ded284e40e8 req-8ac38ac8-befc-4e19-9767-3b592557a86e service nova] [instance: c93ae122-c523-498c-acbc-d2518e228584] Refreshing instance network info cache due to event network-changed-9493a899-e71d-4abd-83fd-1e78b06eab07. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:51:51 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-6fc1f0aa-bd4b-4612-bdc6-9ded284e40e8 req-8ac38ac8-befc-4e19-9767-3b592557a86e service nova] Acquiring lock "refresh_cache-c93ae122-c523-498c-acbc-d2518e228584" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:51:51 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-6fc1f0aa-bd4b-4612-bdc6-9ded284e40e8 req-8ac38ac8-befc-4e19-9767-3b592557a86e service nova] Acquired lock "refresh_cache-c93ae122-c523-498c-acbc-d2518e228584" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:51:51 user nova-compute[72586]: DEBUG nova.network.neutron [req-6fc1f0aa-bd4b-4612-bdc6-9ded284e40e8 req-8ac38ac8-befc-4e19-9767-3b592557a86e service nova] [instance: c93ae122-c523-498c-acbc-d2518e228584] Refreshing network info cache for port 9493a899-e71d-4abd-83fd-1e78b06eab07 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:51:51 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:51:51 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:51:51 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Hypervisor/Node resource view: name=user free_ram=8376MB free_disk=25.24234390258789GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72586) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 21:51:51 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:51:51 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:51:51 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-82978b99-390d-4852-9703-23cc5bdd940c tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Acquiring lock "c93ae122-c523-498c-acbc-d2518e228584" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:51:51 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-82978b99-390d-4852-9703-23cc5bdd940c tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "c93ae122-c523-498c-acbc-d2518e228584" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:51:51 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-82978b99-390d-4852-9703-23cc5bdd940c tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Acquiring lock "c93ae122-c523-498c-acbc-d2518e228584-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:51:51 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-82978b99-390d-4852-9703-23cc5bdd940c tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "c93ae122-c523-498c-acbc-d2518e228584-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:51:51 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-82978b99-390d-4852-9703-23cc5bdd940c tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "c93ae122-c523-498c-acbc-d2518e228584-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:51:51 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:51:51 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance c93ae122-c523-498c-acbc-d2518e228584 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:51:51 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance d0fa04b2-75e5-4542-9600-7a1517884041 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:51:51 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 055a4027-b090-43f3-998e-5bd3ba3c0109 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:51:51 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 21:51:51 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 21:51:51 user nova-compute[72586]: INFO nova.compute.manager [None req-82978b99-390d-4852-9703-23cc5bdd940c tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: c93ae122-c523-498c-acbc-d2518e228584] Terminating instance
Aug 01 21:51:51 user nova-compute[72586]: DEBUG nova.compute.manager [None req-82978b99-390d-4852-9703-23cc5bdd940c tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: c93ae122-c523-498c-acbc-d2518e228584] Start destroying the instance on the hypervisor. {{(pid=72586) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 21:51:51 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:51:51 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:51:51 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:51:51 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:51:51 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Compute_service record updated for user:user {{(pid=72586) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 21:51:51 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.335s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:51:51 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:51:51 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:51:51 user nova-compute[72586]: DEBUG nova.network.neutron [req-6fc1f0aa-bd4b-4612-bdc6-9ded284e40e8 req-8ac38ac8-befc-4e19-9767-3b592557a86e service nova] [instance: c93ae122-c523-498c-acbc-d2518e228584] Updated VIF entry in instance network info cache for port 9493a899-e71d-4abd-83fd-1e78b06eab07. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:51:51 user nova-compute[72586]: DEBUG nova.network.neutron [req-6fc1f0aa-bd4b-4612-bdc6-9ded284e40e8 req-8ac38ac8-befc-4e19-9767-3b592557a86e service nova] [instance: c93ae122-c523-498c-acbc-d2518e228584] Updating instance_info_cache with network_info: [{"id": "9493a899-e71d-4abd-83fd-1e78b06eab07", "address": "fa:16:3e:f0:02:db", "network": {"id": "52ee6623-01e5-491e-ab5e-d1d0511bd15f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-765176125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063dd272226340d49a7ac0756413cadf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9493a899-e7", "ovs_interfaceid": "9493a899-e71d-4abd-83fd-1e78b06eab07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:51:51 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-6fc1f0aa-bd4b-4612-bdc6-9ded284e40e8 req-8ac38ac8-befc-4e19-9767-3b592557a86e service nova] Releasing lock "refresh_cache-c93ae122-c523-498c-acbc-d2518e228584" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:51:51 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:51:51 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:51:51 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: c93ae122-c523-498c-acbc-d2518e228584] Instance destroyed successfully.
Aug 01 21:51:51 user nova-compute[72586]: DEBUG nova.objects.instance [None req-82978b99-390d-4852-9703-23cc5bdd940c tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lazy-loading 'resources' on Instance uuid c93ae122-c523-498c-acbc-d2518e228584 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:51:51 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-82978b99-390d-4852-9703-23cc5bdd940c tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:49:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1110837703',display_name='tempest-AttachVolumeNegativeTest-server-1110837703',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1110837703',id=45,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGm+wMgaTAldyl/Zc4cLFO4q13bhy7gytWAOfX0ujhTtX1ybHPHZ2nHoEgiF5hZGRp+91xXy97uqlmftjKkEdM75vM8GhkXRsGx+8vTXsbdXUogmcgyqwB4lp00svm5/tw==',key_name='tempest-keypair-1590125696',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:50:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='063dd272226340d49a7ac0756413cadf',ramdisk_id='',reservation_id='r-rt2psqv1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-717043369',owner_user_name='tempest-AttachVolumeNegativeTest-717043369-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:50:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37663bab7d31400c8399451058bd5936',uuid=c93ae122-c523-498c-acbc-d2518e228584,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9493a899-e71d-4abd-83fd-1e78b06eab07", "address": "fa:16:3e:f0:02:db", "network": {"id": "52ee6623-01e5-491e-ab5e-d1d0511bd15f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-765176125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063dd272226340d49a7ac0756413cadf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9493a899-e7", "ovs_interfaceid": "9493a899-e71d-4abd-83fd-1e78b06eab07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:51:51 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-82978b99-390d-4852-9703-23cc5bdd940c tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Converting VIF {"id": "9493a899-e71d-4abd-83fd-1e78b06eab07", "address": "fa:16:3e:f0:02:db", "network": {"id": "52ee6623-01e5-491e-ab5e-d1d0511bd15f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-765176125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063dd272226340d49a7ac0756413cadf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9493a899-e7", "ovs_interfaceid": "9493a899-e71d-4abd-83fd-1e78b06eab07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:51:51 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-82978b99-390d-4852-9703-23cc5bdd940c tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:02:db,bridge_name='br-int',has_traffic_filtering=True,id=9493a899-e71d-4abd-83fd-1e78b06eab07,network=Network(52ee6623-01e5-491e-ab5e-d1d0511bd15f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9493a899-e7') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:51:51 user nova-compute[72586]: DEBUG os_vif [None req-82978b99-390d-4852-9703-23cc5bdd940c tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:02:db,bridge_name='br-int',has_traffic_filtering=True,id=9493a899-e71d-4abd-83fd-1e78b06eab07,network=Network(52ee6623-01e5-491e-ab5e-d1d0511bd15f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9493a899-e7') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:51:51 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:51:51 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9493a899-e7, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:51:51 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:51:51 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:51:51 user nova-compute[72586]: INFO os_vif [None req-82978b99-390d-4852-9703-23cc5bdd940c tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:02:db,bridge_name='br-int',has_traffic_filtering=True,id=9493a899-e71d-4abd-83fd-1e78b06eab07,network=Network(52ee6623-01e5-491e-ab5e-d1d0511bd15f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9493a899-e7')
Aug 01 21:51:51 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-82978b99-390d-4852-9703-23cc5bdd940c tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: c93ae122-c523-498c-acbc-d2518e228584] Deleting instance files /opt/stack/data/nova/instances/c93ae122-c523-498c-acbc-d2518e228584_del
Aug 01 21:51:51 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-82978b99-390d-4852-9703-23cc5bdd940c tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: c93ae122-c523-498c-acbc-d2518e228584] Deletion of /opt/stack/data/nova/instances/c93ae122-c523-498c-acbc-d2518e228584_del complete
Aug 01 21:51:51 user nova-compute[72586]: INFO nova.compute.manager [None req-82978b99-390d-4852-9703-23cc5bdd940c tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: c93ae122-c523-498c-acbc-d2518e228584] Took 0.71 seconds to destroy the instance on the hypervisor.
Aug 01 21:51:51 user nova-compute[72586]: DEBUG oslo.service.loopingcall [None req-82978b99-390d-4852-9703-23cc5bdd940c tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72586) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 21:51:51 user nova-compute[72586]: DEBUG nova.compute.manager [-] [instance: c93ae122-c523-498c-acbc-d2518e228584] Deallocating network for instance {{(pid=72586) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 21:51:51 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: c93ae122-c523-498c-acbc-d2518e228584] deallocate_for_instance() {{(pid=72586) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 21:51:52 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: c93ae122-c523-498c-acbc-d2518e228584] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:51:52 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: c93ae122-c523-498c-acbc-d2518e228584] Took 0.80 seconds to deallocate network for instance.
Aug 01 21:51:52 user nova-compute[72586]: DEBUG nova.compute.manager [req-13d30fa1-f6a1-4015-8736-61d637c86e9f req-a43c8737-9875-4742-8aa5-430cb2a47a34 service nova] [instance: c93ae122-c523-498c-acbc-d2518e228584] Received event network-vif-deleted-9493a899-e71d-4abd-83fd-1e78b06eab07 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:51:52 user nova-compute[72586]: INFO nova.compute.manager [req-13d30fa1-f6a1-4015-8736-61d637c86e9f req-a43c8737-9875-4742-8aa5-430cb2a47a34 service nova] [instance: c93ae122-c523-498c-acbc-d2518e228584] Neutron deleted interface 9493a899-e71d-4abd-83fd-1e78b06eab07; detaching it from the instance and deleting it from the info cache
Aug 01 21:51:52 user nova-compute[72586]: DEBUG nova.network.neutron [req-13d30fa1-f6a1-4015-8736-61d637c86e9f req-a43c8737-9875-4742-8aa5-430cb2a47a34 service nova] [instance: c93ae122-c523-498c-acbc-d2518e228584] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:51:52 user nova-compute[72586]: DEBUG nova.compute.manager [req-13d30fa1-f6a1-4015-8736-61d637c86e9f req-a43c8737-9875-4742-8aa5-430cb2a47a34 service nova] [instance: c93ae122-c523-498c-acbc-d2518e228584] Detach interface failed, port_id=9493a899-e71d-4abd-83fd-1e78b06eab07, reason: Instance c93ae122-c523-498c-acbc-d2518e228584 could not be found. {{(pid=72586) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 21:51:52 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-82978b99-390d-4852-9703-23cc5bdd940c tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:51:52 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-82978b99-390d-4852-9703-23cc5bdd940c tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:51:52 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-82978b99-390d-4852-9703-23cc5bdd940c tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:51:52 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-82978b99-390d-4852-9703-23cc5bdd940c tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:51:52 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-82978b99-390d-4852-9703-23cc5bdd940c tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.189s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:51:52 user nova-compute[72586]: DEBUG nova.compute.manager [req-22d84e36-ba3c-4ca0-b874-e05605a499ac req-8c89638a-055e-43f6-ae62-45ce15e80650 service nova] [instance: c93ae122-c523-498c-acbc-d2518e228584] Received event network-vif-unplugged-9493a899-e71d-4abd-83fd-1e78b06eab07 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:51:52 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-22d84e36-ba3c-4ca0-b874-e05605a499ac req-8c89638a-055e-43f6-ae62-45ce15e80650 service nova] Acquiring lock "c93ae122-c523-498c-acbc-d2518e228584-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:51:52 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-22d84e36-ba3c-4ca0-b874-e05605a499ac req-8c89638a-055e-43f6-ae62-45ce15e80650 service nova] Lock "c93ae122-c523-498c-acbc-d2518e228584-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:51:52 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-22d84e36-ba3c-4ca0-b874-e05605a499ac req-8c89638a-055e-43f6-ae62-45ce15e80650 service nova] Lock "c93ae122-c523-498c-acbc-d2518e228584-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:51:52 user nova-compute[72586]: DEBUG nova.compute.manager [req-22d84e36-ba3c-4ca0-b874-e05605a499ac req-8c89638a-055e-43f6-ae62-45ce15e80650 service nova] [instance: c93ae122-c523-498c-acbc-d2518e228584] No waiting events found dispatching network-vif-unplugged-9493a899-e71d-4abd-83fd-1e78b06eab07 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:51:52 user nova-compute[72586]: WARNING nova.compute.manager [req-22d84e36-ba3c-4ca0-b874-e05605a499ac req-8c89638a-055e-43f6-ae62-45ce15e80650 service nova] [instance: c93ae122-c523-498c-acbc-d2518e228584] Received unexpected event network-vif-unplugged-9493a899-e71d-4abd-83fd-1e78b06eab07 for instance with vm_state deleted and task_state None.
Aug 01 21:51:52 user nova-compute[72586]: DEBUG nova.compute.manager [req-22d84e36-ba3c-4ca0-b874-e05605a499ac req-8c89638a-055e-43f6-ae62-45ce15e80650 service nova] [instance: c93ae122-c523-498c-acbc-d2518e228584] Received event network-vif-plugged-9493a899-e71d-4abd-83fd-1e78b06eab07 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:51:52 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-22d84e36-ba3c-4ca0-b874-e05605a499ac req-8c89638a-055e-43f6-ae62-45ce15e80650 service nova] Acquiring lock "c93ae122-c523-498c-acbc-d2518e228584-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:51:52 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-22d84e36-ba3c-4ca0-b874-e05605a499ac req-8c89638a-055e-43f6-ae62-45ce15e80650 service nova] Lock "c93ae122-c523-498c-acbc-d2518e228584-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:51:52 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-22d84e36-ba3c-4ca0-b874-e05605a499ac req-8c89638a-055e-43f6-ae62-45ce15e80650 service nova] Lock "c93ae122-c523-498c-acbc-d2518e228584-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:51:52 user nova-compute[72586]: DEBUG nova.compute.manager [req-22d84e36-ba3c-4ca0-b874-e05605a499ac req-8c89638a-055e-43f6-ae62-45ce15e80650 service nova] [instance: c93ae122-c523-498c-acbc-d2518e228584] No waiting events found dispatching network-vif-plugged-9493a899-e71d-4abd-83fd-1e78b06eab07 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:51:52 user nova-compute[72586]: WARNING nova.compute.manager [req-22d84e36-ba3c-4ca0-b874-e05605a499ac req-8c89638a-055e-43f6-ae62-45ce15e80650 service nova] [instance: c93ae122-c523-498c-acbc-d2518e228584] Received unexpected event network-vif-plugged-9493a899-e71d-4abd-83fd-1e78b06eab07 for instance with vm_state deleted and task_state None.
Aug 01 21:51:53 user nova-compute[72586]: INFO nova.scheduler.client.report [None req-82978b99-390d-4852-9703-23cc5bdd940c tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Deleted allocations for instance c93ae122-c523-498c-acbc-d2518e228584
Aug 01 21:51:53 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-82978b99-390d-4852-9703-23cc5bdd940c tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "c93ae122-c523-498c-acbc-d2518e228584" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.969s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:51:54 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:51:54 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Starting heal instance info cache {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 21:51:54 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "refresh_cache-8ae37bb9-cf4e-46e1-b5e5-81930cdfa824" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:51:54 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquired lock "refresh_cache-8ae37bb9-cf4e-46e1-b5e5-81930cdfa824" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:51:54 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Forcefully refreshing network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 21:51:54 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Updating instance_info_cache with network_info: [{"id": "daadbb57-a9b9-4cef-bded-1ac2305b55de", "address": "fa:16:3e:37:de:60", "network": {"id": "52ee6623-01e5-491e-ab5e-d1d0511bd15f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-765176125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063dd272226340d49a7ac0756413cadf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaadbb57-a9", "ovs_interfaceid": "daadbb57-a9b9-4cef-bded-1ac2305b55de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:51:54 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Releasing lock "refresh_cache-8ae37bb9-cf4e-46e1-b5e5-81930cdfa824" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:51:54 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Updated the network info_cache for instance {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 21:51:54 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:51:54 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:51:55 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:51:56 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:52:01 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:52:03 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:52:06 user nova-compute[72586]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690926711.7726724, c93ae122-c523-498c-acbc-d2518e228584 => Stopped> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:52:06 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: c93ae122-c523-498c-acbc-d2518e228584] VM Stopped (Lifecycle Event)
Aug 01 21:52:06 user nova-compute[72586]: DEBUG nova.compute.manager [None req-29a6f3f5-c144-4a94-826d-212babbced22 None None] [instance: c93ae122-c523-498c-acbc-d2518e228584] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:52:06 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:52:11 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:52:16 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:52:21 user nova-compute[72586]: DEBUG nova.compute.manager [req-35223694-774d-4493-8a99-8d27fc1b5294 req-6a650030-d83e-40e0-8ec7-4d8d958ba644 service nova] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Received event network-changed-3acb8318-c6b2-4b99-b441-62488967760d {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:52:21 user nova-compute[72586]: DEBUG nova.compute.manager [req-35223694-774d-4493-8a99-8d27fc1b5294 req-6a650030-d83e-40e0-8ec7-4d8d958ba644 service nova] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Refreshing instance network info cache due to event network-changed-3acb8318-c6b2-4b99-b441-62488967760d. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:52:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-35223694-774d-4493-8a99-8d27fc1b5294 req-6a650030-d83e-40e0-8ec7-4d8d958ba644 service nova] Acquiring lock "refresh_cache-d0fa04b2-75e5-4542-9600-7a1517884041" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:52:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-35223694-774d-4493-8a99-8d27fc1b5294 req-6a650030-d83e-40e0-8ec7-4d8d958ba644 service nova] Acquired lock "refresh_cache-d0fa04b2-75e5-4542-9600-7a1517884041" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:52:21 user nova-compute[72586]: DEBUG nova.network.neutron [req-35223694-774d-4493-8a99-8d27fc1b5294 req-6a650030-d83e-40e0-8ec7-4d8d958ba644 service nova] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Refreshing network info cache for port 3acb8318-c6b2-4b99-b441-62488967760d {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:52:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b9b6711e-2f25-4d82-a159-3bd162aed3b8 tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Acquiring lock "d0fa04b2-75e5-4542-9600-7a1517884041" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:52:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b9b6711e-2f25-4d82-a159-3bd162aed3b8 tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Lock "d0fa04b2-75e5-4542-9600-7a1517884041" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:52:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b9b6711e-2f25-4d82-a159-3bd162aed3b8 tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Acquiring lock "d0fa04b2-75e5-4542-9600-7a1517884041-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:52:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b9b6711e-2f25-4d82-a159-3bd162aed3b8 tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Lock "d0fa04b2-75e5-4542-9600-7a1517884041-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:52:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b9b6711e-2f25-4d82-a159-3bd162aed3b8 tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Lock "d0fa04b2-75e5-4542-9600-7a1517884041-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:52:21 user nova-compute[72586]: INFO nova.compute.manager [None req-b9b6711e-2f25-4d82-a159-3bd162aed3b8 tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Terminating instance
Aug 01 21:52:21 user nova-compute[72586]: DEBUG nova.compute.manager [None req-b9b6711e-2f25-4d82-a159-3bd162aed3b8 tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Start destroying the instance on the hypervisor. {{(pid=72586) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 21:52:21 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:52:21 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:52:21 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:52:21 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:52:21 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:52:22 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Instance destroyed successfully.
Aug 01 21:52:22 user nova-compute[72586]: DEBUG nova.objects.instance [None req-b9b6711e-2f25-4d82-a159-3bd162aed3b8 tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Lazy-loading 'resources' on Instance uuid d0fa04b2-75e5-4542-9600-7a1517884041 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:52:22 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-b9b6711e-2f25-4d82-a159-3bd162aed3b8 tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T21:46:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1377950842',display_name='tempest-TestShelveInstance-server-1377950842',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1377950842',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB4GX0o8jqyM0mvDzTq47xn7L41FYkxZaqxMMdhfIoyuA1AuqUIPQwXdQlKJh3CoshNHRfVXo+AB0NJD8DSA6Oz1QmbjVr9ojuL7LK7H9A2TUm7EdlrJztLuFeIP+5Kp8Q==',key_name='tempest-TestShelveInstance-70441469',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:50:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d633939ea5ac494c8668f0e5acaba7f1',ramdisk_id='',reservation_id='r-nmpthpez',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1887634001',owner_user_name='tempest-TestShelveInstance-1887634001-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:50:46Z,user_data=None,user_id='d0e99da03c7045b0bc1213eded097dfe',uuid=d0fa04b2-75e5-4542-9600-7a1517884041,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3acb8318-c6b2-4b99-b441-62488967760d", "address": "fa:16:3e:c4:14:cf", "network": {"id": "e072f7ac-9dd8-4e5c-9de2-5d6ef08c261b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1788451595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d633939ea5ac494c8668f0e5acaba7f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3acb8318-c6", "ovs_interfaceid": "3acb8318-c6b2-4b99-b441-62488967760d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:52:22 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-b9b6711e-2f25-4d82-a159-3bd162aed3b8 tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Converting VIF {"id": "3acb8318-c6b2-4b99-b441-62488967760d", "address": "fa:16:3e:c4:14:cf", "network": {"id": "e072f7ac-9dd8-4e5c-9de2-5d6ef08c261b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1788451595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d633939ea5ac494c8668f0e5acaba7f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3acb8318-c6", "ovs_interfaceid": "3acb8318-c6b2-4b99-b441-62488967760d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:52:22 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-b9b6711e-2f25-4d82-a159-3bd162aed3b8 tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:14:cf,bridge_name='br-int',has_traffic_filtering=True,id=3acb8318-c6b2-4b99-b441-62488967760d,network=Network(e072f7ac-9dd8-4e5c-9de2-5d6ef08c261b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3acb8318-c6') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:52:22 user nova-compute[72586]: DEBUG os_vif [None req-b9b6711e-2f25-4d82-a159-3bd162aed3b8 tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:14:cf,bridge_name='br-int',has_traffic_filtering=True,id=3acb8318-c6b2-4b99-b441-62488967760d,network=Network(e072f7ac-9dd8-4e5c-9de2-5d6ef08c261b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3acb8318-c6') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:52:22 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:52:22 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3acb8318-c6, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:52:22 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:52:22 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:52:22 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:52:22 user nova-compute[72586]: INFO os_vif [None req-b9b6711e-2f25-4d82-a159-3bd162aed3b8 tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:14:cf,bridge_name='br-int',has_traffic_filtering=True,id=3acb8318-c6b2-4b99-b441-62488967760d,network=Network(e072f7ac-9dd8-4e5c-9de2-5d6ef08c261b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3acb8318-c6')
Aug 01 21:52:22 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9b6711e-2f25-4d82-a159-3bd162aed3b8 tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] calling os-brick to detach iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 21:52:22 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b6711e-2f25-4d82-a159-3bd162aed3b8 tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, {'target_iqns': ['iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CBSbrpog', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:52:22 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-b9b6711e-2f25-4d82-a159-3bd162aed3b8 tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:52:22 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-b9b6711e-2f25-4d82-a159-3bd162aed3b8 tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:52:22 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-b9b6711e-2f25-4d82-a159-3bd162aed3b8 tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:52:22 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b6711e-2f25-4d82-a159-3bd162aed3b8 tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6', 0)] {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 21:52:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:52:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:52:22 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d279cf8-7581-4652-9bbb-50411020061b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:52:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:52:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:52:22 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[17abeb0c-793b-4f60-912c-236ae7b9bc32]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:52:22 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b6711e-2f25-4d82-a159-3bd162aed3b8 tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29 (non-flash)
Aug 01 21:52:22 user nova-compute[72586]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 (non-flash)
Aug 01 21:52:22 user nova-compute[72586]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 (non-flash)
Aug 01 21:52:22 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:52:22 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b6711e-2f25-4d82-a159-3bd162aed3b8 tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29 (non-flash)
Aug 01 21:52:22 user nova-compute[72586]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 (non-flash)
Aug 01 21:52:22 user nova-compute[72586]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 (non-flash)
Aug 01 21:52:22 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:52:22 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b6711e-2f25-4d82-a159-3bd162aed3b8 tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ed0140550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6'): ({'sdc'}, set())}) {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 21:52:22 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-b9b6711e-2f25-4d82-a159-3bd162aed3b8 tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Removing single pathed devices sdc {{(pid=72586) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 21:52:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:52:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:52:22 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[247a3e69-249b-4d6e-9e52-abedafdf211c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:52:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:52:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:52:22 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[36733ea6-505d-4e08-a201-e372ccb81798]: (4, ('ok\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:52:22 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-b9b6711e-2f25-4d82-a159-3bd162aed3b8 tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Flushing IO for device /dev/sdc {{(pid=72586) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 21:52:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:52:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:52:22 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[3388140b-40c2-43ad-9134-a76bb51d5949]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:52:22 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-b9b6711e-2f25-4d82-a159-3bd162aed3b8 tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72586) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 21:52:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:52:22 user nova-compute[72586]: DEBUG nova.network.neutron [req-35223694-774d-4493-8a99-8d27fc1b5294 req-6a650030-d83e-40e0-8ec7-4d8d958ba644 service nova] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Updated VIF entry in instance network info cache for port 3acb8318-c6b2-4b99-b441-62488967760d. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:52:22 user nova-compute[72586]: DEBUG nova.network.neutron [req-35223694-774d-4493-8a99-8d27fc1b5294 req-6a650030-d83e-40e0-8ec7-4d8d958ba644 service nova] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Updating instance_info_cache with network_info: [{"id": "3acb8318-c6b2-4b99-b441-62488967760d", "address": "fa:16:3e:c4:14:cf", "network": {"id": "e072f7ac-9dd8-4e5c-9de2-5d6ef08c261b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1788451595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d633939ea5ac494c8668f0e5acaba7f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3acb8318-c6", "ovs_interfaceid": "3acb8318-c6b2-4b99-b441-62488967760d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:52:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-35223694-774d-4493-8a99-8d27fc1b5294 req-6a650030-d83e-40e0-8ec7-4d8d958ba644 service nova] Releasing lock "refresh_cache-d0fa04b2-75e5-4542-9600-7a1517884041" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:52:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:52:22 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[822fc12e-c4b2-43c2-bcdf-738b02df899a]: (4, ('1', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:52:22 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-b9b6711e-2f25-4d82-a159-3bd162aed3b8 tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 21:52:22 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-b9b6711e-2f25-4d82-a159-3bd162aed3b8 tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] SCSI volumes sdc have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 21:52:22 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b6711e-2f25-4d82-a159-3bd162aed3b8 tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6')] {{(pid=72586) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 21:52:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:52:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:52:22 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[addf814f-092c-4ed7-a2c6-8a5e97b7e2d7]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:52:22 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b6711e-2f25-4d82-a159-3bd162aed3b8 tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:52:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 -p 172.16.0.220:3260 --logout {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:52:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:52:22 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f929f0f9-997c-4937-a866-61a94c4b0400]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:52:22 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b6711e-2f25-4d82-a159-3bd162aed3b8 tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6, portal: 172.16.0.220,3260]
Aug 01 21:52:22 user nova-compute[72586]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6, portal: 172.16.0.220,3260] successful.
Aug 01 21:52:22 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:52:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 -p 172.16.0.220:3260 --op delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:52:22 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89992cbb-33b3-4a79-a3b7-534d9854a5a6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:52:22 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3e5c71-e4a3-4d7d-a74a-af169716f763]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:52:22 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b6711e-2f25-4d82-a159-3bd162aed3b8 tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:52:22 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-b9b6711e-2f25-4d82-a159-3bd162aed3b8 tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:52:22 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b6711e-2f25-4d82-a159-3bd162aed3b8 tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] <== disconnect_volume: return (296ms) None {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:52:22 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9b6711e-2f25-4d82-a159-3bd162aed3b8 tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Disconnected iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 21:52:22 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-b9b6711e-2f25-4d82-a159-3bd162aed3b8 tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Deleting instance files /opt/stack/data/nova/instances/d0fa04b2-75e5-4542-9600-7a1517884041_del
Aug 01 21:52:22 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-b9b6711e-2f25-4d82-a159-3bd162aed3b8 tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Deletion of /opt/stack/data/nova/instances/d0fa04b2-75e5-4542-9600-7a1517884041_del complete
Aug 01 21:52:22 user nova-compute[72586]: INFO nova.compute.manager [None req-b9b6711e-2f25-4d82-a159-3bd162aed3b8 tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Took 1.17 seconds to destroy the instance on the hypervisor.
Aug 01 21:52:22 user nova-compute[72586]: DEBUG oslo.service.loopingcall [None req-b9b6711e-2f25-4d82-a159-3bd162aed3b8 tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72586) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 21:52:22 user nova-compute[72586]: DEBUG nova.compute.manager [-] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Deallocating network for instance {{(pid=72586) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 21:52:22 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] deallocate_for_instance() {{(pid=72586) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 21:52:23 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:52:23 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Took 0.48 seconds to deallocate network for instance.
Aug 01 21:52:23 user nova-compute[72586]: DEBUG nova.compute.manager [req-f9062186-0313-4e55-815e-0f35b8b83f4d req-021eff07-aa4d-403b-8773-81304a633947 service nova] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Received event network-vif-deleted-3acb8318-c6b2-4b99-b441-62488967760d {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:52:23 user nova-compute[72586]: DEBUG nova.compute.manager [req-a376399c-1d44-4ed1-a1af-354cf926b2ac req-3289569e-1f2d-4a27-9c6e-efa59a3c0c53 service nova] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Received event network-vif-unplugged-3acb8318-c6b2-4b99-b441-62488967760d {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:52:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-a376399c-1d44-4ed1-a1af-354cf926b2ac req-3289569e-1f2d-4a27-9c6e-efa59a3c0c53 service nova] Acquiring lock "d0fa04b2-75e5-4542-9600-7a1517884041-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:52:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-a376399c-1d44-4ed1-a1af-354cf926b2ac req-3289569e-1f2d-4a27-9c6e-efa59a3c0c53 service nova] Lock "d0fa04b2-75e5-4542-9600-7a1517884041-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:52:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-a376399c-1d44-4ed1-a1af-354cf926b2ac req-3289569e-1f2d-4a27-9c6e-efa59a3c0c53 service nova] Lock "d0fa04b2-75e5-4542-9600-7a1517884041-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:52:23 user nova-compute[72586]: DEBUG nova.compute.manager [req-a376399c-1d44-4ed1-a1af-354cf926b2ac req-3289569e-1f2d-4a27-9c6e-efa59a3c0c53 service nova] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] No waiting events found dispatching network-vif-unplugged-3acb8318-c6b2-4b99-b441-62488967760d {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:52:23 user nova-compute[72586]: DEBUG nova.compute.manager [req-a376399c-1d44-4ed1-a1af-354cf926b2ac req-3289569e-1f2d-4a27-9c6e-efa59a3c0c53 service nova] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Received event network-vif-unplugged-3acb8318-c6b2-4b99-b441-62488967760d for instance with task_state deleting. {{(pid=72586) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 21:52:23 user nova-compute[72586]: DEBUG nova.compute.manager [req-a376399c-1d44-4ed1-a1af-354cf926b2ac req-3289569e-1f2d-4a27-9c6e-efa59a3c0c53 service nova] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Received event network-vif-plugged-3acb8318-c6b2-4b99-b441-62488967760d {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:52:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-a376399c-1d44-4ed1-a1af-354cf926b2ac req-3289569e-1f2d-4a27-9c6e-efa59a3c0c53 service nova] Acquiring lock "d0fa04b2-75e5-4542-9600-7a1517884041-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:52:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-a376399c-1d44-4ed1-a1af-354cf926b2ac req-3289569e-1f2d-4a27-9c6e-efa59a3c0c53 service nova] Lock "d0fa04b2-75e5-4542-9600-7a1517884041-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:52:23 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-a376399c-1d44-4ed1-a1af-354cf926b2ac req-3289569e-1f2d-4a27-9c6e-efa59a3c0c53 service nova] Lock "d0fa04b2-75e5-4542-9600-7a1517884041-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:52:23 user nova-compute[72586]: DEBUG nova.compute.manager [req-a376399c-1d44-4ed1-a1af-354cf926b2ac req-3289569e-1f2d-4a27-9c6e-efa59a3c0c53 service nova] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] No waiting events found dispatching network-vif-plugged-3acb8318-c6b2-4b99-b441-62488967760d {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:52:23 user nova-compute[72586]: WARNING nova.compute.manager [req-a376399c-1d44-4ed1-a1af-354cf926b2ac req-3289569e-1f2d-4a27-9c6e-efa59a3c0c53 service nova] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Received unexpected event network-vif-plugged-3acb8318-c6b2-4b99-b441-62488967760d for instance with vm_state active and task_state deleting.
Aug 01 21:52:24 user nova-compute[72586]: INFO nova.compute.manager [None req-b9b6711e-2f25-4d82-a159-3bd162aed3b8 tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Took 0.72 seconds to detach 1 volumes for instance.
Aug 01 21:52:24 user nova-compute[72586]: DEBUG nova.compute.manager [None req-b9b6711e-2f25-4d82-a159-3bd162aed3b8 tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Deleting volume: 89992cbb-33b3-4a79-a3b7-534d9854a5a6 {{(pid=72586) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 01 21:52:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b9b6711e-2f25-4d82-a159-3bd162aed3b8 tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:52:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b9b6711e-2f25-4d82-a159-3bd162aed3b8 tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:52:24 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-b9b6711e-2f25-4d82-a159-3bd162aed3b8 tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:52:24 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-b9b6711e-2f25-4d82-a159-3bd162aed3b8 tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:52:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b9b6711e-2f25-4d82-a159-3bd162aed3b8 tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.146s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:52:24 user nova-compute[72586]: INFO nova.scheduler.client.report [None req-b9b6711e-2f25-4d82-a159-3bd162aed3b8 tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Deleted allocations for instance d0fa04b2-75e5-4542-9600-7a1517884041
Aug 01 21:52:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b9b6711e-2f25-4d82-a159-3bd162aed3b8 tempest-TestShelveInstance-1887634001 tempest-TestShelveInstance-1887634001-project-member] Lock "d0fa04b2-75e5-4542-9600-7a1517884041" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.737s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:52:25 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:52:27 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:52:32 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:52:37 user nova-compute[72586]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690926742.400357, d0fa04b2-75e5-4542-9600-7a1517884041 => Stopped> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:52:37 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] VM Stopped (Lifecycle Event)
Aug 01 21:52:37 user nova-compute[72586]: DEBUG nova.compute.manager [None req-0176e542-1188-4970-9056-97e9bc27ae2e None None] [instance: d0fa04b2-75e5-4542-9600-7a1517884041] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:52:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:52:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:52:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72586) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 21:52:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72586) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 21:52:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72586) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 21:52:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:52:42 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-e9602b7d-8d4c-4187-8993-2ce95dda03c0 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Acquiring lock "8ae37bb9-cf4e-46e1-b5e5-81930cdfa824" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:52:42 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-e9602b7d-8d4c-4187-8993-2ce95dda03c0 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "8ae37bb9-cf4e-46e1-b5e5-81930cdfa824" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:52:42 user nova-compute[72586]: INFO nova.compute.manager [None req-e9602b7d-8d4c-4187-8993-2ce95dda03c0 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Detaching volume fbf45a4b-e005-42ee-83c8-81e38152df29
Aug 01 21:52:42 user nova-compute[72586]: INFO nova.virt.block_device [None req-e9602b7d-8d4c-4187-8993-2ce95dda03c0 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Attempting to driver detach volume fbf45a4b-e005-42ee-83c8-81e38152df29 from mountpoint /dev/vdb
Aug 01 21:52:42 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-e9602b7d-8d4c-4187-8993-2ce95dda03c0 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Attempting to detach device vdb from instance 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824 from the persistent domain config. {{(pid=72586) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 21:52:42 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-e9602b7d-8d4c-4187-8993-2ce95dda03c0 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 21:52:42 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:52:42 user nova-compute[72586]:   <source dev="/dev/sdb"/>
Aug 01 21:52:42 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:52:42 user nova-compute[72586]:   <serial>fbf45a4b-e005-42ee-83c8-81e38152df29</serial>
Aug 01 21:52:42 user nova-compute[72586]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 21:52:42 user nova-compute[72586]: </disk>
Aug 01 21:52:42 user nova-compute[72586]:  {{(pid=72586) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 21:52:42 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:52:42 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-e9602b7d-8d4c-4187-8993-2ce95dda03c0 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Successfully detached device vdb from instance 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824 from the persistent domain config.
Aug 01 21:52:42 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-e9602b7d-8d4c-4187-8993-2ce95dda03c0 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824 from the live domain config. {{(pid=72586) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 21:52:42 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-e9602b7d-8d4c-4187-8993-2ce95dda03c0 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 21:52:42 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:52:42 user nova-compute[72586]:   <source dev="/dev/sdb"/>
Aug 01 21:52:42 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:52:42 user nova-compute[72586]:   <serial>fbf45a4b-e005-42ee-83c8-81e38152df29</serial>
Aug 01 21:52:42 user nova-compute[72586]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 21:52:42 user nova-compute[72586]: </disk>
Aug 01 21:52:42 user nova-compute[72586]:  {{(pid=72586) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 21:52:42 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Received event <DeviceRemovedEvent: 1690926762.8855004, 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72586) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 21:52:42 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-e9602b7d-8d4c-4187-8993-2ce95dda03c0 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824 {{(pid=72586) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 21:52:42 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:52:42 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-e9602b7d-8d4c-4187-8993-2ce95dda03c0 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Successfully detached device vdb from instance 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824 from the live domain config.
Aug 01 21:52:42 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9602b7d-8d4c-4187-8993-2ce95dda03c0 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] calling os-brick to detach iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 21:52:42 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9602b7d-8d4c-4187-8993-2ce95dda03c0 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, {'target_iqns': ['iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VUiQvMJo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:52:42 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-e9602b7d-8d4c-4187-8993-2ce95dda03c0 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:52:42 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-e9602b7d-8d4c-4187-8993-2ce95dda03c0 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:52:42 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-e9602b7d-8d4c-4187-8993-2ce95dda03c0 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:52:42 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9602b7d-8d4c-4187-8993-2ce95dda03c0 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29', 0)] {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 21:52:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:52:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:52:42 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a4260c-3a0c-4e97-8958-c07e664f1d71]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:52:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:52:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:52:42 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc059a6-2678-42cb-9a4c-21b45f1a21f2]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:52:42 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9602b7d-8d4c-4187-8993-2ce95dda03c0 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29 (non-flash)
Aug 01 21:52:42 user nova-compute[72586]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 (non-flash)
Aug 01 21:52:42 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:52:42 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9602b7d-8d4c-4187-8993-2ce95dda03c0 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29 (non-flash)
Aug 01 21:52:42 user nova-compute[72586]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 (non-flash)
Aug 01 21:52:42 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:52:42 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9602b7d-8d4c-4187-8993-2ce95dda03c0 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4eac76e7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29'): ({'sdb'}, set())}) {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 21:52:42 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-e9602b7d-8d4c-4187-8993-2ce95dda03c0 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Removing single pathed devices sdb {{(pid=72586) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 21:52:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:52:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:52:42 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb84578c-96f1-47ef-a98f-2a362b48081a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:52:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:52:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:52:43 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d24de92-a39f-41bc-9478-d1993d2a0a2d]: (4, ('ok\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:52:43 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-e9602b7d-8d4c-4187-8993-2ce95dda03c0 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Flushing IO for device /dev/sdb {{(pid=72586) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 21:52:43 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:52:43 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:52:43 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b6c7d6-1922-4780-88a2-8d17a0bea88b]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:52:43 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-e9602b7d-8d4c-4187-8993-2ce95dda03c0 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72586) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 21:52:43 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:52:43 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.031s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:52:43 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[54142ff8-0d94-4afe-9a9c-ee343e5e6233]: (4, ('1', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:52:43 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-e9602b7d-8d4c-4187-8993-2ce95dda03c0 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 21:52:43 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-e9602b7d-8d4c-4187-8993-2ce95dda03c0 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] SCSI volumes sdb have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 21:52:43 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9602b7d-8d4c-4187-8993-2ce95dda03c0 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29')] {{(pid=72586) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 21:52:43 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:52:43 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:52:43 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[93495856-28b0-4c72-b829-59083a475a75]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:52:43 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9602b7d-8d4c-4187-8993-2ce95dda03c0 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:52:43 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29 -p 172.16.0.220:3260 --logout {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:52:43 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:52:43 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d84e8e16-6d91-4bc6-b187-2b39c1164c93]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:52:43 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9602b7d-8d4c-4187-8993-2ce95dda03c0 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29, portal: 172.16.0.220,3260]
Aug 01 21:52:43 user nova-compute[72586]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29, portal: 172.16.0.220,3260] successful.
Aug 01 21:52:43 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:52:43 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29 -p 172.16.0.220:3260 --op delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:52:43 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbf45a4b-e005-42ee-83c8-81e38152df29 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:52:43 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[effdfa7a-ac20-40df-b0f1-c956f0a53ac3]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:52:43 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9602b7d-8d4c-4187-8993-2ce95dda03c0 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:52:43 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-e9602b7d-8d4c-4187-8993-2ce95dda03c0 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.264s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:52:43 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9602b7d-8d4c-4187-8993-2ce95dda03c0 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] <== disconnect_volume: return (266ms) None {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:52:43 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9602b7d-8d4c-4187-8993-2ce95dda03c0 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Disconnected iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 21:52:43 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:52:43 user nova-compute[72586]: DEBUG nova.objects.instance [None req-e9602b7d-8d4c-4187-8993-2ce95dda03c0 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lazy-loading 'flavor' on Instance uuid 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:52:43 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-e9602b7d-8d4c-4187-8993-2ce95dda03c0 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "8ae37bb9-cf4e-46e1-b5e5-81930cdfa824" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.578s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:52:44 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:52:44 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:52:44 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:52:44 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72586) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 21:52:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:52:49 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:52:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:52:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:52:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:52:49 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Auditing locally available compute resources for user (node: user) {{(pid=72586) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 21:52:50 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:52:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae37bb9-cf4e-46e1-b5e5-81930cdfa824/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:52:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae37bb9-cf4e-46e1-b5e5-81930cdfa824/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:52:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae37bb9-cf4e-46e1-b5e5-81930cdfa824/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:52:50 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae37bb9-cf4e-46e1-b5e5-81930cdfa824/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:52:50 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:52:50 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:52:50 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Hypervisor/Node resource view: name=user free_ram=8622MB free_disk=25.269062042236328GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72586) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 21:52:50 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:52:50 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:52:50 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:52:50 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 055a4027-b090-43f3-998e-5bd3ba3c0109 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:52:50 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 21:52:50 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 21:52:50 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:52:50 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:52:50 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Compute_service record updated for user:user {{(pid=72586) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 21:52:50 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.231s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:52:52 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:52:54 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:52:54 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Starting heal instance info cache {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 21:52:54 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Didn't find any instances for network info cache update. {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 21:52:54 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:52:54 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:52:56 user nova-compute[72586]: DEBUG nova.compute.manager [req-0b70b845-9d88-4018-a61e-c3164169bca5 req-b6463c6f-c73a-4a2e-931f-9bd18f195fde service nova] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Received event network-changed-65240d77-844f-4d37-9b69-972686cb6c95 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:52:56 user nova-compute[72586]: DEBUG nova.compute.manager [req-0b70b845-9d88-4018-a61e-c3164169bca5 req-b6463c6f-c73a-4a2e-931f-9bd18f195fde service nova] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Refreshing instance network info cache due to event network-changed-65240d77-844f-4d37-9b69-972686cb6c95. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:52:56 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-0b70b845-9d88-4018-a61e-c3164169bca5 req-b6463c6f-c73a-4a2e-931f-9bd18f195fde service nova] Acquiring lock "refresh_cache-055a4027-b090-43f3-998e-5bd3ba3c0109" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:52:56 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-0b70b845-9d88-4018-a61e-c3164169bca5 req-b6463c6f-c73a-4a2e-931f-9bd18f195fde service nova] Acquired lock "refresh_cache-055a4027-b090-43f3-998e-5bd3ba3c0109" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:52:56 user nova-compute[72586]: DEBUG nova.network.neutron [req-0b70b845-9d88-4018-a61e-c3164169bca5 req-b6463c6f-c73a-4a2e-931f-9bd18f195fde service nova] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Refreshing network info cache for port 65240d77-844f-4d37-9b69-972686cb6c95 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:52:57 user nova-compute[72586]: DEBUG nova.network.neutron [req-0b70b845-9d88-4018-a61e-c3164169bca5 req-b6463c6f-c73a-4a2e-931f-9bd18f195fde service nova] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Updated VIF entry in instance network info cache for port 65240d77-844f-4d37-9b69-972686cb6c95. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:52:57 user nova-compute[72586]: DEBUG nova.network.neutron [req-0b70b845-9d88-4018-a61e-c3164169bca5 req-b6463c6f-c73a-4a2e-931f-9bd18f195fde service nova] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Updating instance_info_cache with network_info: [{"id": "65240d77-844f-4d37-9b69-972686cb6c95", "address": "fa:16:3e:b4:82:5a", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65240d77-84", "ovs_interfaceid": "65240d77-844f-4d37-9b69-972686cb6c95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:52:57 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-0b70b845-9d88-4018-a61e-c3164169bca5 req-b6463c6f-c73a-4a2e-931f-9bd18f195fde service nova] Releasing lock "refresh_cache-055a4027-b090-43f3-998e-5bd3ba3c0109" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:52:57 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:52:57 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:52:57 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72586) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 21:52:57 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72586) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 21:52:57 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72586) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 21:52:57 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:53:00 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:53:02 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:53:05 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:53:07 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:53:08 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Acquiring lock "8ca844b8-493a-419d-9754-92c1b3bb373d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:53:08 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "8ca844b8-493a-419d-9754-92c1b3bb373d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:53:08 user nova-compute[72586]: DEBUG nova.compute.manager [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Starting instance... {{(pid=72586) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 21:53:08 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:53:08 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:53:08 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72586) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 21:53:08 user nova-compute[72586]: INFO nova.compute.claims [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Claim successful on node user
Aug 01 21:53:08 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:53:08 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:53:08 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.216s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:53:08 user nova-compute[72586]: DEBUG nova.compute.manager [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Start building networks asynchronously for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 21:53:08 user nova-compute[72586]: DEBUG nova.compute.manager [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Allocating IP information in the background. {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 21:53:08 user nova-compute[72586]: DEBUG nova.network.neutron [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] allocate_for_instance() {{(pid=72586) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 21:53:08 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 21:53:08 user nova-compute[72586]: DEBUG nova.compute.manager [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Start building block device mappings for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 21:53:08 user nova-compute[72586]: INFO nova.virt.block_device [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Booting with volume 45e58aee-03a2-4803-af14-2bc9e523e86c at /dev/vda
Aug 01 21:53:08 user nova-compute[72586]: DEBUG nova.policy [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '76cd0d9d973b410ca4ff08fc7630fbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a631250d39c34afca47a1fa2817e627e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72586) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 21:53:08 user nova-compute[72586]: DEBUG os_brick.utils [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:53:08 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:53:08 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:53:08 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed8de0a-ee99-4169-9a3f-384ba2612ee4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4bc202fb9cb\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:53:08 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:53:08 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:53:08 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[77bc619c-be7a-4563-8add-9d20f785135a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:53:08 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:53:08 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:53:08 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[379f8bea-4c33-451c-bcd1-20b89f4ad5c7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:53:08 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d6336f-a820-40db-aea1-881935897d39]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:53:08 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Running cmd (subprocess): nvme version {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:53:08 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] 'nvme version' failed. Not Retrying. {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:53:08 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] nvme not present on system {{(pid=72586) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 21:53:09 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:53:09 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:53:09 user nova-compute[72586]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 21:53:09 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e937f47e-ffe3-4d39-a0ab-aeec875b4626]: (4, '') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:53:09 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72586) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 21:53:09 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 21:53:09 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] LIGHTOS: no hostnqn found. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 21:53:09 user nova-compute[72586]: DEBUG os_brick.utils [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4bc202fb9cb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:53:09 user nova-compute[72586]: DEBUG nova.virt.block_device [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Updating existing volume attachment record: f7917cf2-1a1c-485e-965d-cc6ff8e1ab34 {{(pid=72586) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 21:53:09 user nova-compute[72586]: DEBUG nova.network.neutron [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Successfully created port: a5d97e66-99cb-4493-a66d-2fa1709d2175 {{(pid=72586) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 21:53:10 user nova-compute[72586]: DEBUG nova.network.neutron [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Successfully updated port: a5d97e66-99cb-4493-a66d-2fa1709d2175 {{(pid=72586) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 21:53:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Acquiring lock "refresh_cache-8ca844b8-493a-419d-9754-92c1b3bb373d" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:53:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Acquired lock "refresh_cache-8ca844b8-493a-419d-9754-92c1b3bb373d" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:53:10 user nova-compute[72586]: DEBUG nova.network.neutron [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:53:10 user nova-compute[72586]: DEBUG nova.compute.manager [req-5a65e5a0-60ed-4813-bb9c-d355bcd9f4a6 req-493944f9-4fec-4f46-b246-9988d62b492e service nova] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Received event network-changed-a5d97e66-99cb-4493-a66d-2fa1709d2175 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:53:10 user nova-compute[72586]: DEBUG nova.compute.manager [req-5a65e5a0-60ed-4813-bb9c-d355bcd9f4a6 req-493944f9-4fec-4f46-b246-9988d62b492e service nova] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Refreshing instance network info cache due to event network-changed-a5d97e66-99cb-4493-a66d-2fa1709d2175. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:53:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-5a65e5a0-60ed-4813-bb9c-d355bcd9f4a6 req-493944f9-4fec-4f46-b246-9988d62b492e service nova] Acquiring lock "refresh_cache-8ca844b8-493a-419d-9754-92c1b3bb373d" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:53:10 user nova-compute[72586]: DEBUG nova.network.neutron [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Instance cache missing network info. {{(pid=72586) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 21:53:10 user nova-compute[72586]: DEBUG nova.network.neutron [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Updating instance_info_cache with network_info: [{"id": "a5d97e66-99cb-4493-a66d-2fa1709d2175", "address": "fa:16:3e:14:9f:cb", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5d97e66-99", "ovs_interfaceid": "a5d97e66-99cb-4493-a66d-2fa1709d2175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:53:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Releasing lock "refresh_cache-8ca844b8-493a-419d-9754-92c1b3bb373d" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:53:10 user nova-compute[72586]: DEBUG nova.compute.manager [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Instance network_info: |[{"id": "a5d97e66-99cb-4493-a66d-2fa1709d2175", "address": "fa:16:3e:14:9f:cb", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5d97e66-99", "ovs_interfaceid": "a5d97e66-99cb-4493-a66d-2fa1709d2175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 21:53:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-5a65e5a0-60ed-4813-bb9c-d355bcd9f4a6 req-493944f9-4fec-4f46-b246-9988d62b492e service nova] Acquired lock "refresh_cache-8ca844b8-493a-419d-9754-92c1b3bb373d" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:53:10 user nova-compute[72586]: DEBUG nova.network.neutron [req-5a65e5a0-60ed-4813-bb9c-d355bcd9f4a6 req-493944f9-4fec-4f46-b246-9988d62b492e service nova] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Refreshing network info cache for port a5d97e66-99cb-4493-a66d-2fa1709d2175 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:53:11 user nova-compute[72586]: DEBUG nova.network.neutron [req-5a65e5a0-60ed-4813-bb9c-d355bcd9f4a6 req-493944f9-4fec-4f46-b246-9988d62b492e service nova] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Updated VIF entry in instance network info cache for port a5d97e66-99cb-4493-a66d-2fa1709d2175. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:53:11 user nova-compute[72586]: DEBUG nova.network.neutron [req-5a65e5a0-60ed-4813-bb9c-d355bcd9f4a6 req-493944f9-4fec-4f46-b246-9988d62b492e service nova] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Updating instance_info_cache with network_info: [{"id": "a5d97e66-99cb-4493-a66d-2fa1709d2175", "address": "fa:16:3e:14:9f:cb", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5d97e66-99", "ovs_interfaceid": "a5d97e66-99cb-4493-a66d-2fa1709d2175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:53:11 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-5a65e5a0-60ed-4813-bb9c-d355bcd9f4a6 req-493944f9-4fec-4f46-b246-9988d62b492e service nova] Releasing lock "refresh_cache-8ca844b8-493a-419d-9754-92c1b3bb373d" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:53:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:53:14 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:53:15 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:53:15 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG nova.compute.manager [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Start spawning the instance on the hypervisor. {{(pid=72586) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Creating instance directory {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 21:53:16 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Creating image(s)
Aug 01 21:53:16 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Did not create local disks {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Ensure instance console log exists: /opt/stack/data/nova/instances/8ca844b8-493a-419d-9754-92c1b3bb373d/console.log {{(pid=72586) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Start _get_guest_xml network_info=[{"id": "a5d97e66-99cb-4493-a66d-2fa1709d2175", "address": "fa:16:3e:14:9f:cb", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5d97e66-99", "ovs_interfaceid": "a5d97e66-99cb-4493-a66d-2fa1709d2175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:45e58aee-03a2-4803-af14-2bc9e523e86c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hQRyviYV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8ca844b8-493a-419d-9754-92c1b3bb373d', 'attached_at': '', 'detached_at': '', 'volume_id': '45e58aee-03a2-4803-af14-2bc9e523e86c', 'serial': '45e58aee-03a2-4803-af14-2bc9e523e86c'}, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'f7917cf2-1a1c-485e-965d-cc6ff8e1ab34', 'delete_on_termination': False, 'volume_type': None} {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:53:16 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:53:16 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:53:16 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Calling os-brick to attach iSCSI Volume {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:45e58aee-03a2-4803-af14-2bc9e523e86c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hQRyviYV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:53:16 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:53:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:53:16 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:53:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45e58aee-03a2-4803-af14-2bc9e523e86c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45e58aee-03a2-4803-af14-2bc9e523e86c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:53:16 user nova-compute[72586]: INFO os_brick.initiator.connectors.iscsi [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 21:53:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e58aee-03a2-4803-af14-2bc9e523e86c -p 172.16.0.220:3260 {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e58aee-03a2-4803-af14-2bc9e523e86c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb465bfa-1992-4ccd-b48f-c16d0b3c9d3b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 21:53:16 user nova-compute[72586]:  {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e58aee-03a2-4803-af14-2bc9e523e86c -p 172.16.0.220:3260 --interface default --op new {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e58aee-03a2-4803-af14-2bc9e523e86c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab7c13b-485a-43d4-a9b8-3230b9803314]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45e58aee-03a2-4803-af14-2bc9e523e86c] added\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45e58aee-03a2-4803-af14-2bc9e523e86c] added
Aug 01 21:53:16 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e58aee-03a2-4803-af14-2bc9e523e86c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e58aee-03a2-4803-af14-2bc9e523e86c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22ebb2f-1b3f-4a6e-8f33-028cf944d89b]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e58aee-03a2-4803-af14-2bc9e523e86c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e58aee-03a2-4803-af14-2bc9e523e86c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[a941bb49-ff28-4937-8345-abc23aaa5e2b]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e58aee-03a2-4803-af14-2bc9e523e86c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hQRyviYV {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e58aee-03a2-4803-af14-2bc9e523e86c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hQRyviYV" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f820f7-b93a-4729-b0ea-24e0f8ee92c0]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hQRyviYV'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e58aee-03a2-4803-af14-2bc9e523e86c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e58aee-03a2-4803-af14-2bc9e523e86c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f6f645-383e-44c9-9fbc-2977ba98090a]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76b1ac5-c385-4f77-bc2b-3b60b5c3a49d]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 (non-flash)
Aug 01 21:53:16 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 (non-flash)
Aug 01 21:53:16 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e58aee-03a2-4803-af14-2bc9e523e86c -p 172.16.0.220:3260 --login {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e58aee-03a2-4803-af14-2bc9e523e86c -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c5adb8-6a8d-4c02-bcad-fd39716e2d11]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:45e58aee-03a2-4803-af14-2bc9e523e86c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:45e58aee-03a2-4803-af14-2bc9e523e86c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:45e58aee-03a2-4803-af14-2bc9e523e86c, portal: 172.16.0.220,3260]
Aug 01 21:53:16 user nova-compute[72586]: Login to [iface: default, target: iqn.2010-10.org.openstack:45e58aee-03a2-4803-af14-2bc9e523e86c, portal: 172.16.0.220,3260] successful.
Aug 01 21:53:16 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e58aee-03a2-4803-af14-2bc9e523e86c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e58aee-03a2-4803-af14-2bc9e523e86c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0c8ff4-30f7-4858-8830-f9e0cdf1da70]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[862778a2-8f38-4af1-9332-dc0d7dcd5d5a]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e58aee-03a2-4803-af14-2bc9e523e86c (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 (non-flash)
Aug 01 21:53:16 user nova-compute[72586]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e58aee-03a2-4803-af14-2bc9e523e86c (non-flash)
Aug 01 21:53:16 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 (non-flash)
Aug 01 21:53:16 user nova-compute[72586]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e58aee-03a2-4803-af14-2bc9e523e86c (non-flash)
Aug 01 21:53:16 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45e58aee-03a2-4803-af14-2bc9e523e86c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Connected to 172.16.0.220:3260 {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=72586) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72586) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff9ed8e-85c7-40e8-a5b2-1fe994515ed7]: (4, ('- - 0', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:53:16 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: None {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:53:17 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:53:17 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:53:17 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hQRyviYV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 21:53:17 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:53:17 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '23632393665663538', 'path': '/dev/sdb'} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:53:17 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23632393665663538', 'path': '/dev/sdb'} {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 21:53:18 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:53:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-108128777',display_name='tempest-TestVolumeBootPattern-server-108128777',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-108128777',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHNJjSduTMasTSgviwHre/FYLh+Mp4kuIJ4iuAJ7FsI2FanPe3E7nT7btn/7CziUSz0I1qByH5+ECZVnIY2RecZsBlCuwfU8kwCbqZrJSP50B9MRG5Gjmo9qdN10n6adqA==',key_name='tempest-TestVolumeBootPattern-705389702',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a631250d39c34afca47a1fa2817e627e',ramdisk_id='',reservation_id='r-gt8rx9pd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1160754716',owner_user_name='tempest-TestVolumeBootPattern-1160754716-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:53:09Z,user_data=None,user_id='76cd0d9d973b410ca4ff08fc7630fbc6',uuid=8ca844b8-493a-419d-9754-92c1b3bb373d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5d97e66-99cb-4493-a66d-2fa1709d2175", "address": "fa:16:3e:14:9f:cb", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5d97e66-99", "ovs_interfaceid": "a5d97e66-99cb-4493-a66d-2fa1709d2175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:53:18 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Converting VIF {"id": "a5d97e66-99cb-4493-a66d-2fa1709d2175", "address": "fa:16:3e:14:9f:cb", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5d97e66-99", "ovs_interfaceid": "a5d97e66-99cb-4493-a66d-2fa1709d2175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:53:18 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:9f:cb,bridge_name='br-int',has_traffic_filtering=True,id=a5d97e66-99cb-4493-a66d-2fa1709d2175,network=Network(2fbf5ffb-0ec0-403b-bc92-259563ab1d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5d97e66-99') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:53:18 user nova-compute[72586]: DEBUG nova.objects.instance [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lazy-loading 'pci_devices' on Instance uuid 8ca844b8-493a-419d-9754-92c1b3bb373d {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:53:18 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:53:18 user nova-compute[72586]:   <uuid>8ca844b8-493a-419d-9754-92c1b3bb373d</uuid>
Aug 01 21:53:18 user nova-compute[72586]:   <name>instance-0000002f</name>
Aug 01 21:53:18 user nova-compute[72586]:   <memory>524288</memory>
Aug 01 21:53:18 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:53:18 user nova-compute[72586]:   <metadata>
Aug 01 21:53:18 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:53:18 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:53:18 user nova-compute[72586]:       <nova:name>tempest-TestVolumeBootPattern-server-108128777</nova:name>
Aug 01 21:53:18 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:53:16</nova:creationTime>
Aug 01 21:53:18 user nova-compute[72586]:       <nova:flavor name="m1.tiny">
Aug 01 21:53:18 user nova-compute[72586]:         <nova:memory>512</nova:memory>
Aug 01 21:53:18 user nova-compute[72586]:         <nova:disk>1</nova:disk>
Aug 01 21:53:18 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:53:18 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:53:18 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:53:18 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:53:18 user nova-compute[72586]:       <nova:owner>
Aug 01 21:53:18 user nova-compute[72586]:         <nova:user uuid="76cd0d9d973b410ca4ff08fc7630fbc6">tempest-TestVolumeBootPattern-1160754716-project-member</nova:user>
Aug 01 21:53:18 user nova-compute[72586]:         <nova:project uuid="a631250d39c34afca47a1fa2817e627e">tempest-TestVolumeBootPattern-1160754716</nova:project>
Aug 01 21:53:18 user nova-compute[72586]:       </nova:owner>
Aug 01 21:53:18 user nova-compute[72586]:       <nova:ports>
Aug 01 21:53:18 user nova-compute[72586]:         <nova:port uuid="a5d97e66-99cb-4493-a66d-2fa1709d2175">
Aug 01 21:53:18 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 01 21:53:18 user nova-compute[72586]:         </nova:port>
Aug 01 21:53:18 user nova-compute[72586]:       </nova:ports>
Aug 01 21:53:18 user nova-compute[72586]:     </nova:instance>
Aug 01 21:53:18 user nova-compute[72586]:   </metadata>
Aug 01 21:53:18 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:53:18 user nova-compute[72586]:     <system>
Aug 01 21:53:18 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:53:18 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:53:18 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:53:18 user nova-compute[72586]:       <entry name="serial">8ca844b8-493a-419d-9754-92c1b3bb373d</entry>
Aug 01 21:53:18 user nova-compute[72586]:       <entry name="uuid">8ca844b8-493a-419d-9754-92c1b3bb373d</entry>
Aug 01 21:53:18 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:53:18 user nova-compute[72586]:     </system>
Aug 01 21:53:18 user nova-compute[72586]:   </sysinfo>
Aug 01 21:53:18 user nova-compute[72586]:   <os>
Aug 01 21:53:18 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:53:18 user nova-compute[72586]:     <boot dev="hd"/>
Aug 01 21:53:18 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:53:18 user nova-compute[72586]:   </os>
Aug 01 21:53:18 user nova-compute[72586]:   <features>
Aug 01 21:53:18 user nova-compute[72586]:     <acpi/>
Aug 01 21:53:18 user nova-compute[72586]:     <apic/>
Aug 01 21:53:18 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:53:18 user nova-compute[72586]:   </features>
Aug 01 21:53:18 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:53:18 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:53:18 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:53:18 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:53:18 user nova-compute[72586]:   </clock>
Aug 01 21:53:18 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:53:18 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:53:18 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:53:18 user nova-compute[72586]:   </cpu>
Aug 01 21:53:18 user nova-compute[72586]:   <devices>
Aug 01 21:53:18 user nova-compute[72586]:     <disk type="block" device="disk">
Aug 01 21:53:18 user nova-compute[72586]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:53:18 user nova-compute[72586]:       <source dev="/dev/sdb"/>
Aug 01 21:53:18 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:53:18 user nova-compute[72586]:       <serial>45e58aee-03a2-4803-af14-2bc9e523e86c</serial>
Aug 01 21:53:18 user nova-compute[72586]:     </disk>
Aug 01 21:53:18 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:53:18 user nova-compute[72586]:       <mac address="fa:16:3e:14:9f:cb"/>
Aug 01 21:53:18 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:53:18 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:53:18 user nova-compute[72586]:       <target dev="tapa5d97e66-99"/>
Aug 01 21:53:18 user nova-compute[72586]:     </interface>
Aug 01 21:53:18 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:53:18 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/8ca844b8-493a-419d-9754-92c1b3bb373d/console.log" append="off"/>
Aug 01 21:53:18 user nova-compute[72586]:     </serial>
Aug 01 21:53:18 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:53:18 user nova-compute[72586]:     <video>
Aug 01 21:53:18 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:53:18 user nova-compute[72586]:     </video>
Aug 01 21:53:18 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:53:18 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:53:18 user nova-compute[72586]:     </rng>
Aug 01 21:53:18 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:53:18 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:53:18 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:53:18 user nova-compute[72586]:     </memballoon>
Aug 01 21:53:18 user nova-compute[72586]:   </devices>
Aug 01 21:53:18 user nova-compute[72586]: </domain>
Aug 01 21:53:18 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:53:18 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:53:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-108128777',display_name='tempest-TestVolumeBootPattern-server-108128777',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-108128777',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHNJjSduTMasTSgviwHre/FYLh+Mp4kuIJ4iuAJ7FsI2FanPe3E7nT7btn/7CziUSz0I1qByH5+ECZVnIY2RecZsBlCuwfU8kwCbqZrJSP50B9MRG5Gjmo9qdN10n6adqA==',key_name='tempest-TestVolumeBootPattern-705389702',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a631250d39c34afca47a1fa2817e627e',ramdisk_id='',reservation_id='r-gt8rx9pd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1160754716',owner_user_name='tempest-TestVolumeBootPattern-1160754716-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:53:09Z,user_data=None,user_id='76cd0d9d973b410ca4ff08fc7630fbc6',uuid=8ca844b8-493a-419d-9754-92c1b3bb373d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5d97e66-99cb-4493-a66d-2fa1709d2175", "address": "fa:16:3e:14:9f:cb", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5d97e66-99", "ovs_interfaceid": "a5d97e66-99cb-4493-a66d-2fa1709d2175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:53:18 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Converting VIF {"id": "a5d97e66-99cb-4493-a66d-2fa1709d2175", "address": "fa:16:3e:14:9f:cb", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5d97e66-99", "ovs_interfaceid": "a5d97e66-99cb-4493-a66d-2fa1709d2175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:53:18 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:9f:cb,bridge_name='br-int',has_traffic_filtering=True,id=a5d97e66-99cb-4493-a66d-2fa1709d2175,network=Network(2fbf5ffb-0ec0-403b-bc92-259563ab1d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5d97e66-99') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:53:18 user nova-compute[72586]: DEBUG os_vif [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:9f:cb,bridge_name='br-int',has_traffic_filtering=True,id=a5d97e66-99cb-4493-a66d-2fa1709d2175,network=Network(2fbf5ffb-0ec0-403b-bc92-259563ab1d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5d97e66-99') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:53:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:53:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:53:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:53:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:53:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa5d97e66-99, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:53:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa5d97e66-99, col_values=(('external_ids', {'iface-id': 'a5d97e66-99cb-4493-a66d-2fa1709d2175', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:9f:cb', 'vm-uuid': '8ca844b8-493a-419d-9754-92c1b3bb373d'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:53:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:53:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:53:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:53:18 user nova-compute[72586]: INFO os_vif [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:9f:cb,bridge_name='br-int',has_traffic_filtering=True,id=a5d97e66-99cb-4493-a66d-2fa1709d2175,network=Network(2fbf5ffb-0ec0-403b-bc92-259563ab1d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5d97e66-99')
Aug 01 21:53:18 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:53:18 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] No VIF found with MAC fa:16:3e:14:9f:cb, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:53:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:53:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:53:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:53:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:53:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:53:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:53:19 user nova-compute[72586]: DEBUG nova.compute.manager [req-4ddb7667-08f8-485e-a2e6-bf79cb6af3f4 req-7c64a4f1-f9fb-491b-9832-a7cee03ee1b9 service nova] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Received event network-vif-plugged-a5d97e66-99cb-4493-a66d-2fa1709d2175 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:53:20 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-4ddb7667-08f8-485e-a2e6-bf79cb6af3f4 req-7c64a4f1-f9fb-491b-9832-a7cee03ee1b9 service nova] Acquiring lock "8ca844b8-493a-419d-9754-92c1b3bb373d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:53:20 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-4ddb7667-08f8-485e-a2e6-bf79cb6af3f4 req-7c64a4f1-f9fb-491b-9832-a7cee03ee1b9 service nova] Lock "8ca844b8-493a-419d-9754-92c1b3bb373d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:53:20 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-4ddb7667-08f8-485e-a2e6-bf79cb6af3f4 req-7c64a4f1-f9fb-491b-9832-a7cee03ee1b9 service nova] Lock "8ca844b8-493a-419d-9754-92c1b3bb373d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:53:20 user nova-compute[72586]: DEBUG nova.compute.manager [req-4ddb7667-08f8-485e-a2e6-bf79cb6af3f4 req-7c64a4f1-f9fb-491b-9832-a7cee03ee1b9 service nova] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] No waiting events found dispatching network-vif-plugged-a5d97e66-99cb-4493-a66d-2fa1709d2175 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:53:20 user nova-compute[72586]: WARNING nova.compute.manager [req-4ddb7667-08f8-485e-a2e6-bf79cb6af3f4 req-7c64a4f1-f9fb-491b-9832-a7cee03ee1b9 service nova] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Received unexpected event network-vif-plugged-a5d97e66-99cb-4493-a66d-2fa1709d2175 for instance with vm_state building and task_state spawning.
Aug 01 21:53:20 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:53:21 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690926801.5442162, 8ca844b8-493a-419d-9754-92c1b3bb373d => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:53:21 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] VM Resumed (Lifecycle Event)
Aug 01 21:53:21 user nova-compute[72586]: DEBUG nova.compute.manager [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Instance event wait completed in 0 seconds for  {{(pid=72586) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 21:53:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Guest created on hypervisor {{(pid=72586) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 21:53:21 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Instance spawned successfully.
Aug 01 21:53:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 21:53:21 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:53:21 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:53:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Found default for hw_cdrom_bus of ide {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:53:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Found default for hw_disk_bus of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:53:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Found default for hw_input_bus of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:53:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Found default for hw_pointer_model of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:53:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Found default for hw_video_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:53:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Found default for hw_vif_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:53:21 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:53:21 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690926801.5459669, 8ca844b8-493a-419d-9754-92c1b3bb373d => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:53:21 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] VM Started (Lifecycle Event)
Aug 01 21:53:21 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:53:21 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:53:21 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:53:21 user nova-compute[72586]: INFO nova.compute.manager [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Took 5.06 seconds to spawn the instance on the hypervisor.
Aug 01 21:53:21 user nova-compute[72586]: DEBUG nova.compute.manager [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:53:21 user nova-compute[72586]: INFO nova.compute.manager [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Took 13.36 seconds to build instance.
Aug 01 21:53:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-8f1544af-03d4-41b8-aee0-0acbbce0fd5b tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "8ca844b8-493a-419d-9754-92c1b3bb373d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.458s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:53:22 user nova-compute[72586]: DEBUG nova.compute.manager [req-846ff1b7-dada-4d3c-b9ad-1007c1be8872 req-4f39a051-3b1d-4777-ad89-bc104bb03687 service nova] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Received event network-vif-plugged-a5d97e66-99cb-4493-a66d-2fa1709d2175 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:53:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-846ff1b7-dada-4d3c-b9ad-1007c1be8872 req-4f39a051-3b1d-4777-ad89-bc104bb03687 service nova] Acquiring lock "8ca844b8-493a-419d-9754-92c1b3bb373d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:53:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-846ff1b7-dada-4d3c-b9ad-1007c1be8872 req-4f39a051-3b1d-4777-ad89-bc104bb03687 service nova] Lock "8ca844b8-493a-419d-9754-92c1b3bb373d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:53:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-846ff1b7-dada-4d3c-b9ad-1007c1be8872 req-4f39a051-3b1d-4777-ad89-bc104bb03687 service nova] Lock "8ca844b8-493a-419d-9754-92c1b3bb373d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:53:22 user nova-compute[72586]: DEBUG nova.compute.manager [req-846ff1b7-dada-4d3c-b9ad-1007c1be8872 req-4f39a051-3b1d-4777-ad89-bc104bb03687 service nova] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] No waiting events found dispatching network-vif-plugged-a5d97e66-99cb-4493-a66d-2fa1709d2175 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:53:22 user nova-compute[72586]: WARNING nova.compute.manager [req-846ff1b7-dada-4d3c-b9ad-1007c1be8872 req-4f39a051-3b1d-4777-ad89-bc104bb03687 service nova] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Received unexpected event network-vif-plugged-a5d97e66-99cb-4493-a66d-2fa1709d2175 for instance with vm_state active and task_state None.
Aug 01 21:53:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:53:24 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:53:27 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:53:28 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:53:30 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:53:30 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:53:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0aad9b1e-9b38-4da8-ace2-e2df73dc7d92 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Acquiring lock "8ae37bb9-cf4e-46e1-b5e5-81930cdfa824" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:53:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0aad9b1e-9b38-4da8-ace2-e2df73dc7d92 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "8ae37bb9-cf4e-46e1-b5e5-81930cdfa824" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:53:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0aad9b1e-9b38-4da8-ace2-e2df73dc7d92 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Acquiring lock "8ae37bb9-cf4e-46e1-b5e5-81930cdfa824-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:53:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0aad9b1e-9b38-4da8-ace2-e2df73dc7d92 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "8ae37bb9-cf4e-46e1-b5e5-81930cdfa824-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:53:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0aad9b1e-9b38-4da8-ace2-e2df73dc7d92 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "8ae37bb9-cf4e-46e1-b5e5-81930cdfa824-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:53:32 user nova-compute[72586]: INFO nova.compute.manager [None req-0aad9b1e-9b38-4da8-ace2-e2df73dc7d92 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Terminating instance
Aug 01 21:53:32 user nova-compute[72586]: DEBUG nova.compute.manager [None req-0aad9b1e-9b38-4da8-ace2-e2df73dc7d92 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Start destroying the instance on the hypervisor. {{(pid=72586) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 21:53:33 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:53:33 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:53:33 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:53:33 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:53:33 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:53:33 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:53:33 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:53:33 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Instance destroyed successfully.
Aug 01 21:53:33 user nova-compute[72586]: DEBUG nova.objects.instance [None req-0aad9b1e-9b38-4da8-ace2-e2df73dc7d92 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lazy-loading 'resources' on Instance uuid 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:53:33 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-0aad9b1e-9b38-4da8-ace2-e2df73dc7d92 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:47:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1992943926',display_name='tempest-AttachVolumeNegativeTest-server-1992943926',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1992943926',id=43,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCSaCiQ+befkc2a/bfDu4liiF7A3SI4dSfyPTltopt5Q+9MokWzu2UdXxWqI6ihMLr6fQh5czcJ/Lq7wAuTOhLkRvpFYhO+lnr5FNMz2ZOPuFOZvASM7ur1MoIoZyLOlQg==',key_name='tempest-keypair-2009438128',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:47:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='063dd272226340d49a7ac0756413cadf',ramdisk_id='',reservation_id='r-dpn6dzrz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-717043369',owner_user_name='tempest-AttachVolumeNegativeTest-717043369-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:47:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37663bab7d31400c8399451058bd5936',uuid=8ae37bb9-cf4e-46e1-b5e5-81930cdfa824,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "daadbb57-a9b9-4cef-bded-1ac2305b55de", "address": "fa:16:3e:37:de:60", "network": {"id": "52ee6623-01e5-491e-ab5e-d1d0511bd15f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-765176125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063dd272226340d49a7ac0756413cadf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaadbb57-a9", "ovs_interfaceid": "daadbb57-a9b9-4cef-bded-1ac2305b55de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:53:33 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-0aad9b1e-9b38-4da8-ace2-e2df73dc7d92 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Converting VIF {"id": "daadbb57-a9b9-4cef-bded-1ac2305b55de", "address": "fa:16:3e:37:de:60", "network": {"id": "52ee6623-01e5-491e-ab5e-d1d0511bd15f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-765176125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063dd272226340d49a7ac0756413cadf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaadbb57-a9", "ovs_interfaceid": "daadbb57-a9b9-4cef-bded-1ac2305b55de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:53:33 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-0aad9b1e-9b38-4da8-ace2-e2df73dc7d92 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:37:de:60,bridge_name='br-int',has_traffic_filtering=True,id=daadbb57-a9b9-4cef-bded-1ac2305b55de,network=Network(52ee6623-01e5-491e-ab5e-d1d0511bd15f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaadbb57-a9') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:53:33 user nova-compute[72586]: DEBUG os_vif [None req-0aad9b1e-9b38-4da8-ace2-e2df73dc7d92 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:de:60,bridge_name='br-int',has_traffic_filtering=True,id=daadbb57-a9b9-4cef-bded-1ac2305b55de,network=Network(52ee6623-01e5-491e-ab5e-d1d0511bd15f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaadbb57-a9') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:53:33 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:53:33 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdaadbb57-a9, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:53:33 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:53:33 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:53:33 user nova-compute[72586]: INFO os_vif [None req-0aad9b1e-9b38-4da8-ace2-e2df73dc7d92 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:de:60,bridge_name='br-int',has_traffic_filtering=True,id=daadbb57-a9b9-4cef-bded-1ac2305b55de,network=Network(52ee6623-01e5-491e-ab5e-d1d0511bd15f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaadbb57-a9')
Aug 01 21:53:33 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-0aad9b1e-9b38-4da8-ace2-e2df73dc7d92 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Deleting instance files /opt/stack/data/nova/instances/8ae37bb9-cf4e-46e1-b5e5-81930cdfa824_del
Aug 01 21:53:33 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-0aad9b1e-9b38-4da8-ace2-e2df73dc7d92 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Deletion of /opt/stack/data/nova/instances/8ae37bb9-cf4e-46e1-b5e5-81930cdfa824_del complete
Aug 01 21:53:33 user nova-compute[72586]: INFO nova.compute.manager [None req-0aad9b1e-9b38-4da8-ace2-e2df73dc7d92 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 01 21:53:33 user nova-compute[72586]: DEBUG oslo.service.loopingcall [None req-0aad9b1e-9b38-4da8-ace2-e2df73dc7d92 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72586) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 21:53:33 user nova-compute[72586]: DEBUG nova.compute.manager [-] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Deallocating network for instance {{(pid=72586) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 21:53:33 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] deallocate_for_instance() {{(pid=72586) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 21:53:33 user nova-compute[72586]: DEBUG nova.compute.manager [req-ccf9346a-97b8-45d4-a0ea-3970bc07355a req-9d5b3e3f-1891-4772-a3c5-bcc3a372b968 service nova] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Received event network-vif-unplugged-daadbb57-a9b9-4cef-bded-1ac2305b55de {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:53:33 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ccf9346a-97b8-45d4-a0ea-3970bc07355a req-9d5b3e3f-1891-4772-a3c5-bcc3a372b968 service nova] Acquiring lock "8ae37bb9-cf4e-46e1-b5e5-81930cdfa824-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:53:33 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ccf9346a-97b8-45d4-a0ea-3970bc07355a req-9d5b3e3f-1891-4772-a3c5-bcc3a372b968 service nova] Lock "8ae37bb9-cf4e-46e1-b5e5-81930cdfa824-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:53:33 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ccf9346a-97b8-45d4-a0ea-3970bc07355a req-9d5b3e3f-1891-4772-a3c5-bcc3a372b968 service nova] Lock "8ae37bb9-cf4e-46e1-b5e5-81930cdfa824-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:53:33 user nova-compute[72586]: DEBUG nova.compute.manager [req-ccf9346a-97b8-45d4-a0ea-3970bc07355a req-9d5b3e3f-1891-4772-a3c5-bcc3a372b968 service nova] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] No waiting events found dispatching network-vif-unplugged-daadbb57-a9b9-4cef-bded-1ac2305b55de {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:53:33 user nova-compute[72586]: DEBUG nova.compute.manager [req-ccf9346a-97b8-45d4-a0ea-3970bc07355a req-9d5b3e3f-1891-4772-a3c5-bcc3a372b968 service nova] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Received event network-vif-unplugged-daadbb57-a9b9-4cef-bded-1ac2305b55de for instance with task_state deleting. {{(pid=72586) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 21:53:34 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:53:34 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Took 1.17 seconds to deallocate network for instance.
Aug 01 21:53:34 user nova-compute[72586]: DEBUG nova.compute.manager [req-69f1c273-ca0e-4c4b-9849-2aa2010ecc34 req-40a29516-e181-467b-9c56-e4db9b07a119 service nova] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Received event network-vif-deleted-daadbb57-a9b9-4cef-bded-1ac2305b55de {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:53:34 user nova-compute[72586]: INFO nova.compute.manager [req-69f1c273-ca0e-4c4b-9849-2aa2010ecc34 req-40a29516-e181-467b-9c56-e4db9b07a119 service nova] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Neutron deleted interface daadbb57-a9b9-4cef-bded-1ac2305b55de; detaching it from the instance and deleting it from the info cache
Aug 01 21:53:34 user nova-compute[72586]: DEBUG nova.network.neutron [req-69f1c273-ca0e-4c4b-9849-2aa2010ecc34 req-40a29516-e181-467b-9c56-e4db9b07a119 service nova] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:53:35 user nova-compute[72586]: DEBUG nova.compute.manager [req-69f1c273-ca0e-4c4b-9849-2aa2010ecc34 req-40a29516-e181-467b-9c56-e4db9b07a119 service nova] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Detach interface failed, port_id=daadbb57-a9b9-4cef-bded-1ac2305b55de, reason: Instance 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824 could not be found. {{(pid=72586) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 21:53:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0aad9b1e-9b38-4da8-ace2-e2df73dc7d92 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:53:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0aad9b1e-9b38-4da8-ace2-e2df73dc7d92 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:53:35 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-0aad9b1e-9b38-4da8-ace2-e2df73dc7d92 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:53:35 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-0aad9b1e-9b38-4da8-ace2-e2df73dc7d92 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:53:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0aad9b1e-9b38-4da8-ace2-e2df73dc7d92 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.159s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:53:35 user nova-compute[72586]: INFO nova.scheduler.client.report [None req-0aad9b1e-9b38-4da8-ace2-e2df73dc7d92 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Deleted allocations for instance 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824
Aug 01 21:53:35 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:53:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0aad9b1e-9b38-4da8-ace2-e2df73dc7d92 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "8ae37bb9-cf4e-46e1-b5e5-81930cdfa824" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.398s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:53:35 user nova-compute[72586]: DEBUG nova.compute.manager [req-051774b3-5cc5-4759-9b6c-5c70e5e5478b req-454854f1-e618-4b9e-830c-b73a1c0c22e6 service nova] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Received event network-vif-plugged-daadbb57-a9b9-4cef-bded-1ac2305b55de {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:53:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-051774b3-5cc5-4759-9b6c-5c70e5e5478b req-454854f1-e618-4b9e-830c-b73a1c0c22e6 service nova] Acquiring lock "8ae37bb9-cf4e-46e1-b5e5-81930cdfa824-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:53:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-051774b3-5cc5-4759-9b6c-5c70e5e5478b req-454854f1-e618-4b9e-830c-b73a1c0c22e6 service nova] Lock "8ae37bb9-cf4e-46e1-b5e5-81930cdfa824-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:53:35 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-051774b3-5cc5-4759-9b6c-5c70e5e5478b req-454854f1-e618-4b9e-830c-b73a1c0c22e6 service nova] Lock "8ae37bb9-cf4e-46e1-b5e5-81930cdfa824-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:53:35 user nova-compute[72586]: DEBUG nova.compute.manager [req-051774b3-5cc5-4759-9b6c-5c70e5e5478b req-454854f1-e618-4b9e-830c-b73a1c0c22e6 service nova] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] No waiting events found dispatching network-vif-plugged-daadbb57-a9b9-4cef-bded-1ac2305b55de {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:53:35 user nova-compute[72586]: WARNING nova.compute.manager [req-051774b3-5cc5-4759-9b6c-5c70e5e5478b req-454854f1-e618-4b9e-830c-b73a1c0c22e6 service nova] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Received unexpected event network-vif-plugged-daadbb57-a9b9-4cef-bded-1ac2305b55de for instance with vm_state deleted and task_state None.
Aug 01 21:53:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Acquiring lock "ec73ec4b-4591-46f2-9192-7868125c53c5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:53:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lock "ec73ec4b-4591-46f2-9192-7868125c53c5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:53:37 user nova-compute[72586]: DEBUG nova.compute.manager [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Starting instance... {{(pid=72586) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 21:53:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:53:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:53:37 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72586) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 21:53:37 user nova-compute[72586]: INFO nova.compute.claims [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Claim successful on node user
Aug 01 21:53:37 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:53:37 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:53:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.251s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:53:37 user nova-compute[72586]: DEBUG nova.compute.manager [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Start building networks asynchronously for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 21:53:37 user nova-compute[72586]: DEBUG nova.compute.manager [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Allocating IP information in the background. {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 21:53:37 user nova-compute[72586]: DEBUG nova.network.neutron [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] allocate_for_instance() {{(pid=72586) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 21:53:37 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 21:53:37 user nova-compute[72586]: DEBUG nova.compute.manager [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Start building block device mappings for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 21:53:37 user nova-compute[72586]: DEBUG nova.policy [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7b481c57931941c79ecd184146f20dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6745cf6719124010a510bd54fd5b9259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72586) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 21:53:37 user nova-compute[72586]: DEBUG nova.compute.manager [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Start spawning the instance on the hypervisor. {{(pid=72586) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 21:53:37 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Creating instance directory {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 21:53:37 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Creating image(s)
Aug 01 21:53:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Acquiring lock "/opt/stack/data/nova/instances/ec73ec4b-4591-46f2-9192-7868125c53c5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:53:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lock "/opt/stack/data/nova/instances/ec73ec4b-4591-46f2-9192-7868125c53c5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:53:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lock "/opt/stack/data/nova/instances/ec73ec4b-4591-46f2-9192-7868125c53c5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:53:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:53:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.138s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:53:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Acquiring lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:53:37 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:53:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:53:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.144s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:53:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/ec73ec4b-4591-46f2-9192-7868125c53c5/disk 1073741824 {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:53:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/ec73ec4b-4591-46f2-9192-7868125c53c5/disk 1073741824" returned: 0 in 0.161s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:53:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.311s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:53:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:53:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.139s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:53:38 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ec73ec4b-4591-46f2-9192-7868125c53c5/disk. size=1073741824 {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 21:53:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec73ec4b-4591-46f2-9192-7868125c53c5/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:53:38 user nova-compute[72586]: DEBUG nova.network.neutron [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Successfully created port: 7bb3754b-f5e0-465c-a140-3bbddd87400a {{(pid=72586) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 21:53:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec73ec4b-4591-46f2-9192-7868125c53c5/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:53:38 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Cannot resize image /opt/stack/data/nova/instances/ec73ec4b-4591-46f2-9192-7868125c53c5/disk to a smaller size. {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 21:53:38 user nova-compute[72586]: DEBUG nova.objects.instance [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lazy-loading 'migration_context' on Instance uuid ec73ec4b-4591-46f2-9192-7868125c53c5 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:53:38 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Created local disks {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 21:53:38 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Ensure instance console log exists: /opt/stack/data/nova/instances/ec73ec4b-4591-46f2-9192-7868125c53c5/console.log {{(pid=72586) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 21:53:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:53:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:53:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:53:38 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:53:39 user nova-compute[72586]: DEBUG nova.network.neutron [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Successfully updated port: 7bb3754b-f5e0-465c-a140-3bbddd87400a {{(pid=72586) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 21:53:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Acquiring lock "refresh_cache-ec73ec4b-4591-46f2-9192-7868125c53c5" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:53:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Acquired lock "refresh_cache-ec73ec4b-4591-46f2-9192-7868125c53c5" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:53:39 user nova-compute[72586]: DEBUG nova.network.neutron [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:53:39 user nova-compute[72586]: DEBUG nova.compute.manager [req-3fb19aa5-04bb-4c89-b74d-87799a37751a req-84b07b02-3b48-478c-8816-a896ebed79b5 service nova] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Received event network-changed-7bb3754b-f5e0-465c-a140-3bbddd87400a {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:53:39 user nova-compute[72586]: DEBUG nova.compute.manager [req-3fb19aa5-04bb-4c89-b74d-87799a37751a req-84b07b02-3b48-478c-8816-a896ebed79b5 service nova] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Refreshing instance network info cache due to event network-changed-7bb3754b-f5e0-465c-a140-3bbddd87400a. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:53:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-3fb19aa5-04bb-4c89-b74d-87799a37751a req-84b07b02-3b48-478c-8816-a896ebed79b5 service nova] Acquiring lock "refresh_cache-ec73ec4b-4591-46f2-9192-7868125c53c5" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:53:39 user nova-compute[72586]: DEBUG nova.network.neutron [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Instance cache missing network info. {{(pid=72586) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 21:53:39 user nova-compute[72586]: DEBUG nova.network.neutron [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Updating instance_info_cache with network_info: [{"id": "7bb3754b-f5e0-465c-a140-3bbddd87400a", "address": "fa:16:3e:56:f7:d0", "network": {"id": "6b6d5e8a-1c0a-4d1b-93d1-4de7246e39fb", "bridge": "br-int", "label": "tempest-TestStampPattern-2085707213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6745cf6719124010a510bd54fd5b9259", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bb3754b-f5", "ovs_interfaceid": "7bb3754b-f5e0-465c-a140-3bbddd87400a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:53:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Releasing lock "refresh_cache-ec73ec4b-4591-46f2-9192-7868125c53c5" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:53:39 user nova-compute[72586]: DEBUG nova.compute.manager [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Instance network_info: |[{"id": "7bb3754b-f5e0-465c-a140-3bbddd87400a", "address": "fa:16:3e:56:f7:d0", "network": {"id": "6b6d5e8a-1c0a-4d1b-93d1-4de7246e39fb", "bridge": "br-int", "label": "tempest-TestStampPattern-2085707213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6745cf6719124010a510bd54fd5b9259", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bb3754b-f5", "ovs_interfaceid": "7bb3754b-f5e0-465c-a140-3bbddd87400a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 21:53:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-3fb19aa5-04bb-4c89-b74d-87799a37751a req-84b07b02-3b48-478c-8816-a896ebed79b5 service nova] Acquired lock "refresh_cache-ec73ec4b-4591-46f2-9192-7868125c53c5" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:53:39 user nova-compute[72586]: DEBUG nova.network.neutron [req-3fb19aa5-04bb-4c89-b74d-87799a37751a req-84b07b02-3b48-478c-8816-a896ebed79b5 service nova] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Refreshing network info cache for port 7bb3754b-f5e0-465c-a140-3bbddd87400a {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:53:39 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Start _get_guest_xml network_info=[{"id": "7bb3754b-f5e0-465c-a140-3bbddd87400a", "address": "fa:16:3e:56:f7:d0", "network": {"id": "6b6d5e8a-1c0a-4d1b-93d1-4de7246e39fb", "bridge": "br-int", "label": "tempest-TestStampPattern-2085707213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6745cf6719124010a510bd54fd5b9259", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bb3754b-f5", "ovs_interfaceid": "7bb3754b-f5e0-465c-a140-3bbddd87400a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '0243d46b-6819-42a5-926f-42b71f0c97ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:53:39 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:53:39 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:53:39 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:53:39 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:53:39 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:53:39 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:53:39 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:53:39 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:53:39 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:53:39 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:53:39 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:53:39 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:53:39 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:53:39 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:53:39 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:53:39 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:53:39 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:53:39 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:53:39 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:53:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1398519775',display_name='tempest-TestStampPattern-server-1398519775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1398519775',id=48,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5zerJIOKAGpKQc33aoGj7w4cb3+pxQP7Uruya5ewYasxo4ClP2x6OPm9JVHlh3eOVAilC4CllBK7iFF9X0sTWOPMaSESsH80PKRKhlbIYzYqaKwb7isTjWrZQ4uPEpww==',key_name='tempest-TestStampPattern-769887333',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6745cf6719124010a510bd54fd5b9259',ramdisk_id='',reservation_id='r-kmz93wwl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-582092164',owner_user_name='tempest-TestStampPattern-582092164-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:53:38Z,user_data=None,user_id='7b481c57931941c79ecd184146f20dba',uuid=ec73ec4b-4591-46f2-9192-7868125c53c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7bb3754b-f5e0-465c-a140-3bbddd87400a", "address": "fa:16:3e:56:f7:d0", "network": {"id": "6b6d5e8a-1c0a-4d1b-93d1-4de7246e39fb", "bridge": "br-int", "label": "tempest-TestStampPattern-2085707213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6745cf6719124010a510bd54fd5b9259", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bb3754b-f5", "ovs_interfaceid": "7bb3754b-f5e0-465c-a140-3bbddd87400a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:53:39 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Converting VIF {"id": "7bb3754b-f5e0-465c-a140-3bbddd87400a", "address": "fa:16:3e:56:f7:d0", "network": {"id": "6b6d5e8a-1c0a-4d1b-93d1-4de7246e39fb", "bridge": "br-int", "label": "tempest-TestStampPattern-2085707213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6745cf6719124010a510bd54fd5b9259", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bb3754b-f5", "ovs_interfaceid": "7bb3754b-f5e0-465c-a140-3bbddd87400a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:53:39 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:f7:d0,bridge_name='br-int',has_traffic_filtering=True,id=7bb3754b-f5e0-465c-a140-3bbddd87400a,network=Network(6b6d5e8a-1c0a-4d1b-93d1-4de7246e39fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bb3754b-f5') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:53:39 user nova-compute[72586]: DEBUG nova.objects.instance [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lazy-loading 'pci_devices' on Instance uuid ec73ec4b-4591-46f2-9192-7868125c53c5 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:53:39 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:53:39 user nova-compute[72586]:   <uuid>ec73ec4b-4591-46f2-9192-7868125c53c5</uuid>
Aug 01 21:53:39 user nova-compute[72586]:   <name>instance-00000030</name>
Aug 01 21:53:39 user nova-compute[72586]:   <memory>524288</memory>
Aug 01 21:53:39 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:53:39 user nova-compute[72586]:   <metadata>
Aug 01 21:53:39 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:53:39 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:53:39 user nova-compute[72586]:       <nova:name>tempest-TestStampPattern-server-1398519775</nova:name>
Aug 01 21:53:39 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:53:39</nova:creationTime>
Aug 01 21:53:39 user nova-compute[72586]:       <nova:flavor name="m1.tiny">
Aug 01 21:53:39 user nova-compute[72586]:         <nova:memory>512</nova:memory>
Aug 01 21:53:39 user nova-compute[72586]:         <nova:disk>1</nova:disk>
Aug 01 21:53:39 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:53:39 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:53:39 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:53:39 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:53:39 user nova-compute[72586]:       <nova:owner>
Aug 01 21:53:39 user nova-compute[72586]:         <nova:user uuid="7b481c57931941c79ecd184146f20dba">tempest-TestStampPattern-582092164-project-member</nova:user>
Aug 01 21:53:39 user nova-compute[72586]:         <nova:project uuid="6745cf6719124010a510bd54fd5b9259">tempest-TestStampPattern-582092164</nova:project>
Aug 01 21:53:39 user nova-compute[72586]:       </nova:owner>
Aug 01 21:53:39 user nova-compute[72586]:       <nova:root type="image" uuid="0243d46b-6819-42a5-926f-42b71f0c97ad"/>
Aug 01 21:53:39 user nova-compute[72586]:       <nova:ports>
Aug 01 21:53:39 user nova-compute[72586]:         <nova:port uuid="7bb3754b-f5e0-465c-a140-3bbddd87400a">
Aug 01 21:53:39 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 01 21:53:39 user nova-compute[72586]:         </nova:port>
Aug 01 21:53:39 user nova-compute[72586]:       </nova:ports>
Aug 01 21:53:39 user nova-compute[72586]:     </nova:instance>
Aug 01 21:53:39 user nova-compute[72586]:   </metadata>
Aug 01 21:53:39 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:53:39 user nova-compute[72586]:     <system>
Aug 01 21:53:39 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:53:39 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:53:39 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:53:39 user nova-compute[72586]:       <entry name="serial">ec73ec4b-4591-46f2-9192-7868125c53c5</entry>
Aug 01 21:53:39 user nova-compute[72586]:       <entry name="uuid">ec73ec4b-4591-46f2-9192-7868125c53c5</entry>
Aug 01 21:53:39 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:53:39 user nova-compute[72586]:     </system>
Aug 01 21:53:39 user nova-compute[72586]:   </sysinfo>
Aug 01 21:53:39 user nova-compute[72586]:   <os>
Aug 01 21:53:39 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:53:39 user nova-compute[72586]:     <boot dev="hd"/>
Aug 01 21:53:39 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:53:39 user nova-compute[72586]:   </os>
Aug 01 21:53:39 user nova-compute[72586]:   <features>
Aug 01 21:53:39 user nova-compute[72586]:     <acpi/>
Aug 01 21:53:39 user nova-compute[72586]:     <apic/>
Aug 01 21:53:39 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:53:39 user nova-compute[72586]:   </features>
Aug 01 21:53:39 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:53:39 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:53:39 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:53:39 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:53:39 user nova-compute[72586]:   </clock>
Aug 01 21:53:39 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:53:39 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:53:39 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:53:39 user nova-compute[72586]:   </cpu>
Aug 01 21:53:39 user nova-compute[72586]:   <devices>
Aug 01 21:53:39 user nova-compute[72586]:     <disk type="file" device="disk">
Aug 01 21:53:39 user nova-compute[72586]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 21:53:39 user nova-compute[72586]:       <source file="/opt/stack/data/nova/instances/ec73ec4b-4591-46f2-9192-7868125c53c5/disk"/>
Aug 01 21:53:39 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:53:39 user nova-compute[72586]:     </disk>
Aug 01 21:53:39 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:53:39 user nova-compute[72586]:       <mac address="fa:16:3e:56:f7:d0"/>
Aug 01 21:53:39 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:53:39 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:53:39 user nova-compute[72586]:       <target dev="tap7bb3754b-f5"/>
Aug 01 21:53:39 user nova-compute[72586]:     </interface>
Aug 01 21:53:39 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:53:39 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/ec73ec4b-4591-46f2-9192-7868125c53c5/console.log" append="off"/>
Aug 01 21:53:39 user nova-compute[72586]:     </serial>
Aug 01 21:53:39 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:53:39 user nova-compute[72586]:     <video>
Aug 01 21:53:39 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:53:39 user nova-compute[72586]:     </video>
Aug 01 21:53:39 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:53:39 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:53:39 user nova-compute[72586]:     </rng>
Aug 01 21:53:39 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:53:39 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:53:39 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:53:39 user nova-compute[72586]:     </memballoon>
Aug 01 21:53:39 user nova-compute[72586]:   </devices>
Aug 01 21:53:39 user nova-compute[72586]: </domain>
Aug 01 21:53:39 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:53:39 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:53:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1398519775',display_name='tempest-TestStampPattern-server-1398519775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1398519775',id=48,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5zerJIOKAGpKQc33aoGj7w4cb3+pxQP7Uruya5ewYasxo4ClP2x6OPm9JVHlh3eOVAilC4CllBK7iFF9X0sTWOPMaSESsH80PKRKhlbIYzYqaKwb7isTjWrZQ4uPEpww==',key_name='tempest-TestStampPattern-769887333',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6745cf6719124010a510bd54fd5b9259',ramdisk_id='',reservation_id='r-kmz93wwl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-582092164',owner_user_name='tempest-TestStampPattern-582092164-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:53:38Z,user_data=None,user_id='7b481c57931941c79ecd184146f20dba',uuid=ec73ec4b-4591-46f2-9192-7868125c53c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7bb3754b-f5e0-465c-a140-3bbddd87400a", "address": "fa:16:3e:56:f7:d0", "network": {"id": "6b6d5e8a-1c0a-4d1b-93d1-4de7246e39fb", "bridge": "br-int", "label": "tempest-TestStampPattern-2085707213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6745cf6719124010a510bd54fd5b9259", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bb3754b-f5", "ovs_interfaceid": "7bb3754b-f5e0-465c-a140-3bbddd87400a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:53:39 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Converting VIF {"id": "7bb3754b-f5e0-465c-a140-3bbddd87400a", "address": "fa:16:3e:56:f7:d0", "network": {"id": "6b6d5e8a-1c0a-4d1b-93d1-4de7246e39fb", "bridge": "br-int", "label": "tempest-TestStampPattern-2085707213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6745cf6719124010a510bd54fd5b9259", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bb3754b-f5", "ovs_interfaceid": "7bb3754b-f5e0-465c-a140-3bbddd87400a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:53:39 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:f7:d0,bridge_name='br-int',has_traffic_filtering=True,id=7bb3754b-f5e0-465c-a140-3bbddd87400a,network=Network(6b6d5e8a-1c0a-4d1b-93d1-4de7246e39fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bb3754b-f5') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:53:39 user nova-compute[72586]: DEBUG os_vif [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:f7:d0,bridge_name='br-int',has_traffic_filtering=True,id=7bb3754b-f5e0-465c-a140-3bbddd87400a,network=Network(6b6d5e8a-1c0a-4d1b-93d1-4de7246e39fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bb3754b-f5') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:53:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:53:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:53:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:53:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:53:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7bb3754b-f5, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:53:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7bb3754b-f5, col_values=(('external_ids', {'iface-id': '7bb3754b-f5e0-465c-a140-3bbddd87400a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:f7:d0', 'vm-uuid': 'ec73ec4b-4591-46f2-9192-7868125c53c5'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:53:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:53:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:53:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:53:39 user nova-compute[72586]: INFO os_vif [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:f7:d0,bridge_name='br-int',has_traffic_filtering=True,id=7bb3754b-f5e0-465c-a140-3bbddd87400a,network=Network(6b6d5e8a-1c0a-4d1b-93d1-4de7246e39fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bb3754b-f5')
Aug 01 21:53:39 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:53:39 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] No VIF found with MAC fa:16:3e:56:f7:d0, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:53:39 user nova-compute[72586]: DEBUG nova.network.neutron [req-3fb19aa5-04bb-4c89-b74d-87799a37751a req-84b07b02-3b48-478c-8816-a896ebed79b5 service nova] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Updated VIF entry in instance network info cache for port 7bb3754b-f5e0-465c-a140-3bbddd87400a. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:53:39 user nova-compute[72586]: DEBUG nova.network.neutron [req-3fb19aa5-04bb-4c89-b74d-87799a37751a req-84b07b02-3b48-478c-8816-a896ebed79b5 service nova] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Updating instance_info_cache with network_info: [{"id": "7bb3754b-f5e0-465c-a140-3bbddd87400a", "address": "fa:16:3e:56:f7:d0", "network": {"id": "6b6d5e8a-1c0a-4d1b-93d1-4de7246e39fb", "bridge": "br-int", "label": "tempest-TestStampPattern-2085707213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6745cf6719124010a510bd54fd5b9259", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bb3754b-f5", "ovs_interfaceid": "7bb3754b-f5e0-465c-a140-3bbddd87400a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:53:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-3fb19aa5-04bb-4c89-b74d-87799a37751a req-84b07b02-3b48-478c-8816-a896ebed79b5 service nova] Releasing lock "refresh_cache-ec73ec4b-4591-46f2-9192-7868125c53c5" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:53:40 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:53:40 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:53:40 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:53:40 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:53:41 user nova-compute[72586]: DEBUG nova.compute.manager [req-138ae234-53da-4955-b495-e56ef7793dce req-8482d586-6a74-4d09-ad2a-ec7c25d61ce6 service nova] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Received event network-vif-plugged-7bb3754b-f5e0-465c-a140-3bbddd87400a {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:53:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-138ae234-53da-4955-b495-e56ef7793dce req-8482d586-6a74-4d09-ad2a-ec7c25d61ce6 service nova] Acquiring lock "ec73ec4b-4591-46f2-9192-7868125c53c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:53:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-138ae234-53da-4955-b495-e56ef7793dce req-8482d586-6a74-4d09-ad2a-ec7c25d61ce6 service nova] Lock "ec73ec4b-4591-46f2-9192-7868125c53c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:53:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-138ae234-53da-4955-b495-e56ef7793dce req-8482d586-6a74-4d09-ad2a-ec7c25d61ce6 service nova] Lock "ec73ec4b-4591-46f2-9192-7868125c53c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:53:41 user nova-compute[72586]: DEBUG nova.compute.manager [req-138ae234-53da-4955-b495-e56ef7793dce req-8482d586-6a74-4d09-ad2a-ec7c25d61ce6 service nova] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] No waiting events found dispatching network-vif-plugged-7bb3754b-f5e0-465c-a140-3bbddd87400a {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:53:41 user nova-compute[72586]: WARNING nova.compute.manager [req-138ae234-53da-4955-b495-e56ef7793dce req-8482d586-6a74-4d09-ad2a-ec7c25d61ce6 service nova] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Received unexpected event network-vif-plugged-7bb3754b-f5e0-465c-a140-3bbddd87400a for instance with vm_state building and task_state spawning.
Aug 01 21:53:41 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:53:41 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:53:41 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:53:43 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690926823.1540349, ec73ec4b-4591-46f2-9192-7868125c53c5 => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:53:43 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] VM Resumed (Lifecycle Event)
Aug 01 21:53:43 user nova-compute[72586]: DEBUG nova.compute.manager [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Instance event wait completed in 0 seconds for  {{(pid=72586) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 21:53:43 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Guest created on hypervisor {{(pid=72586) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 21:53:43 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Instance spawned successfully.
Aug 01 21:53:43 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 21:53:43 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:53:43 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:53:43 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Found default for hw_cdrom_bus of ide {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:53:43 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Found default for hw_disk_bus of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:53:43 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Found default for hw_input_bus of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:53:43 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Found default for hw_pointer_model of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:53:43 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Found default for hw_video_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:53:43 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Found default for hw_vif_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:53:43 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:53:43 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690926823.155922, ec73ec4b-4591-46f2-9192-7868125c53c5 => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:53:43 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] VM Started (Lifecycle Event)
Aug 01 21:53:43 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:53:43 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:53:43 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:53:43 user nova-compute[72586]: DEBUG nova.compute.manager [req-19161f1c-0f1c-41bb-b3fc-c8c61fb5e3e9 req-7264a313-d9cb-47a9-ad3f-ff0a7438ddbd service nova] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Received event network-vif-plugged-7bb3754b-f5e0-465c-a140-3bbddd87400a {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:53:43 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-19161f1c-0f1c-41bb-b3fc-c8c61fb5e3e9 req-7264a313-d9cb-47a9-ad3f-ff0a7438ddbd service nova] Acquiring lock "ec73ec4b-4591-46f2-9192-7868125c53c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:53:43 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-19161f1c-0f1c-41bb-b3fc-c8c61fb5e3e9 req-7264a313-d9cb-47a9-ad3f-ff0a7438ddbd service nova] Lock "ec73ec4b-4591-46f2-9192-7868125c53c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:53:43 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-19161f1c-0f1c-41bb-b3fc-c8c61fb5e3e9 req-7264a313-d9cb-47a9-ad3f-ff0a7438ddbd service nova] Lock "ec73ec4b-4591-46f2-9192-7868125c53c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:53:43 user nova-compute[72586]: DEBUG nova.compute.manager [req-19161f1c-0f1c-41bb-b3fc-c8c61fb5e3e9 req-7264a313-d9cb-47a9-ad3f-ff0a7438ddbd service nova] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] No waiting events found dispatching network-vif-plugged-7bb3754b-f5e0-465c-a140-3bbddd87400a {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:53:43 user nova-compute[72586]: WARNING nova.compute.manager [req-19161f1c-0f1c-41bb-b3fc-c8c61fb5e3e9 req-7264a313-d9cb-47a9-ad3f-ff0a7438ddbd service nova] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Received unexpected event network-vif-plugged-7bb3754b-f5e0-465c-a140-3bbddd87400a for instance with vm_state building and task_state spawning.
Aug 01 21:53:43 user nova-compute[72586]: INFO nova.compute.manager [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Took 5.51 seconds to spawn the instance on the hypervisor.
Aug 01 21:53:43 user nova-compute[72586]: DEBUG nova.compute.manager [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:53:43 user nova-compute[72586]: INFO nova.compute.manager [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Took 6.12 seconds to build instance.
Aug 01 21:53:43 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-602de0fd-d811-498e-b59d-b16223a9397a tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lock "ec73ec4b-4591-46f2-9192-7868125c53c5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.206s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:53:43 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:53:44 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:53:44 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:53:44 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:53:44 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:53:44 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72586) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 21:53:45 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:53:46 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:53:48 user nova-compute[72586]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690926813.7039511, 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824 => Stopped> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:53:48 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] VM Stopped (Lifecycle Event)
Aug 01 21:53:48 user nova-compute[72586]: DEBUG nova.compute.manager [None req-858bc770-cfeb-4b51-b1e9-78ab5df80b36 None None] [instance: 8ae37bb9-cf4e-46e1-b5e5-81930cdfa824] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:53:49 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:53:50 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:53:50 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:53:50 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:53:50 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:53:50 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:53:50 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Auditing locally available compute resources for user (node: user) {{(pid=72586) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 21:53:51 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:53:51 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec73ec4b-4591-46f2-9192-7868125c53c5/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:53:51 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec73ec4b-4591-46f2-9192-7868125c53c5/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:53:51 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec73ec4b-4591-46f2-9192-7868125c53c5/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:53:51 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec73ec4b-4591-46f2-9192-7868125c53c5/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:53:51 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:53:51 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:53:51 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:53:51 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Hypervisor/Node resource view: name=user free_ram=8446MB free_disk=25.28453826904297GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72586) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 21:53:51 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:53:51 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:53:51 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 055a4027-b090-43f3-998e-5bd3ba3c0109 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:53:51 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 8ca844b8-493a-419d-9754-92c1b3bb373d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:53:51 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance ec73ec4b-4591-46f2-9192-7868125c53c5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:53:51 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 21:53:51 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 21:53:51 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:53:51 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:53:52 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Compute_service record updated for user:user {{(pid=72586) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 21:53:52 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.344s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:53:54 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:53:56 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:53:56 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Starting heal instance info cache {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 21:53:56 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Rebuilding the list of instances to heal {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 21:53:56 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "refresh_cache-055a4027-b090-43f3-998e-5bd3ba3c0109" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:53:56 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquired lock "refresh_cache-055a4027-b090-43f3-998e-5bd3ba3c0109" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:53:56 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Forcefully refreshing network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 21:53:56 user nova-compute[72586]: DEBUG nova.objects.instance [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lazy-loading 'info_cache' on Instance uuid 055a4027-b090-43f3-998e-5bd3ba3c0109 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:53:56 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Updating instance_info_cache with network_info: [{"id": "65240d77-844f-4d37-9b69-972686cb6c95", "address": "fa:16:3e:b4:82:5a", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65240d77-84", "ovs_interfaceid": "65240d77-844f-4d37-9b69-972686cb6c95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:53:56 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Releasing lock "refresh_cache-055a4027-b090-43f3-998e-5bd3ba3c0109" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:53:56 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Updated the network info_cache for instance {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 21:53:56 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:53:56 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:53:59 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:54:00 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:54:03 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:54:04 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:54:05 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:54:09 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:54:10 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:54:14 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:54:15 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:54:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:54:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:54:24 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:54:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Acquiring lock "7900178d-22dc-4571-8aa4-b5562fb3a927" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:54:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "7900178d-22dc-4571-8aa4-b5562fb3a927" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:54:26 user nova-compute[72586]: DEBUG nova.compute.manager [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Starting instance... {{(pid=72586) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 21:54:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:54:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:54:26 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72586) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 21:54:26 user nova-compute[72586]: INFO nova.compute.claims [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Claim successful on node user
Aug 01 21:54:26 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:54:26 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:54:26 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.252s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:54:26 user nova-compute[72586]: DEBUG nova.compute.manager [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Start building networks asynchronously for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 21:54:26 user nova-compute[72586]: DEBUG nova.compute.manager [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Allocating IP information in the background. {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 21:54:26 user nova-compute[72586]: DEBUG nova.network.neutron [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] allocate_for_instance() {{(pid=72586) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 21:54:27 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 21:54:27 user nova-compute[72586]: DEBUG nova.compute.manager [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Start building block device mappings for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 21:54:27 user nova-compute[72586]: DEBUG nova.compute.manager [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Start spawning the instance on the hypervisor. {{(pid=72586) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 21:54:27 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Creating instance directory {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 21:54:27 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Creating image(s)
Aug 01 21:54:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Acquiring lock "/opt/stack/data/nova/instances/7900178d-22dc-4571-8aa4-b5562fb3a927/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:54:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "/opt/stack/data/nova/instances/7900178d-22dc-4571-8aa4-b5562fb3a927/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:54:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "/opt/stack/data/nova/instances/7900178d-22dc-4571-8aa4-b5562fb3a927/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:54:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:54:27 user nova-compute[72586]: DEBUG nova.policy [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '37663bab7d31400c8399451058bd5936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063dd272226340d49a7ac0756413cadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72586) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 21:54:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.147s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:54:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Acquiring lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:54:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:54:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:54:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.144s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:54:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/7900178d-22dc-4571-8aa4-b5562fb3a927/disk 1073741824 {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:54:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/7900178d-22dc-4571-8aa4-b5562fb3a927/disk 1073741824" returned: 0 in 0.049s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:54:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.199s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:54:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:54:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.133s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:54:27 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7900178d-22dc-4571-8aa4-b5562fb3a927/disk. size=1073741824 {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 21:54:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7900178d-22dc-4571-8aa4-b5562fb3a927/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:54:27 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7900178d-22dc-4571-8aa4-b5562fb3a927/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:54:27 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Cannot resize image /opt/stack/data/nova/instances/7900178d-22dc-4571-8aa4-b5562fb3a927/disk to a smaller size. {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 21:54:27 user nova-compute[72586]: DEBUG nova.objects.instance [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lazy-loading 'migration_context' on Instance uuid 7900178d-22dc-4571-8aa4-b5562fb3a927 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:54:27 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Created local disks {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 21:54:27 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Ensure instance console log exists: /opt/stack/data/nova/instances/7900178d-22dc-4571-8aa4-b5562fb3a927/console.log {{(pid=72586) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 21:54:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:54:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:54:27 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:54:28 user nova-compute[72586]: DEBUG nova.network.neutron [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Successfully created port: d5d860ea-6f19-4513-8b09-fd220204cb58 {{(pid=72586) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 21:54:28 user nova-compute[72586]: DEBUG nova.network.neutron [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Successfully updated port: d5d860ea-6f19-4513-8b09-fd220204cb58 {{(pid=72586) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 21:54:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Acquiring lock "refresh_cache-7900178d-22dc-4571-8aa4-b5562fb3a927" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:54:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Acquired lock "refresh_cache-7900178d-22dc-4571-8aa4-b5562fb3a927" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:54:28 user nova-compute[72586]: DEBUG nova.network.neutron [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:54:28 user nova-compute[72586]: DEBUG nova.compute.manager [req-75ce934e-8f9c-4a56-ad0e-e3e5cb6bc5ec req-07415957-4231-4b6c-9552-343956d5cc65 service nova] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Received event network-changed-d5d860ea-6f19-4513-8b09-fd220204cb58 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:54:28 user nova-compute[72586]: DEBUG nova.compute.manager [req-75ce934e-8f9c-4a56-ad0e-e3e5cb6bc5ec req-07415957-4231-4b6c-9552-343956d5cc65 service nova] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Refreshing instance network info cache due to event network-changed-d5d860ea-6f19-4513-8b09-fd220204cb58. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:54:28 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-75ce934e-8f9c-4a56-ad0e-e3e5cb6bc5ec req-07415957-4231-4b6c-9552-343956d5cc65 service nova] Acquiring lock "refresh_cache-7900178d-22dc-4571-8aa4-b5562fb3a927" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:54:29 user nova-compute[72586]: DEBUG nova.network.neutron [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Instance cache missing network info. {{(pid=72586) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 21:54:29 user nova-compute[72586]: DEBUG nova.network.neutron [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Updating instance_info_cache with network_info: [{"id": "d5d860ea-6f19-4513-8b09-fd220204cb58", "address": "fa:16:3e:d9:8e:26", "network": {"id": "52ee6623-01e5-491e-ab5e-d1d0511bd15f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-765176125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063dd272226340d49a7ac0756413cadf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5d860ea-6f", "ovs_interfaceid": "d5d860ea-6f19-4513-8b09-fd220204cb58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:54:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Releasing lock "refresh_cache-7900178d-22dc-4571-8aa4-b5562fb3a927" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:54:29 user nova-compute[72586]: DEBUG nova.compute.manager [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Instance network_info: |[{"id": "d5d860ea-6f19-4513-8b09-fd220204cb58", "address": "fa:16:3e:d9:8e:26", "network": {"id": "52ee6623-01e5-491e-ab5e-d1d0511bd15f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-765176125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063dd272226340d49a7ac0756413cadf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5d860ea-6f", "ovs_interfaceid": "d5d860ea-6f19-4513-8b09-fd220204cb58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 21:54:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-75ce934e-8f9c-4a56-ad0e-e3e5cb6bc5ec req-07415957-4231-4b6c-9552-343956d5cc65 service nova] Acquired lock "refresh_cache-7900178d-22dc-4571-8aa4-b5562fb3a927" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:54:29 user nova-compute[72586]: DEBUG nova.network.neutron [req-75ce934e-8f9c-4a56-ad0e-e3e5cb6bc5ec req-07415957-4231-4b6c-9552-343956d5cc65 service nova] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Refreshing network info cache for port d5d860ea-6f19-4513-8b09-fd220204cb58 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:54:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Start _get_guest_xml network_info=[{"id": "d5d860ea-6f19-4513-8b09-fd220204cb58", "address": "fa:16:3e:d9:8e:26", "network": {"id": "52ee6623-01e5-491e-ab5e-d1d0511bd15f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-765176125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063dd272226340d49a7ac0756413cadf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5d860ea-6f", "ovs_interfaceid": "d5d860ea-6f19-4513-8b09-fd220204cb58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '0243d46b-6819-42a5-926f-42b71f0c97ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:54:29 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:54:29 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:54:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:54:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:54:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:54:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:54:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:54:29 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:54:29 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:54:29 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:54:29 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:54:29 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:54:29 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:54:29 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:54:29 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:54:29 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:54:29 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:54:29 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:54:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:54:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1539186367',display_name='tempest-AttachVolumeNegativeTest-server-1539186367',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1539186367',id=49,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFg8tzthd9EJgUf7w8xR/Bf5qIErAGe/5PcJTaVL4Y8+ua8cthxEqtYsOcMw+IfA1MqZHxNIDVXSXZx612FUeDd//p60cZvnfmjv3UUIs3XknHCWBz3TovOyogYdvqmc0A==',key_name='tempest-keypair-1142853449',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='063dd272226340d49a7ac0756413cadf',ramdisk_id='',reservation_id='r-ipdwuaub',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-717043369',owner_user_name='tempest-AttachVolumeNegativeTest-717043369-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:54:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37663bab7d31400c8399451058bd5936',uuid=7900178d-22dc-4571-8aa4-b5562fb3a927,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5d860ea-6f19-4513-8b09-fd220204cb58", "address": "fa:16:3e:d9:8e:26", "network": {"id": "52ee6623-01e5-491e-ab5e-d1d0511bd15f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-765176125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063dd272226340d49a7ac0756413cadf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5d860ea-6f", "ovs_interfaceid": "d5d860ea-6f19-4513-8b09-fd220204cb58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:54:29 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Converting VIF {"id": "d5d860ea-6f19-4513-8b09-fd220204cb58", "address": "fa:16:3e:d9:8e:26", "network": {"id": "52ee6623-01e5-491e-ab5e-d1d0511bd15f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-765176125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063dd272226340d49a7ac0756413cadf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5d860ea-6f", "ovs_interfaceid": "d5d860ea-6f19-4513-8b09-fd220204cb58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:54:29 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:8e:26,bridge_name='br-int',has_traffic_filtering=True,id=d5d860ea-6f19-4513-8b09-fd220204cb58,network=Network(52ee6623-01e5-491e-ab5e-d1d0511bd15f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5d860ea-6f') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:54:29 user nova-compute[72586]: DEBUG nova.objects.instance [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lazy-loading 'pci_devices' on Instance uuid 7900178d-22dc-4571-8aa4-b5562fb3a927 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:54:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:54:29 user nova-compute[72586]:   <uuid>7900178d-22dc-4571-8aa4-b5562fb3a927</uuid>
Aug 01 21:54:29 user nova-compute[72586]:   <name>instance-00000031</name>
Aug 01 21:54:29 user nova-compute[72586]:   <memory>524288</memory>
Aug 01 21:54:29 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:54:29 user nova-compute[72586]:   <metadata>
Aug 01 21:54:29 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:54:29 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:54:29 user nova-compute[72586]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1539186367</nova:name>
Aug 01 21:54:29 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:54:29</nova:creationTime>
Aug 01 21:54:29 user nova-compute[72586]:       <nova:flavor name="m1.tiny">
Aug 01 21:54:29 user nova-compute[72586]:         <nova:memory>512</nova:memory>
Aug 01 21:54:29 user nova-compute[72586]:         <nova:disk>1</nova:disk>
Aug 01 21:54:29 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:54:29 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:54:29 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:54:29 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:54:29 user nova-compute[72586]:       <nova:owner>
Aug 01 21:54:29 user nova-compute[72586]:         <nova:user uuid="37663bab7d31400c8399451058bd5936">tempest-AttachVolumeNegativeTest-717043369-project-member</nova:user>
Aug 01 21:54:29 user nova-compute[72586]:         <nova:project uuid="063dd272226340d49a7ac0756413cadf">tempest-AttachVolumeNegativeTest-717043369</nova:project>
Aug 01 21:54:29 user nova-compute[72586]:       </nova:owner>
Aug 01 21:54:29 user nova-compute[72586]:       <nova:root type="image" uuid="0243d46b-6819-42a5-926f-42b71f0c97ad"/>
Aug 01 21:54:29 user nova-compute[72586]:       <nova:ports>
Aug 01 21:54:29 user nova-compute[72586]:         <nova:port uuid="d5d860ea-6f19-4513-8b09-fd220204cb58">
Aug 01 21:54:29 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 01 21:54:29 user nova-compute[72586]:         </nova:port>
Aug 01 21:54:29 user nova-compute[72586]:       </nova:ports>
Aug 01 21:54:29 user nova-compute[72586]:     </nova:instance>
Aug 01 21:54:29 user nova-compute[72586]:   </metadata>
Aug 01 21:54:29 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:54:29 user nova-compute[72586]:     <system>
Aug 01 21:54:29 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:54:29 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:54:29 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:54:29 user nova-compute[72586]:       <entry name="serial">7900178d-22dc-4571-8aa4-b5562fb3a927</entry>
Aug 01 21:54:29 user nova-compute[72586]:       <entry name="uuid">7900178d-22dc-4571-8aa4-b5562fb3a927</entry>
Aug 01 21:54:29 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:54:29 user nova-compute[72586]:     </system>
Aug 01 21:54:29 user nova-compute[72586]:   </sysinfo>
Aug 01 21:54:29 user nova-compute[72586]:   <os>
Aug 01 21:54:29 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:54:29 user nova-compute[72586]:     <boot dev="hd"/>
Aug 01 21:54:29 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:54:29 user nova-compute[72586]:   </os>
Aug 01 21:54:29 user nova-compute[72586]:   <features>
Aug 01 21:54:29 user nova-compute[72586]:     <acpi/>
Aug 01 21:54:29 user nova-compute[72586]:     <apic/>
Aug 01 21:54:29 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:54:29 user nova-compute[72586]:   </features>
Aug 01 21:54:29 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:54:29 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:54:29 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:54:29 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:54:29 user nova-compute[72586]:   </clock>
Aug 01 21:54:29 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:54:29 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:54:29 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:54:29 user nova-compute[72586]:   </cpu>
Aug 01 21:54:29 user nova-compute[72586]:   <devices>
Aug 01 21:54:29 user nova-compute[72586]:     <disk type="file" device="disk">
Aug 01 21:54:29 user nova-compute[72586]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 21:54:29 user nova-compute[72586]:       <source file="/opt/stack/data/nova/instances/7900178d-22dc-4571-8aa4-b5562fb3a927/disk"/>
Aug 01 21:54:29 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:54:29 user nova-compute[72586]:     </disk>
Aug 01 21:54:29 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:54:29 user nova-compute[72586]:       <mac address="fa:16:3e:d9:8e:26"/>
Aug 01 21:54:29 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:54:29 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:54:29 user nova-compute[72586]:       <target dev="tapd5d860ea-6f"/>
Aug 01 21:54:29 user nova-compute[72586]:     </interface>
Aug 01 21:54:29 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:54:29 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/7900178d-22dc-4571-8aa4-b5562fb3a927/console.log" append="off"/>
Aug 01 21:54:29 user nova-compute[72586]:     </serial>
Aug 01 21:54:29 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:54:29 user nova-compute[72586]:     <video>
Aug 01 21:54:29 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:54:29 user nova-compute[72586]:     </video>
Aug 01 21:54:29 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:54:29 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:54:29 user nova-compute[72586]:     </rng>
Aug 01 21:54:29 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:54:29 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:54:29 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:54:29 user nova-compute[72586]:     </memballoon>
Aug 01 21:54:29 user nova-compute[72586]:   </devices>
Aug 01 21:54:29 user nova-compute[72586]: </domain>
Aug 01 21:54:29 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:54:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:54:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1539186367',display_name='tempest-AttachVolumeNegativeTest-server-1539186367',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1539186367',id=49,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFg8tzthd9EJgUf7w8xR/Bf5qIErAGe/5PcJTaVL4Y8+ua8cthxEqtYsOcMw+IfA1MqZHxNIDVXSXZx612FUeDd//p60cZvnfmjv3UUIs3XknHCWBz3TovOyogYdvqmc0A==',key_name='tempest-keypair-1142853449',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='063dd272226340d49a7ac0756413cadf',ramdisk_id='',reservation_id='r-ipdwuaub',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-717043369',owner_user_name='tempest-AttachVolumeNegativeTest-717043369-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:54:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37663bab7d31400c8399451058bd5936',uuid=7900178d-22dc-4571-8aa4-b5562fb3a927,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5d860ea-6f19-4513-8b09-fd220204cb58", "address": "fa:16:3e:d9:8e:26", "network": {"id": "52ee6623-01e5-491e-ab5e-d1d0511bd15f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-765176125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063dd272226340d49a7ac0756413cadf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5d860ea-6f", "ovs_interfaceid": "d5d860ea-6f19-4513-8b09-fd220204cb58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:54:29 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Converting VIF {"id": "d5d860ea-6f19-4513-8b09-fd220204cb58", "address": "fa:16:3e:d9:8e:26", "network": {"id": "52ee6623-01e5-491e-ab5e-d1d0511bd15f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-765176125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063dd272226340d49a7ac0756413cadf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5d860ea-6f", "ovs_interfaceid": "d5d860ea-6f19-4513-8b09-fd220204cb58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:54:29 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:8e:26,bridge_name='br-int',has_traffic_filtering=True,id=d5d860ea-6f19-4513-8b09-fd220204cb58,network=Network(52ee6623-01e5-491e-ab5e-d1d0511bd15f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5d860ea-6f') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:54:29 user nova-compute[72586]: DEBUG os_vif [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:8e:26,bridge_name='br-int',has_traffic_filtering=True,id=d5d860ea-6f19-4513-8b09-fd220204cb58,network=Network(52ee6623-01e5-491e-ab5e-d1d0511bd15f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5d860ea-6f') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:54:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:54:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:54:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:54:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:54:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd5d860ea-6f, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:54:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd5d860ea-6f, col_values=(('external_ids', {'iface-id': 'd5d860ea-6f19-4513-8b09-fd220204cb58', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:8e:26', 'vm-uuid': '7900178d-22dc-4571-8aa4-b5562fb3a927'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:54:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:54:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:54:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:54:29 user nova-compute[72586]: INFO os_vif [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:8e:26,bridge_name='br-int',has_traffic_filtering=True,id=d5d860ea-6f19-4513-8b09-fd220204cb58,network=Network(52ee6623-01e5-491e-ab5e-d1d0511bd15f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5d860ea-6f')
Aug 01 21:54:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:54:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] No VIF found with MAC fa:16:3e:d9:8e:26, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:54:29 user nova-compute[72586]: DEBUG nova.network.neutron [req-75ce934e-8f9c-4a56-ad0e-e3e5cb6bc5ec req-07415957-4231-4b6c-9552-343956d5cc65 service nova] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Updated VIF entry in instance network info cache for port d5d860ea-6f19-4513-8b09-fd220204cb58. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:54:29 user nova-compute[72586]: DEBUG nova.network.neutron [req-75ce934e-8f9c-4a56-ad0e-e3e5cb6bc5ec req-07415957-4231-4b6c-9552-343956d5cc65 service nova] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Updating instance_info_cache with network_info: [{"id": "d5d860ea-6f19-4513-8b09-fd220204cb58", "address": "fa:16:3e:d9:8e:26", "network": {"id": "52ee6623-01e5-491e-ab5e-d1d0511bd15f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-765176125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063dd272226340d49a7ac0756413cadf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5d860ea-6f", "ovs_interfaceid": "d5d860ea-6f19-4513-8b09-fd220204cb58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:54:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-75ce934e-8f9c-4a56-ad0e-e3e5cb6bc5ec req-07415957-4231-4b6c-9552-343956d5cc65 service nova] Releasing lock "refresh_cache-7900178d-22dc-4571-8aa4-b5562fb3a927" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:54:30 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:54:30 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:54:30 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:54:30 user nova-compute[72586]: DEBUG nova.compute.manager [req-b5eadfe4-42e6-4af9-8243-6057fd4607f7 req-1ac6f255-a95b-44ca-a95a-a56de4f5229a service nova] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Received event network-vif-plugged-d5d860ea-6f19-4513-8b09-fd220204cb58 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:54:30 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-b5eadfe4-42e6-4af9-8243-6057fd4607f7 req-1ac6f255-a95b-44ca-a95a-a56de4f5229a service nova] Acquiring lock "7900178d-22dc-4571-8aa4-b5562fb3a927-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:54:30 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-b5eadfe4-42e6-4af9-8243-6057fd4607f7 req-1ac6f255-a95b-44ca-a95a-a56de4f5229a service nova] Lock "7900178d-22dc-4571-8aa4-b5562fb3a927-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:54:30 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-b5eadfe4-42e6-4af9-8243-6057fd4607f7 req-1ac6f255-a95b-44ca-a95a-a56de4f5229a service nova] Lock "7900178d-22dc-4571-8aa4-b5562fb3a927-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:54:30 user nova-compute[72586]: DEBUG nova.compute.manager [req-b5eadfe4-42e6-4af9-8243-6057fd4607f7 req-1ac6f255-a95b-44ca-a95a-a56de4f5229a service nova] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] No waiting events found dispatching network-vif-plugged-d5d860ea-6f19-4513-8b09-fd220204cb58 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:54:30 user nova-compute[72586]: WARNING nova.compute.manager [req-b5eadfe4-42e6-4af9-8243-6057fd4607f7 req-1ac6f255-a95b-44ca-a95a-a56de4f5229a service nova] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Received unexpected event network-vif-plugged-d5d860ea-6f19-4513-8b09-fd220204cb58 for instance with vm_state building and task_state spawning.
Aug 01 21:54:31 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:54:31 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:54:32 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690926872.797658, 7900178d-22dc-4571-8aa4-b5562fb3a927 => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:54:32 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] VM Resumed (Lifecycle Event)
Aug 01 21:54:32 user nova-compute[72586]: DEBUG nova.compute.manager [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Instance event wait completed in 0 seconds for  {{(pid=72586) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 21:54:32 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Guest created on hypervisor {{(pid=72586) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 21:54:32 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Instance spawned successfully.
Aug 01 21:54:32 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 21:54:32 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Found default for hw_cdrom_bus of ide {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:54:32 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Found default for hw_disk_bus of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:54:32 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Found default for hw_input_bus of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:54:32 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Found default for hw_pointer_model of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:54:32 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Found default for hw_video_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:54:32 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Found default for hw_vif_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:54:32 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:54:32 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:54:32 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:54:32 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690926872.8015661, 7900178d-22dc-4571-8aa4-b5562fb3a927 => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:54:32 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] VM Started (Lifecycle Event)
Aug 01 21:54:32 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:54:32 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:54:32 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:54:32 user nova-compute[72586]: INFO nova.compute.manager [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Took 5.77 seconds to spawn the instance on the hypervisor.
Aug 01 21:54:32 user nova-compute[72586]: DEBUG nova.compute.manager [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:54:32 user nova-compute[72586]: DEBUG nova.compute.manager [req-3dde4116-c543-4200-bbb1-2681724c4268 req-1043d063-c034-4a73-8f01-4d940445b84b service nova] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Received event network-vif-plugged-d5d860ea-6f19-4513-8b09-fd220204cb58 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:54:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-3dde4116-c543-4200-bbb1-2681724c4268 req-1043d063-c034-4a73-8f01-4d940445b84b service nova] Acquiring lock "7900178d-22dc-4571-8aa4-b5562fb3a927-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:54:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-3dde4116-c543-4200-bbb1-2681724c4268 req-1043d063-c034-4a73-8f01-4d940445b84b service nova] Lock "7900178d-22dc-4571-8aa4-b5562fb3a927-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:54:32 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-3dde4116-c543-4200-bbb1-2681724c4268 req-1043d063-c034-4a73-8f01-4d940445b84b service nova] Lock "7900178d-22dc-4571-8aa4-b5562fb3a927-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:54:32 user nova-compute[72586]: DEBUG nova.compute.manager [req-3dde4116-c543-4200-bbb1-2681724c4268 req-1043d063-c034-4a73-8f01-4d940445b84b service nova] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] No waiting events found dispatching network-vif-plugged-d5d860ea-6f19-4513-8b09-fd220204cb58 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:54:32 user nova-compute[72586]: WARNING nova.compute.manager [req-3dde4116-c543-4200-bbb1-2681724c4268 req-1043d063-c034-4a73-8f01-4d940445b84b service nova] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Received unexpected event network-vif-plugged-d5d860ea-6f19-4513-8b09-fd220204cb58 for instance with vm_state building and task_state spawning.
Aug 01 21:54:33 user nova-compute[72586]: INFO nova.compute.manager [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Took 6.34 seconds to build instance.
Aug 01 21:54:33 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0eed557c-01f2-46de-9237-2039f38d1c04 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "7900178d-22dc-4571-8aa4-b5562fb3a927" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.435s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:54:34 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:54:35 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:54:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:54:44 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:54:44 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:54:44 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72586) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 21:54:44 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72586) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 21:54:44 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72586) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 21:54:44 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:54:44 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:54:45 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:54:45 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:54:45 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:54:45 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72586) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 21:54:46 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:54:49 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:54:50 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:54:51 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:54:51 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:54:51 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:54:51 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:54:51 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Auditing locally available compute resources for user (node: user) {{(pid=72586) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 21:54:52 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7900178d-22dc-4571-8aa4-b5562fb3a927/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:54:52 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7900178d-22dc-4571-8aa4-b5562fb3a927/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:54:52 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7900178d-22dc-4571-8aa4-b5562fb3a927/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:54:52 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7900178d-22dc-4571-8aa4-b5562fb3a927/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:54:52 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:54:52 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec73ec4b-4591-46f2-9192-7868125c53c5/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:54:52 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec73ec4b-4591-46f2-9192-7868125c53c5/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:54:52 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec73ec4b-4591-46f2-9192-7868125c53c5/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:54:52 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec73ec4b-4591-46f2-9192-7868125c53c5/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:54:52 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:54:53 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:54:53 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:54:53 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Hypervisor/Node resource view: name=user free_ram=8320MB free_disk=25.228378295898438GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72586) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 21:54:53 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:54:53 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:54:53 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 055a4027-b090-43f3-998e-5bd3ba3c0109 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:54:53 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 8ca844b8-493a-419d-9754-92c1b3bb373d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:54:53 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance ec73ec4b-4591-46f2-9192-7868125c53c5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:54:53 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 7900178d-22dc-4571-8aa4-b5562fb3a927 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:54:53 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 21:54:53 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 21:54:53 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:54:53 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:54:53 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Compute_service record updated for user:user {{(pid=72586) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 21:54:53 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.269s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:54:54 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:54:55 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:54:57 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:54:57 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Starting heal instance info cache {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 21:54:57 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "refresh_cache-8ca844b8-493a-419d-9754-92c1b3bb373d" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:54:57 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquired lock "refresh_cache-8ca844b8-493a-419d-9754-92c1b3bb373d" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:54:57 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Forcefully refreshing network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 21:54:58 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Updating instance_info_cache with network_info: [{"id": "a5d97e66-99cb-4493-a66d-2fa1709d2175", "address": "fa:16:3e:14:9f:cb", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5d97e66-99", "ovs_interfaceid": "a5d97e66-99cb-4493-a66d-2fa1709d2175", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:54:58 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Releasing lock "refresh_cache-8ca844b8-493a-419d-9754-92c1b3bb373d" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:54:58 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Updated the network info_cache for instance {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 21:54:58 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:54:58 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:54:59 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:55:00 user nova-compute[72586]: DEBUG nova.compute.manager [req-79b4e023-fbb0-46aa-8271-eaf8cf3ab03e req-02f86575-fa48-44f6-8140-369adab85818 service nova] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Received event network-changed-a5d97e66-99cb-4493-a66d-2fa1709d2175 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:55:00 user nova-compute[72586]: DEBUG nova.compute.manager [req-79b4e023-fbb0-46aa-8271-eaf8cf3ab03e req-02f86575-fa48-44f6-8140-369adab85818 service nova] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Refreshing instance network info cache due to event network-changed-a5d97e66-99cb-4493-a66d-2fa1709d2175. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:55:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-79b4e023-fbb0-46aa-8271-eaf8cf3ab03e req-02f86575-fa48-44f6-8140-369adab85818 service nova] Acquiring lock "refresh_cache-8ca844b8-493a-419d-9754-92c1b3bb373d" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:55:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-79b4e023-fbb0-46aa-8271-eaf8cf3ab03e req-02f86575-fa48-44f6-8140-369adab85818 service nova] Acquired lock "refresh_cache-8ca844b8-493a-419d-9754-92c1b3bb373d" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:55:00 user nova-compute[72586]: DEBUG nova.network.neutron [req-79b4e023-fbb0-46aa-8271-eaf8cf3ab03e req-02f86575-fa48-44f6-8140-369adab85818 service nova] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Refreshing network info cache for port a5d97e66-99cb-4493-a66d-2fa1709d2175 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:55:00 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:55:00 user nova-compute[72586]: DEBUG nova.network.neutron [req-79b4e023-fbb0-46aa-8271-eaf8cf3ab03e req-02f86575-fa48-44f6-8140-369adab85818 service nova] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Updated VIF entry in instance network info cache for port a5d97e66-99cb-4493-a66d-2fa1709d2175. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:55:00 user nova-compute[72586]: DEBUG nova.network.neutron [req-79b4e023-fbb0-46aa-8271-eaf8cf3ab03e req-02f86575-fa48-44f6-8140-369adab85818 service nova] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Updating instance_info_cache with network_info: [{"id": "a5d97e66-99cb-4493-a66d-2fa1709d2175", "address": "fa:16:3e:14:9f:cb", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5d97e66-99", "ovs_interfaceid": "a5d97e66-99cb-4493-a66d-2fa1709d2175", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:55:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-79b4e023-fbb0-46aa-8271-eaf8cf3ab03e req-02f86575-fa48-44f6-8140-369adab85818 service nova] Releasing lock "refresh_cache-8ca844b8-493a-419d-9754-92c1b3bb373d" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:55:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-bb225be4-ef6a-448f-bff9-8e901665a093 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Acquiring lock "8ca844b8-493a-419d-9754-92c1b3bb373d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:55:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-bb225be4-ef6a-448f-bff9-8e901665a093 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "8ca844b8-493a-419d-9754-92c1b3bb373d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:55:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-bb225be4-ef6a-448f-bff9-8e901665a093 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Acquiring lock "8ca844b8-493a-419d-9754-92c1b3bb373d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:55:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-bb225be4-ef6a-448f-bff9-8e901665a093 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "8ca844b8-493a-419d-9754-92c1b3bb373d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:55:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-bb225be4-ef6a-448f-bff9-8e901665a093 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "8ca844b8-493a-419d-9754-92c1b3bb373d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:55:01 user nova-compute[72586]: INFO nova.compute.manager [None req-bb225be4-ef6a-448f-bff9-8e901665a093 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Terminating instance
Aug 01 21:55:01 user nova-compute[72586]: DEBUG nova.compute.manager [None req-bb225be4-ef6a-448f-bff9-8e901665a093 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Start destroying the instance on the hypervisor. {{(pid=72586) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 21:55:01 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:55:01 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:55:01 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:55:01 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:55:01 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:55:02 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Instance destroyed successfully.
Aug 01 21:55:02 user nova-compute[72586]: DEBUG nova.objects.instance [None req-bb225be4-ef6a-448f-bff9-8e901665a093 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lazy-loading 'resources' on Instance uuid 8ca844b8-493a-419d-9754-92c1b3bb373d {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-bb225be4-ef6a-448f-bff9-8e901665a093 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:53:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-108128777',display_name='tempest-TestVolumeBootPattern-server-108128777',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-108128777',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHNJjSduTMasTSgviwHre/FYLh+Mp4kuIJ4iuAJ7FsI2FanPe3E7nT7btn/7CziUSz0I1qByH5+ECZVnIY2RecZsBlCuwfU8kwCbqZrJSP50B9MRG5Gjmo9qdN10n6adqA==',key_name='tempest-TestVolumeBootPattern-705389702',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:53:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a631250d39c34afca47a1fa2817e627e',ramdisk_id='',reservation_id='r-gt8rx9pd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1160754716',owner_user_name='tempest-TestVolumeBootPattern-1160754716-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:53:22Z,user_data=None,user_id='76cd0d9d973b410ca4ff08fc7630fbc6',uuid=8ca844b8-493a-419d-9754-92c1b3bb373d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a5d97e66-99cb-4493-a66d-2fa1709d2175", "address": "fa:16:3e:14:9f:cb", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5d97e66-99", "ovs_interfaceid": "a5d97e66-99cb-4493-a66d-2fa1709d2175", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-bb225be4-ef6a-448f-bff9-8e901665a093 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Converting VIF {"id": "a5d97e66-99cb-4493-a66d-2fa1709d2175", "address": "fa:16:3e:14:9f:cb", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5d97e66-99", "ovs_interfaceid": "a5d97e66-99cb-4493-a66d-2fa1709d2175", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-bb225be4-ef6a-448f-bff9-8e901665a093 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:9f:cb,bridge_name='br-int',has_traffic_filtering=True,id=a5d97e66-99cb-4493-a66d-2fa1709d2175,network=Network(2fbf5ffb-0ec0-403b-bc92-259563ab1d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5d97e66-99') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG os_vif [None req-bb225be4-ef6a-448f-bff9-8e901665a093 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:9f:cb,bridge_name='br-int',has_traffic_filtering=True,id=a5d97e66-99cb-4493-a66d-2fa1709d2175,network=Network(2fbf5ffb-0ec0-403b-bc92-259563ab1d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5d97e66-99') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa5d97e66-99, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:55:02 user nova-compute[72586]: INFO os_vif [None req-bb225be4-ef6a-448f-bff9-8e901665a093 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:9f:cb,bridge_name='br-int',has_traffic_filtering=True,id=a5d97e66-99cb-4493-a66d-2fa1709d2175,network=Network(2fbf5ffb-0ec0-403b-bc92-259563ab1d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5d97e66-99')
Aug 01 21:55:02 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb225be4-ef6a-448f-bff9-8e901665a093 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] calling os-brick to detach iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb225be4-ef6a-448f-bff9-8e901665a093 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, {'target_iqns': ['iqn.2010-10.org.openstack:45e58aee-03a2-4803-af14-2bc9e523e86c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hQRyviYV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:55:02 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-bb225be4-ef6a-448f-bff9-8e901665a093 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:55:02 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-bb225be4-ef6a-448f-bff9-8e901665a093 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-bb225be4-ef6a-448f-bff9-8e901665a093 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb225be4-ef6a-448f-bff9-8e901665a093 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45e58aee-03a2-4803-af14-2bc9e523e86c', 0)] {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33e1043-4514-48e6-80a9-dcd03756cc75]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45e58aee-03a2-4803-af14-2bc9e523e86c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d12d54-7019-4bc7-b8d9-df797edba54b]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e58aee-03a2-4803-af14-2bc9e523e86c (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb225be4-ef6a-448f-bff9-8e901665a093 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 (non-flash)
Aug 01 21:55:02 user nova-compute[72586]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e58aee-03a2-4803-af14-2bc9e523e86c (non-flash)
Aug 01 21:55:02 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb225be4-ef6a-448f-bff9-8e901665a093 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 (non-flash)
Aug 01 21:55:02 user nova-compute[72586]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e58aee-03a2-4803-af14-2bc9e523e86c (non-flash)
Aug 01 21:55:02 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb225be4-ef6a-448f-bff9-8e901665a093 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ed03d5cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45e58aee-03a2-4803-af14-2bc9e523e86c'): ({'sdb'}, set())}) {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-bb225be4-ef6a-448f-bff9-8e901665a093 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Removing single pathed devices sdb {{(pid=72586) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG nova.compute.manager [req-7985ce41-938e-491b-8948-a13eeaecef36 req-b36f9ca3-7442-4940-8c2d-b8646eb4aa96 service nova] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Received event network-changed-a5d97e66-99cb-4493-a66d-2fa1709d2175 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG nova.compute.manager [req-7985ce41-938e-491b-8948-a13eeaecef36 req-b36f9ca3-7442-4940-8c2d-b8646eb4aa96 service nova] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Refreshing instance network info cache due to event network-changed-a5d97e66-99cb-4493-a66d-2fa1709d2175. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-7985ce41-938e-491b-8948-a13eeaecef36 req-b36f9ca3-7442-4940-8c2d-b8646eb4aa96 service nova] Acquiring lock "refresh_cache-8ca844b8-493a-419d-9754-92c1b3bb373d" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-7985ce41-938e-491b-8948-a13eeaecef36 req-b36f9ca3-7442-4940-8c2d-b8646eb4aa96 service nova] Acquired lock "refresh_cache-8ca844b8-493a-419d-9754-92c1b3bb373d" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG nova.network.neutron [req-7985ce41-938e-491b-8948-a13eeaecef36 req-b36f9ca3-7442-4940-8c2d-b8646eb4aa96 service nova] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Refreshing network info cache for port a5d97e66-99cb-4493-a66d-2fa1709d2175 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb54eb8-dce6-4397-a7c8-007b6c41a59b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[437daa7f-74bb-4dbd-a5ea-80a84aec4bc2]: (4, ('ok\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-bb225be4-ef6a-448f-bff9-8e901665a093 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Flushing IO for device /dev/sdb {{(pid=72586) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9522f4a8-b154-4063-a57d-0c4a3741f064]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-bb225be4-ef6a-448f-bff9-8e901665a093 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72586) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6cc2c25-2dd8-4720-990e-4bec9854224b]: (4, ('1', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-bb225be4-ef6a-448f-bff9-8e901665a093 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-bb225be4-ef6a-448f-bff9-8e901665a093 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] SCSI volumes sdb have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO196cae45-6296ef58d1730201', '/dev/disk/by-id/scsi-23632393665663538', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_196cae45') {{(pid=83581) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[52514cef-145c-42ea-bf74-9f789e38b9b8]: (4, None) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb225be4-ef6a-448f-bff9-8e901665a093 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45e58aee-03a2-4803-af14-2bc9e523e86c')] {{(pid=72586) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e58aee-03a2-4803-af14-2bc9e523e86c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e58aee-03a2-4803-af14-2bc9e523e86c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc0824a-f610-4356-ac86-1ccade2ed620]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb225be4-ef6a-448f-bff9-8e901665a093 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e58aee-03a2-4803-af14-2bc9e523e86c -p 172.16.0.220:3260 --logout {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e58aee-03a2-4803-af14-2bc9e523e86c -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[21860bc8-5fec-48cf-b542-8cb3f41e8c9b]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:45e58aee-03a2-4803-af14-2bc9e523e86c, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:45e58aee-03a2-4803-af14-2bc9e523e86c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb225be4-ef6a-448f-bff9-8e901665a093 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:45e58aee-03a2-4803-af14-2bc9e523e86c, portal: 172.16.0.220,3260]
Aug 01 21:55:02 user nova-compute[72586]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:45e58aee-03a2-4803-af14-2bc9e523e86c, portal: 172.16.0.220,3260] successful.
Aug 01 21:55:02 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e58aee-03a2-4803-af14-2bc9e523e86c -p 172.16.0.220:3260 --op delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e58aee-03a2-4803-af14-2bc9e523e86c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eda30d8-a311-4baa-8b92-439a3f394fb7]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb225be4-ef6a-448f-bff9-8e901665a093 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-bb225be4-ef6a-448f-bff9-8e901665a093 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb225be4-ef6a-448f-bff9-8e901665a093 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] <== disconnect_volume: return (331ms) None {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb225be4-ef6a-448f-bff9-8e901665a093 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Disconnected iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 21:55:02 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-bb225be4-ef6a-448f-bff9-8e901665a093 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Deleting instance files /opt/stack/data/nova/instances/8ca844b8-493a-419d-9754-92c1b3bb373d_del
Aug 01 21:55:02 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-bb225be4-ef6a-448f-bff9-8e901665a093 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Deletion of /opt/stack/data/nova/instances/8ca844b8-493a-419d-9754-92c1b3bb373d_del complete
Aug 01 21:55:02 user nova-compute[72586]: INFO nova.compute.manager [None req-bb225be4-ef6a-448f-bff9-8e901665a093 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Took 1.24 seconds to destroy the instance on the hypervisor.
Aug 01 21:55:02 user nova-compute[72586]: DEBUG oslo.service.loopingcall [None req-bb225be4-ef6a-448f-bff9-8e901665a093 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72586) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG nova.compute.manager [-] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Deallocating network for instance {{(pid=72586) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] deallocate_for_instance() {{(pid=72586) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG nova.network.neutron [req-7985ce41-938e-491b-8948-a13eeaecef36 req-b36f9ca3-7442-4940-8c2d-b8646eb4aa96 service nova] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Updated VIF entry in instance network info cache for port a5d97e66-99cb-4493-a66d-2fa1709d2175. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG nova.network.neutron [req-7985ce41-938e-491b-8948-a13eeaecef36 req-b36f9ca3-7442-4940-8c2d-b8646eb4aa96 service nova] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Updating instance_info_cache with network_info: [{"id": "a5d97e66-99cb-4493-a66d-2fa1709d2175", "address": "fa:16:3e:14:9f:cb", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5d97e66-99", "ovs_interfaceid": "a5d97e66-99cb-4493-a66d-2fa1709d2175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-7985ce41-938e-491b-8948-a13eeaecef36 req-b36f9ca3-7442-4940-8c2d-b8646eb4aa96 service nova] Releasing lock "refresh_cache-8ca844b8-493a-419d-9754-92c1b3bb373d" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG nova.compute.manager [req-7985ce41-938e-491b-8948-a13eeaecef36 req-b36f9ca3-7442-4940-8c2d-b8646eb4aa96 service nova] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Received event network-vif-unplugged-a5d97e66-99cb-4493-a66d-2fa1709d2175 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-7985ce41-938e-491b-8948-a13eeaecef36 req-b36f9ca3-7442-4940-8c2d-b8646eb4aa96 service nova] Acquiring lock "8ca844b8-493a-419d-9754-92c1b3bb373d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-7985ce41-938e-491b-8948-a13eeaecef36 req-b36f9ca3-7442-4940-8c2d-b8646eb4aa96 service nova] Lock "8ca844b8-493a-419d-9754-92c1b3bb373d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-7985ce41-938e-491b-8948-a13eeaecef36 req-b36f9ca3-7442-4940-8c2d-b8646eb4aa96 service nova] Lock "8ca844b8-493a-419d-9754-92c1b3bb373d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG nova.compute.manager [req-7985ce41-938e-491b-8948-a13eeaecef36 req-b36f9ca3-7442-4940-8c2d-b8646eb4aa96 service nova] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] No waiting events found dispatching network-vif-unplugged-a5d97e66-99cb-4493-a66d-2fa1709d2175 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG nova.compute.manager [req-7985ce41-938e-491b-8948-a13eeaecef36 req-b36f9ca3-7442-4940-8c2d-b8646eb4aa96 service nova] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Received event network-vif-unplugged-a5d97e66-99cb-4493-a66d-2fa1709d2175 for instance with task_state deleting. {{(pid=72586) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG nova.compute.manager [req-7985ce41-938e-491b-8948-a13eeaecef36 req-b36f9ca3-7442-4940-8c2d-b8646eb4aa96 service nova] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Received event network-vif-plugged-a5d97e66-99cb-4493-a66d-2fa1709d2175 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-7985ce41-938e-491b-8948-a13eeaecef36 req-b36f9ca3-7442-4940-8c2d-b8646eb4aa96 service nova] Acquiring lock "8ca844b8-493a-419d-9754-92c1b3bb373d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-7985ce41-938e-491b-8948-a13eeaecef36 req-b36f9ca3-7442-4940-8c2d-b8646eb4aa96 service nova] Lock "8ca844b8-493a-419d-9754-92c1b3bb373d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-7985ce41-938e-491b-8948-a13eeaecef36 req-b36f9ca3-7442-4940-8c2d-b8646eb4aa96 service nova] Lock "8ca844b8-493a-419d-9754-92c1b3bb373d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:55:02 user nova-compute[72586]: DEBUG nova.compute.manager [req-7985ce41-938e-491b-8948-a13eeaecef36 req-b36f9ca3-7442-4940-8c2d-b8646eb4aa96 service nova] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] No waiting events found dispatching network-vif-plugged-a5d97e66-99cb-4493-a66d-2fa1709d2175 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:55:02 user nova-compute[72586]: WARNING nova.compute.manager [req-7985ce41-938e-491b-8948-a13eeaecef36 req-b36f9ca3-7442-4940-8c2d-b8646eb4aa96 service nova] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Received unexpected event network-vif-plugged-a5d97e66-99cb-4493-a66d-2fa1709d2175 for instance with vm_state active and task_state deleting.
Aug 01 21:55:03 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:55:03 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Took 0.54 seconds to deallocate network for instance.
Aug 01 21:55:03 user nova-compute[72586]: INFO nova.compute.manager [None req-bb225be4-ef6a-448f-bff9-8e901665a093 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Took 0.74 seconds to detach 1 volumes for instance.
Aug 01 21:55:03 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-bb225be4-ef6a-448f-bff9-8e901665a093 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:55:03 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-bb225be4-ef6a-448f-bff9-8e901665a093 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:55:04 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-bb225be4-ef6a-448f-bff9-8e901665a093 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:55:04 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-bb225be4-ef6a-448f-bff9-8e901665a093 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:55:04 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-bb225be4-ef6a-448f-bff9-8e901665a093 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.216s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:55:04 user nova-compute[72586]: INFO nova.scheduler.client.report [None req-bb225be4-ef6a-448f-bff9-8e901665a093 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Deleted allocations for instance 8ca844b8-493a-419d-9754-92c1b3bb373d
Aug 01 21:55:04 user nova-compute[72586]: DEBUG nova.compute.manager [req-809d8ae6-1efe-4c9b-b8ac-f765a4d23760 req-ce6b63d5-2d1f-492a-9361-590c50f1d6a3 service nova] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Received event network-vif-deleted-a5d97e66-99cb-4493-a66d-2fa1709d2175 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:55:04 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-bb225be4-ef6a-448f-bff9-8e901665a093 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "8ca844b8-493a-419d-9754-92c1b3bb373d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.951s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:55:05 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:55:07 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:55:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:55:14 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:55:14 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:55:14 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:55:14 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:55:14 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:55:14 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:55:14 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:55:14 user nova-compute[72586]: DEBUG nova.virt.libvirt.imagecache [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Verify base images {{(pid=72586) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 01 21:55:14 user nova-compute[72586]: DEBUG nova.virt.libvirt.imagecache [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Image id 0243d46b-6819-42a5-926f-42b71f0c97ad yields fingerprint 9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 {{(pid=72586) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 01 21:55:14 user nova-compute[72586]: INFO nova.virt.libvirt.imagecache [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] image 0243d46b-6819-42a5-926f-42b71f0c97ad at (/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08): checking
Aug 01 21:55:14 user nova-compute[72586]: DEBUG nova.virt.libvirt.imagecache [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] image 0243d46b-6819-42a5-926f-42b71f0c97ad at (/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08): image is in use {{(pid=72586) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 01 21:55:14 user nova-compute[72586]: DEBUG nova.virt.libvirt.imagecache [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=72586) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 01 21:55:14 user nova-compute[72586]: DEBUG nova.virt.libvirt.imagecache [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] 055a4027-b090-43f3-998e-5bd3ba3c0109 is a valid instance name {{(pid=72586) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 01 21:55:14 user nova-compute[72586]: DEBUG nova.virt.libvirt.imagecache [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] 7900178d-22dc-4571-8aa4-b5562fb3a927 is a valid instance name {{(pid=72586) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 01 21:55:14 user nova-compute[72586]: DEBUG nova.virt.libvirt.imagecache [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] 7900178d-22dc-4571-8aa4-b5562fb3a927 has a disk file {{(pid=72586) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 01 21:55:14 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7900178d-22dc-4571-8aa4-b5562fb3a927/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:55:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7900178d-22dc-4571-8aa4-b5562fb3a927/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:55:15 user nova-compute[72586]: DEBUG nova.virt.libvirt.imagecache [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 7900178d-22dc-4571-8aa4-b5562fb3a927 is backed by 9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 {{(pid=72586) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 01 21:55:15 user nova-compute[72586]: DEBUG nova.virt.libvirt.imagecache [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] ec73ec4b-4591-46f2-9192-7868125c53c5 is a valid instance name {{(pid=72586) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 01 21:55:15 user nova-compute[72586]: DEBUG nova.virt.libvirt.imagecache [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] ec73ec4b-4591-46f2-9192-7868125c53c5 has a disk file {{(pid=72586) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 01 21:55:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec73ec4b-4591-46f2-9192-7868125c53c5/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:55:15 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec73ec4b-4591-46f2-9192-7868125c53c5/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:55:15 user nova-compute[72586]: DEBUG nova.virt.libvirt.imagecache [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance ec73ec4b-4591-46f2-9192-7868125c53c5 is backed by 9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 {{(pid=72586) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 01 21:55:15 user nova-compute[72586]: WARNING nova.virt.libvirt.imagecache [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Unknown base file: /opt/stack/data/nova/instances/_base/035f4a080c60286e064e7502ecc933d55f1d246e
Aug 01 21:55:15 user nova-compute[72586]: WARNING nova.virt.libvirt.imagecache [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Unknown base file: /opt/stack/data/nova/instances/_base/26780bcd8d16ee62b640857842ecaa2af4b1ae58
Aug 01 21:55:15 user nova-compute[72586]: WARNING nova.virt.libvirt.imagecache [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Unknown base file: /opt/stack/data/nova/instances/_base/bcc4a6e008b642e8af0e223900f983c2ebd5af9a
Aug 01 21:55:15 user nova-compute[72586]: WARNING nova.virt.libvirt.imagecache [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Unknown base file: /opt/stack/data/nova/instances/_base/7d80961d96ee6d713f11e481bbede074b74a3258
Aug 01 21:55:15 user nova-compute[72586]: WARNING nova.virt.libvirt.imagecache [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Unknown base file: /opt/stack/data/nova/instances/_base/1abfc712f2676c281ed5204e1d05e6a731788b26
Aug 01 21:55:15 user nova-compute[72586]: WARNING nova.virt.libvirt.imagecache [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Unknown base file: /opt/stack/data/nova/instances/_base/616316bc3aa017e5be44b4848d8064f39fb2137c
Aug 01 21:55:15 user nova-compute[72586]: WARNING nova.virt.libvirt.imagecache [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Unknown base file: /opt/stack/data/nova/instances/_base/b4c15f4ad18a8fa36f6467fbeacb2e64b53dd35c
Aug 01 21:55:15 user nova-compute[72586]: WARNING nova.virt.libvirt.imagecache [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Unknown base file: /opt/stack/data/nova/instances/_base/0827cb066310d196d104f1a1fa3b55bde3df850a
Aug 01 21:55:15 user nova-compute[72586]: INFO nova.virt.libvirt.imagecache [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Active base files: /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08
Aug 01 21:55:15 user nova-compute[72586]: INFO nova.virt.libvirt.imagecache [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Removable base files: /opt/stack/data/nova/instances/_base/035f4a080c60286e064e7502ecc933d55f1d246e /opt/stack/data/nova/instances/_base/26780bcd8d16ee62b640857842ecaa2af4b1ae58 /opt/stack/data/nova/instances/_base/bcc4a6e008b642e8af0e223900f983c2ebd5af9a /opt/stack/data/nova/instances/_base/7d80961d96ee6d713f11e481bbede074b74a3258 /opt/stack/data/nova/instances/_base/1abfc712f2676c281ed5204e1d05e6a731788b26 /opt/stack/data/nova/instances/_base/616316bc3aa017e5be44b4848d8064f39fb2137c /opt/stack/data/nova/instances/_base/b4c15f4ad18a8fa36f6467fbeacb2e64b53dd35c /opt/stack/data/nova/instances/_base/0827cb066310d196d104f1a1fa3b55bde3df850a
Aug 01 21:55:15 user nova-compute[72586]: INFO nova.virt.libvirt.imagecache [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/035f4a080c60286e064e7502ecc933d55f1d246e
Aug 01 21:55:15 user nova-compute[72586]: INFO nova.virt.libvirt.imagecache [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/26780bcd8d16ee62b640857842ecaa2af4b1ae58
Aug 01 21:55:15 user nova-compute[72586]: INFO nova.virt.libvirt.imagecache [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/bcc4a6e008b642e8af0e223900f983c2ebd5af9a
Aug 01 21:55:15 user nova-compute[72586]: INFO nova.virt.libvirt.imagecache [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7d80961d96ee6d713f11e481bbede074b74a3258
Aug 01 21:55:15 user nova-compute[72586]: INFO nova.virt.libvirt.imagecache [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1abfc712f2676c281ed5204e1d05e6a731788b26
Aug 01 21:55:15 user nova-compute[72586]: INFO nova.virt.libvirt.imagecache [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/616316bc3aa017e5be44b4848d8064f39fb2137c
Aug 01 21:55:15 user nova-compute[72586]: INFO nova.virt.libvirt.imagecache [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b4c15f4ad18a8fa36f6467fbeacb2e64b53dd35c
Aug 01 21:55:15 user nova-compute[72586]: INFO nova.virt.libvirt.imagecache [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/0827cb066310d196d104f1a1fa3b55bde3df850a
Aug 01 21:55:15 user nova-compute[72586]: DEBUG nova.virt.libvirt.imagecache [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Verification complete {{(pid=72586) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 01 21:55:15 user nova-compute[72586]: DEBUG nova.virt.libvirt.imagecache [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Verify swap images {{(pid=72586) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 01 21:55:15 user nova-compute[72586]: DEBUG nova.virt.libvirt.imagecache [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Verify ephemeral images {{(pid=72586) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 01 21:55:17 user nova-compute[72586]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690926902.0533288, 8ca844b8-493a-419d-9754-92c1b3bb373d => Stopped> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:55:17 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] VM Stopped (Lifecycle Event)
Aug 01 21:55:17 user nova-compute[72586]: DEBUG nova.compute.manager [None req-579914d1-806c-418c-9231-3607d4a6e937 None None] [instance: 8ca844b8-493a-419d-9754-92c1b3bb373d] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:55:17 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:55:22 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:55:27 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:55:28 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:55:29 user nova-compute[72586]: DEBUG nova.compute.manager [req-fc84fb28-ae6e-41bf-8894-f22c96c967e0 req-bdff3c12-0ed0-4981-a589-000782d56686 service nova] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Received event network-changed-7bb3754b-f5e0-465c-a140-3bbddd87400a {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:55:29 user nova-compute[72586]: DEBUG nova.compute.manager [req-fc84fb28-ae6e-41bf-8894-f22c96c967e0 req-bdff3c12-0ed0-4981-a589-000782d56686 service nova] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Refreshing instance network info cache due to event network-changed-7bb3754b-f5e0-465c-a140-3bbddd87400a. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:55:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-fc84fb28-ae6e-41bf-8894-f22c96c967e0 req-bdff3c12-0ed0-4981-a589-000782d56686 service nova] Acquiring lock "refresh_cache-ec73ec4b-4591-46f2-9192-7868125c53c5" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:55:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-fc84fb28-ae6e-41bf-8894-f22c96c967e0 req-bdff3c12-0ed0-4981-a589-000782d56686 service nova] Acquired lock "refresh_cache-ec73ec4b-4591-46f2-9192-7868125c53c5" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:55:29 user nova-compute[72586]: DEBUG nova.network.neutron [req-fc84fb28-ae6e-41bf-8894-f22c96c967e0 req-bdff3c12-0ed0-4981-a589-000782d56686 service nova] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Refreshing network info cache for port 7bb3754b-f5e0-465c-a140-3bbddd87400a {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:55:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b75e1cf2-eb52-4ca5-b49e-2614b31001d4 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Acquiring lock "ec73ec4b-4591-46f2-9192-7868125c53c5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:55:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b75e1cf2-eb52-4ca5-b49e-2614b31001d4 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lock "ec73ec4b-4591-46f2-9192-7868125c53c5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:55:29 user nova-compute[72586]: DEBUG nova.objects.instance [None req-b75e1cf2-eb52-4ca5-b49e-2614b31001d4 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lazy-loading 'flavor' on Instance uuid ec73ec4b-4591-46f2-9192-7868125c53c5 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:55:29 user nova-compute[72586]: DEBUG nova.network.neutron [req-fc84fb28-ae6e-41bf-8894-f22c96c967e0 req-bdff3c12-0ed0-4981-a589-000782d56686 service nova] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Updated VIF entry in instance network info cache for port 7bb3754b-f5e0-465c-a140-3bbddd87400a. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:55:29 user nova-compute[72586]: DEBUG nova.network.neutron [req-fc84fb28-ae6e-41bf-8894-f22c96c967e0 req-bdff3c12-0ed0-4981-a589-000782d56686 service nova] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Updating instance_info_cache with network_info: [{"id": "7bb3754b-f5e0-465c-a140-3bbddd87400a", "address": "fa:16:3e:56:f7:d0", "network": {"id": "6b6d5e8a-1c0a-4d1b-93d1-4de7246e39fb", "bridge": "br-int", "label": "tempest-TestStampPattern-2085707213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6745cf6719124010a510bd54fd5b9259", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bb3754b-f5", "ovs_interfaceid": "7bb3754b-f5e0-465c-a140-3bbddd87400a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:55:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b75e1cf2-eb52-4ca5-b49e-2614b31001d4 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lock "ec73ec4b-4591-46f2-9192-7868125c53c5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:55:29 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-fc84fb28-ae6e-41bf-8894-f22c96c967e0 req-bdff3c12-0ed0-4981-a589-000782d56686 service nova] Releasing lock "refresh_cache-ec73ec4b-4591-46f2-9192-7868125c53c5" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:55:30 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b75e1cf2-eb52-4ca5-b49e-2614b31001d4 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Acquiring lock "ec73ec4b-4591-46f2-9192-7868125c53c5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:55:30 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b75e1cf2-eb52-4ca5-b49e-2614b31001d4 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lock "ec73ec4b-4591-46f2-9192-7868125c53c5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:55:30 user nova-compute[72586]: INFO nova.compute.manager [None req-b75e1cf2-eb52-4ca5-b49e-2614b31001d4 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Attaching volume bd1da95c-5033-464a-89bc-963de4ce8ba7 to /dev/vdb
Aug 01 21:55:30 user nova-compute[72586]: DEBUG os_brick.utils [None req-b75e1cf2-eb52-4ca5-b49e-2614b31001d4 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:55:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:55:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:55:30 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[12df5fe6-1dfe-436b-8adc-cf365a7326e4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4bc202fb9cb\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:55:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:55:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:55:30 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[84585e0e-857c-4310-b429-79df467df007]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:55:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:55:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:55:30 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c0b83c-74f5-4072-a5c6-5784574e6b1e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:55:30 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[913214ce-a058-41f5-8dfb-48ccda09fa67]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:55:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-b75e1cf2-eb52-4ca5-b49e-2614b31001d4 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Running cmd (subprocess): nvme version {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:55:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-b75e1cf2-eb52-4ca5-b49e-2614b31001d4 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] 'nvme version' failed. Not Retrying. {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:55:30 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b75e1cf2-eb52-4ca5-b49e-2614b31001d4 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] nvme not present on system {{(pid=72586) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 21:55:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:55:30 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:55:30 user nova-compute[72586]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 21:55:30 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[970e5b84-220e-40cc-b170-3b28e096c264]: (4, '') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:55:30 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-b75e1cf2-eb52-4ca5-b49e-2614b31001d4 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72586) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 21:55:30 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-b75e1cf2-eb52-4ca5-b49e-2614b31001d4 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 21:55:30 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-b75e1cf2-eb52-4ca5-b49e-2614b31001d4 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] LIGHTOS: no hostnqn found. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 21:55:30 user nova-compute[72586]: DEBUG os_brick.utils [None req-b75e1cf2-eb52-4ca5-b49e-2614b31001d4 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4bc202fb9cb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:55:30 user nova-compute[72586]: DEBUG nova.virt.block_device [None req-b75e1cf2-eb52-4ca5-b49e-2614b31001d4 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Updating existing volume attachment record: 33a2eb06-6fc2-43f6-9611-0b76f079c075 {{(pid=72586) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 21:55:30 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:55:32 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:55:35 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:55:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:55:37 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b75e1cf2-eb52-4ca5-b49e-2614b31001d4 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Calling os-brick to attach iSCSI Volume {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 21:55:37 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75e1cf2-eb52-4ca5-b49e-2614b31001d4 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bd1da95c-5033-464a-89bc-963de4ce8ba7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'inqbFYPZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:55:37 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-b75e1cf2-eb52-4ca5-b49e-2614b31001d4 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:55:37 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-b75e1cf2-eb52-4ca5-b49e-2614b31001d4 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:55:37 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-b75e1cf2-eb52-4ca5-b49e-2614b31001d4 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:55:37 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-b75e1cf2-eb52-4ca5-b49e-2614b31001d4 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:55:37 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-b75e1cf2-eb52-4ca5-b49e-2614b31001d4 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd1da95c-5033-464a-89bc-963de4ce8ba7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:55:37 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-b75e1cf2-eb52-4ca5-b49e-2614b31001d4 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd1da95c-5033-464a-89bc-963de4ce8ba7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:55:37 user nova-compute[72586]: INFO os_brick.initiator.connectors.iscsi [None req-b75e1cf2-eb52-4ca5-b49e-2614b31001d4 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 21:55:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd1da95c-5033-464a-89bc-963de4ce8ba7 -p 172.16.0.220:3260 {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:55:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd1da95c-5033-464a-89bc-963de4ce8ba7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:55:37 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1a28a6-b301-4e8d-9a50-bf17adde53b1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:55:37 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75e1cf2-eb52-4ca5-b49e-2614b31001d4 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 21:55:37 user nova-compute[72586]:  {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:55:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd1da95c-5033-464a-89bc-963de4ce8ba7 -p 172.16.0.220:3260 --interface default --op new {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:55:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd1da95c-5033-464a-89bc-963de4ce8ba7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:55:37 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d41bd38-597d-4b24-8780-3d6f87e4dc1c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bd1da95c-5033-464a-89bc-963de4ce8ba7] added\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:55:37 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75e1cf2-eb52-4ca5-b49e-2614b31001d4 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bd1da95c-5033-464a-89bc-963de4ce8ba7] added
Aug 01 21:55:37 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:55:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd1da95c-5033-464a-89bc-963de4ce8ba7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:55:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd1da95c-5033-464a-89bc-963de4ce8ba7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:55:37 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b808fe0b-6fe2-453b-bdaa-81a2204140b5]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:55:37 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75e1cf2-eb52-4ca5-b49e-2614b31001d4 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:55:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd1da95c-5033-464a-89bc-963de4ce8ba7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:55:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd1da95c-5033-464a-89bc-963de4ce8ba7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:55:37 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4dcd686-8265-4d0f-b1d0-97cd2024cd9f]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:55:37 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75e1cf2-eb52-4ca5-b49e-2614b31001d4 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:55:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd1da95c-5033-464a-89bc-963de4ce8ba7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v inqbFYPZ {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:55:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd1da95c-5033-464a-89bc-963de4ce8ba7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v inqbFYPZ" returned: 0 in 0.026s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:55:37 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e03e01f-77e4-4905-a2ca-0bc1d539418e]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:55:37 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75e1cf2-eb52-4ca5-b49e-2614b31001d4 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'inqbFYPZ'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:55:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd1da95c-5033-464a-89bc-963de4ce8ba7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:55:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd1da95c-5033-464a-89bc-963de4ce8ba7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:55:37 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[937cf3d0-376c-4853-a355-582d179790a4]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:55:37 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75e1cf2-eb52-4ca5-b49e-2614b31001d4 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:55:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:55:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:55:37 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[414f976b-6880-4502-b462-d03f51169b30]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:55:37 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75e1cf2-eb52-4ca5-b49e-2614b31001d4 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 (non-flash)
Aug 01 21:55:37 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:55:37 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75e1cf2-eb52-4ca5-b49e-2614b31001d4 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 (non-flash)
Aug 01 21:55:37 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:55:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd1da95c-5033-464a-89bc-963de4ce8ba7 -p 172.16.0.220:3260 --login {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:55:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd1da95c-5033-464a-89bc-963de4ce8ba7 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:55:37 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4db6b7c-e931-49a0-b1b0-7e97b35b0c42]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bd1da95c-5033-464a-89bc-963de4ce8ba7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bd1da95c-5033-464a-89bc-963de4ce8ba7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:55:37 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75e1cf2-eb52-4ca5-b49e-2614b31001d4 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bd1da95c-5033-464a-89bc-963de4ce8ba7, portal: 172.16.0.220,3260]
Aug 01 21:55:37 user nova-compute[72586]: Login to [iface: default, target: iqn.2010-10.org.openstack:bd1da95c-5033-464a-89bc-963de4ce8ba7, portal: 172.16.0.220,3260] successful.
Aug 01 21:55:37 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:55:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd1da95c-5033-464a-89bc-963de4ce8ba7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:55:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd1da95c-5033-464a-89bc-963de4ce8ba7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:55:37 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[58bc480e-2aa5-41bd-8584-f109c24d9ee5]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:55:37 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75e1cf2-eb52-4ca5-b49e-2614b31001d4 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:55:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:55:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:55:37 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7eeb86a-654e-4072-bfe4-5502db70651b]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd1da95c-5033-464a-89bc-963de4ce8ba7 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:55:37 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75e1cf2-eb52-4ca5-b49e-2614b31001d4 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 (non-flash)
Aug 01 21:55:37 user nova-compute[72586]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd1da95c-5033-464a-89bc-963de4ce8ba7 (non-flash)
Aug 01 21:55:37 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:55:37 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75e1cf2-eb52-4ca5-b49e-2614b31001d4 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 (non-flash)
Aug 01 21:55:37 user nova-compute[72586]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd1da95c-5033-464a-89bc-963de4ce8ba7 (non-flash)
Aug 01 21:55:37 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:55:37 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-b75e1cf2-eb52-4ca5-b49e-2614b31001d4 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd1da95c-5033-464a-89bc-963de4ce8ba7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:55:37 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75e1cf2-eb52-4ca5-b49e-2614b31001d4 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Connected to 172.16.0.220:3260 {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 21:55:37 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-b75e1cf2-eb52-4ca5-b49e-2614b31001d4 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=72586) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 21:55:37 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-b75e1cf2-eb52-4ca5-b49e-2614b31001d4 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72586) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 21:55:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:55:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:55:37 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb76d20-7151-4d60-a706-39634bce8b6b]: (4, ('- - 0', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:55:37 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-b75e1cf2-eb52-4ca5-b49e-2614b31001d4 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: None {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:55:38 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-b75e1cf2-eb52-4ca5-b49e-2614b31001d4 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:55:38 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75e1cf2-eb52-4ca5-b49e-2614b31001d4 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'inqbFYPZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 21:55:38 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-b75e1cf2-eb52-4ca5-b49e-2614b31001d4 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:55:38 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75e1cf2-eb52-4ca5-b49e-2614b31001d4 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23933643335323265', 'path': '/dev/sdb'} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:55:38 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b75e1cf2-eb52-4ca5-b49e-2614b31001d4 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933643335323265', 'path': '/dev/sdb'} {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 21:55:38 user nova-compute[72586]: DEBUG nova.objects.instance [None req-b75e1cf2-eb52-4ca5-b49e-2614b31001d4 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lazy-loading 'flavor' on Instance uuid ec73ec4b-4591-46f2-9192-7868125c53c5 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:55:38 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-b75e1cf2-eb52-4ca5-b49e-2614b31001d4 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 21:55:38 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:55:38 user nova-compute[72586]:   <source dev="/dev/sdb"/>
Aug 01 21:55:38 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:55:38 user nova-compute[72586]:   <serial>bd1da95c-5033-464a-89bc-963de4ce8ba7</serial>
Aug 01 21:55:38 user nova-compute[72586]: </disk>
Aug 01 21:55:38 user nova-compute[72586]:  {{(pid=72586) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 21:55:39 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-b75e1cf2-eb52-4ca5-b49e-2614b31001d4 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:55:39 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-b75e1cf2-eb52-4ca5-b49e-2614b31001d4 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:55:39 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-b75e1cf2-eb52-4ca5-b49e-2614b31001d4 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] No VIF found with MAC fa:16:3e:56:f7:d0, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:55:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b75e1cf2-eb52-4ca5-b49e-2614b31001d4 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lock "ec73ec4b-4591-46f2-9192-7868125c53c5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.147s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:55:40 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:55:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-11033a91-ae05-42c2-80b1-8091464cbda0 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Acquiring lock "ec73ec4b-4591-46f2-9192-7868125c53c5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:55:41 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-11033a91-ae05-42c2-80b1-8091464cbda0 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lock "ec73ec4b-4591-46f2-9192-7868125c53c5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:55:41 user nova-compute[72586]: INFO nova.compute.manager [None req-11033a91-ae05-42c2-80b1-8091464cbda0 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Detaching volume bd1da95c-5033-464a-89bc-963de4ce8ba7
Aug 01 21:55:41 user nova-compute[72586]: INFO nova.virt.block_device [None req-11033a91-ae05-42c2-80b1-8091464cbda0 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Attempting to driver detach volume bd1da95c-5033-464a-89bc-963de4ce8ba7 from mountpoint /dev/vdb
Aug 01 21:55:41 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-11033a91-ae05-42c2-80b1-8091464cbda0 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Attempting to detach device vdb from instance ec73ec4b-4591-46f2-9192-7868125c53c5 from the persistent domain config. {{(pid=72586) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 21:55:41 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-11033a91-ae05-42c2-80b1-8091464cbda0 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 21:55:41 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:55:41 user nova-compute[72586]:   <source dev="/dev/sdb"/>
Aug 01 21:55:41 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:55:41 user nova-compute[72586]:   <serial>bd1da95c-5033-464a-89bc-963de4ce8ba7</serial>
Aug 01 21:55:41 user nova-compute[72586]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 21:55:41 user nova-compute[72586]: </disk>
Aug 01 21:55:41 user nova-compute[72586]:  {{(pid=72586) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 21:55:41 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-11033a91-ae05-42c2-80b1-8091464cbda0 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Successfully detached device vdb from instance ec73ec4b-4591-46f2-9192-7868125c53c5 from the persistent domain config.
Aug 01 21:55:41 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-11033a91-ae05-42c2-80b1-8091464cbda0 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ec73ec4b-4591-46f2-9192-7868125c53c5 from the live domain config. {{(pid=72586) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 21:55:41 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-11033a91-ae05-42c2-80b1-8091464cbda0 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 21:55:41 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:55:41 user nova-compute[72586]:   <source dev="/dev/sdb"/>
Aug 01 21:55:41 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:55:41 user nova-compute[72586]:   <serial>bd1da95c-5033-464a-89bc-963de4ce8ba7</serial>
Aug 01 21:55:41 user nova-compute[72586]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 21:55:41 user nova-compute[72586]: </disk>
Aug 01 21:55:41 user nova-compute[72586]:  {{(pid=72586) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 21:55:41 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Received event <DeviceRemovedEvent: 1690926941.983741, ec73ec4b-4591-46f2-9192-7868125c53c5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72586) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 21:55:41 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-11033a91-ae05-42c2-80b1-8091464cbda0 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ec73ec4b-4591-46f2-9192-7868125c53c5 {{(pid=72586) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 21:55:41 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-11033a91-ae05-42c2-80b1-8091464cbda0 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Successfully detached device vdb from instance ec73ec4b-4591-46f2-9192-7868125c53c5 from the live domain config.
Aug 01 21:55:41 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11033a91-ae05-42c2-80b1-8091464cbda0 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] calling os-brick to detach iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 21:55:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-11033a91-ae05-42c2-80b1-8091464cbda0 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, {'target_iqns': ['iqn.2010-10.org.openstack:bd1da95c-5033-464a-89bc-963de4ce8ba7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'inqbFYPZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:55:41 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-11033a91-ae05-42c2-80b1-8091464cbda0 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:55:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-11033a91-ae05-42c2-80b1-8091464cbda0 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:55:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-11033a91-ae05-42c2-80b1-8091464cbda0 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:55:41 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-11033a91-ae05-42c2-80b1-8091464cbda0 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd1da95c-5033-464a-89bc-963de4ce8ba7', 0)] {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 21:55:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:55:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:55:42 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae3d75b-d5a6-498a-8405-54f25f9693fb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd1da95c-5033-464a-89bc-963de4ce8ba7\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:55:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:55:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:55:42 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9da8fe6-71f2-442e-979d-351db9da9425]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd1da95c-5033-464a-89bc-963de4ce8ba7 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:55:42 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-11033a91-ae05-42c2-80b1-8091464cbda0 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 (non-flash)
Aug 01 21:55:42 user nova-compute[72586]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd1da95c-5033-464a-89bc-963de4ce8ba7 (non-flash)
Aug 01 21:55:42 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:55:42 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-11033a91-ae05-42c2-80b1-8091464cbda0 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 (non-flash)
Aug 01 21:55:42 user nova-compute[72586]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd1da95c-5033-464a-89bc-963de4ce8ba7 (non-flash)
Aug 01 21:55:42 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:55:42 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-11033a91-ae05-42c2-80b1-8091464cbda0 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ee837bc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd1da95c-5033-464a-89bc-963de4ce8ba7'): ({'sdb'}, set())}) {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 21:55:42 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-11033a91-ae05-42c2-80b1-8091464cbda0 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Removing single pathed devices sdb {{(pid=72586) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 21:55:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:55:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:55:42 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b32383-63c6-44c5-a418-34a819275acb]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:55:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:55:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:55:42 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16af163-75d6-4866-8d88-93d3c95aea6f]: (4, ('ok\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:55:42 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-11033a91-ae05-42c2-80b1-8091464cbda0 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Flushing IO for device /dev/sdb {{(pid=72586) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 21:55:42 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:55:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:55:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:55:42 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b656a8-f3dd-4dcc-85e2-08870f6cbbd0]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:55:42 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-11033a91-ae05-42c2-80b1-8091464cbda0 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72586) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 21:55:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:55:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:55:42 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4b0ff1-37b4-4be1-95e1-cdc95819fdd9]: (4, ('1', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:55:42 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-11033a91-ae05-42c2-80b1-8091464cbda0 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 21:55:42 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-11033a91-ae05-42c2-80b1-8091464cbda0 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] SCSI volumes sdb have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 21:55:42 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-11033a91-ae05-42c2-80b1-8091464cbda0 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd1da95c-5033-464a-89bc-963de4ce8ba7')] {{(pid=72586) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 21:55:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd1da95c-5033-464a-89bc-963de4ce8ba7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:55:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd1da95c-5033-464a-89bc-963de4ce8ba7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:55:42 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d95864d-3861-4289-af5d-aa5158e0f17a]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:55:42 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-11033a91-ae05-42c2-80b1-8091464cbda0 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:55:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd1da95c-5033-464a-89bc-963de4ce8ba7 -p 172.16.0.220:3260 --logout {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:55:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd1da95c-5033-464a-89bc-963de4ce8ba7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:55:42 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[07329184-b596-4310-88d5-c7a1d151265d]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:bd1da95c-5033-464a-89bc-963de4ce8ba7, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:bd1da95c-5033-464a-89bc-963de4ce8ba7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:55:42 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-11033a91-ae05-42c2-80b1-8091464cbda0 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:bd1da95c-5033-464a-89bc-963de4ce8ba7, portal: 172.16.0.220,3260]
Aug 01 21:55:42 user nova-compute[72586]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:bd1da95c-5033-464a-89bc-963de4ce8ba7, portal: 172.16.0.220,3260] successful.
Aug 01 21:55:42 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:55:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd1da95c-5033-464a-89bc-963de4ce8ba7 -p 172.16.0.220:3260 --op delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:55:42 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd1da95c-5033-464a-89bc-963de4ce8ba7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:55:42 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f9419c-e41e-4fbd-8085-2d5750d04657]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:55:42 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-11033a91-ae05-42c2-80b1-8091464cbda0 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:55:42 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-11033a91-ae05-42c2-80b1-8091464cbda0 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:55:42 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-11033a91-ae05-42c2-80b1-8091464cbda0 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] <== disconnect_volume: return (272ms) None {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:55:42 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11033a91-ae05-42c2-80b1-8091464cbda0 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Disconnected iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 21:55:43 user nova-compute[72586]: DEBUG nova.objects.instance [None req-11033a91-ae05-42c2-80b1-8091464cbda0 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lazy-loading 'flavor' on Instance uuid ec73ec4b-4591-46f2-9192-7868125c53c5 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:55:43 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-11033a91-ae05-42c2-80b1-8091464cbda0 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lock "ec73ec4b-4591-46f2-9192-7868125c53c5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.611s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:55:45 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:55:45 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:55:46 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:55:46 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72586) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 21:55:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:55:47 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:55:47 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:55:47 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:55:49 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:55:49 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Cleaning up deleted instances with incomplete migration  {{(pid=72586) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 21:55:52 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:55:52 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:55:52 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:55:52 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:55:52 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:55:52 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Auditing locally available compute resources for user (node: user) {{(pid=72586) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 21:55:53 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7900178d-22dc-4571-8aa4-b5562fb3a927/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:55:53 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7900178d-22dc-4571-8aa4-b5562fb3a927/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:55:53 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7900178d-22dc-4571-8aa4-b5562fb3a927/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:55:53 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7900178d-22dc-4571-8aa4-b5562fb3a927/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:55:53 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72586) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 21:55:53 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec73ec4b-4591-46f2-9192-7868125c53c5/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:55:53 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec73ec4b-4591-46f2-9192-7868125c53c5/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:55:53 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec73ec4b-4591-46f2-9192-7868125c53c5/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:55:53 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec73ec4b-4591-46f2-9192-7868125c53c5/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:55:54 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:55:54 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:55:54 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Hypervisor/Node resource view: name=user free_ram=8510MB free_disk=25.225406646728516GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72586) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 21:55:54 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:55:54 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:55:54 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 055a4027-b090-43f3-998e-5bd3ba3c0109 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:55:54 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance ec73ec4b-4591-46f2-9192-7868125c53c5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:55:54 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 7900178d-22dc-4571-8aa4-b5562fb3a927 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:55:54 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 21:55:54 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 21:55:54 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Refreshing inventories for resource provider ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 21:55:54 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Updating ProviderTree inventory for provider ca6775c1-2a64-43f9-9467-372aa0457b1d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 21:55:54 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Updating inventory in ProviderTree for provider ca6775c1-2a64-43f9-9467-372aa0457b1d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 21:55:54 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Refreshing aggregate associations for resource provider ca6775c1-2a64-43f9-9467-372aa0457b1d, aggregates: None {{(pid=72586) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 21:55:54 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Refreshing trait associations for resource provider ca6775c1-2a64-43f9-9467-372aa0457b1d, traits: COMPUTE_NODE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_TRUSTED_CERTS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AMI {{(pid=72586) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 21:55:54 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:55:54 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:55:54 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Compute_service record updated for user:user {{(pid=72586) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 21:55:54 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.514s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:55:57 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:55:58 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:55:58 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Starting heal instance info cache {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 21:55:58 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "refresh_cache-ec73ec4b-4591-46f2-9192-7868125c53c5" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:55:58 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquired lock "refresh_cache-ec73ec4b-4591-46f2-9192-7868125c53c5" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:55:58 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Forcefully refreshing network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 21:55:59 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Updating instance_info_cache with network_info: [{"id": "7bb3754b-f5e0-465c-a140-3bbddd87400a", "address": "fa:16:3e:56:f7:d0", "network": {"id": "6b6d5e8a-1c0a-4d1b-93d1-4de7246e39fb", "bridge": "br-int", "label": "tempest-TestStampPattern-2085707213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6745cf6719124010a510bd54fd5b9259", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bb3754b-f5", "ovs_interfaceid": "7bb3754b-f5e0-465c-a140-3bbddd87400a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:55:59 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Releasing lock "refresh_cache-ec73ec4b-4591-46f2-9192-7868125c53c5" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:55:59 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Updated the network info_cache for instance {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 21:55:59 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:55:59 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:56:00 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:56:00 user nova-compute[72586]: DEBUG nova.compute.manager [req-8e30c969-e02d-40f5-b5b8-8d59cb7d298f req-432d50e0-196c-4bef-bc52-84fb6222c8ba service nova] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Received event network-changed-65240d77-844f-4d37-9b69-972686cb6c95 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:56:00 user nova-compute[72586]: DEBUG nova.compute.manager [req-8e30c969-e02d-40f5-b5b8-8d59cb7d298f req-432d50e0-196c-4bef-bc52-84fb6222c8ba service nova] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Refreshing instance network info cache due to event network-changed-65240d77-844f-4d37-9b69-972686cb6c95. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:56:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-8e30c969-e02d-40f5-b5b8-8d59cb7d298f req-432d50e0-196c-4bef-bc52-84fb6222c8ba service nova] Acquiring lock "refresh_cache-055a4027-b090-43f3-998e-5bd3ba3c0109" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:56:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-8e30c969-e02d-40f5-b5b8-8d59cb7d298f req-432d50e0-196c-4bef-bc52-84fb6222c8ba service nova] Acquired lock "refresh_cache-055a4027-b090-43f3-998e-5bd3ba3c0109" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:56:00 user nova-compute[72586]: DEBUG nova.network.neutron [req-8e30c969-e02d-40f5-b5b8-8d59cb7d298f req-432d50e0-196c-4bef-bc52-84fb6222c8ba service nova] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Refreshing network info cache for port 65240d77-844f-4d37-9b69-972686cb6c95 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:56:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-886b302d-c553-487d-9458-6f234d1596d6 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Acquiring lock "055a4027-b090-43f3-998e-5bd3ba3c0109" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:56:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-886b302d-c553-487d-9458-6f234d1596d6 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "055a4027-b090-43f3-998e-5bd3ba3c0109" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:56:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-886b302d-c553-487d-9458-6f234d1596d6 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Acquiring lock "055a4027-b090-43f3-998e-5bd3ba3c0109-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:56:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-886b302d-c553-487d-9458-6f234d1596d6 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "055a4027-b090-43f3-998e-5bd3ba3c0109-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:56:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-886b302d-c553-487d-9458-6f234d1596d6 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "055a4027-b090-43f3-998e-5bd3ba3c0109-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:56:00 user nova-compute[72586]: INFO nova.compute.manager [None req-886b302d-c553-487d-9458-6f234d1596d6 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Terminating instance
Aug 01 21:56:00 user nova-compute[72586]: DEBUG nova.compute.manager [None req-886b302d-c553-487d-9458-6f234d1596d6 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Start destroying the instance on the hypervisor. {{(pid=72586) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 21:56:01 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:56:01 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:56:01 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:56:01 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:56:01 user nova-compute[72586]: DEBUG nova.compute.manager [req-3288970e-aa7a-4e04-a1e2-704312152b58 req-4dfbfd53-40f8-4e3a-a64a-638000d44182 service nova] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Received event network-vif-unplugged-65240d77-844f-4d37-9b69-972686cb6c95 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:56:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-3288970e-aa7a-4e04-a1e2-704312152b58 req-4dfbfd53-40f8-4e3a-a64a-638000d44182 service nova] Acquiring lock "055a4027-b090-43f3-998e-5bd3ba3c0109-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:56:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-3288970e-aa7a-4e04-a1e2-704312152b58 req-4dfbfd53-40f8-4e3a-a64a-638000d44182 service nova] Lock "055a4027-b090-43f3-998e-5bd3ba3c0109-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:56:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-3288970e-aa7a-4e04-a1e2-704312152b58 req-4dfbfd53-40f8-4e3a-a64a-638000d44182 service nova] Lock "055a4027-b090-43f3-998e-5bd3ba3c0109-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:56:01 user nova-compute[72586]: DEBUG nova.compute.manager [req-3288970e-aa7a-4e04-a1e2-704312152b58 req-4dfbfd53-40f8-4e3a-a64a-638000d44182 service nova] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] No waiting events found dispatching network-vif-unplugged-65240d77-844f-4d37-9b69-972686cb6c95 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:56:01 user nova-compute[72586]: DEBUG nova.compute.manager [req-3288970e-aa7a-4e04-a1e2-704312152b58 req-4dfbfd53-40f8-4e3a-a64a-638000d44182 service nova] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Received event network-vif-unplugged-65240d77-844f-4d37-9b69-972686cb6c95 for instance with task_state deleting. {{(pid=72586) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 21:56:01 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Instance destroyed successfully.
Aug 01 21:56:01 user nova-compute[72586]: DEBUG nova.objects.instance [None req-886b302d-c553-487d-9458-6f234d1596d6 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lazy-loading 'resources' on Instance uuid 055a4027-b090-43f3-998e-5bd3ba3c0109 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:56:01 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-886b302d-c553-487d-9458-6f234d1596d6 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:51:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-490189203',display_name='tempest-TestVolumeBootPattern-server-490189203',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-490189203',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHNJjSduTMasTSgviwHre/FYLh+Mp4kuIJ4iuAJ7FsI2FanPe3E7nT7btn/7CziUSz0I1qByH5+ECZVnIY2RecZsBlCuwfU8kwCbqZrJSP50B9MRG5Gjmo9qdN10n6adqA==',key_name='tempest-TestVolumeBootPattern-705389702',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:51:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a631250d39c34afca47a1fa2817e627e',ramdisk_id='',reservation_id='r-2raf2770',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1160754716',owner_user_name='tempest-TestVolumeBootPattern-1160754716-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:51:21Z,user_data=None,user_id='76cd0d9d973b410ca4ff08fc7630fbc6',uuid=055a4027-b090-43f3-998e-5bd3ba3c0109,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "65240d77-844f-4d37-9b69-972686cb6c95", "address": "fa:16:3e:b4:82:5a", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65240d77-84", "ovs_interfaceid": "65240d77-844f-4d37-9b69-972686cb6c95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:56:01 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-886b302d-c553-487d-9458-6f234d1596d6 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Converting VIF {"id": "65240d77-844f-4d37-9b69-972686cb6c95", "address": "fa:16:3e:b4:82:5a", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65240d77-84", "ovs_interfaceid": "65240d77-844f-4d37-9b69-972686cb6c95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:56:01 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-886b302d-c553-487d-9458-6f234d1596d6 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:82:5a,bridge_name='br-int',has_traffic_filtering=True,id=65240d77-844f-4d37-9b69-972686cb6c95,network=Network(2fbf5ffb-0ec0-403b-bc92-259563ab1d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65240d77-84') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:56:01 user nova-compute[72586]: DEBUG os_vif [None req-886b302d-c553-487d-9458-6f234d1596d6 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:82:5a,bridge_name='br-int',has_traffic_filtering=True,id=65240d77-844f-4d37-9b69-972686cb6c95,network=Network(2fbf5ffb-0ec0-403b-bc92-259563ab1d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65240d77-84') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:56:01 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:56:01 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap65240d77-84, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:56:01 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:56:01 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:56:01 user nova-compute[72586]: INFO os_vif [None req-886b302d-c553-487d-9458-6f234d1596d6 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:82:5a,bridge_name='br-int',has_traffic_filtering=True,id=65240d77-844f-4d37-9b69-972686cb6c95,network=Network(2fbf5ffb-0ec0-403b-bc92-259563ab1d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65240d77-84')
Aug 01 21:56:01 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-886b302d-c553-487d-9458-6f234d1596d6 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] calling os-brick to detach iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 21:56:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-886b302d-c553-487d-9458-6f234d1596d6 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, {'target_iqns': ['iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QeybaUVI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:56:01 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-886b302d-c553-487d-9458-6f234d1596d6 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:56:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-886b302d-c553-487d-9458-6f234d1596d6 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:56:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-886b302d-c553-487d-9458-6f234d1596d6 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:56:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-886b302d-c553-487d-9458-6f234d1596d6 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178', 0)] {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 21:56:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:56:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:56:01 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11bdb70-e6d7-45d1-9fe6-dd3f67d721e6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:56:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:56:01 user nova-compute[72586]: DEBUG nova.network.neutron [req-8e30c969-e02d-40f5-b5b8-8d59cb7d298f req-432d50e0-196c-4bef-bc52-84fb6222c8ba service nova] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Updated VIF entry in instance network info cache for port 65240d77-844f-4d37-9b69-972686cb6c95. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:56:01 user nova-compute[72586]: DEBUG nova.network.neutron [req-8e30c969-e02d-40f5-b5b8-8d59cb7d298f req-432d50e0-196c-4bef-bc52-84fb6222c8ba service nova] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Updating instance_info_cache with network_info: [{"id": "65240d77-844f-4d37-9b69-972686cb6c95", "address": "fa:16:3e:b4:82:5a", "network": {"id": "2fbf5ffb-0ec0-403b-bc92-259563ab1d55", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1733848699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a631250d39c34afca47a1fa2817e627e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65240d77-84", "ovs_interfaceid": "65240d77-844f-4d37-9b69-972686cb6c95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:56:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:56:01 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc018ff8-fa91-4bae-b742-6ac34c8889aa]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:56:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-886b302d-c553-487d-9458-6f234d1596d6 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 (non-flash)
Aug 01 21:56:01 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:56:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-886b302d-c553-487d-9458-6f234d1596d6 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 (non-flash)
Aug 01 21:56:01 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:56:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-886b302d-c553-487d-9458-6f234d1596d6 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ed02cd7e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178'): ({'sdd'}, set())}) {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 21:56:01 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-886b302d-c553-487d-9458-6f234d1596d6 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Removing single pathed devices sdd {{(pid=72586) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 21:56:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-8e30c969-e02d-40f5-b5b8-8d59cb7d298f req-432d50e0-196c-4bef-bc52-84fb6222c8ba service nova] Releasing lock "refresh_cache-055a4027-b090-43f3-998e-5bd3ba3c0109" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:56:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:56:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:56:01 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ae2757-a0b4-41ab-bc68-46c9355aebdc]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:56:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:56:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:56:01 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[07940d06-674d-44e8-884d-41c5079784ab]: (4, ('ok\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:56:01 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-886b302d-c553-487d-9458-6f234d1596d6 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Flushing IO for device /dev/sdd {{(pid=72586) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 21:56:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:56:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:56:01 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e57cd8-9667-4461-81d2-32fdb4ac8849]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:56:01 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-886b302d-c553-487d-9458-6f234d1596d6 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72586) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 21:56:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:56:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:56:01 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b49e49-35c8-4aa4-97ab-40850a124949]: (4, ('1', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:56:01 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-886b302d-c553-487d-9458-6f234d1596d6 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 21:56:01 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-886b302d-c553-487d-9458-6f234d1596d6 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] SCSI volumes sdd have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 21:56:01 user nova-compute[72586]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26261386133303839', '/dev/disk/by-id/scsi-1SCST_BIO14df97ec-ba8a3089420d631f', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_14df97ec') {{(pid=83581) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 01 21:56:01 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[befa2109-1065-40ff-b661-68016e758822]: (4, None) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:56:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-886b302d-c553-487d-9458-6f234d1596d6 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178')] {{(pid=72586) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 21:56:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:56:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:56:01 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57b28d6-f4eb-45b2-9a64-271699cbf138]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:56:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-886b302d-c553-487d-9458-6f234d1596d6 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:56:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 -p 172.16.0.220:3260 --logout {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:56:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:56:01 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[045b25e7-d8a5-4ea4-a4bf-7a66971d79cf]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:56:01 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-886b302d-c553-487d-9458-6f234d1596d6 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178, portal: 172.16.0.220,3260]
Aug 01 21:56:01 user nova-compute[72586]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178, portal: 172.16.0.220,3260] successful.
Aug 01 21:56:01 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:56:01 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 -p 172.16.0.220:3260 --op delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:56:02 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:902655e6-2982-46c0-a124-0255707cd178 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:56:02 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcca62a5-bfee-4369-848c-6edc7cd11d58]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:56:02 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-886b302d-c553-487d-9458-6f234d1596d6 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:56:02 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-886b302d-c553-487d-9458-6f234d1596d6 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:56:02 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-886b302d-c553-487d-9458-6f234d1596d6 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] <== disconnect_volume: return (283ms) None {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:56:02 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-886b302d-c553-487d-9458-6f234d1596d6 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Disconnected iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 21:56:02 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-886b302d-c553-487d-9458-6f234d1596d6 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Deleting instance files /opt/stack/data/nova/instances/055a4027-b090-43f3-998e-5bd3ba3c0109_del
Aug 01 21:56:02 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-886b302d-c553-487d-9458-6f234d1596d6 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Deletion of /opt/stack/data/nova/instances/055a4027-b090-43f3-998e-5bd3ba3c0109_del complete
Aug 01 21:56:02 user nova-compute[72586]: INFO nova.compute.manager [None req-886b302d-c553-487d-9458-6f234d1596d6 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Took 1.15 seconds to destroy the instance on the hypervisor.
Aug 01 21:56:02 user nova-compute[72586]: DEBUG oslo.service.loopingcall [None req-886b302d-c553-487d-9458-6f234d1596d6 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72586) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 21:56:02 user nova-compute[72586]: DEBUG nova.compute.manager [-] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Deallocating network for instance {{(pid=72586) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 21:56:02 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] deallocate_for_instance() {{(pid=72586) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 21:56:02 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:56:02 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Took 0.55 seconds to deallocate network for instance.
Aug 01 21:56:02 user nova-compute[72586]: DEBUG nova.compute.manager [req-d3728d9c-3b79-4fc4-8380-20fa9186d5e5 req-c429e136-8e6f-4b7c-8310-f1bd6baf4a93 service nova] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Received event network-vif-deleted-65240d77-844f-4d37-9b69-972686cb6c95 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:56:03 user nova-compute[72586]: DEBUG nova.compute.manager [req-db0d7491-3193-4eed-9ca6-5fb5561fa5ec req-185f8521-e3a7-45b0-86d8-5bca3539901d service nova] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Received event network-vif-plugged-65240d77-844f-4d37-9b69-972686cb6c95 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:56:03 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-db0d7491-3193-4eed-9ca6-5fb5561fa5ec req-185f8521-e3a7-45b0-86d8-5bca3539901d service nova] Acquiring lock "055a4027-b090-43f3-998e-5bd3ba3c0109-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:56:03 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-db0d7491-3193-4eed-9ca6-5fb5561fa5ec req-185f8521-e3a7-45b0-86d8-5bca3539901d service nova] Lock "055a4027-b090-43f3-998e-5bd3ba3c0109-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:56:03 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-db0d7491-3193-4eed-9ca6-5fb5561fa5ec req-185f8521-e3a7-45b0-86d8-5bca3539901d service nova] Lock "055a4027-b090-43f3-998e-5bd3ba3c0109-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:56:03 user nova-compute[72586]: DEBUG nova.compute.manager [req-db0d7491-3193-4eed-9ca6-5fb5561fa5ec req-185f8521-e3a7-45b0-86d8-5bca3539901d service nova] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] No waiting events found dispatching network-vif-plugged-65240d77-844f-4d37-9b69-972686cb6c95 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:56:03 user nova-compute[72586]: WARNING nova.compute.manager [req-db0d7491-3193-4eed-9ca6-5fb5561fa5ec req-185f8521-e3a7-45b0-86d8-5bca3539901d service nova] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Received unexpected event network-vif-plugged-65240d77-844f-4d37-9b69-972686cb6c95 for instance with vm_state active and task_state deleting.
Aug 01 21:56:03 user nova-compute[72586]: INFO nova.compute.manager [None req-886b302d-c553-487d-9458-6f234d1596d6 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Took 0.77 seconds to detach 1 volumes for instance.
Aug 01 21:56:03 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-886b302d-c553-487d-9458-6f234d1596d6 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:56:03 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-886b302d-c553-487d-9458-6f234d1596d6 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:56:03 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-886b302d-c553-487d-9458-6f234d1596d6 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:56:03 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-886b302d-c553-487d-9458-6f234d1596d6 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:56:03 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-886b302d-c553-487d-9458-6f234d1596d6 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.184s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:56:03 user nova-compute[72586]: INFO nova.scheduler.client.report [None req-886b302d-c553-487d-9458-6f234d1596d6 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Deleted allocations for instance 055a4027-b090-43f3-998e-5bd3ba3c0109
Aug 01 21:56:03 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-886b302d-c553-487d-9458-6f234d1596d6 tempest-TestVolumeBootPattern-1160754716 tempest-TestVolumeBootPattern-1160754716-project-member] Lock "055a4027-b090-43f3-998e-5bd3ba3c0109" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.838s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:56:06 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:56:06 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:56:08 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:56:11 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:56:11 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:56:11 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72586) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 21:56:11 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72586) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 21:56:11 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72586) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 21:56:11 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:56:13 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._sync_power_states {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:56:13 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Triggering sync for uuid ec73ec4b-4591-46f2-9192-7868125c53c5 {{(pid=72586) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 21:56:13 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Triggering sync for uuid 7900178d-22dc-4571-8aa4-b5562fb3a927 {{(pid=72586) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 21:56:13 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "ec73ec4b-4591-46f2-9192-7868125c53c5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:56:13 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "ec73ec4b-4591-46f2-9192-7868125c53c5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:56:13 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "7900178d-22dc-4571-8aa4-b5562fb3a927" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:56:13 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "7900178d-22dc-4571-8aa4-b5562fb3a927" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:56:13 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "7900178d-22dc-4571-8aa4-b5562fb3a927" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:56:13 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "ec73ec4b-4591-46f2-9192-7868125c53c5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:56:16 user nova-compute[72586]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690926961.67914, 055a4027-b090-43f3-998e-5bd3ba3c0109 => Stopped> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:56:16 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] VM Stopped (Lifecycle Event)
Aug 01 21:56:16 user nova-compute[72586]: DEBUG nova.compute.manager [None req-95993be1-b1a0-4d32-b423-7a217eb0ba8c None None] [instance: 055a4027-b090-43f3-998e-5bd3ba3c0109] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:56:16 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:56:17 user nova-compute[72586]: DEBUG nova.compute.manager [req-333a9a7d-6382-4837-9103-b943509b3b80 req-a5dc1b83-c9ab-41d0-875f-2ae9033ce060 service nova] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Received event network-changed-d5d860ea-6f19-4513-8b09-fd220204cb58 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:56:17 user nova-compute[72586]: DEBUG nova.compute.manager [req-333a9a7d-6382-4837-9103-b943509b3b80 req-a5dc1b83-c9ab-41d0-875f-2ae9033ce060 service nova] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Refreshing instance network info cache due to event network-changed-d5d860ea-6f19-4513-8b09-fd220204cb58. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:56:17 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-333a9a7d-6382-4837-9103-b943509b3b80 req-a5dc1b83-c9ab-41d0-875f-2ae9033ce060 service nova] Acquiring lock "refresh_cache-7900178d-22dc-4571-8aa4-b5562fb3a927" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:56:17 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-333a9a7d-6382-4837-9103-b943509b3b80 req-a5dc1b83-c9ab-41d0-875f-2ae9033ce060 service nova] Acquired lock "refresh_cache-7900178d-22dc-4571-8aa4-b5562fb3a927" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:56:17 user nova-compute[72586]: DEBUG nova.network.neutron [req-333a9a7d-6382-4837-9103-b943509b3b80 req-a5dc1b83-c9ab-41d0-875f-2ae9033ce060 service nova] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Refreshing network info cache for port d5d860ea-6f19-4513-8b09-fd220204cb58 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:56:17 user nova-compute[72586]: DEBUG nova.network.neutron [req-333a9a7d-6382-4837-9103-b943509b3b80 req-a5dc1b83-c9ab-41d0-875f-2ae9033ce060 service nova] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Updated VIF entry in instance network info cache for port d5d860ea-6f19-4513-8b09-fd220204cb58. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:56:17 user nova-compute[72586]: DEBUG nova.network.neutron [req-333a9a7d-6382-4837-9103-b943509b3b80 req-a5dc1b83-c9ab-41d0-875f-2ae9033ce060 service nova] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Updating instance_info_cache with network_info: [{"id": "d5d860ea-6f19-4513-8b09-fd220204cb58", "address": "fa:16:3e:d9:8e:26", "network": {"id": "52ee6623-01e5-491e-ab5e-d1d0511bd15f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-765176125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063dd272226340d49a7ac0756413cadf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5d860ea-6f", "ovs_interfaceid": "d5d860ea-6f19-4513-8b09-fd220204cb58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:56:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-333a9a7d-6382-4837-9103-b943509b3b80 req-a5dc1b83-c9ab-41d0-875f-2ae9033ce060 service nova] Releasing lock "refresh_cache-7900178d-22dc-4571-8aa4-b5562fb3a927" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:56:18 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:56:18 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Cleaning up deleted instances {{(pid=72586) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 21:56:18 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] There are 0 instances to clean {{(pid=72586) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 21:56:20 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:56:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-4776f722-2777-4c46-99f3-ea78ea5cfc49 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Acquiring lock "7900178d-22dc-4571-8aa4-b5562fb3a927" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:56:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-4776f722-2777-4c46-99f3-ea78ea5cfc49 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "7900178d-22dc-4571-8aa4-b5562fb3a927" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:56:21 user nova-compute[72586]: DEBUG nova.objects.instance [None req-4776f722-2777-4c46-99f3-ea78ea5cfc49 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lazy-loading 'flavor' on Instance uuid 7900178d-22dc-4571-8aa4-b5562fb3a927 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:56:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-4776f722-2777-4c46-99f3-ea78ea5cfc49 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "7900178d-22dc-4571-8aa4-b5562fb3a927" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:56:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-4776f722-2777-4c46-99f3-ea78ea5cfc49 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Acquiring lock "7900178d-22dc-4571-8aa4-b5562fb3a927" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:56:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-4776f722-2777-4c46-99f3-ea78ea5cfc49 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "7900178d-22dc-4571-8aa4-b5562fb3a927" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:56:21 user nova-compute[72586]: INFO nova.compute.manager [None req-4776f722-2777-4c46-99f3-ea78ea5cfc49 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Attaching volume 736e9bb7-c11e-40e9-8a7a-849ba5802dd6 to /dev/vdb
Aug 01 21:56:21 user nova-compute[72586]: DEBUG os_brick.utils [None req-4776f722-2777-4c46-99f3-ea78ea5cfc49 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:56:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:56:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:56:21 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e892f666-d291-4a1e-8acd-1045a1fe3ae1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4bc202fb9cb\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:56:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:56:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:56:21 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ddcdd3-2b76-4030-9fd0-428fef1904ff]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:56:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:56:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:56:21 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d35ee6-4a56-4da1-98db-fb8150edbb64]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:56:21 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[320de964-c093-477e-9342-533105425220]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:56:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-4776f722-2777-4c46-99f3-ea78ea5cfc49 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Running cmd (subprocess): nvme version {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:56:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-4776f722-2777-4c46-99f3-ea78ea5cfc49 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] 'nvme version' failed. Not Retrying. {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:56:21 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4776f722-2777-4c46-99f3-ea78ea5cfc49 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] nvme not present on system {{(pid=72586) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 21:56:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:56:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:56:21 user nova-compute[72586]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 21:56:21 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[02caed66-10f9-47f0-aabd-e0b742db3164]: (4, '') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:56:21 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-4776f722-2777-4c46-99f3-ea78ea5cfc49 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72586) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 21:56:21 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-4776f722-2777-4c46-99f3-ea78ea5cfc49 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 21:56:21 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-4776f722-2777-4c46-99f3-ea78ea5cfc49 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] LIGHTOS: no hostnqn found. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 21:56:21 user nova-compute[72586]: DEBUG os_brick.utils [None req-4776f722-2777-4c46-99f3-ea78ea5cfc49 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4bc202fb9cb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:56:21 user nova-compute[72586]: DEBUG nova.virt.block_device [None req-4776f722-2777-4c46-99f3-ea78ea5cfc49 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Updating existing volume attachment record: dbe1f0e5-86a5-4861-881b-ca3dab4fde5b {{(pid=72586) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 21:56:21 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:56:25 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:56:26 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:56:28 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4776f722-2777-4c46-99f3-ea78ea5cfc49 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Calling os-brick to attach iSCSI Volume {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 21:56:28 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-4776f722-2777-4c46-99f3-ea78ea5cfc49 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:736e9bb7-c11e-40e9-8a7a-849ba5802dd6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nmfONeSH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:56:28 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-4776f722-2777-4c46-99f3-ea78ea5cfc49 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:56:28 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-4776f722-2777-4c46-99f3-ea78ea5cfc49 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:56:28 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-4776f722-2777-4c46-99f3-ea78ea5cfc49 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:56:28 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-4776f722-2777-4c46-99f3-ea78ea5cfc49 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:56:28 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-4776f722-2777-4c46-99f3-ea78ea5cfc49 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:736e9bb7-c11e-40e9-8a7a-849ba5802dd6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:56:28 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-4776f722-2777-4c46-99f3-ea78ea5cfc49 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:736e9bb7-c11e-40e9-8a7a-849ba5802dd6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:56:28 user nova-compute[72586]: INFO os_brick.initiator.connectors.iscsi [None req-4776f722-2777-4c46-99f3-ea78ea5cfc49 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 21:56:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:736e9bb7-c11e-40e9-8a7a-849ba5802dd6 -p 172.16.0.220:3260 {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:56:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:736e9bb7-c11e-40e9-8a7a-849ba5802dd6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:56:28 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccded3a0-549b-45ca-a8d5-5015ad15c959]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:56:28 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-4776f722-2777-4c46-99f3-ea78ea5cfc49 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 21:56:28 user nova-compute[72586]:  {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:56:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:736e9bb7-c11e-40e9-8a7a-849ba5802dd6 -p 172.16.0.220:3260 --interface default --op new {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:56:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:736e9bb7-c11e-40e9-8a7a-849ba5802dd6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:56:28 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9686a7a-64f2-4b5d-a20a-44cd7d5af713]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:736e9bb7-c11e-40e9-8a7a-849ba5802dd6] added\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:56:28 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-4776f722-2777-4c46-99f3-ea78ea5cfc49 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:736e9bb7-c11e-40e9-8a7a-849ba5802dd6] added
Aug 01 21:56:28 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:56:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:736e9bb7-c11e-40e9-8a7a-849ba5802dd6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:56:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:736e9bb7-c11e-40e9-8a7a-849ba5802dd6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:56:28 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a20d81-4892-4174-9eff-a18e113d969a]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:56:28 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-4776f722-2777-4c46-99f3-ea78ea5cfc49 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:56:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:736e9bb7-c11e-40e9-8a7a-849ba5802dd6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:56:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:736e9bb7-c11e-40e9-8a7a-849ba5802dd6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:56:28 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b220c0a6-de2b-4308-a26b-9f787ee73106]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:56:28 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-4776f722-2777-4c46-99f3-ea78ea5cfc49 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:56:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:736e9bb7-c11e-40e9-8a7a-849ba5802dd6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nmfONeSH {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:56:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:736e9bb7-c11e-40e9-8a7a-849ba5802dd6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nmfONeSH" returned: 0 in 0.022s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:56:28 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb078757-a133-4bd9-9c22-88226b2654b0]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:56:28 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-4776f722-2777-4c46-99f3-ea78ea5cfc49 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nmfONeSH'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:56:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:736e9bb7-c11e-40e9-8a7a-849ba5802dd6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:56:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:736e9bb7-c11e-40e9-8a7a-849ba5802dd6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:56:28 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[3006df9c-3b2c-4aae-bea7-28d4c66b6b90]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:56:28 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-4776f722-2777-4c46-99f3-ea78ea5cfc49 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:56:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:56:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:56:28 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[beaa3e9c-b2aa-4340-a653-1db76b57cb6c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:56:28 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-4776f722-2777-4c46-99f3-ea78ea5cfc49 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 21:56:28 user nova-compute[72586]:  {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:56:28 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-4776f722-2777-4c46-99f3-ea78ea5cfc49 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 21:56:28 user nova-compute[72586]:  {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:56:28 user nova-compute[72586]: WARNING os_brick.initiator.connectors.iscsi [None req-4776f722-2777-4c46-99f3-ea78ea5cfc49 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 21:56:28 user nova-compute[72586]: 
Aug 01 21:56:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:736e9bb7-c11e-40e9-8a7a-849ba5802dd6 -p 172.16.0.220:3260 --login {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:56:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:736e9bb7-c11e-40e9-8a7a-849ba5802dd6 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:56:28 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c91679-315a-4091-a52a-a3e03fc891a4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:736e9bb7-c11e-40e9-8a7a-849ba5802dd6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:736e9bb7-c11e-40e9-8a7a-849ba5802dd6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:56:28 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-4776f722-2777-4c46-99f3-ea78ea5cfc49 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:736e9bb7-c11e-40e9-8a7a-849ba5802dd6, portal: 172.16.0.220,3260]
Aug 01 21:56:28 user nova-compute[72586]: Login to [iface: default, target: iqn.2010-10.org.openstack:736e9bb7-c11e-40e9-8a7a-849ba5802dd6, portal: 172.16.0.220,3260] successful.
Aug 01 21:56:28 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:56:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:736e9bb7-c11e-40e9-8a7a-849ba5802dd6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:56:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:736e9bb7-c11e-40e9-8a7a-849ba5802dd6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:56:28 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75a0f60-8d87-47e7-9ceb-8575a5aee56d]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:56:28 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-4776f722-2777-4c46-99f3-ea78ea5cfc49 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:56:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:56:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:56:28 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a2210a0-75bd-4ad4-b149-530febe2bff4]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:736e9bb7-c11e-40e9-8a7a-849ba5802dd6 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:56:28 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-4776f722-2777-4c46-99f3-ea78ea5cfc49 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:736e9bb7-c11e-40e9-8a7a-849ba5802dd6 (non-flash)
Aug 01 21:56:28 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:56:28 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-4776f722-2777-4c46-99f3-ea78ea5cfc49 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:736e9bb7-c11e-40e9-8a7a-849ba5802dd6 (non-flash)
Aug 01 21:56:28 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:56:28 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-4776f722-2777-4c46-99f3-ea78ea5cfc49 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:736e9bb7-c11e-40e9-8a7a-849ba5802dd6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:56:28 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-4776f722-2777-4c46-99f3-ea78ea5cfc49 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Connected to 172.16.0.220:3260 {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 21:56:28 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-4776f722-2777-4c46-99f3-ea78ea5cfc49 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=72586) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 21:56:28 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-4776f722-2777-4c46-99f3-ea78ea5cfc49 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72586) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 21:56:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:56:28 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:56:28 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[af62d93d-f443-4dac-81c1-a439e16be76d]: (4, ('- - 0', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:56:28 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-4776f722-2777-4c46-99f3-ea78ea5cfc49 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:56:28 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-4776f722-2777-4c46-99f3-ea78ea5cfc49 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nmfONeSH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 21:56:29 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-4776f722-2777-4c46-99f3-ea78ea5cfc49 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:56:29 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-4776f722-2777-4c46-99f3-ea78ea5cfc49 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] <== connect_volume: return (1282ms) {'type': 'block', 'scsi_wwn': '23736626133356662', 'path': '/dev/sdb'} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:56:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4776f722-2777-4c46-99f3-ea78ea5cfc49 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736626133356662', 'path': '/dev/sdb'} {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 21:56:29 user nova-compute[72586]: DEBUG nova.objects.instance [None req-4776f722-2777-4c46-99f3-ea78ea5cfc49 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lazy-loading 'flavor' on Instance uuid 7900178d-22dc-4571-8aa4-b5562fb3a927 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:56:29 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-4776f722-2777-4c46-99f3-ea78ea5cfc49 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 21:56:29 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:56:29 user nova-compute[72586]:   <source dev="/dev/sdb"/>
Aug 01 21:56:29 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:56:29 user nova-compute[72586]:   <serial>736e9bb7-c11e-40e9-8a7a-849ba5802dd6</serial>
Aug 01 21:56:29 user nova-compute[72586]: </disk>
Aug 01 21:56:29 user nova-compute[72586]:  {{(pid=72586) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 21:56:30 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-4776f722-2777-4c46-99f3-ea78ea5cfc49 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:56:30 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-4776f722-2777-4c46-99f3-ea78ea5cfc49 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:56:30 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-4776f722-2777-4c46-99f3-ea78ea5cfc49 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] No VIF found with MAC fa:16:3e:d9:8e:26, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:56:30 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-4776f722-2777-4c46-99f3-ea78ea5cfc49 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "7900178d-22dc-4571-8aa4-b5562fb3a927" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.223s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:56:31 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-638aa2ae-d4a8-41b0-af6e-ce6c2690e23f tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Acquiring lock "7900178d-22dc-4571-8aa4-b5562fb3a927" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:56:31 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-638aa2ae-d4a8-41b0-af6e-ce6c2690e23f tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "7900178d-22dc-4571-8aa4-b5562fb3a927" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:56:31 user nova-compute[72586]: INFO nova.compute.manager [None req-638aa2ae-d4a8-41b0-af6e-ce6c2690e23f tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Detaching volume 736e9bb7-c11e-40e9-8a7a-849ba5802dd6
Aug 01 21:56:31 user nova-compute[72586]: INFO nova.virt.block_device [None req-638aa2ae-d4a8-41b0-af6e-ce6c2690e23f tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Attempting to driver detach volume 736e9bb7-c11e-40e9-8a7a-849ba5802dd6 from mountpoint /dev/vdb
Aug 01 21:56:31 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-638aa2ae-d4a8-41b0-af6e-ce6c2690e23f tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Attempting to detach device vdb from instance 7900178d-22dc-4571-8aa4-b5562fb3a927 from the persistent domain config. {{(pid=72586) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 21:56:31 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-638aa2ae-d4a8-41b0-af6e-ce6c2690e23f tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 21:56:31 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:56:31 user nova-compute[72586]:   <source dev="/dev/sdb"/>
Aug 01 21:56:31 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:56:31 user nova-compute[72586]:   <serial>736e9bb7-c11e-40e9-8a7a-849ba5802dd6</serial>
Aug 01 21:56:31 user nova-compute[72586]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 21:56:31 user nova-compute[72586]: </disk>
Aug 01 21:56:31 user nova-compute[72586]:  {{(pid=72586) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 21:56:31 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-638aa2ae-d4a8-41b0-af6e-ce6c2690e23f tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Successfully detached device vdb from instance 7900178d-22dc-4571-8aa4-b5562fb3a927 from the persistent domain config.
Aug 01 21:56:31 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-638aa2ae-d4a8-41b0-af6e-ce6c2690e23f tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7900178d-22dc-4571-8aa4-b5562fb3a927 from the live domain config. {{(pid=72586) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 21:56:31 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-638aa2ae-d4a8-41b0-af6e-ce6c2690e23f tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 21:56:31 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:56:31 user nova-compute[72586]:   <source dev="/dev/sdb"/>
Aug 01 21:56:31 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:56:31 user nova-compute[72586]:   <serial>736e9bb7-c11e-40e9-8a7a-849ba5802dd6</serial>
Aug 01 21:56:31 user nova-compute[72586]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 21:56:31 user nova-compute[72586]: </disk>
Aug 01 21:56:31 user nova-compute[72586]:  {{(pid=72586) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 21:56:31 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:56:31 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:56:31 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72586) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 21:56:31 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72586) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 21:56:31 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72586) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 21:56:31 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:56:32 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Received event <DeviceRemovedEvent: 1690926992.0817842, 7900178d-22dc-4571-8aa4-b5562fb3a927 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72586) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 21:56:32 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-638aa2ae-d4a8-41b0-af6e-ce6c2690e23f tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7900178d-22dc-4571-8aa4-b5562fb3a927 {{(pid=72586) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 21:56:32 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-638aa2ae-d4a8-41b0-af6e-ce6c2690e23f tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Successfully detached device vdb from instance 7900178d-22dc-4571-8aa4-b5562fb3a927 from the live domain config.
Aug 01 21:56:32 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-638aa2ae-d4a8-41b0-af6e-ce6c2690e23f tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] calling os-brick to detach iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 21:56:32 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-638aa2ae-d4a8-41b0-af6e-ce6c2690e23f tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, {'target_iqns': ['iqn.2010-10.org.openstack:736e9bb7-c11e-40e9-8a7a-849ba5802dd6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nmfONeSH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:56:32 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-638aa2ae-d4a8-41b0-af6e-ce6c2690e23f tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:56:32 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-638aa2ae-d4a8-41b0-af6e-ce6c2690e23f tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:56:32 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-638aa2ae-d4a8-41b0-af6e-ce6c2690e23f tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:56:32 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-638aa2ae-d4a8-41b0-af6e-ce6c2690e23f tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:736e9bb7-c11e-40e9-8a7a-849ba5802dd6', 0)] {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 21:56:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:56:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:56:32 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[235fcf74-132d-4dde-a7df-054e6af9fd68]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:736e9bb7-c11e-40e9-8a7a-849ba5802dd6\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:56:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:56:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:56:32 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[14125462-fa25-4bd2-8e01-4140f233231a]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:736e9bb7-c11e-40e9-8a7a-849ba5802dd6 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:56:32 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-638aa2ae-d4a8-41b0-af6e-ce6c2690e23f tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:736e9bb7-c11e-40e9-8a7a-849ba5802dd6 (non-flash)
Aug 01 21:56:32 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:56:32 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-638aa2ae-d4a8-41b0-af6e-ce6c2690e23f tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:736e9bb7-c11e-40e9-8a7a-849ba5802dd6 (non-flash)
Aug 01 21:56:32 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:56:32 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-638aa2ae-d4a8-41b0-af6e-ce6c2690e23f tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ed03d7be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:736e9bb7-c11e-40e9-8a7a-849ba5802dd6'): ({'sdb'}, set())}) {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 21:56:32 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-638aa2ae-d4a8-41b0-af6e-ce6c2690e23f tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Removing single pathed devices sdb {{(pid=72586) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 21:56:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:56:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:56:32 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[73fd946a-edeb-47d6-9a7a-cf71b61df081]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:56:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:56:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:56:32 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22bb7a2-6987-4b29-8ffb-cfa27f55c134]: (4, ('ok\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:56:32 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-638aa2ae-d4a8-41b0-af6e-ce6c2690e23f tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Flushing IO for device /dev/sdb {{(pid=72586) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 21:56:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:56:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:56:32 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccad4eb0-ce47-4672-afd4-252df92c219a]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:56:32 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-638aa2ae-d4a8-41b0-af6e-ce6c2690e23f tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72586) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 21:56:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:56:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:56:32 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e143835a-778b-4516-b7e2-02f3e1fa9451]: (4, ('1', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:56:32 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-638aa2ae-d4a8-41b0-af6e-ce6c2690e23f tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 21:56:32 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-638aa2ae-d4a8-41b0-af6e-ce6c2690e23f tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] SCSI volumes sdb have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 21:56:32 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-638aa2ae-d4a8-41b0-af6e-ce6c2690e23f tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:736e9bb7-c11e-40e9-8a7a-849ba5802dd6')] {{(pid=72586) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 21:56:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:736e9bb7-c11e-40e9-8a7a-849ba5802dd6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:56:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:736e9bb7-c11e-40e9-8a7a-849ba5802dd6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:56:32 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[866ae5df-a838-4442-94cd-964a3d178e47]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:56:32 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-638aa2ae-d4a8-41b0-af6e-ce6c2690e23f tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:56:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:736e9bb7-c11e-40e9-8a7a-849ba5802dd6 -p 172.16.0.220:3260 --logout {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:56:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:736e9bb7-c11e-40e9-8a7a-849ba5802dd6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:56:32 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8abd7a-9f58-4a06-a7e9-53b424ac0866]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:736e9bb7-c11e-40e9-8a7a-849ba5802dd6, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:736e9bb7-c11e-40e9-8a7a-849ba5802dd6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:56:32 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-638aa2ae-d4a8-41b0-af6e-ce6c2690e23f tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:736e9bb7-c11e-40e9-8a7a-849ba5802dd6, portal: 172.16.0.220,3260]
Aug 01 21:56:32 user nova-compute[72586]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:736e9bb7-c11e-40e9-8a7a-849ba5802dd6, portal: 172.16.0.220,3260] successful.
Aug 01 21:56:32 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:56:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:736e9bb7-c11e-40e9-8a7a-849ba5802dd6 -p 172.16.0.220:3260 --op delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:56:32 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:736e9bb7-c11e-40e9-8a7a-849ba5802dd6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:56:32 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[46591cdd-dae5-4b45-84b7-7b0a603c55d7]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:56:32 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-638aa2ae-d4a8-41b0-af6e-ce6c2690e23f tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:56:32 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-638aa2ae-d4a8-41b0-af6e-ce6c2690e23f tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.251s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:56:32 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-638aa2ae-d4a8-41b0-af6e-ce6c2690e23f tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] <== disconnect_volume: return (253ms) None {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:56:32 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-638aa2ae-d4a8-41b0-af6e-ce6c2690e23f tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Disconnected iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 21:56:33 user nova-compute[72586]: DEBUG nova.objects.instance [None req-638aa2ae-d4a8-41b0-af6e-ce6c2690e23f tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lazy-loading 'flavor' on Instance uuid 7900178d-22dc-4571-8aa4-b5562fb3a927 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:56:33 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-638aa2ae-d4a8-41b0-af6e-ce6c2690e23f tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "7900178d-22dc-4571-8aa4-b5562fb3a927" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.613s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:56:35 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:56:36 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:56:37 user nova-compute[72586]: DEBUG nova.compute.manager [None req-4c1e58cb-edfb-4c97-ac03-5929682b445d tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:56:37 user nova-compute[72586]: INFO nova.compute.manager [None req-4c1e58cb-edfb-4c97-ac03-5929682b445d tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] instance snapshotting
Aug 01 21:56:37 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-4c1e58cb-edfb-4c97-ac03-5929682b445d tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Beginning live snapshot process
Aug 01 21:56:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-4c1e58cb-edfb-4c97-ac03-5929682b445d tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec73ec4b-4591-46f2-9192-7868125c53c5/disk --force-share --output=json -f qcow2 {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:56:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-4c1e58cb-edfb-4c97-ac03-5929682b445d tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec73ec4b-4591-46f2-9192-7868125c53c5/disk --force-share --output=json -f qcow2" returned: 0 in 0.142s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:56:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-4c1e58cb-edfb-4c97-ac03-5929682b445d tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec73ec4b-4591-46f2-9192-7868125c53c5/disk --force-share --output=json -f qcow2 {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:56:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-4c1e58cb-edfb-4c97-ac03-5929682b445d tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec73ec4b-4591-46f2-9192-7868125c53c5/disk --force-share --output=json -f qcow2" returned: 0 in 0.164s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:56:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-4c1e58cb-edfb-4c97-ac03-5929682b445d tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:56:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-4c1e58cb-edfb-4c97-ac03-5929682b445d tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.136s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:56:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-4c1e58cb-edfb-4c97-ac03-5929682b445d tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpqp6xdjsj/1412eb40fb614a9a9d69569ae3461230.delta 1073741824 {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:56:38 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-4c1e58cb-edfb-4c97-ac03-5929682b445d tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpqp6xdjsj/1412eb40fb614a9a9d69569ae3461230.delta 1073741824" returned: 0 in 0.052s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:56:38 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-4c1e58cb-edfb-4c97-ac03-5929682b445d tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 01 21:56:39 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-4c1e58cb-edfb-4c97-ac03-5929682b445d tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=72586) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 21:56:39 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-4c1e58cb-edfb-4c97-ac03-5929682b445d tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=72586) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 21:56:39 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-4c1e58cb-edfb-4c97-ac03-5929682b445d tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 01 21:56:39 user nova-compute[72586]: DEBUG nova.privsep.utils [None req-4c1e58cb-edfb-4c97-ac03-5929682b445d tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72586) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 21:56:39 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-4c1e58cb-edfb-4c97-ac03-5929682b445d tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpqp6xdjsj/1412eb40fb614a9a9d69569ae3461230.delta /opt/stack/data/nova/instances/snapshots/tmpqp6xdjsj/1412eb40fb614a9a9d69569ae3461230 {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:56:40 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-4c1e58cb-edfb-4c97-ac03-5929682b445d tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpqp6xdjsj/1412eb40fb614a9a9d69569ae3461230.delta /opt/stack/data/nova/instances/snapshots/tmpqp6xdjsj/1412eb40fb614a9a9d69569ae3461230" returned: 0 in 0.528s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:56:40 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-4c1e58cb-edfb-4c97-ac03-5929682b445d tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Snapshot extracted, beginning image upload
Aug 01 21:56:41 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:56:42 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-4c1e58cb-edfb-4c97-ac03-5929682b445d tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Snapshot image upload complete
Aug 01 21:56:42 user nova-compute[72586]: INFO nova.compute.manager [None req-4c1e58cb-edfb-4c97-ac03-5929682b445d tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Took 4.80 seconds to snapshot the instance on the hypervisor.
Aug 01 21:56:44 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Acquiring lock "4e5f6dc7-cd0b-4cb9-b5b3-49907903499f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:56:44 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lock "4e5f6dc7-cd0b-4cb9-b5b3-49907903499f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:56:44 user nova-compute[72586]: DEBUG nova.compute.manager [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Starting instance... {{(pid=72586) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 21:56:44 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:56:44 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:56:44 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72586) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 21:56:44 user nova-compute[72586]: INFO nova.compute.claims [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Claim successful on node user
Aug 01 21:56:44 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:56:44 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:56:44 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.319s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:56:44 user nova-compute[72586]: DEBUG nova.compute.manager [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Start building networks asynchronously for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 21:56:44 user nova-compute[72586]: DEBUG nova.compute.manager [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Allocating IP information in the background. {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 21:56:44 user nova-compute[72586]: DEBUG nova.network.neutron [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] allocate_for_instance() {{(pid=72586) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 21:56:44 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 21:56:44 user nova-compute[72586]: DEBUG nova.compute.manager [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Start building block device mappings for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 21:56:44 user nova-compute[72586]: DEBUG nova.policy [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7b481c57931941c79ecd184146f20dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6745cf6719124010a510bd54fd5b9259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72586) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 21:56:45 user nova-compute[72586]: DEBUG nova.compute.manager [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Start spawning the instance on the hypervisor. {{(pid=72586) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 21:56:45 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Creating instance directory {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 21:56:45 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Creating image(s)
Aug 01 21:56:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Acquiring lock "/opt/stack/data/nova/instances/4e5f6dc7-cd0b-4cb9-b5b3-49907903499f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:56:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lock "/opt/stack/data/nova/instances/4e5f6dc7-cd0b-4cb9-b5b3-49907903499f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:56:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lock "/opt/stack/data/nova/instances/4e5f6dc7-cd0b-4cb9-b5b3-49907903499f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:56:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Acquiring lock "a27913f5f3e89da80cfa5fa513e9a52d8b5a044e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:56:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lock "a27913f5f3e89da80cfa5fa513e9a52d8b5a044e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:56:45 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a27913f5f3e89da80cfa5fa513e9a52d8b5a044e.part --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:56:45 user nova-compute[72586]: DEBUG nova.network.neutron [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Successfully created port: 107ffd50-bf35-42c4-a394-131bf57b4157 {{(pid=72586) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 21:56:45 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:56:45 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a27913f5f3e89da80cfa5fa513e9a52d8b5a044e.part --force-share --output=json" returned: 0 in 0.134s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:56:45 user nova-compute[72586]: DEBUG nova.virt.images [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] 66da76aa-bb45-4e01-9056-8c0661e5c005 was qcow2, converting to raw {{(pid=72586) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 21:56:45 user nova-compute[72586]: DEBUG nova.privsep.utils [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72586) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 21:56:45 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a27913f5f3e89da80cfa5fa513e9a52d8b5a044e.part /opt/stack/data/nova/instances/_base/a27913f5f3e89da80cfa5fa513e9a52d8b5a044e.converted {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:56:46 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a27913f5f3e89da80cfa5fa513e9a52d8b5a044e.part /opt/stack/data/nova/instances/_base/a27913f5f3e89da80cfa5fa513e9a52d8b5a044e.converted" returned: 0 in 0.231s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:56:46 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a27913f5f3e89da80cfa5fa513e9a52d8b5a044e.converted --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:56:46 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a27913f5f3e89da80cfa5fa513e9a52d8b5a044e.converted --force-share --output=json" returned: 0 in 0.138s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:56:46 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lock "a27913f5f3e89da80cfa5fa513e9a52d8b5a044e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.352s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:56:46 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a27913f5f3e89da80cfa5fa513e9a52d8b5a044e --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:56:46 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a27913f5f3e89da80cfa5fa513e9a52d8b5a044e --force-share --output=json" returned: 0 in 0.139s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:56:46 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Acquiring lock "a27913f5f3e89da80cfa5fa513e9a52d8b5a044e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:56:46 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lock "a27913f5f3e89da80cfa5fa513e9a52d8b5a044e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:56:46 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a27913f5f3e89da80cfa5fa513e9a52d8b5a044e --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:56:46 user nova-compute[72586]: DEBUG nova.network.neutron [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Successfully updated port: 107ffd50-bf35-42c4-a394-131bf57b4157 {{(pid=72586) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 21:56:46 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Acquiring lock "refresh_cache-4e5f6dc7-cd0b-4cb9-b5b3-49907903499f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:56:46 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Acquired lock "refresh_cache-4e5f6dc7-cd0b-4cb9-b5b3-49907903499f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:56:46 user nova-compute[72586]: DEBUG nova.network.neutron [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:56:46 user nova-compute[72586]: DEBUG nova.compute.manager [req-055edea5-0b74-413e-98c7-445434139f91 req-297039ed-8343-467e-96f0-b33f523b783b service nova] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Received event network-changed-107ffd50-bf35-42c4-a394-131bf57b4157 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:56:46 user nova-compute[72586]: DEBUG nova.compute.manager [req-055edea5-0b74-413e-98c7-445434139f91 req-297039ed-8343-467e-96f0-b33f523b783b service nova] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Refreshing instance network info cache due to event network-changed-107ffd50-bf35-42c4-a394-131bf57b4157. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:56:46 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-055edea5-0b74-413e-98c7-445434139f91 req-297039ed-8343-467e-96f0-b33f523b783b service nova] Acquiring lock "refresh_cache-4e5f6dc7-cd0b-4cb9-b5b3-49907903499f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:56:46 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a27913f5f3e89da80cfa5fa513e9a52d8b5a044e --force-share --output=json" returned: 0 in 0.142s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:56:46 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a27913f5f3e89da80cfa5fa513e9a52d8b5a044e,backing_fmt=raw /opt/stack/data/nova/instances/4e5f6dc7-cd0b-4cb9-b5b3-49907903499f/disk 1073741824 {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:56:46 user nova-compute[72586]: DEBUG nova.network.neutron [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Instance cache missing network info. {{(pid=72586) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 21:56:46 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a27913f5f3e89da80cfa5fa513e9a52d8b5a044e,backing_fmt=raw /opt/stack/data/nova/instances/4e5f6dc7-cd0b-4cb9-b5b3-49907903499f/disk 1073741824" returned: 0 in 0.067s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:56:46 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:56:46 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lock "a27913f5f3e89da80cfa5fa513e9a52d8b5a044e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.218s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:56:46 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a27913f5f3e89da80cfa5fa513e9a52d8b5a044e --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:56:46 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a27913f5f3e89da80cfa5fa513e9a52d8b5a044e --force-share --output=json" returned: 0 in 0.137s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:56:46 user nova-compute[72586]: DEBUG nova.objects.instance [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lazy-loading 'migration_context' on Instance uuid 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:56:46 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:56:46 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72586) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 21:56:46 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Created local disks {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 21:56:46 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Ensure instance console log exists: /opt/stack/data/nova/instances/4e5f6dc7-cd0b-4cb9-b5b3-49907903499f/console.log {{(pid=72586) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 21:56:46 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:56:46 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:56:46 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:56:47 user nova-compute[72586]: DEBUG nova.network.neutron [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Updating instance_info_cache with network_info: [{"id": "107ffd50-bf35-42c4-a394-131bf57b4157", "address": "fa:16:3e:ff:ef:8d", "network": {"id": "6b6d5e8a-1c0a-4d1b-93d1-4de7246e39fb", "bridge": "br-int", "label": "tempest-TestStampPattern-2085707213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6745cf6719124010a510bd54fd5b9259", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap107ffd50-bf", "ovs_interfaceid": "107ffd50-bf35-42c4-a394-131bf57b4157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:56:47 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Releasing lock "refresh_cache-4e5f6dc7-cd0b-4cb9-b5b3-49907903499f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:56:47 user nova-compute[72586]: DEBUG nova.compute.manager [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Instance network_info: |[{"id": "107ffd50-bf35-42c4-a394-131bf57b4157", "address": "fa:16:3e:ff:ef:8d", "network": {"id": "6b6d5e8a-1c0a-4d1b-93d1-4de7246e39fb", "bridge": "br-int", "label": "tempest-TestStampPattern-2085707213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6745cf6719124010a510bd54fd5b9259", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap107ffd50-bf", "ovs_interfaceid": "107ffd50-bf35-42c4-a394-131bf57b4157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 21:56:47 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-055edea5-0b74-413e-98c7-445434139f91 req-297039ed-8343-467e-96f0-b33f523b783b service nova] Acquired lock "refresh_cache-4e5f6dc7-cd0b-4cb9-b5b3-49907903499f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:56:47 user nova-compute[72586]: DEBUG nova.network.neutron [req-055edea5-0b74-413e-98c7-445434139f91 req-297039ed-8343-467e-96f0-b33f523b783b service nova] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Refreshing network info cache for port 107ffd50-bf35-42c4-a394-131bf57b4157 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:56:47 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Start _get_guest_xml network_info=[{"id": "107ffd50-bf35-42c4-a394-131bf57b4157", "address": "fa:16:3e:ff:ef:8d", "network": {"id": "6b6d5e8a-1c0a-4d1b-93d1-4de7246e39fb", "bridge": "br-int", "label": "tempest-TestStampPattern-2085707213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6745cf6719124010a510bd54fd5b9259", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap107ffd50-bf", "ovs_interfaceid": "107ffd50-bf35-42c4-a394-131bf57b4157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='1f1fb7d4291673488f2ff45052c93332',container_format='bare',created_at=2023-08-01T21:56:38Z,direct_url=<?>,disk_format='qcow2',id=66da76aa-bb45-4e01-9056-8c0661e5c005,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1624352118',owner='6745cf6719124010a510bd54fd5b9259',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-01T21:56:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '66da76aa-bb45-4e01-9056-8c0661e5c005'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:56:47 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:56:47 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:56:47 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:56:47 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:56:47 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:56:47 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:56:47 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:56:47 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='1f1fb7d4291673488f2ff45052c93332',container_format='bare',created_at=2023-08-01T21:56:38Z,direct_url=<?>,disk_format='qcow2',id=66da76aa-bb45-4e01-9056-8c0661e5c005,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1624352118',owner='6745cf6719124010a510bd54fd5b9259',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-01T21:56:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:56:47 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:56:47 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:56:47 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:56:47 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:56:47 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:56:47 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:56:47 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:56:47 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:56:47 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:56:47 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:56:47 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:56:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1162001329',display_name='tempest-TestStampPattern-server-1162001329',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1162001329',id=50,image_ref='66da76aa-bb45-4e01-9056-8c0661e5c005',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5zerJIOKAGpKQc33aoGj7w4cb3+pxQP7Uruya5ewYasxo4ClP2x6OPm9JVHlh3eOVAilC4CllBK7iFF9X0sTWOPMaSESsH80PKRKhlbIYzYqaKwb7isTjWrZQ4uPEpww==',key_name='tempest-TestStampPattern-769887333',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6745cf6719124010a510bd54fd5b9259',ramdisk_id='',reservation_id='r-5e2lr0we',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='ec73ec4b-4591-46f2-9192-7868125c53c5',image_min_disk='1',image_min_ram='0',image_owner_id='6745cf6719124010a510bd54fd5b9259',image_owner_project_name='tempest-TestStampPattern-582092164',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-582092164-project-member',image_user_id='7b481c57931941c79ecd184146f20dba',network_allocated='True',owner_project_name='tempest-TestStampPattern-582092164',owner_user_name='tempest-TestStampPattern-582092164-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:56:45Z,user_data=None,user_id='7b481c57931941c79ecd184146f20dba',uuid=4e5f6dc7-cd0b-4cb9-b5b3-49907903499f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "107ffd50-bf35-42c4-a394-131bf57b4157", "address": "fa:16:3e:ff:ef:8d", "network": {"id": "6b6d5e8a-1c0a-4d1b-93d1-4de7246e39fb", "bridge": "br-int", "label": "tempest-TestStampPattern-2085707213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6745cf6719124010a510bd54fd5b9259", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap107ffd50-bf", "ovs_interfaceid": "107ffd50-bf35-42c4-a394-131bf57b4157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:56:47 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Converting VIF {"id": "107ffd50-bf35-42c4-a394-131bf57b4157", "address": "fa:16:3e:ff:ef:8d", "network": {"id": "6b6d5e8a-1c0a-4d1b-93d1-4de7246e39fb", "bridge": "br-int", "label": "tempest-TestStampPattern-2085707213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6745cf6719124010a510bd54fd5b9259", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap107ffd50-bf", "ovs_interfaceid": "107ffd50-bf35-42c4-a394-131bf57b4157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:56:47 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:ef:8d,bridge_name='br-int',has_traffic_filtering=True,id=107ffd50-bf35-42c4-a394-131bf57b4157,network=Network(6b6d5e8a-1c0a-4d1b-93d1-4de7246e39fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap107ffd50-bf') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:56:47 user nova-compute[72586]: DEBUG nova.objects.instance [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lazy-loading 'pci_devices' on Instance uuid 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:56:47 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:56:47 user nova-compute[72586]:   <uuid>4e5f6dc7-cd0b-4cb9-b5b3-49907903499f</uuid>
Aug 01 21:56:47 user nova-compute[72586]:   <name>instance-00000032</name>
Aug 01 21:56:47 user nova-compute[72586]:   <memory>524288</memory>
Aug 01 21:56:47 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:56:47 user nova-compute[72586]:   <metadata>
Aug 01 21:56:47 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:56:47 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:56:47 user nova-compute[72586]:       <nova:name>tempest-TestStampPattern-server-1162001329</nova:name>
Aug 01 21:56:47 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:56:47</nova:creationTime>
Aug 01 21:56:47 user nova-compute[72586]:       <nova:flavor name="m1.tiny">
Aug 01 21:56:47 user nova-compute[72586]:         <nova:memory>512</nova:memory>
Aug 01 21:56:47 user nova-compute[72586]:         <nova:disk>1</nova:disk>
Aug 01 21:56:47 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:56:47 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:56:47 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:56:47 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:56:47 user nova-compute[72586]:       <nova:owner>
Aug 01 21:56:47 user nova-compute[72586]:         <nova:user uuid="7b481c57931941c79ecd184146f20dba">tempest-TestStampPattern-582092164-project-member</nova:user>
Aug 01 21:56:47 user nova-compute[72586]:         <nova:project uuid="6745cf6719124010a510bd54fd5b9259">tempest-TestStampPattern-582092164</nova:project>
Aug 01 21:56:47 user nova-compute[72586]:       </nova:owner>
Aug 01 21:56:47 user nova-compute[72586]:       <nova:root type="image" uuid="66da76aa-bb45-4e01-9056-8c0661e5c005"/>
Aug 01 21:56:47 user nova-compute[72586]:       <nova:ports>
Aug 01 21:56:47 user nova-compute[72586]:         <nova:port uuid="107ffd50-bf35-42c4-a394-131bf57b4157">
Aug 01 21:56:47 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 01 21:56:47 user nova-compute[72586]:         </nova:port>
Aug 01 21:56:47 user nova-compute[72586]:       </nova:ports>
Aug 01 21:56:47 user nova-compute[72586]:     </nova:instance>
Aug 01 21:56:47 user nova-compute[72586]:   </metadata>
Aug 01 21:56:47 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:56:47 user nova-compute[72586]:     <system>
Aug 01 21:56:47 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:56:47 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:56:47 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:56:47 user nova-compute[72586]:       <entry name="serial">4e5f6dc7-cd0b-4cb9-b5b3-49907903499f</entry>
Aug 01 21:56:47 user nova-compute[72586]:       <entry name="uuid">4e5f6dc7-cd0b-4cb9-b5b3-49907903499f</entry>
Aug 01 21:56:47 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:56:47 user nova-compute[72586]:     </system>
Aug 01 21:56:47 user nova-compute[72586]:   </sysinfo>
Aug 01 21:56:47 user nova-compute[72586]:   <os>
Aug 01 21:56:47 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:56:47 user nova-compute[72586]:     <boot dev="hd"/>
Aug 01 21:56:47 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:56:47 user nova-compute[72586]:   </os>
Aug 01 21:56:47 user nova-compute[72586]:   <features>
Aug 01 21:56:47 user nova-compute[72586]:     <acpi/>
Aug 01 21:56:47 user nova-compute[72586]:     <apic/>
Aug 01 21:56:47 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:56:47 user nova-compute[72586]:   </features>
Aug 01 21:56:47 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:56:47 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:56:47 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:56:47 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:56:47 user nova-compute[72586]:   </clock>
Aug 01 21:56:47 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:56:47 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:56:47 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:56:47 user nova-compute[72586]:   </cpu>
Aug 01 21:56:47 user nova-compute[72586]:   <devices>
Aug 01 21:56:47 user nova-compute[72586]:     <disk type="file" device="disk">
Aug 01 21:56:47 user nova-compute[72586]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 21:56:47 user nova-compute[72586]:       <source file="/opt/stack/data/nova/instances/4e5f6dc7-cd0b-4cb9-b5b3-49907903499f/disk"/>
Aug 01 21:56:47 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:56:47 user nova-compute[72586]:     </disk>
Aug 01 21:56:47 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:56:47 user nova-compute[72586]:       <mac address="fa:16:3e:ff:ef:8d"/>
Aug 01 21:56:47 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:56:47 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:56:47 user nova-compute[72586]:       <target dev="tap107ffd50-bf"/>
Aug 01 21:56:47 user nova-compute[72586]:     </interface>
Aug 01 21:56:47 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:56:47 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/4e5f6dc7-cd0b-4cb9-b5b3-49907903499f/console.log" append="off"/>
Aug 01 21:56:47 user nova-compute[72586]:     </serial>
Aug 01 21:56:47 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:56:47 user nova-compute[72586]:     <video>
Aug 01 21:56:47 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:56:47 user nova-compute[72586]:     </video>
Aug 01 21:56:47 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:56:47 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:56:47 user nova-compute[72586]:     </rng>
Aug 01 21:56:47 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:56:47 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:56:47 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:56:47 user nova-compute[72586]:     </memballoon>
Aug 01 21:56:47 user nova-compute[72586]:   </devices>
Aug 01 21:56:47 user nova-compute[72586]: </domain>
Aug 01 21:56:47 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:56:47 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:56:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1162001329',display_name='tempest-TestStampPattern-server-1162001329',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1162001329',id=50,image_ref='66da76aa-bb45-4e01-9056-8c0661e5c005',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5zerJIOKAGpKQc33aoGj7w4cb3+pxQP7Uruya5ewYasxo4ClP2x6OPm9JVHlh3eOVAilC4CllBK7iFF9X0sTWOPMaSESsH80PKRKhlbIYzYqaKwb7isTjWrZQ4uPEpww==',key_name='tempest-TestStampPattern-769887333',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6745cf6719124010a510bd54fd5b9259',ramdisk_id='',reservation_id='r-5e2lr0we',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='ec73ec4b-4591-46f2-9192-7868125c53c5',image_min_disk='1',image_min_ram='0',image_owner_id='6745cf6719124010a510bd54fd5b9259',image_owner_project_name='tempest-TestStampPattern-582092164',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-582092164-project-member',image_user_id='7b481c57931941c79ecd184146f20dba',network_allocated='True',owner_project_name='tempest-TestStampPattern-582092164',owner_user_name='tempest-TestStampPattern-582092164-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:56:45Z,user_data=None,user_id='7b481c57931941c79ecd184146f20dba',uuid=4e5f6dc7-cd0b-4cb9-b5b3-49907903499f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "107ffd50-bf35-42c4-a394-131bf57b4157", "address": "fa:16:3e:ff:ef:8d", "network": {"id": "6b6d5e8a-1c0a-4d1b-93d1-4de7246e39fb", "bridge": "br-int", "label": "tempest-TestStampPattern-2085707213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6745cf6719124010a510bd54fd5b9259", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap107ffd50-bf", "ovs_interfaceid": "107ffd50-bf35-42c4-a394-131bf57b4157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:56:47 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Converting VIF {"id": "107ffd50-bf35-42c4-a394-131bf57b4157", "address": "fa:16:3e:ff:ef:8d", "network": {"id": "6b6d5e8a-1c0a-4d1b-93d1-4de7246e39fb", "bridge": "br-int", "label": "tempest-TestStampPattern-2085707213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6745cf6719124010a510bd54fd5b9259", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap107ffd50-bf", "ovs_interfaceid": "107ffd50-bf35-42c4-a394-131bf57b4157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:56:47 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:ef:8d,bridge_name='br-int',has_traffic_filtering=True,id=107ffd50-bf35-42c4-a394-131bf57b4157,network=Network(6b6d5e8a-1c0a-4d1b-93d1-4de7246e39fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap107ffd50-bf') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:56:47 user nova-compute[72586]: DEBUG os_vif [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:ef:8d,bridge_name='br-int',has_traffic_filtering=True,id=107ffd50-bf35-42c4-a394-131bf57b4157,network=Network(6b6d5e8a-1c0a-4d1b-93d1-4de7246e39fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap107ffd50-bf') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:56:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:56:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:56:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:56:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:56:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap107ffd50-bf, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:56:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap107ffd50-bf, col_values=(('external_ids', {'iface-id': '107ffd50-bf35-42c4-a394-131bf57b4157', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:ef:8d', 'vm-uuid': '4e5f6dc7-cd0b-4cb9-b5b3-49907903499f'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:56:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:56:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:56:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:56:47 user nova-compute[72586]: INFO os_vif [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:ef:8d,bridge_name='br-int',has_traffic_filtering=True,id=107ffd50-bf35-42c4-a394-131bf57b4157,network=Network(6b6d5e8a-1c0a-4d1b-93d1-4de7246e39fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap107ffd50-bf')
Aug 01 21:56:47 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:56:47 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] No VIF found with MAC fa:16:3e:ff:ef:8d, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:56:47 user nova-compute[72586]: DEBUG nova.network.neutron [req-055edea5-0b74-413e-98c7-445434139f91 req-297039ed-8343-467e-96f0-b33f523b783b service nova] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Updated VIF entry in instance network info cache for port 107ffd50-bf35-42c4-a394-131bf57b4157. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:56:47 user nova-compute[72586]: DEBUG nova.network.neutron [req-055edea5-0b74-413e-98c7-445434139f91 req-297039ed-8343-467e-96f0-b33f523b783b service nova] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Updating instance_info_cache with network_info: [{"id": "107ffd50-bf35-42c4-a394-131bf57b4157", "address": "fa:16:3e:ff:ef:8d", "network": {"id": "6b6d5e8a-1c0a-4d1b-93d1-4de7246e39fb", "bridge": "br-int", "label": "tempest-TestStampPattern-2085707213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6745cf6719124010a510bd54fd5b9259", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap107ffd50-bf", "ovs_interfaceid": "107ffd50-bf35-42c4-a394-131bf57b4157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:56:47 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-055edea5-0b74-413e-98c7-445434139f91 req-297039ed-8343-467e-96f0-b33f523b783b service nova] Releasing lock "refresh_cache-4e5f6dc7-cd0b-4cb9-b5b3-49907903499f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:56:47 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:56:47 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:56:48 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:56:48 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:56:48 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:56:48 user nova-compute[72586]: DEBUG nova.compute.manager [req-8e4ed682-438a-41a8-8ca6-26e3de59257a req-70daf01f-0148-40cd-95da-91194e4101b3 service nova] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Received event network-vif-plugged-107ffd50-bf35-42c4-a394-131bf57b4157 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:56:48 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-8e4ed682-438a-41a8-8ca6-26e3de59257a req-70daf01f-0148-40cd-95da-91194e4101b3 service nova] Acquiring lock "4e5f6dc7-cd0b-4cb9-b5b3-49907903499f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:56:48 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-8e4ed682-438a-41a8-8ca6-26e3de59257a req-70daf01f-0148-40cd-95da-91194e4101b3 service nova] Lock "4e5f6dc7-cd0b-4cb9-b5b3-49907903499f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:56:48 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-8e4ed682-438a-41a8-8ca6-26e3de59257a req-70daf01f-0148-40cd-95da-91194e4101b3 service nova] Lock "4e5f6dc7-cd0b-4cb9-b5b3-49907903499f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:56:48 user nova-compute[72586]: DEBUG nova.compute.manager [req-8e4ed682-438a-41a8-8ca6-26e3de59257a req-70daf01f-0148-40cd-95da-91194e4101b3 service nova] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] No waiting events found dispatching network-vif-plugged-107ffd50-bf35-42c4-a394-131bf57b4157 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:56:48 user nova-compute[72586]: WARNING nova.compute.manager [req-8e4ed682-438a-41a8-8ca6-26e3de59257a req-70daf01f-0148-40cd-95da-91194e4101b3 service nova] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Received unexpected event network-vif-plugged-107ffd50-bf35-42c4-a394-131bf57b4157 for instance with vm_state building and task_state spawning.
Aug 01 21:56:48 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:56:48 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:56:48 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:56:50 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:56:50 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690927010.5521562, 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:56:50 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] VM Resumed (Lifecycle Event)
Aug 01 21:56:50 user nova-compute[72586]: DEBUG nova.compute.manager [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Instance event wait completed in 0 seconds for  {{(pid=72586) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 21:56:50 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Guest created on hypervisor {{(pid=72586) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 21:56:50 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Instance spawned successfully.
Aug 01 21:56:50 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 21:56:50 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Found default for hw_input_bus of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:56:50 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Found default for hw_pointer_model of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:56:50 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:56:50 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:56:50 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:56:50 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690927010.5545132, 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:56:50 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] VM Started (Lifecycle Event)
Aug 01 21:56:50 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:56:50 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:56:50 user nova-compute[72586]: INFO nova.compute.manager [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Took 5.63 seconds to spawn the instance on the hypervisor.
Aug 01 21:56:50 user nova-compute[72586]: DEBUG nova.compute.manager [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:56:50 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:56:50 user nova-compute[72586]: INFO nova.compute.manager [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Took 6.31 seconds to build instance.
Aug 01 21:56:50 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-0988acd4-28ef-475f-92bd-e1e822438f48 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lock "4e5f6dc7-cd0b-4cb9-b5b3-49907903499f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.402s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:56:50 user nova-compute[72586]: DEBUG nova.compute.manager [req-9a2db97a-d1fe-4645-a9c9-4001c0999298 req-87905fa4-385e-40e8-a6d4-3a77794a4326 service nova] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Received event network-vif-plugged-107ffd50-bf35-42c4-a394-131bf57b4157 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:56:50 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-9a2db97a-d1fe-4645-a9c9-4001c0999298 req-87905fa4-385e-40e8-a6d4-3a77794a4326 service nova] Acquiring lock "4e5f6dc7-cd0b-4cb9-b5b3-49907903499f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:56:50 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-9a2db97a-d1fe-4645-a9c9-4001c0999298 req-87905fa4-385e-40e8-a6d4-3a77794a4326 service nova] Lock "4e5f6dc7-cd0b-4cb9-b5b3-49907903499f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:56:50 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-9a2db97a-d1fe-4645-a9c9-4001c0999298 req-87905fa4-385e-40e8-a6d4-3a77794a4326 service nova] Lock "4e5f6dc7-cd0b-4cb9-b5b3-49907903499f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:56:50 user nova-compute[72586]: DEBUG nova.compute.manager [req-9a2db97a-d1fe-4645-a9c9-4001c0999298 req-87905fa4-385e-40e8-a6d4-3a77794a4326 service nova] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] No waiting events found dispatching network-vif-plugged-107ffd50-bf35-42c4-a394-131bf57b4157 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:56:50 user nova-compute[72586]: WARNING nova.compute.manager [req-9a2db97a-d1fe-4645-a9c9-4001c0999298 req-87905fa4-385e-40e8-a6d4-3a77794a4326 service nova] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Received unexpected event network-vif-plugged-107ffd50-bf35-42c4-a394-131bf57b4157 for instance with vm_state active and task_state None.
Aug 01 21:56:52 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:56:53 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:56:53 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:56:53 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:56:53 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:56:53 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Auditing locally available compute resources for user (node: user) {{(pid=72586) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 21:56:54 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7900178d-22dc-4571-8aa4-b5562fb3a927/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:56:54 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7900178d-22dc-4571-8aa4-b5562fb3a927/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:56:54 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7900178d-22dc-4571-8aa4-b5562fb3a927/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:56:54 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7900178d-22dc-4571-8aa4-b5562fb3a927/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:56:54 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec73ec4b-4591-46f2-9192-7868125c53c5/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:56:54 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec73ec4b-4591-46f2-9192-7868125c53c5/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:56:54 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec73ec4b-4591-46f2-9192-7868125c53c5/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:56:54 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec73ec4b-4591-46f2-9192-7868125c53c5/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:56:54 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e5f6dc7-cd0b-4cb9-b5b3-49907903499f/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:56:54 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e5f6dc7-cd0b-4cb9-b5b3-49907903499f/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:56:54 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e5f6dc7-cd0b-4cb9-b5b3-49907903499f/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:56:54 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e5f6dc7-cd0b-4cb9-b5b3-49907903499f/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:56:55 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:56:55 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:56:55 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Hypervisor/Node resource view: name=user free_ram=8567MB free_disk=25.071582794189453GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72586) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 21:56:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:56:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:56:55 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance ec73ec4b-4591-46f2-9192-7868125c53c5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:56:55 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 7900178d-22dc-4571-8aa4-b5562fb3a927 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:56:55 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:56:55 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 21:56:55 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 21:56:55 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:56:55 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:56:55 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Compute_service record updated for user:user {{(pid=72586) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 21:56:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.281s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:56:57 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:56:59 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:56:59 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:56:59 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Starting heal instance info cache {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 21:56:59 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Rebuilding the list of instances to heal {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 21:56:59 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "refresh_cache-ec73ec4b-4591-46f2-9192-7868125c53c5" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:56:59 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquired lock "refresh_cache-ec73ec4b-4591-46f2-9192-7868125c53c5" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:56:59 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Forcefully refreshing network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 21:56:59 user nova-compute[72586]: DEBUG nova.objects.instance [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lazy-loading 'info_cache' on Instance uuid ec73ec4b-4591-46f2-9192-7868125c53c5 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:57:00 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Updating instance_info_cache with network_info: [{"id": "7bb3754b-f5e0-465c-a140-3bbddd87400a", "address": "fa:16:3e:56:f7:d0", "network": {"id": "6b6d5e8a-1c0a-4d1b-93d1-4de7246e39fb", "bridge": "br-int", "label": "tempest-TestStampPattern-2085707213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6745cf6719124010a510bd54fd5b9259", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bb3754b-f5", "ovs_interfaceid": "7bb3754b-f5e0-465c-a140-3bbddd87400a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:57:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Releasing lock "refresh_cache-ec73ec4b-4591-46f2-9192-7868125c53c5" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:57:00 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Updated the network info_cache for instance {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 21:57:00 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:57:00 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:57:02 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:57:03 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:57:05 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:57:07 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:57:10 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:57:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:57:15 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:57:17 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:57:20 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:57:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-8f869388-e041-488e-bd05-3e8e5933983d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Acquiring lock "7900178d-22dc-4571-8aa4-b5562fb3a927" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:57:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-8f869388-e041-488e-bd05-3e8e5933983d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "7900178d-22dc-4571-8aa4-b5562fb3a927" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:57:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-8f869388-e041-488e-bd05-3e8e5933983d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Acquiring lock "7900178d-22dc-4571-8aa4-b5562fb3a927-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:57:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-8f869388-e041-488e-bd05-3e8e5933983d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "7900178d-22dc-4571-8aa4-b5562fb3a927-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:57:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-8f869388-e041-488e-bd05-3e8e5933983d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "7900178d-22dc-4571-8aa4-b5562fb3a927-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:57:21 user nova-compute[72586]: INFO nova.compute.manager [None req-8f869388-e041-488e-bd05-3e8e5933983d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Terminating instance
Aug 01 21:57:21 user nova-compute[72586]: DEBUG nova.compute.manager [None req-8f869388-e041-488e-bd05-3e8e5933983d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Start destroying the instance on the hypervisor. {{(pid=72586) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 21:57:21 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:57:21 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:57:22 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:57:22 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:57:22 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:57:22 user nova-compute[72586]: DEBUG nova.compute.manager [req-5d1fb7ae-a68b-4899-99aa-1f538d854a43 req-91185093-814c-4dce-96de-27d39865252a service nova] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Received event network-vif-unplugged-d5d860ea-6f19-4513-8b09-fd220204cb58 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:57:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-5d1fb7ae-a68b-4899-99aa-1f538d854a43 req-91185093-814c-4dce-96de-27d39865252a service nova] Acquiring lock "7900178d-22dc-4571-8aa4-b5562fb3a927-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:57:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-5d1fb7ae-a68b-4899-99aa-1f538d854a43 req-91185093-814c-4dce-96de-27d39865252a service nova] Lock "7900178d-22dc-4571-8aa4-b5562fb3a927-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:57:22 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-5d1fb7ae-a68b-4899-99aa-1f538d854a43 req-91185093-814c-4dce-96de-27d39865252a service nova] Lock "7900178d-22dc-4571-8aa4-b5562fb3a927-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:57:22 user nova-compute[72586]: DEBUG nova.compute.manager [req-5d1fb7ae-a68b-4899-99aa-1f538d854a43 req-91185093-814c-4dce-96de-27d39865252a service nova] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] No waiting events found dispatching network-vif-unplugged-d5d860ea-6f19-4513-8b09-fd220204cb58 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:57:22 user nova-compute[72586]: DEBUG nova.compute.manager [req-5d1fb7ae-a68b-4899-99aa-1f538d854a43 req-91185093-814c-4dce-96de-27d39865252a service nova] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Received event network-vif-unplugged-d5d860ea-6f19-4513-8b09-fd220204cb58 for instance with task_state deleting. {{(pid=72586) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 21:57:22 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Instance destroyed successfully.
Aug 01 21:57:22 user nova-compute[72586]: DEBUG nova.objects.instance [None req-8f869388-e041-488e-bd05-3e8e5933983d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lazy-loading 'resources' on Instance uuid 7900178d-22dc-4571-8aa4-b5562fb3a927 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:57:22 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-8f869388-e041-488e-bd05-3e8e5933983d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:54:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1539186367',display_name='tempest-AttachVolumeNegativeTest-server-1539186367',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1539186367',id=49,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFg8tzthd9EJgUf7w8xR/Bf5qIErAGe/5PcJTaVL4Y8+ua8cthxEqtYsOcMw+IfA1MqZHxNIDVXSXZx612FUeDd//p60cZvnfmjv3UUIs3XknHCWBz3TovOyogYdvqmc0A==',key_name='tempest-keypair-1142853449',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:54:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='063dd272226340d49a7ac0756413cadf',ramdisk_id='',reservation_id='r-ipdwuaub',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-717043369',owner_user_name='tempest-AttachVolumeNegativeTest-717043369-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:54:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37663bab7d31400c8399451058bd5936',uuid=7900178d-22dc-4571-8aa4-b5562fb3a927,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d5d860ea-6f19-4513-8b09-fd220204cb58", "address": "fa:16:3e:d9:8e:26", "network": {"id": "52ee6623-01e5-491e-ab5e-d1d0511bd15f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-765176125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063dd272226340d49a7ac0756413cadf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5d860ea-6f", "ovs_interfaceid": "d5d860ea-6f19-4513-8b09-fd220204cb58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:57:22 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-8f869388-e041-488e-bd05-3e8e5933983d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Converting VIF {"id": "d5d860ea-6f19-4513-8b09-fd220204cb58", "address": "fa:16:3e:d9:8e:26", "network": {"id": "52ee6623-01e5-491e-ab5e-d1d0511bd15f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-765176125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063dd272226340d49a7ac0756413cadf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5d860ea-6f", "ovs_interfaceid": "d5d860ea-6f19-4513-8b09-fd220204cb58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:57:22 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-8f869388-e041-488e-bd05-3e8e5933983d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:8e:26,bridge_name='br-int',has_traffic_filtering=True,id=d5d860ea-6f19-4513-8b09-fd220204cb58,network=Network(52ee6623-01e5-491e-ab5e-d1d0511bd15f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5d860ea-6f') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:57:22 user nova-compute[72586]: DEBUG os_vif [None req-8f869388-e041-488e-bd05-3e8e5933983d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:8e:26,bridge_name='br-int',has_traffic_filtering=True,id=d5d860ea-6f19-4513-8b09-fd220204cb58,network=Network(52ee6623-01e5-491e-ab5e-d1d0511bd15f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5d860ea-6f') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:57:22 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:57:22 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd5d860ea-6f, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:57:22 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:57:22 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:57:22 user nova-compute[72586]: INFO os_vif [None req-8f869388-e041-488e-bd05-3e8e5933983d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:8e:26,bridge_name='br-int',has_traffic_filtering=True,id=d5d860ea-6f19-4513-8b09-fd220204cb58,network=Network(52ee6623-01e5-491e-ab5e-d1d0511bd15f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5d860ea-6f')
Aug 01 21:57:22 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-8f869388-e041-488e-bd05-3e8e5933983d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Deleting instance files /opt/stack/data/nova/instances/7900178d-22dc-4571-8aa4-b5562fb3a927_del
Aug 01 21:57:22 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-8f869388-e041-488e-bd05-3e8e5933983d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Deletion of /opt/stack/data/nova/instances/7900178d-22dc-4571-8aa4-b5562fb3a927_del complete
Aug 01 21:57:22 user nova-compute[72586]: INFO nova.compute.manager [None req-8f869388-e041-488e-bd05-3e8e5933983d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 01 21:57:22 user nova-compute[72586]: DEBUG oslo.service.loopingcall [None req-8f869388-e041-488e-bd05-3e8e5933983d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72586) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 21:57:22 user nova-compute[72586]: DEBUG nova.compute.manager [-] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Deallocating network for instance {{(pid=72586) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 21:57:22 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] deallocate_for_instance() {{(pid=72586) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 21:57:23 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:57:23 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Took 1.22 seconds to deallocate network for instance.
Aug 01 21:57:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-8f869388-e041-488e-bd05-3e8e5933983d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:57:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-8f869388-e041-488e-bd05-3e8e5933983d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:57:24 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-8f869388-e041-488e-bd05-3e8e5933983d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:57:24 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-8f869388-e041-488e-bd05-3e8e5933983d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:57:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-8f869388-e041-488e-bd05-3e8e5933983d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.149s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:57:24 user nova-compute[72586]: INFO nova.scheduler.client.report [None req-8f869388-e041-488e-bd05-3e8e5933983d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Deleted allocations for instance 7900178d-22dc-4571-8aa4-b5562fb3a927
Aug 01 21:57:24 user nova-compute[72586]: DEBUG nova.compute.manager [req-ea79e99e-ef66-4b01-b277-e83a611596cf req-c06ce496-7f7c-49bb-9a5e-597c0198645f service nova] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Received event network-vif-plugged-d5d860ea-6f19-4513-8b09-fd220204cb58 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:57:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ea79e99e-ef66-4b01-b277-e83a611596cf req-c06ce496-7f7c-49bb-9a5e-597c0198645f service nova] Acquiring lock "7900178d-22dc-4571-8aa4-b5562fb3a927-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:57:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ea79e99e-ef66-4b01-b277-e83a611596cf req-c06ce496-7f7c-49bb-9a5e-597c0198645f service nova] Lock "7900178d-22dc-4571-8aa4-b5562fb3a927-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:57:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-ea79e99e-ef66-4b01-b277-e83a611596cf req-c06ce496-7f7c-49bb-9a5e-597c0198645f service nova] Lock "7900178d-22dc-4571-8aa4-b5562fb3a927-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:57:24 user nova-compute[72586]: DEBUG nova.compute.manager [req-ea79e99e-ef66-4b01-b277-e83a611596cf req-c06ce496-7f7c-49bb-9a5e-597c0198645f service nova] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] No waiting events found dispatching network-vif-plugged-d5d860ea-6f19-4513-8b09-fd220204cb58 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:57:24 user nova-compute[72586]: WARNING nova.compute.manager [req-ea79e99e-ef66-4b01-b277-e83a611596cf req-c06ce496-7f7c-49bb-9a5e-597c0198645f service nova] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Received unexpected event network-vif-plugged-d5d860ea-6f19-4513-8b09-fd220204cb58 for instance with vm_state deleted and task_state None.
Aug 01 21:57:24 user nova-compute[72586]: DEBUG nova.compute.manager [req-ea79e99e-ef66-4b01-b277-e83a611596cf req-c06ce496-7f7c-49bb-9a5e-597c0198645f service nova] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Received event network-vif-deleted-d5d860ea-6f19-4513-8b09-fd220204cb58 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:57:24 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-8f869388-e041-488e-bd05-3e8e5933983d tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "7900178d-22dc-4571-8aa4-b5562fb3a927" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.416s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:57:27 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:57:32 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:57:32 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:57:32 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72586) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 21:57:32 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72586) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 21:57:32 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72586) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 21:57:32 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:57:37 user nova-compute[72586]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690927042.6428246, 7900178d-22dc-4571-8aa4-b5562fb3a927 => Stopped> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:57:37 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] VM Stopped (Lifecycle Event)
Aug 01 21:57:37 user nova-compute[72586]: DEBUG nova.compute.manager [None req-9144b96e-1bf6-4986-bb98-b7c38d2dcb72 None None] [instance: 7900178d-22dc-4571-8aa4-b5562fb3a927] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:57:37 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:57:42 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:57:46 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:57:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:57:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:57:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72586) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 21:57:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72586) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 21:57:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72586) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 21:57:47 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:57:48 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:57:48 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:57:48 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72586) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 21:57:49 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:57:49 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:57:52 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:57:53 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:57:53 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:57:53 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:57:53 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:57:53 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Auditing locally available compute resources for user (node: user) {{(pid=72586) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 21:57:54 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec73ec4b-4591-46f2-9192-7868125c53c5/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:57:54 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec73ec4b-4591-46f2-9192-7868125c53c5/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:57:54 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec73ec4b-4591-46f2-9192-7868125c53c5/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:57:54 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec73ec4b-4591-46f2-9192-7868125c53c5/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:57:54 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e5f6dc7-cd0b-4cb9-b5b3-49907903499f/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:57:54 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e5f6dc7-cd0b-4cb9-b5b3-49907903499f/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:57:54 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e5f6dc7-cd0b-4cb9-b5b3-49907903499f/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:57:54 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e5f6dc7-cd0b-4cb9-b5b3-49907903499f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:57:54 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:57:54 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:57:54 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Hypervisor/Node resource view: name=user free_ram=8678MB free_disk=25.097061157226562GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72586) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 21:57:54 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:57:54 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:57:55 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance ec73ec4b-4591-46f2-9192-7868125c53c5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:57:55 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:57:55 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 21:57:55 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 21:57:55 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:57:55 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:57:55 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Compute_service record updated for user:user {{(pid=72586) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 21:57:55 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.241s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:57:57 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:58:00 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:58:00 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Starting heal instance info cache {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 21:58:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "refresh_cache-4e5f6dc7-cd0b-4cb9-b5b3-49907903499f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:58:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquired lock "refresh_cache-4e5f6dc7-cd0b-4cb9-b5b3-49907903499f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:58:00 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Forcefully refreshing network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 21:58:00 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Updating instance_info_cache with network_info: [{"id": "107ffd50-bf35-42c4-a394-131bf57b4157", "address": "fa:16:3e:ff:ef:8d", "network": {"id": "6b6d5e8a-1c0a-4d1b-93d1-4de7246e39fb", "bridge": "br-int", "label": "tempest-TestStampPattern-2085707213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6745cf6719124010a510bd54fd5b9259", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap107ffd50-bf", "ovs_interfaceid": "107ffd50-bf35-42c4-a394-131bf57b4157", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:58:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Releasing lock "refresh_cache-4e5f6dc7-cd0b-4cb9-b5b3-49907903499f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:58:00 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Updated the network info_cache for instance {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 21:58:00 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:58:01 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:58:02 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:58:07 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:58:08 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:58:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:58:12 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:58:15 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Acquiring lock "77b7d14e-bc78-49c8-b91b-db6343ca62a4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:58:15 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "77b7d14e-bc78-49c8-b91b-db6343ca62a4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:58:15 user nova-compute[72586]: DEBUG nova.compute.manager [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Starting instance... {{(pid=72586) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 21:58:15 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:58:15 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:58:15 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72586) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 21:58:15 user nova-compute[72586]: INFO nova.compute.claims [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Claim successful on node user
Aug 01 21:58:15 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:58:15 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:58:15 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.256s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:58:15 user nova-compute[72586]: DEBUG nova.compute.manager [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Start building networks asynchronously for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 21:58:15 user nova-compute[72586]: DEBUG nova.compute.manager [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Allocating IP information in the background. {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 21:58:15 user nova-compute[72586]: DEBUG nova.network.neutron [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] allocate_for_instance() {{(pid=72586) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 21:58:15 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 21:58:15 user nova-compute[72586]: DEBUG nova.compute.manager [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Start building block device mappings for instance. {{(pid=72586) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 21:58:16 user nova-compute[72586]: DEBUG nova.policy [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '37663bab7d31400c8399451058bd5936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063dd272226340d49a7ac0756413cadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72586) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 21:58:16 user nova-compute[72586]: DEBUG nova.compute.manager [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Start spawning the instance on the hypervisor. {{(pid=72586) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 21:58:16 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Creating instance directory {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 21:58:16 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Creating image(s)
Aug 01 21:58:16 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Acquiring lock "/opt/stack/data/nova/instances/77b7d14e-bc78-49c8-b91b-db6343ca62a4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:58:16 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "/opt/stack/data/nova/instances/77b7d14e-bc78-49c8-b91b-db6343ca62a4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:58:16 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "/opt/stack/data/nova/instances/77b7d14e-bc78-49c8-b91b-db6343ca62a4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:58:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:58:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.138s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:58:16 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Acquiring lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:58:16 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:58:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:58:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.138s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:58:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/77b7d14e-bc78-49c8-b91b-db6343ca62a4/disk 1073741824 {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:58:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08,backing_fmt=raw /opt/stack/data/nova/instances/77b7d14e-bc78-49c8-b91b-db6343ca62a4/disk 1073741824" returned: 0 in 0.048s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:58:16 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "9bfa0e233bd5d21c9af416cf452d3b2b709a1e08" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:58:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:58:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bfa0e233bd5d21c9af416cf452d3b2b709a1e08 --force-share --output=json" returned: 0 in 0.142s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:58:16 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Checking if we can resize image /opt/stack/data/nova/instances/77b7d14e-bc78-49c8-b91b-db6343ca62a4/disk. size=1073741824 {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 21:58:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77b7d14e-bc78-49c8-b91b-db6343ca62a4/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:58:16 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77b7d14e-bc78-49c8-b91b-db6343ca62a4/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:58:16 user nova-compute[72586]: DEBUG nova.virt.disk.api [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Cannot resize image /opt/stack/data/nova/instances/77b7d14e-bc78-49c8-b91b-db6343ca62a4/disk to a smaller size. {{(pid=72586) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 21:58:16 user nova-compute[72586]: DEBUG nova.objects.instance [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lazy-loading 'migration_context' on Instance uuid 77b7d14e-bc78-49c8-b91b-db6343ca62a4 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:58:16 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Created local disks {{(pid=72586) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 21:58:16 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Ensure instance console log exists: /opt/stack/data/nova/instances/77b7d14e-bc78-49c8-b91b-db6343ca62a4/console.log {{(pid=72586) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 21:58:16 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:58:16 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:58:16 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:58:16 user nova-compute[72586]: DEBUG nova.network.neutron [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Successfully created port: 434011b9-6e2f-418c-b001-c73eae1ffdda {{(pid=72586) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 21:58:17 user nova-compute[72586]: DEBUG nova.network.neutron [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Successfully updated port: 434011b9-6e2f-418c-b001-c73eae1ffdda {{(pid=72586) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 21:58:17 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Acquiring lock "refresh_cache-77b7d14e-bc78-49c8-b91b-db6343ca62a4" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:58:17 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Acquired lock "refresh_cache-77b7d14e-bc78-49c8-b91b-db6343ca62a4" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:58:17 user nova-compute[72586]: DEBUG nova.network.neutron [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Building network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 21:58:17 user nova-compute[72586]: DEBUG nova.compute.manager [req-8bae330e-5650-46f9-9aea-9a5d7beb78ea req-d8af6dde-1b18-4500-b862-b19a633a5189 service nova] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Received event network-changed-434011b9-6e2f-418c-b001-c73eae1ffdda {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:58:17 user nova-compute[72586]: DEBUG nova.compute.manager [req-8bae330e-5650-46f9-9aea-9a5d7beb78ea req-d8af6dde-1b18-4500-b862-b19a633a5189 service nova] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Refreshing instance network info cache due to event network-changed-434011b9-6e2f-418c-b001-c73eae1ffdda. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:58:17 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-8bae330e-5650-46f9-9aea-9a5d7beb78ea req-d8af6dde-1b18-4500-b862-b19a633a5189 service nova] Acquiring lock "refresh_cache-77b7d14e-bc78-49c8-b91b-db6343ca62a4" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:58:17 user nova-compute[72586]: DEBUG nova.network.neutron [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Instance cache missing network info. {{(pid=72586) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 21:58:17 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:58:17 user nova-compute[72586]: DEBUG nova.network.neutron [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Updating instance_info_cache with network_info: [{"id": "434011b9-6e2f-418c-b001-c73eae1ffdda", "address": "fa:16:3e:ef:87:ec", "network": {"id": "52ee6623-01e5-491e-ab5e-d1d0511bd15f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-765176125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063dd272226340d49a7ac0756413cadf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434011b9-6e", "ovs_interfaceid": "434011b9-6e2f-418c-b001-c73eae1ffdda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:58:17 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Releasing lock "refresh_cache-77b7d14e-bc78-49c8-b91b-db6343ca62a4" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:58:17 user nova-compute[72586]: DEBUG nova.compute.manager [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Instance network_info: |[{"id": "434011b9-6e2f-418c-b001-c73eae1ffdda", "address": "fa:16:3e:ef:87:ec", "network": {"id": "52ee6623-01e5-491e-ab5e-d1d0511bd15f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-765176125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063dd272226340d49a7ac0756413cadf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434011b9-6e", "ovs_interfaceid": "434011b9-6e2f-418c-b001-c73eae1ffdda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72586) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 21:58:17 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-8bae330e-5650-46f9-9aea-9a5d7beb78ea req-d8af6dde-1b18-4500-b862-b19a633a5189 service nova] Acquired lock "refresh_cache-77b7d14e-bc78-49c8-b91b-db6343ca62a4" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:58:17 user nova-compute[72586]: DEBUG nova.network.neutron [req-8bae330e-5650-46f9-9aea-9a5d7beb78ea req-d8af6dde-1b18-4500-b862-b19a633a5189 service nova] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Refreshing network info cache for port 434011b9-6e2f-418c-b001-c73eae1ffdda {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:58:17 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Start _get_guest_xml network_info=[{"id": "434011b9-6e2f-418c-b001-c73eae1ffdda", "address": "fa:16:3e:ef:87:ec", "network": {"id": "52ee6623-01e5-491e-ab5e-d1d0511bd15f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-765176125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063dd272226340d49a7ac0756413cadf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434011b9-6e", "ovs_interfaceid": "434011b9-6e2f-418c-b001-c73eae1ffdda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '0243d46b-6819-42a5-926f-42b71f0c97ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 21:58:17 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:58:17 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:58:17 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 21:58:17 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] CPU controller missing on host. {{(pid=72586) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 21:58:17 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 21:58:17 user nova-compute[72586]: DEBUG nova.virt.libvirt.host [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] CPU controller found on host. {{(pid=72586) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 21:58:17 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72586) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 21:58:17 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T21:15:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T21:15:43Z,direct_url=<?>,disk_format='qcow2',id=0243d46b-6819-42a5-926f-42b71f0c97ad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1d9dd3f41aa143a5832ea7aa47fa192a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T21:15:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 21:58:17 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Flavor limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 21:58:17 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Image limits 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 21:58:17 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Flavor pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 21:58:17 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Image pref 0:0:0 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 21:58:17 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 21:58:17 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 21:58:17 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 21:58:17 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Got 1 possible topologies {{(pid=72586) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 21:58:17 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 21:58:17 user nova-compute[72586]: DEBUG nova.virt.hardware [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72586) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 21:58:17 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:58:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1395970357',display_name='tempest-AttachVolumeNegativeTest-server-1395970357',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1395970357',id=51,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgOf2HFzydXwO4CWjvuCy1ogrmplikTDNhFsVj/Dz6u9C/ySg9Tlx8guXs378AhT3bzRHx/dM2rrno5QMiGhIz1EzQPsdXDPxozb//9SK8vj3BNlgLiSjxKPyYKofCsLQ==',key_name='tempest-keypair-1099260883',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='063dd272226340d49a7ac0756413cadf',ramdisk_id='',reservation_id='r-yyot4mat',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-717043369',owner_user_name='tempest-AttachVolumeNegativeTest-717043369-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:58:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37663bab7d31400c8399451058bd5936',uuid=77b7d14e-bc78-49c8-b91b-db6343ca62a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "434011b9-6e2f-418c-b001-c73eae1ffdda", "address": "fa:16:3e:ef:87:ec", "network": {"id": "52ee6623-01e5-491e-ab5e-d1d0511bd15f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-765176125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063dd272226340d49a7ac0756413cadf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434011b9-6e", "ovs_interfaceid": "434011b9-6e2f-418c-b001-c73eae1ffdda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72586) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 21:58:17 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Converting VIF {"id": "434011b9-6e2f-418c-b001-c73eae1ffdda", "address": "fa:16:3e:ef:87:ec", "network": {"id": "52ee6623-01e5-491e-ab5e-d1d0511bd15f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-765176125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063dd272226340d49a7ac0756413cadf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434011b9-6e", "ovs_interfaceid": "434011b9-6e2f-418c-b001-c73eae1ffdda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:58:17 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:87:ec,bridge_name='br-int',has_traffic_filtering=True,id=434011b9-6e2f-418c-b001-c73eae1ffdda,network=Network(52ee6623-01e5-491e-ab5e-d1d0511bd15f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap434011b9-6e') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:58:17 user nova-compute[72586]: DEBUG nova.objects.instance [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lazy-loading 'pci_devices' on Instance uuid 77b7d14e-bc78-49c8-b91b-db6343ca62a4 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:58:18 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] End _get_guest_xml xml=<domain type="kvm">
Aug 01 21:58:18 user nova-compute[72586]:   <uuid>77b7d14e-bc78-49c8-b91b-db6343ca62a4</uuid>
Aug 01 21:58:18 user nova-compute[72586]:   <name>instance-00000033</name>
Aug 01 21:58:18 user nova-compute[72586]:   <memory>524288</memory>
Aug 01 21:58:18 user nova-compute[72586]:   <vcpu>1</vcpu>
Aug 01 21:58:18 user nova-compute[72586]:   <metadata>
Aug 01 21:58:18 user nova-compute[72586]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 21:58:18 user nova-compute[72586]:       <nova:package version="0.0.0"/>
Aug 01 21:58:18 user nova-compute[72586]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1395970357</nova:name>
Aug 01 21:58:18 user nova-compute[72586]:       <nova:creationTime>2023-08-01 21:58:17</nova:creationTime>
Aug 01 21:58:18 user nova-compute[72586]:       <nova:flavor name="m1.tiny">
Aug 01 21:58:18 user nova-compute[72586]:         <nova:memory>512</nova:memory>
Aug 01 21:58:18 user nova-compute[72586]:         <nova:disk>1</nova:disk>
Aug 01 21:58:18 user nova-compute[72586]:         <nova:swap>0</nova:swap>
Aug 01 21:58:18 user nova-compute[72586]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 21:58:18 user nova-compute[72586]:         <nova:vcpus>1</nova:vcpus>
Aug 01 21:58:18 user nova-compute[72586]:       </nova:flavor>
Aug 01 21:58:18 user nova-compute[72586]:       <nova:owner>
Aug 01 21:58:18 user nova-compute[72586]:         <nova:user uuid="37663bab7d31400c8399451058bd5936">tempest-AttachVolumeNegativeTest-717043369-project-member</nova:user>
Aug 01 21:58:18 user nova-compute[72586]:         <nova:project uuid="063dd272226340d49a7ac0756413cadf">tempest-AttachVolumeNegativeTest-717043369</nova:project>
Aug 01 21:58:18 user nova-compute[72586]:       </nova:owner>
Aug 01 21:58:18 user nova-compute[72586]:       <nova:root type="image" uuid="0243d46b-6819-42a5-926f-42b71f0c97ad"/>
Aug 01 21:58:18 user nova-compute[72586]:       <nova:ports>
Aug 01 21:58:18 user nova-compute[72586]:         <nova:port uuid="434011b9-6e2f-418c-b001-c73eae1ffdda">
Aug 01 21:58:18 user nova-compute[72586]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 01 21:58:18 user nova-compute[72586]:         </nova:port>
Aug 01 21:58:18 user nova-compute[72586]:       </nova:ports>
Aug 01 21:58:18 user nova-compute[72586]:     </nova:instance>
Aug 01 21:58:18 user nova-compute[72586]:   </metadata>
Aug 01 21:58:18 user nova-compute[72586]:   <sysinfo type="smbios">
Aug 01 21:58:18 user nova-compute[72586]:     <system>
Aug 01 21:58:18 user nova-compute[72586]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 21:58:18 user nova-compute[72586]:       <entry name="product">OpenStack Nova</entry>
Aug 01 21:58:18 user nova-compute[72586]:       <entry name="version">0.0.0</entry>
Aug 01 21:58:18 user nova-compute[72586]:       <entry name="serial">77b7d14e-bc78-49c8-b91b-db6343ca62a4</entry>
Aug 01 21:58:18 user nova-compute[72586]:       <entry name="uuid">77b7d14e-bc78-49c8-b91b-db6343ca62a4</entry>
Aug 01 21:58:18 user nova-compute[72586]:       <entry name="family">Virtual Machine</entry>
Aug 01 21:58:18 user nova-compute[72586]:     </system>
Aug 01 21:58:18 user nova-compute[72586]:   </sysinfo>
Aug 01 21:58:18 user nova-compute[72586]:   <os>
Aug 01 21:58:18 user nova-compute[72586]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 21:58:18 user nova-compute[72586]:     <boot dev="hd"/>
Aug 01 21:58:18 user nova-compute[72586]:     <smbios mode="sysinfo"/>
Aug 01 21:58:18 user nova-compute[72586]:   </os>
Aug 01 21:58:18 user nova-compute[72586]:   <features>
Aug 01 21:58:18 user nova-compute[72586]:     <acpi/>
Aug 01 21:58:18 user nova-compute[72586]:     <apic/>
Aug 01 21:58:18 user nova-compute[72586]:     <vmcoreinfo/>
Aug 01 21:58:18 user nova-compute[72586]:   </features>
Aug 01 21:58:18 user nova-compute[72586]:   <clock offset="utc">
Aug 01 21:58:18 user nova-compute[72586]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 21:58:18 user nova-compute[72586]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 21:58:18 user nova-compute[72586]:     <timer name="hpet" present="no"/>
Aug 01 21:58:18 user nova-compute[72586]:   </clock>
Aug 01 21:58:18 user nova-compute[72586]:   <cpu mode="custom" match="exact">
Aug 01 21:58:18 user nova-compute[72586]:     <model>Nehalem</model>
Aug 01 21:58:18 user nova-compute[72586]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 21:58:18 user nova-compute[72586]:   </cpu>
Aug 01 21:58:18 user nova-compute[72586]:   <devices>
Aug 01 21:58:18 user nova-compute[72586]:     <disk type="file" device="disk">
Aug 01 21:58:18 user nova-compute[72586]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 21:58:18 user nova-compute[72586]:       <source file="/opt/stack/data/nova/instances/77b7d14e-bc78-49c8-b91b-db6343ca62a4/disk"/>
Aug 01 21:58:18 user nova-compute[72586]:       <target dev="vda" bus="virtio"/>
Aug 01 21:58:18 user nova-compute[72586]:     </disk>
Aug 01 21:58:18 user nova-compute[72586]:     <interface type="ethernet">
Aug 01 21:58:18 user nova-compute[72586]:       <mac address="fa:16:3e:ef:87:ec"/>
Aug 01 21:58:18 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:58:18 user nova-compute[72586]:       <mtu size="1442"/>
Aug 01 21:58:18 user nova-compute[72586]:       <target dev="tap434011b9-6e"/>
Aug 01 21:58:18 user nova-compute[72586]:     </interface>
Aug 01 21:58:18 user nova-compute[72586]:     <serial type="pty">
Aug 01 21:58:18 user nova-compute[72586]:       <log file="/opt/stack/data/nova/instances/77b7d14e-bc78-49c8-b91b-db6343ca62a4/console.log" append="off"/>
Aug 01 21:58:18 user nova-compute[72586]:     </serial>
Aug 01 21:58:18 user nova-compute[72586]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 21:58:18 user nova-compute[72586]:     <video>
Aug 01 21:58:18 user nova-compute[72586]:       <model type="virtio"/>
Aug 01 21:58:18 user nova-compute[72586]:     </video>
Aug 01 21:58:18 user nova-compute[72586]:     <rng model="virtio">
Aug 01 21:58:18 user nova-compute[72586]:       <backend model="random">/dev/urandom</backend>
Aug 01 21:58:18 user nova-compute[72586]:     </rng>
Aug 01 21:58:18 user nova-compute[72586]:     <controller type="usb" index="0" model="none"/>
Aug 01 21:58:18 user nova-compute[72586]:     <memballoon model="virtio">
Aug 01 21:58:18 user nova-compute[72586]:       <stats period="10"/>
Aug 01 21:58:18 user nova-compute[72586]:     </memballoon>
Aug 01 21:58:18 user nova-compute[72586]:   </devices>
Aug 01 21:58:18 user nova-compute[72586]: </domain>
Aug 01 21:58:18 user nova-compute[72586]:  {{(pid=72586) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 21:58:18 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:58:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1395970357',display_name='tempest-AttachVolumeNegativeTest-server-1395970357',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1395970357',id=51,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgOf2HFzydXwO4CWjvuCy1ogrmplikTDNhFsVj/Dz6u9C/ySg9Tlx8guXs378AhT3bzRHx/dM2rrno5QMiGhIz1EzQPsdXDPxozb//9SK8vj3BNlgLiSjxKPyYKofCsLQ==',key_name='tempest-keypair-1099260883',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='063dd272226340d49a7ac0756413cadf',ramdisk_id='',reservation_id='r-yyot4mat',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-717043369',owner_user_name='tempest-AttachVolumeNegativeTest-717043369-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T21:58:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37663bab7d31400c8399451058bd5936',uuid=77b7d14e-bc78-49c8-b91b-db6343ca62a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "434011b9-6e2f-418c-b001-c73eae1ffdda", "address": "fa:16:3e:ef:87:ec", "network": {"id": "52ee6623-01e5-491e-ab5e-d1d0511bd15f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-765176125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063dd272226340d49a7ac0756413cadf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434011b9-6e", "ovs_interfaceid": "434011b9-6e2f-418c-b001-c73eae1ffdda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 21:58:18 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Converting VIF {"id": "434011b9-6e2f-418c-b001-c73eae1ffdda", "address": "fa:16:3e:ef:87:ec", "network": {"id": "52ee6623-01e5-491e-ab5e-d1d0511bd15f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-765176125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063dd272226340d49a7ac0756413cadf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434011b9-6e", "ovs_interfaceid": "434011b9-6e2f-418c-b001-c73eae1ffdda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:58:18 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:87:ec,bridge_name='br-int',has_traffic_filtering=True,id=434011b9-6e2f-418c-b001-c73eae1ffdda,network=Network(52ee6623-01e5-491e-ab5e-d1d0511bd15f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap434011b9-6e') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:58:18 user nova-compute[72586]: DEBUG os_vif [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:87:ec,bridge_name='br-int',has_traffic_filtering=True,id=434011b9-6e2f-418c-b001-c73eae1ffdda,network=Network(52ee6623-01e5-491e-ab5e-d1d0511bd15f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap434011b9-6e') {{(pid=72586) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 21:58:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:58:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:58:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 21:58:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:58:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap434011b9-6e, may_exist=True, interface_attrs={}) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:58:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap434011b9-6e, col_values=(('external_ids', {'iface-id': '434011b9-6e2f-418c-b001-c73eae1ffdda', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:87:ec', 'vm-uuid': '77b7d14e-bc78-49c8-b91b-db6343ca62a4'}),), if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:58:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:58:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:58:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:58:18 user nova-compute[72586]: INFO os_vif [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:87:ec,bridge_name='br-int',has_traffic_filtering=True,id=434011b9-6e2f-418c-b001-c73eae1ffdda,network=Network(52ee6623-01e5-491e-ab5e-d1d0511bd15f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap434011b9-6e')
Aug 01 21:58:18 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:58:18 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] No VIF found with MAC fa:16:3e:ef:87:ec, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:58:18 user nova-compute[72586]: DEBUG nova.network.neutron [req-8bae330e-5650-46f9-9aea-9a5d7beb78ea req-d8af6dde-1b18-4500-b862-b19a633a5189 service nova] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Updated VIF entry in instance network info cache for port 434011b9-6e2f-418c-b001-c73eae1ffdda. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:58:18 user nova-compute[72586]: DEBUG nova.network.neutron [req-8bae330e-5650-46f9-9aea-9a5d7beb78ea req-d8af6dde-1b18-4500-b862-b19a633a5189 service nova] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Updating instance_info_cache with network_info: [{"id": "434011b9-6e2f-418c-b001-c73eae1ffdda", "address": "fa:16:3e:ef:87:ec", "network": {"id": "52ee6623-01e5-491e-ab5e-d1d0511bd15f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-765176125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063dd272226340d49a7ac0756413cadf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434011b9-6e", "ovs_interfaceid": "434011b9-6e2f-418c-b001-c73eae1ffdda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:58:18 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-8bae330e-5650-46f9-9aea-9a5d7beb78ea req-d8af6dde-1b18-4500-b862-b19a633a5189 service nova] Releasing lock "refresh_cache-77b7d14e-bc78-49c8-b91b-db6343ca62a4" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:58:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:58:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:58:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:58:19 user nova-compute[72586]: DEBUG nova.compute.manager [req-539ee72a-eea1-4538-b984-150f14df2d60 req-5c7543b2-9e53-425d-90e6-325ad72acc50 service nova] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Received event network-vif-plugged-434011b9-6e2f-418c-b001-c73eae1ffdda {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:58:19 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-539ee72a-eea1-4538-b984-150f14df2d60 req-5c7543b2-9e53-425d-90e6-325ad72acc50 service nova] Acquiring lock "77b7d14e-bc78-49c8-b91b-db6343ca62a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:58:19 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-539ee72a-eea1-4538-b984-150f14df2d60 req-5c7543b2-9e53-425d-90e6-325ad72acc50 service nova] Lock "77b7d14e-bc78-49c8-b91b-db6343ca62a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:58:19 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-539ee72a-eea1-4538-b984-150f14df2d60 req-5c7543b2-9e53-425d-90e6-325ad72acc50 service nova] Lock "77b7d14e-bc78-49c8-b91b-db6343ca62a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:58:19 user nova-compute[72586]: DEBUG nova.compute.manager [req-539ee72a-eea1-4538-b984-150f14df2d60 req-5c7543b2-9e53-425d-90e6-325ad72acc50 service nova] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] No waiting events found dispatching network-vif-plugged-434011b9-6e2f-418c-b001-c73eae1ffdda {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:58:19 user nova-compute[72586]: WARNING nova.compute.manager [req-539ee72a-eea1-4538-b984-150f14df2d60 req-5c7543b2-9e53-425d-90e6-325ad72acc50 service nova] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Received unexpected event network-vif-plugged-434011b9-6e2f-418c-b001-c73eae1ffdda for instance with vm_state building and task_state spawning.
Aug 01 21:58:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:58:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:58:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:58:20 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:58:21 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690927101.459781, 77b7d14e-bc78-49c8-b91b-db6343ca62a4 => Resumed> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:58:21 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] VM Resumed (Lifecycle Event)
Aug 01 21:58:21 user nova-compute[72586]: DEBUG nova.compute.manager [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Instance event wait completed in 0 seconds for  {{(pid=72586) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 21:58:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Guest created on hypervisor {{(pid=72586) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 21:58:21 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Instance spawned successfully.
Aug 01 21:58:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 21:58:21 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:58:21 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:58:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Found default for hw_cdrom_bus of ide {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:58:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Found default for hw_disk_bus of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:58:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Found default for hw_input_bus of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:58:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Found default for hw_pointer_model of None {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:58:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Found default for hw_video_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:58:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Found default for hw_vif_model of virtio {{(pid=72586) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 21:58:21 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:58:21 user nova-compute[72586]: DEBUG nova.virt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Emitting event <LifecycleEvent: 1690927101.4611156, 77b7d14e-bc78-49c8-b91b-db6343ca62a4 => Started> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:58:21 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] VM Started (Lifecycle Event)
Aug 01 21:58:21 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:58:21 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72586) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 21:58:21 user nova-compute[72586]: INFO nova.compute.manager [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 21:58:21 user nova-compute[72586]: INFO nova.compute.manager [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Took 5.49 seconds to spawn the instance on the hypervisor.
Aug 01 21:58:21 user nova-compute[72586]: DEBUG nova.compute.manager [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:58:21 user nova-compute[72586]: DEBUG nova.compute.manager [req-7bb23df7-0b15-4471-a5ce-0561e7de1671 req-57bc99fe-340c-4c4f-bae3-ea37d50f21ca service nova] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Received event network-vif-plugged-434011b9-6e2f-418c-b001-c73eae1ffdda {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:58:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-7bb23df7-0b15-4471-a5ce-0561e7de1671 req-57bc99fe-340c-4c4f-bae3-ea37d50f21ca service nova] Acquiring lock "77b7d14e-bc78-49c8-b91b-db6343ca62a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:58:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-7bb23df7-0b15-4471-a5ce-0561e7de1671 req-57bc99fe-340c-4c4f-bae3-ea37d50f21ca service nova] Lock "77b7d14e-bc78-49c8-b91b-db6343ca62a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:58:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-7bb23df7-0b15-4471-a5ce-0561e7de1671 req-57bc99fe-340c-4c4f-bae3-ea37d50f21ca service nova] Lock "77b7d14e-bc78-49c8-b91b-db6343ca62a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:58:21 user nova-compute[72586]: DEBUG nova.compute.manager [req-7bb23df7-0b15-4471-a5ce-0561e7de1671 req-57bc99fe-340c-4c4f-bae3-ea37d50f21ca service nova] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] No waiting events found dispatching network-vif-plugged-434011b9-6e2f-418c-b001-c73eae1ffdda {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:58:21 user nova-compute[72586]: WARNING nova.compute.manager [req-7bb23df7-0b15-4471-a5ce-0561e7de1671 req-57bc99fe-340c-4c4f-bae3-ea37d50f21ca service nova] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Received unexpected event network-vif-plugged-434011b9-6e2f-418c-b001-c73eae1ffdda for instance with vm_state building and task_state spawning.
Aug 01 21:58:21 user nova-compute[72586]: INFO nova.compute.manager [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Took 6.07 seconds to build instance.
Aug 01 21:58:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-ab47c536-29f4-4641-afc1-33dbf44d5b62 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "77b7d14e-bc78-49c8-b91b-db6343ca62a4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.169s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:58:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:58:25 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:58:28 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:58:33 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:58:35 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:58:36 user nova-compute[72586]: DEBUG nova.compute.manager [req-73ddce5a-2108-444f-bed9-1ee7d4235a03 req-8323de44-1708-4667-91b6-e3707a305f4a service nova] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Received event network-changed-107ffd50-bf35-42c4-a394-131bf57b4157 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:58:36 user nova-compute[72586]: DEBUG nova.compute.manager [req-73ddce5a-2108-444f-bed9-1ee7d4235a03 req-8323de44-1708-4667-91b6-e3707a305f4a service nova] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Refreshing instance network info cache due to event network-changed-107ffd50-bf35-42c4-a394-131bf57b4157. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:58:36 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-73ddce5a-2108-444f-bed9-1ee7d4235a03 req-8323de44-1708-4667-91b6-e3707a305f4a service nova] Acquiring lock "refresh_cache-4e5f6dc7-cd0b-4cb9-b5b3-49907903499f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:58:36 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-73ddce5a-2108-444f-bed9-1ee7d4235a03 req-8323de44-1708-4667-91b6-e3707a305f4a service nova] Acquired lock "refresh_cache-4e5f6dc7-cd0b-4cb9-b5b3-49907903499f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:58:36 user nova-compute[72586]: DEBUG nova.network.neutron [req-73ddce5a-2108-444f-bed9-1ee7d4235a03 req-8323de44-1708-4667-91b6-e3707a305f4a service nova] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Refreshing network info cache for port 107ffd50-bf35-42c4-a394-131bf57b4157 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:58:36 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-59de1d71-7f77-430f-8f92-0ddd2f26d1b3 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Acquiring lock "4e5f6dc7-cd0b-4cb9-b5b3-49907903499f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:58:36 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-59de1d71-7f77-430f-8f92-0ddd2f26d1b3 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lock "4e5f6dc7-cd0b-4cb9-b5b3-49907903499f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:58:36 user nova-compute[72586]: DEBUG nova.objects.instance [None req-59de1d71-7f77-430f-8f92-0ddd2f26d1b3 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lazy-loading 'flavor' on Instance uuid 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:58:36 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-59de1d71-7f77-430f-8f92-0ddd2f26d1b3 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lock "4e5f6dc7-cd0b-4cb9-b5b3-49907903499f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:58:36 user nova-compute[72586]: DEBUG nova.network.neutron [req-73ddce5a-2108-444f-bed9-1ee7d4235a03 req-8323de44-1708-4667-91b6-e3707a305f4a service nova] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Updated VIF entry in instance network info cache for port 107ffd50-bf35-42c4-a394-131bf57b4157. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:58:36 user nova-compute[72586]: DEBUG nova.network.neutron [req-73ddce5a-2108-444f-bed9-1ee7d4235a03 req-8323de44-1708-4667-91b6-e3707a305f4a service nova] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Updating instance_info_cache with network_info: [{"id": "107ffd50-bf35-42c4-a394-131bf57b4157", "address": "fa:16:3e:ff:ef:8d", "network": {"id": "6b6d5e8a-1c0a-4d1b-93d1-4de7246e39fb", "bridge": "br-int", "label": "tempest-TestStampPattern-2085707213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6745cf6719124010a510bd54fd5b9259", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap107ffd50-bf", "ovs_interfaceid": "107ffd50-bf35-42c4-a394-131bf57b4157", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:58:36 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-73ddce5a-2108-444f-bed9-1ee7d4235a03 req-8323de44-1708-4667-91b6-e3707a305f4a service nova] Releasing lock "refresh_cache-4e5f6dc7-cd0b-4cb9-b5b3-49907903499f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:58:36 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-59de1d71-7f77-430f-8f92-0ddd2f26d1b3 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Acquiring lock "4e5f6dc7-cd0b-4cb9-b5b3-49907903499f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:58:36 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-59de1d71-7f77-430f-8f92-0ddd2f26d1b3 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lock "4e5f6dc7-cd0b-4cb9-b5b3-49907903499f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:58:36 user nova-compute[72586]: INFO nova.compute.manager [None req-59de1d71-7f77-430f-8f92-0ddd2f26d1b3 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Attaching volume a1663b8e-fe44-45c4-81ea-216721fb9fe8 to /dev/vdb
Aug 01 21:58:36 user nova-compute[72586]: DEBUG os_brick.utils [None req-59de1d71-7f77-430f-8f92-0ddd2f26d1b3 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:58:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:58:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:58:36 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5380d42-5813-4a4c-a9d8-7aacb1279679]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4bc202fb9cb\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:58:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:58:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:58:36 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb2ad15-0361-4262-b523-74acef188f06]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:58:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:58:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:58:36 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[4450fcf1-e42d-4d12-bb7f-62d70c09f44f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:58:36 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fcf2c64-f695-46b1-8f2a-e9ae1349babc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:58:36 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-59de1d71-7f77-430f-8f92-0ddd2f26d1b3 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Running cmd (subprocess): nvme version {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:58:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-59de1d71-7f77-430f-8f92-0ddd2f26d1b3 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] 'nvme version' failed. Not Retrying. {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:58:37 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.nvmeof [None req-59de1d71-7f77-430f-8f92-0ddd2f26d1b3 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] nvme not present on system {{(pid=72586) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 21:58:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:58:37 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 21:58:37 user nova-compute[72586]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 21:58:37 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c2b15d-7c87-413d-b972-5f7527f4ee9d]: (4, '') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:58:37 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-59de1d71-7f77-430f-8f92-0ddd2f26d1b3 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72586) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 21:58:37 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-59de1d71-7f77-430f-8f92-0ddd2f26d1b3 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 21:58:37 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-59de1d71-7f77-430f-8f92-0ddd2f26d1b3 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] LIGHTOS: no hostnqn found. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 21:58:37 user nova-compute[72586]: DEBUG os_brick.utils [None req-59de1d71-7f77-430f-8f92-0ddd2f26d1b3 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4bc202fb9cb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:58:37 user nova-compute[72586]: DEBUG nova.virt.block_device [None req-59de1d71-7f77-430f-8f92-0ddd2f26d1b3 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Updating existing volume attachment record: dee4748b-f513-4af6-a102-434041cfa92c {{(pid=72586) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 21:58:38 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:58:40 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:58:43 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:58:44 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59de1d71-7f77-430f-8f92-0ddd2f26d1b3 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Calling os-brick to attach iSCSI Volume {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 21:58:44 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-59de1d71-7f77-430f-8f92-0ddd2f26d1b3 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a1663b8e-fe44-45c4-81ea-216721fb9fe8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kYpSienE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:58:44 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-59de1d71-7f77-430f-8f92-0ddd2f26d1b3 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:58:44 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-59de1d71-7f77-430f-8f92-0ddd2f26d1b3 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:58:44 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-59de1d71-7f77-430f-8f92-0ddd2f26d1b3 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:58:44 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-59de1d71-7f77-430f-8f92-0ddd2f26d1b3 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:58:44 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-59de1d71-7f77-430f-8f92-0ddd2f26d1b3 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1663b8e-fe44-45c4-81ea-216721fb9fe8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:58:44 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-59de1d71-7f77-430f-8f92-0ddd2f26d1b3 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1663b8e-fe44-45c4-81ea-216721fb9fe8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:58:44 user nova-compute[72586]: INFO os_brick.initiator.connectors.iscsi [None req-59de1d71-7f77-430f-8f92-0ddd2f26d1b3 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 21:58:44 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1663b8e-fe44-45c4-81ea-216721fb9fe8 -p 172.16.0.220:3260 {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:58:44 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1663b8e-fe44-45c4-81ea-216721fb9fe8 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:58:44 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[2491a9c1-8f6f-47f8-b123-98663782596e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:58:44 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-59de1d71-7f77-430f-8f92-0ddd2f26d1b3 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 21:58:44 user nova-compute[72586]:  {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:58:44 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1663b8e-fe44-45c4-81ea-216721fb9fe8 -p 172.16.0.220:3260 --interface default --op new {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:58:44 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1663b8e-fe44-45c4-81ea-216721fb9fe8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:58:44 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[8977f7f6-bde6-449e-bbce-7cef85934511]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1663b8e-fe44-45c4-81ea-216721fb9fe8] added\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:58:44 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-59de1d71-7f77-430f-8f92-0ddd2f26d1b3 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1663b8e-fe44-45c4-81ea-216721fb9fe8] added
Aug 01 21:58:44 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:58:44 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1663b8e-fe44-45c4-81ea-216721fb9fe8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:58:44 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1663b8e-fe44-45c4-81ea-216721fb9fe8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:58:44 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4b0b4c-3c74-4228-ae27-a825193465fc]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:58:44 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-59de1d71-7f77-430f-8f92-0ddd2f26d1b3 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:58:44 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1663b8e-fe44-45c4-81ea-216721fb9fe8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:58:44 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1663b8e-fe44-45c4-81ea-216721fb9fe8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:58:44 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b902fc-700e-4394-b311-492b582fda85]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:58:44 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-59de1d71-7f77-430f-8f92-0ddd2f26d1b3 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:58:44 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1663b8e-fe44-45c4-81ea-216721fb9fe8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kYpSienE {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:58:44 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1663b8e-fe44-45c4-81ea-216721fb9fe8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kYpSienE" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:58:44 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb490446-d279-4357-9a3b-b09aee854d62]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:58:44 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-59de1d71-7f77-430f-8f92-0ddd2f26d1b3 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kYpSienE'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:58:44 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1663b8e-fe44-45c4-81ea-216721fb9fe8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:58:44 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1663b8e-fe44-45c4-81ea-216721fb9fe8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:58:44 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[4559eac3-fecf-4120-841a-5014ed08f4fc]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:58:44 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-59de1d71-7f77-430f-8f92-0ddd2f26d1b3 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:58:44 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:58:44 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:58:44 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6c0337-4c75-4c7a-93a1-530e0d726639]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:58:44 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-59de1d71-7f77-430f-8f92-0ddd2f26d1b3 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 21:58:44 user nova-compute[72586]:  {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:58:44 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-59de1d71-7f77-430f-8f92-0ddd2f26d1b3 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 21:58:44 user nova-compute[72586]:  {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:58:44 user nova-compute[72586]: WARNING os_brick.initiator.connectors.iscsi [None req-59de1d71-7f77-430f-8f92-0ddd2f26d1b3 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 21:58:44 user nova-compute[72586]: 
Aug 01 21:58:44 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1663b8e-fe44-45c4-81ea-216721fb9fe8 -p 172.16.0.220:3260 --login {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:58:44 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1663b8e-fe44-45c4-81ea-216721fb9fe8 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:58:44 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc32cca-cbe6-425b-ae50-566658394ca5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1663b8e-fe44-45c4-81ea-216721fb9fe8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a1663b8e-fe44-45c4-81ea-216721fb9fe8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:58:44 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-59de1d71-7f77-430f-8f92-0ddd2f26d1b3 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1663b8e-fe44-45c4-81ea-216721fb9fe8, portal: 172.16.0.220,3260]
Aug 01 21:58:44 user nova-compute[72586]: Login to [iface: default, target: iqn.2010-10.org.openstack:a1663b8e-fe44-45c4-81ea-216721fb9fe8, portal: 172.16.0.220,3260] successful.
Aug 01 21:58:44 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:58:44 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1663b8e-fe44-45c4-81ea-216721fb9fe8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:58:44 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1663b8e-fe44-45c4-81ea-216721fb9fe8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:58:44 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[13dc55f6-59ce-4972-b88e-8062ce981583]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:58:44 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-59de1d71-7f77-430f-8f92-0ddd2f26d1b3 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:58:44 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:58:44 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:58:44 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ee777c-68bf-480c-b38e-a9afbf64b474]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1663b8e-fe44-45c4-81ea-216721fb9fe8 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:58:44 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-59de1d71-7f77-430f-8f92-0ddd2f26d1b3 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1663b8e-fe44-45c4-81ea-216721fb9fe8 (non-flash)
Aug 01 21:58:44 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:58:44 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-59de1d71-7f77-430f-8f92-0ddd2f26d1b3 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1663b8e-fe44-45c4-81ea-216721fb9fe8 (non-flash)
Aug 01 21:58:44 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:58:44 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-59de1d71-7f77-430f-8f92-0ddd2f26d1b3 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1663b8e-fe44-45c4-81ea-216721fb9fe8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:58:44 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-59de1d71-7f77-430f-8f92-0ddd2f26d1b3 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Connected to 172.16.0.220:3260 {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 21:58:44 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-59de1d71-7f77-430f-8f92-0ddd2f26d1b3 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=72586) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 21:58:44 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-59de1d71-7f77-430f-8f92-0ddd2f26d1b3 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72586) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 21:58:44 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:58:44 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:58:44 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6bfd95c-3a36-492e-8dd5-fbde49f07c9a]: (4, ('- - 0', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:58:44 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-59de1d71-7f77-430f-8f92-0ddd2f26d1b3 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 21:58:44 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-59de1d71-7f77-430f-8f92-0ddd2f26d1b3 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kYpSienE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 21:58:45 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:58:45 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-59de1d71-7f77-430f-8f92-0ddd2f26d1b3 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:58:45 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-59de1d71-7f77-430f-8f92-0ddd2f26d1b3 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23531653436333362', 'path': '/dev/sdb'} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:58:45 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59de1d71-7f77-430f-8f92-0ddd2f26d1b3 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23531653436333362', 'path': '/dev/sdb'} {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 21:58:45 user nova-compute[72586]: DEBUG nova.objects.instance [None req-59de1d71-7f77-430f-8f92-0ddd2f26d1b3 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lazy-loading 'flavor' on Instance uuid 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:58:45 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-59de1d71-7f77-430f-8f92-0ddd2f26d1b3 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 21:58:45 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:58:45 user nova-compute[72586]:   <source dev="/dev/sdb"/>
Aug 01 21:58:45 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:58:45 user nova-compute[72586]:   <serial>a1663b8e-fe44-45c4-81ea-216721fb9fe8</serial>
Aug 01 21:58:45 user nova-compute[72586]: </disk>
Aug 01 21:58:45 user nova-compute[72586]:  {{(pid=72586) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 21:58:45 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-59de1d71-7f77-430f-8f92-0ddd2f26d1b3 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:58:45 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-59de1d71-7f77-430f-8f92-0ddd2f26d1b3 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 21:58:45 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-59de1d71-7f77-430f-8f92-0ddd2f26d1b3 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] No VIF found with MAC fa:16:3e:ff:ef:8d, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 21:58:45 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-59de1d71-7f77-430f-8f92-0ddd2f26d1b3 tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lock "4e5f6dc7-cd0b-4cb9-b5b3-49907903499f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.110s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:58:47 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b5be4be9-d916-4b4e-b246-8b366c6d8e3c tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Acquiring lock "4e5f6dc7-cd0b-4cb9-b5b3-49907903499f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:58:47 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b5be4be9-d916-4b4e-b246-8b366c6d8e3c tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lock "4e5f6dc7-cd0b-4cb9-b5b3-49907903499f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:58:47 user nova-compute[72586]: INFO nova.compute.manager [None req-b5be4be9-d916-4b4e-b246-8b366c6d8e3c tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Detaching volume a1663b8e-fe44-45c4-81ea-216721fb9fe8
Aug 01 21:58:47 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:58:47 user nova-compute[72586]: INFO nova.virt.block_device [None req-b5be4be9-d916-4b4e-b246-8b366c6d8e3c tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Attempting to driver detach volume a1663b8e-fe44-45c4-81ea-216721fb9fe8 from mountpoint /dev/vdb
Aug 01 21:58:47 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-b5be4be9-d916-4b4e-b246-8b366c6d8e3c tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Attempting to detach device vdb from instance 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f from the persistent domain config. {{(pid=72586) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 21:58:47 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-b5be4be9-d916-4b4e-b246-8b366c6d8e3c tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 21:58:47 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:58:47 user nova-compute[72586]:   <source dev="/dev/sdb"/>
Aug 01 21:58:47 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:58:47 user nova-compute[72586]:   <serial>a1663b8e-fe44-45c4-81ea-216721fb9fe8</serial>
Aug 01 21:58:47 user nova-compute[72586]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 21:58:47 user nova-compute[72586]: </disk>
Aug 01 21:58:47 user nova-compute[72586]:  {{(pid=72586) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 21:58:47 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-b5be4be9-d916-4b4e-b246-8b366c6d8e3c tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Successfully detached device vdb from instance 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f from the persistent domain config.
Aug 01 21:58:47 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-b5be4be9-d916-4b4e-b246-8b366c6d8e3c tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f from the live domain config. {{(pid=72586) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 21:58:47 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-b5be4be9-d916-4b4e-b246-8b366c6d8e3c tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 21:58:47 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 21:58:47 user nova-compute[72586]:   <source dev="/dev/sdb"/>
Aug 01 21:58:47 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 21:58:47 user nova-compute[72586]:   <serial>a1663b8e-fe44-45c4-81ea-216721fb9fe8</serial>
Aug 01 21:58:47 user nova-compute[72586]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 21:58:47 user nova-compute[72586]: </disk>
Aug 01 21:58:47 user nova-compute[72586]:  {{(pid=72586) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 21:58:48 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:58:48 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Received event <DeviceRemovedEvent: 1690927128.4167626, 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72586) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 21:58:48 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-b5be4be9-d916-4b4e-b246-8b366c6d8e3c tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f {{(pid=72586) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 21:58:48 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-b5be4be9-d916-4b4e-b246-8b366c6d8e3c tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Successfully detached device vdb from instance 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f from the live domain config.
Aug 01 21:58:48 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5be4be9-d916-4b4e-b246-8b366c6d8e3c tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] calling os-brick to detach iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 21:58:48 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5be4be9-d916-4b4e-b246-8b366c6d8e3c tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, {'target_iqns': ['iqn.2010-10.org.openstack:a1663b8e-fe44-45c4-81ea-216721fb9fe8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kYpSienE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 21:58:48 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-b5be4be9-d916-4b4e-b246-8b366c6d8e3c tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 21:58:48 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-b5be4be9-d916-4b4e-b246-8b366c6d8e3c tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 21:58:48 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-b5be4be9-d916-4b4e-b246-8b366c6d8e3c tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 21:58:48 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5be4be9-d916-4b4e-b246-8b366c6d8e3c tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1663b8e-fe44-45c4-81ea-216721fb9fe8', 0)] {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 21:58:48 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:58:48 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:58:48 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[839060ab-e9e7-43eb-a07a-3eb39dcb3d78]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1663b8e-fe44-45c4-81ea-216721fb9fe8\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:58:48 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:58:48 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:58:48 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[3517b69e-175f-4f3b-912b-42ccd03973b7]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1663b8e-fe44-45c4-81ea-216721fb9fe8 (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:58:48 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5be4be9-d916-4b4e-b246-8b366c6d8e3c tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1663b8e-fe44-45c4-81ea-216721fb9fe8 (non-flash)
Aug 01 21:58:48 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 21:58:48 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5be4be9-d916-4b4e-b246-8b366c6d8e3c tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1663b8e-fe44-45c4-81ea-216721fb9fe8 (non-flash)
Aug 01 21:58:48 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 21:58:48 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5be4be9-d916-4b4e-b246-8b366c6d8e3c tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ed065d750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1663b8e-fe44-45c4-81ea-216721fb9fe8'): ({'sdb'}, set())}) {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 21:58:48 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-b5be4be9-d916-4b4e-b246-8b366c6d8e3c tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Removing single pathed devices sdb {{(pid=72586) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 21:58:48 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:58:48 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:58:48 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09d9e05-dd09-4df8-ae6c-102a0d9806d3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:58:48 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:58:48 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:58:48 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec6077e-f2ec-4cd5-9966-7bd67c587827]: (4, ('ok\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:58:48 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-b5be4be9-d916-4b4e-b246-8b366c6d8e3c tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Flushing IO for device /dev/sdb {{(pid=72586) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 21:58:48 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:58:48 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:58:48 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3bebe38-3470-4406-a38c-642ba2f3eb3c]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:58:48 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-b5be4be9-d916-4b4e-b246-8b366c6d8e3c tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72586) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 21:58:48 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:58:48 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:58:48 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b98ff3-de5b-4e62-b575-254a6e5f3d57]: (4, ('1', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:58:48 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-b5be4be9-d916-4b4e-b246-8b366c6d8e3c tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 21:58:48 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-b5be4be9-d916-4b4e-b246-8b366c6d8e3c tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] SCSI volumes sdb have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 21:58:48 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5be4be9-d916-4b4e-b246-8b366c6d8e3c tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1663b8e-fe44-45c4-81ea-216721fb9fe8')] {{(pid=72586) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 21:58:48 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1663b8e-fe44-45c4-81ea-216721fb9fe8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:58:48 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1663b8e-fe44-45c4-81ea-216721fb9fe8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:58:48 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb0bc9dd-ee51-4aef-9e6e-14f3f4d51728]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:58:48 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5be4be9-d916-4b4e-b246-8b366c6d8e3c tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:58:48 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1663b8e-fe44-45c4-81ea-216721fb9fe8 -p 172.16.0.220:3260 --logout {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:58:48 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1663b8e-fe44-45c4-81ea-216721fb9fe8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:58:48 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c42682b-aea1-4a4a-b7a1-43b6bdc95874]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:a1663b8e-fe44-45c4-81ea-216721fb9fe8, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:a1663b8e-fe44-45c4-81ea-216721fb9fe8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:58:48 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5be4be9-d916-4b4e-b246-8b366c6d8e3c tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:a1663b8e-fe44-45c4-81ea-216721fb9fe8, portal: 172.16.0.220,3260]
Aug 01 21:58:48 user nova-compute[72586]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:a1663b8e-fe44-45c4-81ea-216721fb9fe8, portal: 172.16.0.220,3260] successful.
Aug 01 21:58:48 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:58:48 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1663b8e-fe44-45c4-81ea-216721fb9fe8 -p 172.16.0.220:3260 --op delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:58:48 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1663b8e-fe44-45c4-81ea-216721fb9fe8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:58:48 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[143f104d-143c-44e0-ae20-18fedcc185ee]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 21:58:48 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5be4be9-d916-4b4e-b246-8b366c6d8e3c tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 21:58:48 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-b5be4be9-d916-4b4e-b246-8b366c6d8e3c tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.259s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 21:58:48 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5be4be9-d916-4b4e-b246-8b366c6d8e3c tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] <== disconnect_volume: return (260ms) None {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 21:58:48 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5be4be9-d916-4b4e-b246-8b366c6d8e3c tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Disconnected iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 21:58:48 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:58:49 user nova-compute[72586]: DEBUG nova.objects.instance [None req-b5be4be9-d916-4b4e-b246-8b366c6d8e3c tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lazy-loading 'flavor' on Instance uuid 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:58:49 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-b5be4be9-d916-4b4e-b246-8b366c6d8e3c tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lock "4e5f6dc7-cd0b-4cb9-b5b3-49907903499f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.592s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:58:49 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:58:49 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:58:49 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:58:49 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72586) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 21:58:50 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:58:53 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:58:54 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:58:54 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:58:54 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:58:54 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:58:54 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Auditing locally available compute resources for user (node: user) {{(pid=72586) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 21:58:55 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec73ec4b-4591-46f2-9192-7868125c53c5/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:58:55 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec73ec4b-4591-46f2-9192-7868125c53c5/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:58:55 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec73ec4b-4591-46f2-9192-7868125c53c5/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:58:55 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec73ec4b-4591-46f2-9192-7868125c53c5/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:58:55 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e5f6dc7-cd0b-4cb9-b5b3-49907903499f/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:58:55 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:58:55 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e5f6dc7-cd0b-4cb9-b5b3-49907903499f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:58:55 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e5f6dc7-cd0b-4cb9-b5b3-49907903499f/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:58:55 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e5f6dc7-cd0b-4cb9-b5b3-49907903499f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:58:55 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77b7d14e-bc78-49c8-b91b-db6343ca62a4/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:58:55 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77b7d14e-bc78-49c8-b91b-db6343ca62a4/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:58:55 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77b7d14e-bc78-49c8-b91b-db6343ca62a4/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:58:55 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77b7d14e-bc78-49c8-b91b-db6343ca62a4/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:58:56 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:58:56 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:58:56 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Hypervisor/Node resource view: name=user free_ram=8549MB free_disk=25.066761016845703GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72586) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 21:58:56 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:58:56 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:58:56 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance ec73ec4b-4591-46f2-9192-7868125c53c5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:58:56 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:58:56 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 77b7d14e-bc78-49c8-b91b-db6343ca62a4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:58:56 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 21:58:56 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 21:58:56 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:58:56 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:58:56 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Compute_service record updated for user:user {{(pid=72586) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 21:58:56 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.275s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:58:58 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:59:00 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:59:00 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Starting heal instance info cache {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 21:59:00 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Rebuilding the list of instances to heal {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 21:59:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "refresh_cache-ec73ec4b-4591-46f2-9192-7868125c53c5" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:59:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquired lock "refresh_cache-ec73ec4b-4591-46f2-9192-7868125c53c5" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:59:00 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Forcefully refreshing network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 21:59:00 user nova-compute[72586]: DEBUG nova.objects.instance [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lazy-loading 'info_cache' on Instance uuid ec73ec4b-4591-46f2-9192-7868125c53c5 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:59:01 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Updating instance_info_cache with network_info: [{"id": "7bb3754b-f5e0-465c-a140-3bbddd87400a", "address": "fa:16:3e:56:f7:d0", "network": {"id": "6b6d5e8a-1c0a-4d1b-93d1-4de7246e39fb", "bridge": "br-int", "label": "tempest-TestStampPattern-2085707213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6745cf6719124010a510bd54fd5b9259", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bb3754b-f5", "ovs_interfaceid": "7bb3754b-f5e0-465c-a140-3bbddd87400a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:59:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Releasing lock "refresh_cache-ec73ec4b-4591-46f2-9192-7868125c53c5" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:59:01 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Updated the network info_cache for instance {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 21:59:01 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:59:02 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:59:03 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:59:03 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:59:03 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72586) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 21:59:03 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72586) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 21:59:03 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72586) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 21:59:03 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:59:08 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:59:08 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:59:08 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72586) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 21:59:08 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72586) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 21:59:08 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72586) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 21:59:08 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:59:10 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:59:13 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:59:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:59:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:59:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72586) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 21:59:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72586) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 21:59:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72586) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 21:59:18 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:59:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:59:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:59:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72586) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 21:59:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72586) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 21:59:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72586) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 21:59:23 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:59:28 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:59:33 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:59:33 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:59:33 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72586) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 21:59:33 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72586) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 21:59:33 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72586) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 21:59:33 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:59:38 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:59:38 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:59:38 user nova-compute[72586]: DEBUG nova.compute.manager [req-21dbf3d8-5cd6-4ec5-b3a3-2f789bc4da34 req-13f8db2e-c2a2-462f-a003-e5c9a694b114 service nova] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Received event network-changed-107ffd50-bf35-42c4-a394-131bf57b4157 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:59:38 user nova-compute[72586]: DEBUG nova.compute.manager [req-21dbf3d8-5cd6-4ec5-b3a3-2f789bc4da34 req-13f8db2e-c2a2-462f-a003-e5c9a694b114 service nova] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Refreshing instance network info cache due to event network-changed-107ffd50-bf35-42c4-a394-131bf57b4157. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 21:59:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-21dbf3d8-5cd6-4ec5-b3a3-2f789bc4da34 req-13f8db2e-c2a2-462f-a003-e5c9a694b114 service nova] Acquiring lock "refresh_cache-4e5f6dc7-cd0b-4cb9-b5b3-49907903499f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 21:59:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-21dbf3d8-5cd6-4ec5-b3a3-2f789bc4da34 req-13f8db2e-c2a2-462f-a003-e5c9a694b114 service nova] Acquired lock "refresh_cache-4e5f6dc7-cd0b-4cb9-b5b3-49907903499f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 21:59:38 user nova-compute[72586]: DEBUG nova.network.neutron [req-21dbf3d8-5cd6-4ec5-b3a3-2f789bc4da34 req-13f8db2e-c2a2-462f-a003-e5c9a694b114 service nova] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Refreshing network info cache for port 107ffd50-bf35-42c4-a394-131bf57b4157 {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 21:59:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-badf17c7-c85e-4471-9bd0-ff7d70b698ec tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Acquiring lock "4e5f6dc7-cd0b-4cb9-b5b3-49907903499f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:59:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-badf17c7-c85e-4471-9bd0-ff7d70b698ec tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lock "4e5f6dc7-cd0b-4cb9-b5b3-49907903499f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:59:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-badf17c7-c85e-4471-9bd0-ff7d70b698ec tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Acquiring lock "4e5f6dc7-cd0b-4cb9-b5b3-49907903499f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:59:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-badf17c7-c85e-4471-9bd0-ff7d70b698ec tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lock "4e5f6dc7-cd0b-4cb9-b5b3-49907903499f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:59:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-badf17c7-c85e-4471-9bd0-ff7d70b698ec tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lock "4e5f6dc7-cd0b-4cb9-b5b3-49907903499f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:59:38 user nova-compute[72586]: INFO nova.compute.manager [None req-badf17c7-c85e-4471-9bd0-ff7d70b698ec tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Terminating instance
Aug 01 21:59:38 user nova-compute[72586]: DEBUG nova.compute.manager [None req-badf17c7-c85e-4471-9bd0-ff7d70b698ec tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Start destroying the instance on the hypervisor. {{(pid=72586) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 21:59:38 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:59:38 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:59:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:59:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:59:39 user nova-compute[72586]: DEBUG nova.network.neutron [req-21dbf3d8-5cd6-4ec5-b3a3-2f789bc4da34 req-13f8db2e-c2a2-462f-a003-e5c9a694b114 service nova] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Updated VIF entry in instance network info cache for port 107ffd50-bf35-42c4-a394-131bf57b4157. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 21:59:39 user nova-compute[72586]: DEBUG nova.network.neutron [req-21dbf3d8-5cd6-4ec5-b3a3-2f789bc4da34 req-13f8db2e-c2a2-462f-a003-e5c9a694b114 service nova] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Updating instance_info_cache with network_info: [{"id": "107ffd50-bf35-42c4-a394-131bf57b4157", "address": "fa:16:3e:ff:ef:8d", "network": {"id": "6b6d5e8a-1c0a-4d1b-93d1-4de7246e39fb", "bridge": "br-int", "label": "tempest-TestStampPattern-2085707213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6745cf6719124010a510bd54fd5b9259", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap107ffd50-bf", "ovs_interfaceid": "107ffd50-bf35-42c4-a394-131bf57b4157", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:59:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-21dbf3d8-5cd6-4ec5-b3a3-2f789bc4da34 req-13f8db2e-c2a2-462f-a003-e5c9a694b114 service nova] Releasing lock "refresh_cache-4e5f6dc7-cd0b-4cb9-b5b3-49907903499f" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 21:59:39 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Instance destroyed successfully.
Aug 01 21:59:39 user nova-compute[72586]: DEBUG nova.objects.instance [None req-badf17c7-c85e-4471-9bd0-ff7d70b698ec tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lazy-loading 'resources' on Instance uuid 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 21:59:39 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-badf17c7-c85e-4471-9bd0-ff7d70b698ec tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:56:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1162001329',display_name='tempest-TestStampPattern-server-1162001329',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1162001329',id=50,image_ref='66da76aa-bb45-4e01-9056-8c0661e5c005',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5zerJIOKAGpKQc33aoGj7w4cb3+pxQP7Uruya5ewYasxo4ClP2x6OPm9JVHlh3eOVAilC4CllBK7iFF9X0sTWOPMaSESsH80PKRKhlbIYzYqaKwb7isTjWrZQ4uPEpww==',key_name='tempest-TestStampPattern-769887333',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:56:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6745cf6719124010a510bd54fd5b9259',ramdisk_id='',reservation_id='r-5e2lr0we',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='ec73ec4b-4591-46f2-9192-7868125c53c5',image_min_disk='1',image_min_ram='0',image_owner_id='6745cf6719124010a510bd54fd5b9259',image_owner_project_name='tempest-TestStampPattern-582092164',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-582092164-project-member',image_user_id='7b481c57931941c79ecd184146f20dba',owner_project_name='tempest-TestStampPattern-582092164',owner_user_name='tempest-TestStampPattern-582092164-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:56:51Z,user_data=None,user_id='7b481c57931941c79ecd184146f20dba',uuid=4e5f6dc7-cd0b-4cb9-b5b3-49907903499f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "107ffd50-bf35-42c4-a394-131bf57b4157", "address": "fa:16:3e:ff:ef:8d", "network": {"id": "6b6d5e8a-1c0a-4d1b-93d1-4de7246e39fb", "bridge": "br-int", "label": "tempest-TestStampPattern-2085707213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6745cf6719124010a510bd54fd5b9259", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap107ffd50-bf", "ovs_interfaceid": "107ffd50-bf35-42c4-a394-131bf57b4157", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 21:59:39 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-badf17c7-c85e-4471-9bd0-ff7d70b698ec tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Converting VIF {"id": "107ffd50-bf35-42c4-a394-131bf57b4157", "address": "fa:16:3e:ff:ef:8d", "network": {"id": "6b6d5e8a-1c0a-4d1b-93d1-4de7246e39fb", "bridge": "br-int", "label": "tempest-TestStampPattern-2085707213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6745cf6719124010a510bd54fd5b9259", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap107ffd50-bf", "ovs_interfaceid": "107ffd50-bf35-42c4-a394-131bf57b4157", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 21:59:39 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-badf17c7-c85e-4471-9bd0-ff7d70b698ec tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ff:ef:8d,bridge_name='br-int',has_traffic_filtering=True,id=107ffd50-bf35-42c4-a394-131bf57b4157,network=Network(6b6d5e8a-1c0a-4d1b-93d1-4de7246e39fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap107ffd50-bf') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 21:59:39 user nova-compute[72586]: DEBUG os_vif [None req-badf17c7-c85e-4471-9bd0-ff7d70b698ec tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:ef:8d,bridge_name='br-int',has_traffic_filtering=True,id=107ffd50-bf35-42c4-a394-131bf57b4157,network=Network(6b6d5e8a-1c0a-4d1b-93d1-4de7246e39fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap107ffd50-bf') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 21:59:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:59:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap107ffd50-bf, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 21:59:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:59:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:59:39 user nova-compute[72586]: INFO os_vif [None req-badf17c7-c85e-4471-9bd0-ff7d70b698ec tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:ef:8d,bridge_name='br-int',has_traffic_filtering=True,id=107ffd50-bf35-42c4-a394-131bf57b4157,network=Network(6b6d5e8a-1c0a-4d1b-93d1-4de7246e39fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap107ffd50-bf')
Aug 01 21:59:39 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-badf17c7-c85e-4471-9bd0-ff7d70b698ec tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Deleting instance files /opt/stack/data/nova/instances/4e5f6dc7-cd0b-4cb9-b5b3-49907903499f_del
Aug 01 21:59:39 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-badf17c7-c85e-4471-9bd0-ff7d70b698ec tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Deletion of /opt/stack/data/nova/instances/4e5f6dc7-cd0b-4cb9-b5b3-49907903499f_del complete
Aug 01 21:59:39 user nova-compute[72586]: INFO nova.compute.manager [None req-badf17c7-c85e-4471-9bd0-ff7d70b698ec tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 01 21:59:39 user nova-compute[72586]: DEBUG oslo.service.loopingcall [None req-badf17c7-c85e-4471-9bd0-ff7d70b698ec tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72586) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 21:59:39 user nova-compute[72586]: DEBUG nova.compute.manager [-] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Deallocating network for instance {{(pid=72586) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 21:59:39 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] deallocate_for_instance() {{(pid=72586) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 21:59:40 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 21:59:40 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Took 0.57 seconds to deallocate network for instance.
Aug 01 21:59:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-badf17c7-c85e-4471-9bd0-ff7d70b698ec tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:59:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-badf17c7-c85e-4471-9bd0-ff7d70b698ec tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:59:40 user nova-compute[72586]: DEBUG nova.compute.manager [req-eb9b034d-db05-42f5-926c-8ba9988d387d req-a04ecca0-0250-4842-81e4-106052cccbc8 service nova] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Received event network-vif-deleted-107ffd50-bf35-42c4-a394-131bf57b4157 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:59:40 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-badf17c7-c85e-4471-9bd0-ff7d70b698ec tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:59:40 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-badf17c7-c85e-4471-9bd0-ff7d70b698ec tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:59:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-badf17c7-c85e-4471-9bd0-ff7d70b698ec tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.195s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:59:40 user nova-compute[72586]: INFO nova.scheduler.client.report [None req-badf17c7-c85e-4471-9bd0-ff7d70b698ec tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Deleted allocations for instance 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f
Aug 01 21:59:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-badf17c7-c85e-4471-9bd0-ff7d70b698ec tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lock "4e5f6dc7-cd0b-4cb9-b5b3-49907903499f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.818s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:59:40 user nova-compute[72586]: DEBUG nova.compute.manager [req-b814ad5d-714f-4147-8d95-6a40c35545af req-59423a96-09e3-4fc8-a698-23dce248b432 service nova] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Received event network-vif-unplugged-107ffd50-bf35-42c4-a394-131bf57b4157 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:59:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-b814ad5d-714f-4147-8d95-6a40c35545af req-59423a96-09e3-4fc8-a698-23dce248b432 service nova] Acquiring lock "4e5f6dc7-cd0b-4cb9-b5b3-49907903499f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:59:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-b814ad5d-714f-4147-8d95-6a40c35545af req-59423a96-09e3-4fc8-a698-23dce248b432 service nova] Lock "4e5f6dc7-cd0b-4cb9-b5b3-49907903499f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:59:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-b814ad5d-714f-4147-8d95-6a40c35545af req-59423a96-09e3-4fc8-a698-23dce248b432 service nova] Lock "4e5f6dc7-cd0b-4cb9-b5b3-49907903499f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:59:40 user nova-compute[72586]: DEBUG nova.compute.manager [req-b814ad5d-714f-4147-8d95-6a40c35545af req-59423a96-09e3-4fc8-a698-23dce248b432 service nova] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] No waiting events found dispatching network-vif-unplugged-107ffd50-bf35-42c4-a394-131bf57b4157 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:59:40 user nova-compute[72586]: WARNING nova.compute.manager [req-b814ad5d-714f-4147-8d95-6a40c35545af req-59423a96-09e3-4fc8-a698-23dce248b432 service nova] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Received unexpected event network-vif-unplugged-107ffd50-bf35-42c4-a394-131bf57b4157 for instance with vm_state deleted and task_state None.
Aug 01 21:59:40 user nova-compute[72586]: DEBUG nova.compute.manager [req-b814ad5d-714f-4147-8d95-6a40c35545af req-59423a96-09e3-4fc8-a698-23dce248b432 service nova] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Received event network-vif-plugged-107ffd50-bf35-42c4-a394-131bf57b4157 {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 21:59:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-b814ad5d-714f-4147-8d95-6a40c35545af req-59423a96-09e3-4fc8-a698-23dce248b432 service nova] Acquiring lock "4e5f6dc7-cd0b-4cb9-b5b3-49907903499f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:59:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-b814ad5d-714f-4147-8d95-6a40c35545af req-59423a96-09e3-4fc8-a698-23dce248b432 service nova] Lock "4e5f6dc7-cd0b-4cb9-b5b3-49907903499f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:59:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-b814ad5d-714f-4147-8d95-6a40c35545af req-59423a96-09e3-4fc8-a698-23dce248b432 service nova] Lock "4e5f6dc7-cd0b-4cb9-b5b3-49907903499f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:59:40 user nova-compute[72586]: DEBUG nova.compute.manager [req-b814ad5d-714f-4147-8d95-6a40c35545af req-59423a96-09e3-4fc8-a698-23dce248b432 service nova] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] No waiting events found dispatching network-vif-plugged-107ffd50-bf35-42c4-a394-131bf57b4157 {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 21:59:40 user nova-compute[72586]: WARNING nova.compute.manager [req-b814ad5d-714f-4147-8d95-6a40c35545af req-59423a96-09e3-4fc8-a698-23dce248b432 service nova] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Received unexpected event network-vif-plugged-107ffd50-bf35-42c4-a394-131bf57b4157 for instance with vm_state deleted and task_state None.
Aug 01 21:59:44 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 21:59:49 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:59:49 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:59:49 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:59:50 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:59:51 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:59:51 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:59:51 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72586) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 21:59:54 user nova-compute[72586]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690927179.502276, 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f => Stopped> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 21:59:54 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] VM Stopped (Lifecycle Event)
Aug 01 21:59:54 user nova-compute[72586]: DEBUG nova.compute.manager [None req-d66d87e9-8759-430e-8823-d0808adec63b None None] [instance: 4e5f6dc7-cd0b-4cb9-b5b3-49907903499f] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 21:59:54 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 21:59:56 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 21:59:56 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:59:56 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:59:56 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:59:56 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Auditing locally available compute resources for user (node: user) {{(pid=72586) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 21:59:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec73ec4b-4591-46f2-9192-7868125c53c5/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:59:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec73ec4b-4591-46f2-9192-7868125c53c5/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:59:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec73ec4b-4591-46f2-9192-7868125c53c5/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:59:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec73ec4b-4591-46f2-9192-7868125c53c5/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:59:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77b7d14e-bc78-49c8-b91b-db6343ca62a4/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:59:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77b7d14e-bc78-49c8-b91b-db6343ca62a4/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:59:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77b7d14e-bc78-49c8-b91b-db6343ca62a4/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 21:59:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77b7d14e-bc78-49c8-b91b-db6343ca62a4/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 21:59:58 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:59:58 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 21:59:58 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Hypervisor/Node resource view: name=user free_ram=8683MB free_disk=25.06729507446289GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72586) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 21:59:58 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 21:59:58 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 21:59:58 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance ec73ec4b-4591-46f2-9192-7868125c53c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:59:58 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 77b7d14e-bc78-49c8-b91b-db6343ca62a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 21:59:58 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 21:59:58 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 21:59:58 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 21:59:58 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 21:59:58 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Compute_service record updated for user:user {{(pid=72586) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 21:59:58 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.522s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 21:59:59 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:00:01 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 22:00:01 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Starting heal instance info cache {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 22:00:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "refresh_cache-77b7d14e-bc78-49c8-b91b-db6343ca62a4" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 22:00:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquired lock "refresh_cache-77b7d14e-bc78-49c8-b91b-db6343ca62a4" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 22:00:01 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Forcefully refreshing network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 22:00:02 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Updating instance_info_cache with network_info: [{"id": "434011b9-6e2f-418c-b001-c73eae1ffdda", "address": "fa:16:3e:ef:87:ec", "network": {"id": "52ee6623-01e5-491e-ab5e-d1d0511bd15f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-765176125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063dd272226340d49a7ac0756413cadf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434011b9-6e", "ovs_interfaceid": "434011b9-6e2f-418c-b001-c73eae1ffdda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 22:00:02 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Releasing lock "refresh_cache-77b7d14e-bc78-49c8-b91b-db6343ca62a4" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 22:00:02 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Updated the network info_cache for instance {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 22:00:02 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 22:00:02 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 22:00:04 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 22:00:06 user nova-compute[72586]: DEBUG nova.compute.manager [req-cb7c4fd0-c0d3-4549-97fe-8250004ad48b req-36b531c4-0f36-42f7-a828-c957ac949631 service nova] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Received event network-changed-434011b9-6e2f-418c-b001-c73eae1ffdda {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 22:00:06 user nova-compute[72586]: DEBUG nova.compute.manager [req-cb7c4fd0-c0d3-4549-97fe-8250004ad48b req-36b531c4-0f36-42f7-a828-c957ac949631 service nova] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Refreshing instance network info cache due to event network-changed-434011b9-6e2f-418c-b001-c73eae1ffdda. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 22:00:06 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-cb7c4fd0-c0d3-4549-97fe-8250004ad48b req-36b531c4-0f36-42f7-a828-c957ac949631 service nova] Acquiring lock "refresh_cache-77b7d14e-bc78-49c8-b91b-db6343ca62a4" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 22:00:06 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-cb7c4fd0-c0d3-4549-97fe-8250004ad48b req-36b531c4-0f36-42f7-a828-c957ac949631 service nova] Acquired lock "refresh_cache-77b7d14e-bc78-49c8-b91b-db6343ca62a4" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 22:00:06 user nova-compute[72586]: DEBUG nova.network.neutron [req-cb7c4fd0-c0d3-4549-97fe-8250004ad48b req-36b531c4-0f36-42f7-a828-c957ac949631 service nova] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Refreshing network info cache for port 434011b9-6e2f-418c-b001-c73eae1ffdda {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 22:00:06 user nova-compute[72586]: DEBUG nova.network.neutron [req-cb7c4fd0-c0d3-4549-97fe-8250004ad48b req-36b531c4-0f36-42f7-a828-c957ac949631 service nova] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Updated VIF entry in instance network info cache for port 434011b9-6e2f-418c-b001-c73eae1ffdda. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 22:00:06 user nova-compute[72586]: DEBUG nova.network.neutron [req-cb7c4fd0-c0d3-4549-97fe-8250004ad48b req-36b531c4-0f36-42f7-a828-c957ac949631 service nova] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Updating instance_info_cache with network_info: [{"id": "434011b9-6e2f-418c-b001-c73eae1ffdda", "address": "fa:16:3e:ef:87:ec", "network": {"id": "52ee6623-01e5-491e-ab5e-d1d0511bd15f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-765176125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063dd272226340d49a7ac0756413cadf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434011b9-6e", "ovs_interfaceid": "434011b9-6e2f-418c-b001-c73eae1ffdda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 22:00:06 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-cb7c4fd0-c0d3-4549-97fe-8250004ad48b req-36b531c4-0f36-42f7-a828-c957ac949631 service nova] Releasing lock "refresh_cache-77b7d14e-bc78-49c8-b91b-db6343ca62a4" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 22:00:09 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:00:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-e3b0084b-c7f9-478e-9b81-8247a046ab05 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Acquiring lock "77b7d14e-bc78-49c8-b91b-db6343ca62a4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 22:00:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-e3b0084b-c7f9-478e-9b81-8247a046ab05 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "77b7d14e-bc78-49c8-b91b-db6343ca62a4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 22:00:10 user nova-compute[72586]: DEBUG nova.objects.instance [None req-e3b0084b-c7f9-478e-9b81-8247a046ab05 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lazy-loading 'flavor' on Instance uuid 77b7d14e-bc78-49c8-b91b-db6343ca62a4 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 22:00:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-e3b0084b-c7f9-478e-9b81-8247a046ab05 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "77b7d14e-bc78-49c8-b91b-db6343ca62a4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.047s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 22:00:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-e3b0084b-c7f9-478e-9b81-8247a046ab05 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Acquiring lock "77b7d14e-bc78-49c8-b91b-db6343ca62a4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 22:00:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-e3b0084b-c7f9-478e-9b81-8247a046ab05 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "77b7d14e-bc78-49c8-b91b-db6343ca62a4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 22:00:10 user nova-compute[72586]: INFO nova.compute.manager [None req-e3b0084b-c7f9-478e-9b81-8247a046ab05 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Attaching volume 94878db6-9a11-4418-8558-df33d10df0ec to /dev/vdb
Aug 01 22:00:10 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:00:10 user nova-compute[72586]: DEBUG os_brick.utils [None req-e3b0084b-c7f9-478e-9b81-8247a046ab05 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 22:00:10 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 22:00:10 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 22:00:10 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[15366746-cfff-49ae-8bf1-2785ecab533f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d4bc202fb9cb\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 22:00:10 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 22:00:10 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 22:00:10 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f35496-d712-484c-b0a4-ac9a61d7c14b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 22:00:10 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 22:00:10 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 22:00:10 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[53797b9e-1d83-4bad-a629-9e40f426a9ae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 22:00:10 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4379e79-fc99-47e6-a57c-bb680d2eff9a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 22:00:10 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-e3b0084b-c7f9-478e-9b81-8247a046ab05 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Running cmd (subprocess): nvme version {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 22:00:10 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-e3b0084b-c7f9-478e-9b81-8247a046ab05 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] 'nvme version' failed. Not Retrying. {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 22:00:10 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e3b0084b-c7f9-478e-9b81-8247a046ab05 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] nvme not present on system {{(pid=72586) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 22:00:10 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 22:00:10 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 22:00:10 user nova-compute[72586]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 22:00:10 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c56942f-3122-47aa-89c5-18b52007ec86]: (4, '') {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 22:00:10 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-e3b0084b-c7f9-478e-9b81-8247a046ab05 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72586) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 22:00:10 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-e3b0084b-c7f9-478e-9b81-8247a046ab05 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 22:00:10 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.lightos [None req-e3b0084b-c7f9-478e-9b81-8247a046ab05 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] LIGHTOS: no hostnqn found. {{(pid=72586) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 22:00:10 user nova-compute[72586]: DEBUG os_brick.utils [None req-e3b0084b-c7f9-478e-9b81-8247a046ab05 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d4bc202fb9cb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 22:00:10 user nova-compute[72586]: DEBUG nova.virt.block_device [None req-e3b0084b-c7f9-478e-9b81-8247a046ab05 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Updating existing volume attachment record: 0bc2fd3f-c031-414e-87b6-1e8dabe02789 {{(pid=72586) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 22:00:10 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 22:00:14 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:00:15 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:00:17 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3b0084b-c7f9-478e-9b81-8247a046ab05 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Calling os-brick to attach iSCSI Volume {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 22:00:17 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3b0084b-c7f9-478e-9b81-8247a046ab05 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:94878db6-9a11-4418-8558-df33d10df0ec'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XLODdbKI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 22:00:17 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-e3b0084b-c7f9-478e-9b81-8247a046ab05 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 22:00:17 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-e3b0084b-c7f9-478e-9b81-8247a046ab05 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 22:00:17 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-e3b0084b-c7f9-478e-9b81-8247a046ab05 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 22:00:17 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-e3b0084b-c7f9-478e-9b81-8247a046ab05 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 22:00:17 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-e3b0084b-c7f9-478e-9b81-8247a046ab05 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94878db6-9a11-4418-8558-df33d10df0ec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 22:00:17 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-e3b0084b-c7f9-478e-9b81-8247a046ab05 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94878db6-9a11-4418-8558-df33d10df0ec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 22:00:17 user nova-compute[72586]: INFO os_brick.initiator.connectors.iscsi [None req-e3b0084b-c7f9-478e-9b81-8247a046ab05 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 22:00:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94878db6-9a11-4418-8558-df33d10df0ec -p 172.16.0.220:3260 {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 22:00:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94878db6-9a11-4418-8558-df33d10df0ec -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 22:00:17 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1683fec5-5c5d-4b97-8ee0-8a3e7932dbcc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 22:00:17 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3b0084b-c7f9-478e-9b81-8247a046ab05 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 22:00:17 user nova-compute[72586]:  {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 22:00:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94878db6-9a11-4418-8558-df33d10df0ec -p 172.16.0.220:3260 --interface default --op new {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 22:00:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94878db6-9a11-4418-8558-df33d10df0ec -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 22:00:17 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a1886f-8862-4e9c-b688-a7b0397b936f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94878db6-9a11-4418-8558-df33d10df0ec] added\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 22:00:17 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3b0084b-c7f9-478e-9b81-8247a046ab05 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94878db6-9a11-4418-8558-df33d10df0ec] added
Aug 01 22:00:17 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 22:00:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94878db6-9a11-4418-8558-df33d10df0ec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 22:00:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94878db6-9a11-4418-8558-df33d10df0ec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 22:00:17 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca63f106-d858-4d5d-ba35-56effa7bc5e1]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 22:00:17 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3b0084b-c7f9-478e-9b81-8247a046ab05 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 22:00:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94878db6-9a11-4418-8558-df33d10df0ec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 22:00:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94878db6-9a11-4418-8558-df33d10df0ec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 22:00:17 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc9bfc2-eeed-411d-a2e9-590161c20fe2]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 22:00:17 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3b0084b-c7f9-478e-9b81-8247a046ab05 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 22:00:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94878db6-9a11-4418-8558-df33d10df0ec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XLODdbKI {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 22:00:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94878db6-9a11-4418-8558-df33d10df0ec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XLODdbKI" returned: 0 in 0.021s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 22:00:17 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[52df2c31-be91-41d0-874e-fbf35d625eda]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 22:00:17 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3b0084b-c7f9-478e-9b81-8247a046ab05 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XLODdbKI'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 22:00:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94878db6-9a11-4418-8558-df33d10df0ec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 22:00:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94878db6-9a11-4418-8558-df33d10df0ec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 22:00:17 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae0a223-df94-4f75-8c11-b7d931759b9b]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 22:00:17 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3b0084b-c7f9-478e-9b81-8247a046ab05 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 22:00:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 22:00:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 22:00:17 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e092a5-4ce9-441d-af0f-7bdc0d0a609c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 22:00:17 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3b0084b-c7f9-478e-9b81-8247a046ab05 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 22:00:17 user nova-compute[72586]:  {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 22:00:17 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3b0084b-c7f9-478e-9b81-8247a046ab05 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 22:00:17 user nova-compute[72586]:  {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 22:00:17 user nova-compute[72586]: WARNING os_brick.initiator.connectors.iscsi [None req-e3b0084b-c7f9-478e-9b81-8247a046ab05 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 22:00:17 user nova-compute[72586]: 
Aug 01 22:00:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94878db6-9a11-4418-8558-df33d10df0ec -p 172.16.0.220:3260 --login {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 22:00:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94878db6-9a11-4418-8558-df33d10df0ec -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 22:00:17 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca151eec-ce2f-43b0-b441-642aa00b46f4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:94878db6-9a11-4418-8558-df33d10df0ec, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:94878db6-9a11-4418-8558-df33d10df0ec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 22:00:17 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3b0084b-c7f9-478e-9b81-8247a046ab05 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:94878db6-9a11-4418-8558-df33d10df0ec, portal: 172.16.0.220,3260]
Aug 01 22:00:17 user nova-compute[72586]: Login to [iface: default, target: iqn.2010-10.org.openstack:94878db6-9a11-4418-8558-df33d10df0ec, portal: 172.16.0.220,3260] successful.
Aug 01 22:00:17 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 22:00:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94878db6-9a11-4418-8558-df33d10df0ec -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 22:00:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94878db6-9a11-4418-8558-df33d10df0ec -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 22:00:17 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[94bdbfb5-51d4-4801-bc4a-5201a81900c3]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 22:00:17 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3b0084b-c7f9-478e-9b81-8247a046ab05 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 22:00:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 22:00:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 22:00:17 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[35317731-8cf2-40ec-90e9-2ba686053ce4]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94878db6-9a11-4418-8558-df33d10df0ec (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 22:00:17 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3b0084b-c7f9-478e-9b81-8247a046ab05 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94878db6-9a11-4418-8558-df33d10df0ec (non-flash)
Aug 01 22:00:17 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 22:00:17 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3b0084b-c7f9-478e-9b81-8247a046ab05 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94878db6-9a11-4418-8558-df33d10df0ec (non-flash)
Aug 01 22:00:17 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 22:00:17 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-e3b0084b-c7f9-478e-9b81-8247a046ab05 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94878db6-9a11-4418-8558-df33d10df0ec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 22:00:17 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3b0084b-c7f9-478e-9b81-8247a046ab05 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Connected to 172.16.0.220:3260 {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 22:00:17 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-e3b0084b-c7f9-478e-9b81-8247a046ab05 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=72586) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 22:00:17 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-e3b0084b-c7f9-478e-9b81-8247a046ab05 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72586) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 22:00:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 22:00:17 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 22:00:17 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[98395932-2218-4769-809d-17a5c6c3af73]: (4, ('- - 0', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 22:00:17 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-e3b0084b-c7f9-478e-9b81-8247a046ab05 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72586) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 22:00:17 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3b0084b-c7f9-478e-9b81-8247a046ab05 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XLODdbKI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72586) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 22:00:18 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-e3b0084b-c7f9-478e-9b81-8247a046ab05 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.279s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 22:00:18 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3b0084b-c7f9-478e-9b81-8247a046ab05 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] <== connect_volume: return (1282ms) {'type': 'block', 'scsi_wwn': '26133356135636137', 'path': '/dev/sdb'} {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 22:00:18 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3b0084b-c7f9-478e-9b81-8247a046ab05 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133356135636137', 'path': '/dev/sdb'} {{(pid=72586) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 22:00:18 user nova-compute[72586]: DEBUG nova.objects.instance [None req-e3b0084b-c7f9-478e-9b81-8247a046ab05 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lazy-loading 'flavor' on Instance uuid 77b7d14e-bc78-49c8-b91b-db6343ca62a4 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 22:00:18 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-e3b0084b-c7f9-478e-9b81-8247a046ab05 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 22:00:18 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 22:00:18 user nova-compute[72586]:   <source dev="/dev/sdb"/>
Aug 01 22:00:18 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 22:00:18 user nova-compute[72586]:   <serial>94878db6-9a11-4418-8558-df33d10df0ec</serial>
Aug 01 22:00:18 user nova-compute[72586]: </disk>
Aug 01 22:00:18 user nova-compute[72586]:  {{(pid=72586) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 22:00:19 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-e3b0084b-c7f9-478e-9b81-8247a046ab05 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] No BDM found with device name vda, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 22:00:19 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-e3b0084b-c7f9-478e-9b81-8247a046ab05 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72586) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 22:00:19 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-e3b0084b-c7f9-478e-9b81-8247a046ab05 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] No VIF found with MAC fa:16:3e:ef:87:ec, not building metadata {{(pid=72586) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 22:00:19 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-e3b0084b-c7f9-478e-9b81-8247a046ab05 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "77b7d14e-bc78-49c8-b91b-db6343ca62a4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.146s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 22:00:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:00:20 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c56cd621-6e33-48a3-951c-3450daf30beb tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Acquiring lock "77b7d14e-bc78-49c8-b91b-db6343ca62a4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 22:00:20 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c56cd621-6e33-48a3-951c-3450daf30beb tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "77b7d14e-bc78-49c8-b91b-db6343ca62a4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 22:00:20 user nova-compute[72586]: INFO nova.compute.manager [None req-c56cd621-6e33-48a3-951c-3450daf30beb tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Detaching volume 94878db6-9a11-4418-8558-df33d10df0ec
Aug 01 22:00:20 user nova-compute[72586]: INFO nova.virt.block_device [None req-c56cd621-6e33-48a3-951c-3450daf30beb tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Attempting to driver detach volume 94878db6-9a11-4418-8558-df33d10df0ec from mountpoint /dev/vdb
Aug 01 22:00:20 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c56cd621-6e33-48a3-951c-3450daf30beb tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Attempting to detach device vdb from instance 77b7d14e-bc78-49c8-b91b-db6343ca62a4 from the persistent domain config. {{(pid=72586) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 22:00:20 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-c56cd621-6e33-48a3-951c-3450daf30beb tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 22:00:20 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 22:00:20 user nova-compute[72586]:   <source dev="/dev/sdb"/>
Aug 01 22:00:20 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 22:00:20 user nova-compute[72586]:   <serial>94878db6-9a11-4418-8558-df33d10df0ec</serial>
Aug 01 22:00:20 user nova-compute[72586]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 22:00:20 user nova-compute[72586]: </disk>
Aug 01 22:00:20 user nova-compute[72586]:  {{(pid=72586) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 22:00:20 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-c56cd621-6e33-48a3-951c-3450daf30beb tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Successfully detached device vdb from instance 77b7d14e-bc78-49c8-b91b-db6343ca62a4 from the persistent domain config.
Aug 01 22:00:20 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c56cd621-6e33-48a3-951c-3450daf30beb tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 77b7d14e-bc78-49c8-b91b-db6343ca62a4 from the live domain config. {{(pid=72586) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 22:00:20 user nova-compute[72586]: DEBUG nova.virt.libvirt.guest [None req-c56cd621-6e33-48a3-951c-3450daf30beb tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 22:00:20 user nova-compute[72586]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 22:00:20 user nova-compute[72586]:   <source dev="/dev/sdb"/>
Aug 01 22:00:20 user nova-compute[72586]:   <target dev="vdb" bus="virtio"/>
Aug 01 22:00:20 user nova-compute[72586]:   <serial>94878db6-9a11-4418-8558-df33d10df0ec</serial>
Aug 01 22:00:20 user nova-compute[72586]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 22:00:20 user nova-compute[72586]: </disk>
Aug 01 22:00:20 user nova-compute[72586]:  {{(pid=72586) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 22:00:20 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-eb9b2fff-3f6d-462b-88b2-98b2c5fe0061 None None] Received event <DeviceRemovedEvent: 1690927220.8782845, 77b7d14e-bc78-49c8-b91b-db6343ca62a4 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72586) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 22:00:20 user nova-compute[72586]: DEBUG nova.virt.libvirt.driver [None req-c56cd621-6e33-48a3-951c-3450daf30beb tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 77b7d14e-bc78-49c8-b91b-db6343ca62a4 {{(pid=72586) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 22:00:20 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-c56cd621-6e33-48a3-951c-3450daf30beb tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Successfully detached device vdb from instance 77b7d14e-bc78-49c8-b91b-db6343ca62a4 from the live domain config.
Aug 01 22:00:20 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c56cd621-6e33-48a3-951c-3450daf30beb tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] calling os-brick to detach iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 22:00:20 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56cd621-6e33-48a3-951c-3450daf30beb tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ee825a680>, {'target_iqns': ['iqn.2010-10.org.openstack:94878db6-9a11-4418-8558-df33d10df0ec'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XLODdbKI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 22:00:20 user nova-compute[72586]: WARNING os_brick.initiator.connectors.base [None req-c56cd621-6e33-48a3-951c-3450daf30beb tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 22:00:20 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-c56cd621-6e33-48a3-951c-3450daf30beb tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 22:00:20 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-c56cd621-6e33-48a3-951c-3450daf30beb tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 22:00:20 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56cd621-6e33-48a3-951c-3450daf30beb tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94878db6-9a11-4418-8558-df33d10df0ec', 0)] {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 22:00:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 22:00:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 22:00:20 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f175a9f1-9222-4010-a1f1-fe9364c8314a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94878db6-9a11-4418-8558-df33d10df0ec\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 22:00:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 22:00:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 22:00:20 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[562e18b7-a608-4f8b-95a8-33acdb075157]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94878db6-9a11-4418-8558-df33d10df0ec (non-flash)\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 22:00:20 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56cd621-6e33-48a3-951c-3450daf30beb tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94878db6-9a11-4418-8558-df33d10df0ec (non-flash)
Aug 01 22:00:20 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 22:00:20 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56cd621-6e33-48a3-951c-3450daf30beb tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94878db6-9a11-4418-8558-df33d10df0ec (non-flash)
Aug 01 22:00:20 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 22:00:20 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56cd621-6e33-48a3-951c-3450daf30beb tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ef6de9090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94878db6-9a11-4418-8558-df33d10df0ec'): ({'sdb'}, set())}) {{(pid=72586) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 22:00:20 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-c56cd621-6e33-48a3-951c-3450daf30beb tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Removing single pathed devices sdb {{(pid=72586) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 22:00:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 22:00:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 22:00:20 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad79d2b-44cd-409e-872b-373baa595857]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 22:00:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 22:00:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 22:00:20 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[601f5772-70d9-428b-97fe-d2218858334d]: (4, ('ok\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 22:00:20 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-c56cd621-6e33-48a3-951c-3450daf30beb tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Flushing IO for device /dev/sdb {{(pid=72586) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 22:00:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 22:00:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 22:00:20 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7740a4-1363-4e1f-89fb-5d483dadbee2]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 22:00:20 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-c56cd621-6e33-48a3-951c-3450daf30beb tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72586) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 22:00:20 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 22:00:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 22:00:21 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0364f2dd-7c4d-43e5-a2a4-f95039ef2a35]: (4, ('1', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 22:00:21 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-c56cd621-6e33-48a3-951c-3450daf30beb tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 22:00:21 user nova-compute[72586]: DEBUG os_brick.initiator.linuxscsi [None req-c56cd621-6e33-48a3-951c-3450daf30beb tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] SCSI volumes sdb have been removed. {{(pid=72586) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 22:00:21 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56cd621-6e33-48a3-951c-3450daf30beb tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94878db6-9a11-4418-8558-df33d10df0ec')] {{(pid=72586) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 22:00:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94878db6-9a11-4418-8558-df33d10df0ec -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 22:00:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94878db6-9a11-4418-8558-df33d10df0ec -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 22:00:21 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4d4fc8-5cb9-4560-8ce3-083cd0cbaa89]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 22:00:21 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56cd621-6e33-48a3-951c-3450daf30beb tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 22:00:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94878db6-9a11-4418-8558-df33d10df0ec -p 172.16.0.220:3260 --logout {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 22:00:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94878db6-9a11-4418-8558-df33d10df0ec -p 172.16.0.220:3260 --logout" returned: 0 in 0.144s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 22:00:21 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[96cf4dac-fa57-4790-b72f-4694d75cf99a]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:94878db6-9a11-4418-8558-df33d10df0ec, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:94878db6-9a11-4418-8558-df33d10df0ec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 22:00:21 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56cd621-6e33-48a3-951c-3450daf30beb tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:94878db6-9a11-4418-8558-df33d10df0ec, portal: 172.16.0.220,3260]
Aug 01 22:00:21 user nova-compute[72586]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:94878db6-9a11-4418-8558-df33d10df0ec, portal: 172.16.0.220,3260] successful.
Aug 01 22:00:21 user nova-compute[72586]:  stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 22:00:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94878db6-9a11-4418-8558-df33d10df0ec -p 172.16.0.220:3260 --op delete {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 22:00:21 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94878db6-9a11-4418-8558-df33d10df0ec -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83581) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 22:00:21 user nova-compute[72586]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ab5a66-e218-42ad-b956-7fc99ebb188c]: (4, ('', '')) {{(pid=83581) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 22:00:21 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56cd621-6e33-48a3-951c-3450daf30beb tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72586) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 22:00:21 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.base [None req-c56cd621-6e33-48a3-951c-3450daf30beb tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 22:00:21 user nova-compute[72586]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56cd621-6e33-48a3-951c-3450daf30beb tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] <== disconnect_volume: return (341ms) None {{(pid=72586) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 22:00:21 user nova-compute[72586]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c56cd621-6e33-48a3-951c-3450daf30beb tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Disconnected iSCSI Volume {{(pid=72586) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 22:00:21 user nova-compute[72586]: DEBUG nova.objects.instance [None req-c56cd621-6e33-48a3-951c-3450daf30beb tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lazy-loading 'flavor' on Instance uuid 77b7d14e-bc78-49c8-b91b-db6343ca62a4 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 22:00:21 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-c56cd621-6e33-48a3-951c-3450daf30beb tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "77b7d14e-bc78-49c8-b91b-db6343ca62a4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.659s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 22:00:24 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 22:00:25 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:00:29 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:00:34 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:00:38 user nova-compute[72586]: DEBUG nova.compute.manager [req-5b493257-16ea-4c84-8250-fb989e84fd7b req-e4b5ab6a-f14c-49ae-bde5-0e42067ebea9 service nova] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Received event network-changed-7bb3754b-f5e0-465c-a140-3bbddd87400a {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 22:00:38 user nova-compute[72586]: DEBUG nova.compute.manager [req-5b493257-16ea-4c84-8250-fb989e84fd7b req-e4b5ab6a-f14c-49ae-bde5-0e42067ebea9 service nova] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Refreshing instance network info cache due to event network-changed-7bb3754b-f5e0-465c-a140-3bbddd87400a. {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 22:00:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-5b493257-16ea-4c84-8250-fb989e84fd7b req-e4b5ab6a-f14c-49ae-bde5-0e42067ebea9 service nova] Acquiring lock "refresh_cache-ec73ec4b-4591-46f2-9192-7868125c53c5" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 22:00:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-5b493257-16ea-4c84-8250-fb989e84fd7b req-e4b5ab6a-f14c-49ae-bde5-0e42067ebea9 service nova] Acquired lock "refresh_cache-ec73ec4b-4591-46f2-9192-7868125c53c5" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 22:00:38 user nova-compute[72586]: DEBUG nova.network.neutron [req-5b493257-16ea-4c84-8250-fb989e84fd7b req-e4b5ab6a-f14c-49ae-bde5-0e42067ebea9 service nova] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Refreshing network info cache for port 7bb3754b-f5e0-465c-a140-3bbddd87400a {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 22:00:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-eec4b940-31b0-4b81-bcdf-8954d9020b0f tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Acquiring lock "ec73ec4b-4591-46f2-9192-7868125c53c5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 22:00:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-eec4b940-31b0-4b81-bcdf-8954d9020b0f tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lock "ec73ec4b-4591-46f2-9192-7868125c53c5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 22:00:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-eec4b940-31b0-4b81-bcdf-8954d9020b0f tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Acquiring lock "ec73ec4b-4591-46f2-9192-7868125c53c5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 22:00:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-eec4b940-31b0-4b81-bcdf-8954d9020b0f tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lock "ec73ec4b-4591-46f2-9192-7868125c53c5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 22:00:38 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-eec4b940-31b0-4b81-bcdf-8954d9020b0f tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lock "ec73ec4b-4591-46f2-9192-7868125c53c5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 22:00:38 user nova-compute[72586]: INFO nova.compute.manager [None req-eec4b940-31b0-4b81-bcdf-8954d9020b0f tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Terminating instance
Aug 01 22:00:38 user nova-compute[72586]: DEBUG nova.compute.manager [None req-eec4b940-31b0-4b81-bcdf-8954d9020b0f tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Start destroying the instance on the hypervisor. {{(pid=72586) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 22:00:38 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:00:38 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:00:38 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:00:38 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:00:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:00:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:00:39 user nova-compute[72586]: DEBUG nova.network.neutron [req-5b493257-16ea-4c84-8250-fb989e84fd7b req-e4b5ab6a-f14c-49ae-bde5-0e42067ebea9 service nova] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Updated VIF entry in instance network info cache for port 7bb3754b-f5e0-465c-a140-3bbddd87400a. {{(pid=72586) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 22:00:39 user nova-compute[72586]: DEBUG nova.network.neutron [req-5b493257-16ea-4c84-8250-fb989e84fd7b req-e4b5ab6a-f14c-49ae-bde5-0e42067ebea9 service nova] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Updating instance_info_cache with network_info: [{"id": "7bb3754b-f5e0-465c-a140-3bbddd87400a", "address": "fa:16:3e:56:f7:d0", "network": {"id": "6b6d5e8a-1c0a-4d1b-93d1-4de7246e39fb", "bridge": "br-int", "label": "tempest-TestStampPattern-2085707213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6745cf6719124010a510bd54fd5b9259", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bb3754b-f5", "ovs_interfaceid": "7bb3754b-f5e0-465c-a140-3bbddd87400a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 22:00:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:00:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-5b493257-16ea-4c84-8250-fb989e84fd7b req-e4b5ab6a-f14c-49ae-bde5-0e42067ebea9 service nova] Releasing lock "refresh_cache-ec73ec4b-4591-46f2-9192-7868125c53c5" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 22:00:39 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Instance destroyed successfully.
Aug 01 22:00:39 user nova-compute[72586]: DEBUG nova.objects.instance [None req-eec4b940-31b0-4b81-bcdf-8954d9020b0f tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lazy-loading 'resources' on Instance uuid ec73ec4b-4591-46f2-9192-7868125c53c5 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 22:00:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:00:39 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-eec4b940-31b0-4b81-bcdf-8954d9020b0f tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:53:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1398519775',display_name='tempest-TestStampPattern-server-1398519775',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1398519775',id=48,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5zerJIOKAGpKQc33aoGj7w4cb3+pxQP7Uruya5ewYasxo4ClP2x6OPm9JVHlh3eOVAilC4CllBK7iFF9X0sTWOPMaSESsH80PKRKhlbIYzYqaKwb7isTjWrZQ4uPEpww==',key_name='tempest-TestStampPattern-769887333',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:53:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6745cf6719124010a510bd54fd5b9259',ramdisk_id='',reservation_id='r-kmz93wwl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-582092164',owner_user_name='tempest-TestStampPattern-582092164-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:56:43Z,user_data=None,user_id='7b481c57931941c79ecd184146f20dba',uuid=ec73ec4b-4591-46f2-9192-7868125c53c5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7bb3754b-f5e0-465c-a140-3bbddd87400a", "address": "fa:16:3e:56:f7:d0", "network": {"id": "6b6d5e8a-1c0a-4d1b-93d1-4de7246e39fb", "bridge": "br-int", "label": "tempest-TestStampPattern-2085707213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6745cf6719124010a510bd54fd5b9259", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bb3754b-f5", "ovs_interfaceid": "7bb3754b-f5e0-465c-a140-3bbddd87400a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 22:00:39 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-eec4b940-31b0-4b81-bcdf-8954d9020b0f tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Converting VIF {"id": "7bb3754b-f5e0-465c-a140-3bbddd87400a", "address": "fa:16:3e:56:f7:d0", "network": {"id": "6b6d5e8a-1c0a-4d1b-93d1-4de7246e39fb", "bridge": "br-int", "label": "tempest-TestStampPattern-2085707213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6745cf6719124010a510bd54fd5b9259", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bb3754b-f5", "ovs_interfaceid": "7bb3754b-f5e0-465c-a140-3bbddd87400a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 22:00:39 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-eec4b940-31b0-4b81-bcdf-8954d9020b0f tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:56:f7:d0,bridge_name='br-int',has_traffic_filtering=True,id=7bb3754b-f5e0-465c-a140-3bbddd87400a,network=Network(6b6d5e8a-1c0a-4d1b-93d1-4de7246e39fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bb3754b-f5') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 22:00:39 user nova-compute[72586]: DEBUG os_vif [None req-eec4b940-31b0-4b81-bcdf-8954d9020b0f tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:f7:d0,bridge_name='br-int',has_traffic_filtering=True,id=7bb3754b-f5e0-465c-a140-3bbddd87400a,network=Network(6b6d5e8a-1c0a-4d1b-93d1-4de7246e39fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bb3754b-f5') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 22:00:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:00:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7bb3754b-f5, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 22:00:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:00:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 22:00:39 user nova-compute[72586]: INFO os_vif [None req-eec4b940-31b0-4b81-bcdf-8954d9020b0f tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:f7:d0,bridge_name='br-int',has_traffic_filtering=True,id=7bb3754b-f5e0-465c-a140-3bbddd87400a,network=Network(6b6d5e8a-1c0a-4d1b-93d1-4de7246e39fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bb3754b-f5')
Aug 01 22:00:39 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-eec4b940-31b0-4b81-bcdf-8954d9020b0f tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Deleting instance files /opt/stack/data/nova/instances/ec73ec4b-4591-46f2-9192-7868125c53c5_del
Aug 01 22:00:39 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-eec4b940-31b0-4b81-bcdf-8954d9020b0f tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Deletion of /opt/stack/data/nova/instances/ec73ec4b-4591-46f2-9192-7868125c53c5_del complete
Aug 01 22:00:39 user nova-compute[72586]: INFO nova.compute.manager [None req-eec4b940-31b0-4b81-bcdf-8954d9020b0f tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 01 22:00:39 user nova-compute[72586]: DEBUG oslo.service.loopingcall [None req-eec4b940-31b0-4b81-bcdf-8954d9020b0f tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72586) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 22:00:39 user nova-compute[72586]: DEBUG nova.compute.manager [-] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Deallocating network for instance {{(pid=72586) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 22:00:39 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] deallocate_for_instance() {{(pid=72586) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 22:00:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:00:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:00:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:00:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:00:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:00:39 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 22:00:39 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Took 0.64 seconds to deallocate network for instance.
Aug 01 22:00:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-eec4b940-31b0-4b81-bcdf-8954d9020b0f tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 22:00:39 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-eec4b940-31b0-4b81-bcdf-8954d9020b0f tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 22:00:40 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-eec4b940-31b0-4b81-bcdf-8954d9020b0f tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 22:00:40 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-eec4b940-31b0-4b81-bcdf-8954d9020b0f tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 22:00:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-eec4b940-31b0-4b81-bcdf-8954d9020b0f tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.161s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 22:00:40 user nova-compute[72586]: INFO nova.scheduler.client.report [None req-eec4b940-31b0-4b81-bcdf-8954d9020b0f tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Deleted allocations for instance ec73ec4b-4591-46f2-9192-7868125c53c5
Aug 01 22:00:40 user nova-compute[72586]: DEBUG nova.compute.manager [req-5a2179c1-7205-4f0c-9f79-83a9875c5275 req-d7f5f2e0-92c5-4e72-9a4e-a1a348da6c15 service nova] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Received event network-vif-unplugged-7bb3754b-f5e0-465c-a140-3bbddd87400a {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 22:00:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-5a2179c1-7205-4f0c-9f79-83a9875c5275 req-d7f5f2e0-92c5-4e72-9a4e-a1a348da6c15 service nova] Acquiring lock "ec73ec4b-4591-46f2-9192-7868125c53c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 22:00:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-5a2179c1-7205-4f0c-9f79-83a9875c5275 req-d7f5f2e0-92c5-4e72-9a4e-a1a348da6c15 service nova] Lock "ec73ec4b-4591-46f2-9192-7868125c53c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 22:00:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-5a2179c1-7205-4f0c-9f79-83a9875c5275 req-d7f5f2e0-92c5-4e72-9a4e-a1a348da6c15 service nova] Lock "ec73ec4b-4591-46f2-9192-7868125c53c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 22:00:40 user nova-compute[72586]: DEBUG nova.compute.manager [req-5a2179c1-7205-4f0c-9f79-83a9875c5275 req-d7f5f2e0-92c5-4e72-9a4e-a1a348da6c15 service nova] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] No waiting events found dispatching network-vif-unplugged-7bb3754b-f5e0-465c-a140-3bbddd87400a {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 22:00:40 user nova-compute[72586]: WARNING nova.compute.manager [req-5a2179c1-7205-4f0c-9f79-83a9875c5275 req-d7f5f2e0-92c5-4e72-9a4e-a1a348da6c15 service nova] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Received unexpected event network-vif-unplugged-7bb3754b-f5e0-465c-a140-3bbddd87400a for instance with vm_state deleted and task_state None.
Aug 01 22:00:40 user nova-compute[72586]: DEBUG nova.compute.manager [req-5a2179c1-7205-4f0c-9f79-83a9875c5275 req-d7f5f2e0-92c5-4e72-9a4e-a1a348da6c15 service nova] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Received event network-vif-plugged-7bb3754b-f5e0-465c-a140-3bbddd87400a {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 22:00:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-5a2179c1-7205-4f0c-9f79-83a9875c5275 req-d7f5f2e0-92c5-4e72-9a4e-a1a348da6c15 service nova] Acquiring lock "ec73ec4b-4591-46f2-9192-7868125c53c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 22:00:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-5a2179c1-7205-4f0c-9f79-83a9875c5275 req-d7f5f2e0-92c5-4e72-9a4e-a1a348da6c15 service nova] Lock "ec73ec4b-4591-46f2-9192-7868125c53c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 22:00:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-5a2179c1-7205-4f0c-9f79-83a9875c5275 req-d7f5f2e0-92c5-4e72-9a4e-a1a348da6c15 service nova] Lock "ec73ec4b-4591-46f2-9192-7868125c53c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 22:00:40 user nova-compute[72586]: DEBUG nova.compute.manager [req-5a2179c1-7205-4f0c-9f79-83a9875c5275 req-d7f5f2e0-92c5-4e72-9a4e-a1a348da6c15 service nova] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] No waiting events found dispatching network-vif-plugged-7bb3754b-f5e0-465c-a140-3bbddd87400a {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 22:00:40 user nova-compute[72586]: WARNING nova.compute.manager [req-5a2179c1-7205-4f0c-9f79-83a9875c5275 req-d7f5f2e0-92c5-4e72-9a4e-a1a348da6c15 service nova] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Received unexpected event network-vif-plugged-7bb3754b-f5e0-465c-a140-3bbddd87400a for instance with vm_state deleted and task_state None.
Aug 01 22:00:40 user nova-compute[72586]: DEBUG nova.compute.manager [req-5a2179c1-7205-4f0c-9f79-83a9875c5275 req-d7f5f2e0-92c5-4e72-9a4e-a1a348da6c15 service nova] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Received event network-vif-plugged-7bb3754b-f5e0-465c-a140-3bbddd87400a {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 22:00:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-5a2179c1-7205-4f0c-9f79-83a9875c5275 req-d7f5f2e0-92c5-4e72-9a4e-a1a348da6c15 service nova] Acquiring lock "ec73ec4b-4591-46f2-9192-7868125c53c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 22:00:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-5a2179c1-7205-4f0c-9f79-83a9875c5275 req-d7f5f2e0-92c5-4e72-9a4e-a1a348da6c15 service nova] Lock "ec73ec4b-4591-46f2-9192-7868125c53c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 22:00:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-5a2179c1-7205-4f0c-9f79-83a9875c5275 req-d7f5f2e0-92c5-4e72-9a4e-a1a348da6c15 service nova] Lock "ec73ec4b-4591-46f2-9192-7868125c53c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 22:00:40 user nova-compute[72586]: DEBUG nova.compute.manager [req-5a2179c1-7205-4f0c-9f79-83a9875c5275 req-d7f5f2e0-92c5-4e72-9a4e-a1a348da6c15 service nova] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] No waiting events found dispatching network-vif-plugged-7bb3754b-f5e0-465c-a140-3bbddd87400a {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 22:00:40 user nova-compute[72586]: WARNING nova.compute.manager [req-5a2179c1-7205-4f0c-9f79-83a9875c5275 req-d7f5f2e0-92c5-4e72-9a4e-a1a348da6c15 service nova] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Received unexpected event network-vif-plugged-7bb3754b-f5e0-465c-a140-3bbddd87400a for instance with vm_state deleted and task_state None.
Aug 01 22:00:40 user nova-compute[72586]: DEBUG nova.compute.manager [req-5a2179c1-7205-4f0c-9f79-83a9875c5275 req-d7f5f2e0-92c5-4e72-9a4e-a1a348da6c15 service nova] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Received event network-vif-deleted-7bb3754b-f5e0-465c-a140-3bbddd87400a {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 22:00:40 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-eec4b940-31b0-4b81-bcdf-8954d9020b0f tempest-TestStampPattern-582092164 tempest-TestStampPattern-582092164-project-member] Lock "ec73ec4b-4591-46f2-9192-7868125c53c5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.878s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 22:00:40 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:00:44 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:00:49 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:00:49 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 22:00:50 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 22:00:51 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 22:00:51 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72586) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 22:00:52 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 22:00:52 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 22:00:52 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Cleaning up deleted instances with incomplete migration  {{(pid=72586) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 22:00:53 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 22:00:54 user nova-compute[72586]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690927239.0664496, ec73ec4b-4591-46f2-9192-7868125c53c5 => Stopped> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 22:00:54 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] VM Stopped (Lifecycle Event)
Aug 01 22:00:54 user nova-compute[72586]: DEBUG nova.compute.manager [None req-190fa712-9782-463c-94d6-ea0c26e42b87 None None] [instance: ec73ec4b-4591-46f2-9192-7868125c53c5] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 22:00:54 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 22:00:57 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 22:00:57 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 22:00:57 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 22:00:57 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 22:00:57 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Auditing locally available compute resources for user (node: user) {{(pid=72586) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 22:00:57 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77b7d14e-bc78-49c8-b91b-db6343ca62a4/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 22:00:58 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77b7d14e-bc78-49c8-b91b-db6343ca62a4/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 22:00:58 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77b7d14e-bc78-49c8-b91b-db6343ca62a4/disk --force-share --output=json {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 22:00:58 user nova-compute[72586]: DEBUG oslo_concurrency.processutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77b7d14e-bc78-49c8-b91b-db6343ca62a4/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72586) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 22:00:58 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 22:00:58 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 22:00:58 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Hypervisor/Node resource view: name=user free_ram=8752MB free_disk=25.19125747680664GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72586) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 22:00:58 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 22:00:58 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 22:00:58 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Instance 77b7d14e-bc78-49c8-b91b-db6343ca62a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72586) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 22:00:58 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 22:00:58 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 22:00:58 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Refreshing inventories for resource provider ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 22:00:58 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Updating ProviderTree inventory for provider ca6775c1-2a64-43f9-9467-372aa0457b1d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 22:00:58 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Updating inventory in ProviderTree for provider ca6775c1-2a64-43f9-9467-372aa0457b1d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 22:00:58 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Refreshing aggregate associations for resource provider ca6775c1-2a64-43f9-9467-372aa0457b1d, aggregates: None {{(pid=72586) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 22:00:58 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Refreshing trait associations for resource provider ca6775c1-2a64-43f9-9467-372aa0457b1d, traits: COMPUTE_NODE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_TRUSTED_CERTS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AMI {{(pid=72586) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 22:00:58 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 22:00:58 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 22:00:59 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Compute_service record updated for user:user {{(pid=72586) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 22:00:59 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.354s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 22:00:59 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 22:01:01 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 22:01:01 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Starting heal instance info cache {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 22:01:01 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Rebuilding the list of instances to heal {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 22:01:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "refresh_cache-77b7d14e-bc78-49c8-b91b-db6343ca62a4" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 22:01:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquired lock "refresh_cache-77b7d14e-bc78-49c8-b91b-db6343ca62a4" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 22:01:01 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Forcefully refreshing network info cache for instance {{(pid=72586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 22:01:01 user nova-compute[72586]: DEBUG nova.objects.instance [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lazy-loading 'info_cache' on Instance uuid 77b7d14e-bc78-49c8-b91b-db6343ca62a4 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 22:01:01 user nova-compute[72586]: DEBUG nova.network.neutron [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Updating instance_info_cache with network_info: [{"id": "434011b9-6e2f-418c-b001-c73eae1ffdda", "address": "fa:16:3e:ef:87:ec", "network": {"id": "52ee6623-01e5-491e-ab5e-d1d0511bd15f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-765176125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063dd272226340d49a7ac0756413cadf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434011b9-6e", "ovs_interfaceid": "434011b9-6e2f-418c-b001-c73eae1ffdda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 22:01:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Releasing lock "refresh_cache-77b7d14e-bc78-49c8-b91b-db6343ca62a4" {{(pid=72586) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 22:01:01 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Updated the network info_cache for instance {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 22:01:01 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 22:01:03 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 22:01:04 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:01:09 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 22:01:09 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:01:09 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72586) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 22:01:09 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72586) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 22:01:09 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72586) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 22:01:09 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:01:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-44e857aa-199d-427c-9290-bd47c0597fa0 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Acquiring lock "77b7d14e-bc78-49c8-b91b-db6343ca62a4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 22:01:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-44e857aa-199d-427c-9290-bd47c0597fa0 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "77b7d14e-bc78-49c8-b91b-db6343ca62a4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 22:01:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-44e857aa-199d-427c-9290-bd47c0597fa0 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Acquiring lock "77b7d14e-bc78-49c8-b91b-db6343ca62a4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 22:01:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-44e857aa-199d-427c-9290-bd47c0597fa0 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "77b7d14e-bc78-49c8-b91b-db6343ca62a4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 22:01:10 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-44e857aa-199d-427c-9290-bd47c0597fa0 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "77b7d14e-bc78-49c8-b91b-db6343ca62a4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 22:01:10 user nova-compute[72586]: INFO nova.compute.manager [None req-44e857aa-199d-427c-9290-bd47c0597fa0 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Terminating instance
Aug 01 22:01:10 user nova-compute[72586]: DEBUG nova.compute.manager [None req-44e857aa-199d-427c-9290-bd47c0597fa0 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Start destroying the instance on the hypervisor. {{(pid=72586) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 22:01:10 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:01:10 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:01:10 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:01:10 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:01:10 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:01:11 user nova-compute[72586]: DEBUG nova.compute.manager [req-9ea053f1-121f-4a48-943c-0d8ea60d6b5f req-7bceda91-12dd-4bdd-af27-b34fb99469b9 service nova] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Received event network-vif-unplugged-434011b9-6e2f-418c-b001-c73eae1ffdda {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 22:01:11 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-9ea053f1-121f-4a48-943c-0d8ea60d6b5f req-7bceda91-12dd-4bdd-af27-b34fb99469b9 service nova] Acquiring lock "77b7d14e-bc78-49c8-b91b-db6343ca62a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 22:01:11 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-9ea053f1-121f-4a48-943c-0d8ea60d6b5f req-7bceda91-12dd-4bdd-af27-b34fb99469b9 service nova] Lock "77b7d14e-bc78-49c8-b91b-db6343ca62a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 22:01:11 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-9ea053f1-121f-4a48-943c-0d8ea60d6b5f req-7bceda91-12dd-4bdd-af27-b34fb99469b9 service nova] Lock "77b7d14e-bc78-49c8-b91b-db6343ca62a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 22:01:11 user nova-compute[72586]: DEBUG nova.compute.manager [req-9ea053f1-121f-4a48-943c-0d8ea60d6b5f req-7bceda91-12dd-4bdd-af27-b34fb99469b9 service nova] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] No waiting events found dispatching network-vif-unplugged-434011b9-6e2f-418c-b001-c73eae1ffdda {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 22:01:11 user nova-compute[72586]: DEBUG nova.compute.manager [req-9ea053f1-121f-4a48-943c-0d8ea60d6b5f req-7bceda91-12dd-4bdd-af27-b34fb99469b9 service nova] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Received event network-vif-unplugged-434011b9-6e2f-418c-b001-c73eae1ffdda for instance with task_state deleting. {{(pid=72586) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 22:01:11 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:01:11 user nova-compute[72586]: INFO nova.virt.libvirt.driver [-] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Instance destroyed successfully.
Aug 01 22:01:11 user nova-compute[72586]: DEBUG nova.objects.instance [None req-44e857aa-199d-427c-9290-bd47c0597fa0 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lazy-loading 'resources' on Instance uuid 77b7d14e-bc78-49c8-b91b-db6343ca62a4 {{(pid=72586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 22:01:11 user nova-compute[72586]: DEBUG nova.virt.libvirt.vif [None req-44e857aa-199d-427c-9290-bd47c0597fa0 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T21:58:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1395970357',display_name='tempest-AttachVolumeNegativeTest-server-1395970357',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1395970357',id=51,image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgOf2HFzydXwO4CWjvuCy1ogrmplikTDNhFsVj/Dz6u9C/ySg9Tlx8guXs378AhT3bzRHx/dM2rrno5QMiGhIz1EzQPsdXDPxozb//9SK8vj3BNlgLiSjxKPyYKofCsLQ==',key_name='tempest-keypair-1099260883',keypairs=<?>,launch_index=0,launched_at=2023-08-01T21:58:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='063dd272226340d49a7ac0756413cadf',ramdisk_id='',reservation_id='r-yyot4mat',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0243d46b-6819-42a5-926f-42b71f0c97ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-717043369',owner_user_name='tempest-AttachVolumeNegativeTest-717043369-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T21:58:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37663bab7d31400c8399451058bd5936',uuid=77b7d14e-bc78-49c8-b91b-db6343ca62a4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "434011b9-6e2f-418c-b001-c73eae1ffdda", "address": "fa:16:3e:ef:87:ec", "network": {"id": "52ee6623-01e5-491e-ab5e-d1d0511bd15f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-765176125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063dd272226340d49a7ac0756413cadf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434011b9-6e", "ovs_interfaceid": "434011b9-6e2f-418c-b001-c73eae1ffdda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 22:01:11 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-44e857aa-199d-427c-9290-bd47c0597fa0 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Converting VIF {"id": "434011b9-6e2f-418c-b001-c73eae1ffdda", "address": "fa:16:3e:ef:87:ec", "network": {"id": "52ee6623-01e5-491e-ab5e-d1d0511bd15f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-765176125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063dd272226340d49a7ac0756413cadf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434011b9-6e", "ovs_interfaceid": "434011b9-6e2f-418c-b001-c73eae1ffdda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 22:01:11 user nova-compute[72586]: DEBUG nova.network.os_vif_util [None req-44e857aa-199d-427c-9290-bd47c0597fa0 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:87:ec,bridge_name='br-int',has_traffic_filtering=True,id=434011b9-6e2f-418c-b001-c73eae1ffdda,network=Network(52ee6623-01e5-491e-ab5e-d1d0511bd15f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap434011b9-6e') {{(pid=72586) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 22:01:11 user nova-compute[72586]: DEBUG os_vif [None req-44e857aa-199d-427c-9290-bd47c0597fa0 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:87:ec,bridge_name='br-int',has_traffic_filtering=True,id=434011b9-6e2f-418c-b001-c73eae1ffdda,network=Network(52ee6623-01e5-491e-ab5e-d1d0511bd15f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap434011b9-6e') {{(pid=72586) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 22:01:11 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:01:11 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap434011b9-6e, bridge=br-int, if_exists=True) {{(pid=72586) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 22:01:11 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:01:11 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 22:01:11 user nova-compute[72586]: INFO os_vif [None req-44e857aa-199d-427c-9290-bd47c0597fa0 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:87:ec,bridge_name='br-int',has_traffic_filtering=True,id=434011b9-6e2f-418c-b001-c73eae1ffdda,network=Network(52ee6623-01e5-491e-ab5e-d1d0511bd15f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap434011b9-6e')
Aug 01 22:01:11 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-44e857aa-199d-427c-9290-bd47c0597fa0 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Deleting instance files /opt/stack/data/nova/instances/77b7d14e-bc78-49c8-b91b-db6343ca62a4_del
Aug 01 22:01:11 user nova-compute[72586]: INFO nova.virt.libvirt.driver [None req-44e857aa-199d-427c-9290-bd47c0597fa0 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Deletion of /opt/stack/data/nova/instances/77b7d14e-bc78-49c8-b91b-db6343ca62a4_del complete
Aug 01 22:01:11 user nova-compute[72586]: INFO nova.compute.manager [None req-44e857aa-199d-427c-9290-bd47c0597fa0 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 01 22:01:11 user nova-compute[72586]: DEBUG oslo.service.loopingcall [None req-44e857aa-199d-427c-9290-bd47c0597fa0 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72586) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 22:01:11 user nova-compute[72586]: DEBUG nova.compute.manager [-] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Deallocating network for instance {{(pid=72586) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 22:01:11 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] deallocate_for_instance() {{(pid=72586) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 22:01:12 user nova-compute[72586]: DEBUG nova.network.neutron [-] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 22:01:12 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Took 0.78 seconds to deallocate network for instance.
Aug 01 22:01:12 user nova-compute[72586]: DEBUG nova.compute.manager [req-c998590b-3973-4f15-9b99-26556d1a73f8 req-da14d24b-cbc3-4d7a-83a2-2931f9cd8fd0 service nova] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Received event network-vif-deleted-434011b9-6e2f-418c-b001-c73eae1ffdda {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 22:01:12 user nova-compute[72586]: INFO nova.compute.manager [req-c998590b-3973-4f15-9b99-26556d1a73f8 req-da14d24b-cbc3-4d7a-83a2-2931f9cd8fd0 service nova] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Neutron deleted interface 434011b9-6e2f-418c-b001-c73eae1ffdda; detaching it from the instance and deleting it from the info cache
Aug 01 22:01:12 user nova-compute[72586]: DEBUG nova.network.neutron [req-c998590b-3973-4f15-9b99-26556d1a73f8 req-da14d24b-cbc3-4d7a-83a2-2931f9cd8fd0 service nova] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Updating instance_info_cache with network_info: [] {{(pid=72586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 22:01:12 user nova-compute[72586]: DEBUG nova.compute.manager [req-c998590b-3973-4f15-9b99-26556d1a73f8 req-da14d24b-cbc3-4d7a-83a2-2931f9cd8fd0 service nova] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Detach interface failed, port_id=434011b9-6e2f-418c-b001-c73eae1ffdda, reason: Instance 77b7d14e-bc78-49c8-b91b-db6343ca62a4 could not be found. {{(pid=72586) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 22:01:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-44e857aa-199d-427c-9290-bd47c0597fa0 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 22:01:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-44e857aa-199d-427c-9290-bd47c0597fa0 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 22:01:12 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-44e857aa-199d-427c-9290-bd47c0597fa0 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 22:01:12 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-44e857aa-199d-427c-9290-bd47c0597fa0 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 22:01:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-44e857aa-199d-427c-9290-bd47c0597fa0 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.103s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 22:01:12 user nova-compute[72586]: INFO nova.scheduler.client.report [None req-44e857aa-199d-427c-9290-bd47c0597fa0 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Deleted allocations for instance 77b7d14e-bc78-49c8-b91b-db6343ca62a4
Aug 01 22:01:12 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-44e857aa-199d-427c-9290-bd47c0597fa0 tempest-AttachVolumeNegativeTest-717043369 tempest-AttachVolumeNegativeTest-717043369-project-member] Lock "77b7d14e-bc78-49c8-b91b-db6343ca62a4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.940s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 22:01:13 user nova-compute[72586]: DEBUG nova.compute.manager [req-3b5abe01-b5d9-454b-b907-9533b98fae66 req-1316c766-4219-41cf-9f6a-1fe851d2adf9 service nova] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Received event network-vif-plugged-434011b9-6e2f-418c-b001-c73eae1ffdda {{(pid=72586) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 22:01:13 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-3b5abe01-b5d9-454b-b907-9533b98fae66 req-1316c766-4219-41cf-9f6a-1fe851d2adf9 service nova] Acquiring lock "77b7d14e-bc78-49c8-b91b-db6343ca62a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 22:01:13 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-3b5abe01-b5d9-454b-b907-9533b98fae66 req-1316c766-4219-41cf-9f6a-1fe851d2adf9 service nova] Lock "77b7d14e-bc78-49c8-b91b-db6343ca62a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 22:01:13 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [req-3b5abe01-b5d9-454b-b907-9533b98fae66 req-1316c766-4219-41cf-9f6a-1fe851d2adf9 service nova] Lock "77b7d14e-bc78-49c8-b91b-db6343ca62a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 22:01:13 user nova-compute[72586]: DEBUG nova.compute.manager [req-3b5abe01-b5d9-454b-b907-9533b98fae66 req-1316c766-4219-41cf-9f6a-1fe851d2adf9 service nova] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] No waiting events found dispatching network-vif-plugged-434011b9-6e2f-418c-b001-c73eae1ffdda {{(pid=72586) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 22:01:13 user nova-compute[72586]: WARNING nova.compute.manager [req-3b5abe01-b5d9-454b-b907-9533b98fae66 req-1316c766-4219-41cf-9f6a-1fe851d2adf9 service nova] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Received unexpected event network-vif-plugged-434011b9-6e2f-418c-b001-c73eae1ffdda for instance with vm_state deleted and task_state None.
Aug 01 22:01:16 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:01:20 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 22:01:20 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Cleaning up deleted instances {{(pid=72586) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 22:01:20 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] There are 0 instances to clean {{(pid=72586) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 22:01:21 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 22:01:21 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 22:01:26 user nova-compute[72586]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690927271.4373825, 77b7d14e-bc78-49c8-b91b-db6343ca62a4 => Stopped> {{(pid=72586) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 22:01:26 user nova-compute[72586]: INFO nova.compute.manager [-] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] VM Stopped (Lifecycle Event)
Aug 01 22:01:26 user nova-compute[72586]: DEBUG nova.compute.manager [None req-1d7a1a4c-3e30-4a06-bf23-8d4595d1ef22 None None] [instance: 77b7d14e-bc78-49c8-b91b-db6343ca62a4] Checking state {{(pid=72586) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 22:01:26 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 22:01:26 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:01:26 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72586) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 22:01:26 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72586) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 22:01:26 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72586) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 22:01:26 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:01:31 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:01:36 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:01:36 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:01:39 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:01:41 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:01:46 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 22:01:50 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 22:01:51 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:01:51 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 22:01:51 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72586) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 22:01:52 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 22:01:53 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 22:01:54 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 22:01:56 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:01:59 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 22:01:59 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 22:01:59 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 22:01:59 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 22:01:59 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Auditing locally available compute resources for user (node: user) {{(pid=72586) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 22:02:00 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 22:02:00 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 22:02:00 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Hypervisor/Node resource view: name=user free_ram=8987MB free_disk=25.217857360839844GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72586) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 22:02:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 22:02:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 22:02:00 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 22:02:00 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 22:02:00 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 22:02:00 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 22:02:00 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Compute_service record updated for user:user {{(pid=72586) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 22:02:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.157s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 22:02:01 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 22:02:01 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 22:02:01 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Starting heal instance info cache {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 22:02:01 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Rebuilding the list of instances to heal {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 22:02:01 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Didn't find any instances for network info cache update. {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 22:02:01 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 22:02:05 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 22:02:06 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 22:02:11 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 22:02:11 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:02:11 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72586) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 22:02:11 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72586) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 22:02:11 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72586) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 22:02:11 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:02:14 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 22:02:16 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:02:17 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:02:19 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:02:21 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:02:26 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 22:02:26 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:02:26 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72586) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 22:02:26 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72586) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 22:02:26 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72586) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 22:02:26 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:02:31 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 22:02:36 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 22:02:41 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:02:46 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 22:02:51 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:02:51 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 22:02:53 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 22:02:53 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 22:02:53 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72586) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 22:02:54 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 22:02:56 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 22:02:56 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 22:03:00 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 22:03:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 22:03:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 22:03:00 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 22:03:00 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Auditing locally available compute resources for user (node: user) {{(pid=72586) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 22:03:01 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 22:03:01 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 22:03:01 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Hypervisor/Node resource view: name=user free_ram=8981MB free_disk=25.207427978515625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72586) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 22:03:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 22:03:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 22:03:01 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 22:03:01 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 22:03:01 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 22:03:01 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 22:03:01 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Compute_service record updated for user:user {{(pid=72586) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 22:03:01 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.125s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 22:03:01 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:03:03 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 22:03:03 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Starting heal instance info cache {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 22:03:03 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Rebuilding the list of instances to heal {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 22:03:03 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Didn't find any instances for network info cache update. {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 22:03:03 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 22:03:05 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 22:03:06 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:03:11 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 22:03:11 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:03:11 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72586) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 22:03:11 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72586) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 22:03:11 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72586) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 22:03:11 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:03:16 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:03:21 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:03:26 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:03:31 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 22:03:36 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:03:41 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 22:03:46 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 22:03:51 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:03:51 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 22:03:55 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:03:55 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 22:03:55 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 22:03:55 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 22:03:55 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72586) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 22:03:56 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:03:57 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 22:04:01 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:04:02 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 22:04:02 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Starting heal instance info cache {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 22:04:02 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Rebuilding the list of instances to heal {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 22:04:02 user nova-compute[72586]: DEBUG nova.compute.manager [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Didn't find any instances for network info cache update. {{(pid=72586) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 22:04:02 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 22:04:02 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 22:04:02 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 22:04:02 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 22:04:02 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 22:04:02 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Auditing locally available compute resources for user (node: user) {{(pid=72586) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 22:04:03 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 22:04:03 user nova-compute[72586]: WARNING nova.virt.libvirt.driver [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 22:04:03 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Hypervisor/Node resource view: name=user free_ram=8997MB free_disk=25.20578384399414GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72586) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 22:04:03 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 22:04:03 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 22:04:03 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 22:04:03 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72586) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 22:04:03 user nova-compute[72586]: DEBUG nova.compute.provider_tree [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed in ProviderTree for provider: ca6775c1-2a64-43f9-9467-372aa0457b1d {{(pid=72586) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 22:04:03 user nova-compute[72586]: DEBUG nova.scheduler.client.report [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Inventory has not changed for provider ca6775c1-2a64-43f9-9467-372aa0457b1d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72586) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 22:04:03 user nova-compute[72586]: DEBUG nova.compute.resource_tracker [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Compute_service record updated for user:user {{(pid=72586) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 22:04:03 user nova-compute[72586]: DEBUG oslo_concurrency.lockutils [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.146s {{(pid=72586) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 22:04:06 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:04:08 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 22:04:11 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:04:15 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 22:04:16 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 22:04:21 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:04:26 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 22:04:31 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:04:36 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 22:04:41 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:04:46 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:04:51 user nova-compute[72586]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72586) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 22:04:51 user nova-compute[72586]: DEBUG oslo_service.periodic_task [None req-5dc08750-ad90-417a-86ad-cca7eb8e742c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72586) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}